Watched my old company's hiring algorithm switch from keyword scores to skills tests, and the shortlist flipped completely | Algorithmic Fairness Debate

Sean Green · 2026-10-03T07:10:03.171495+00:00

I worked at a logistics company in Columbus and our hiring tool ranked resumes by keyword matches for about 2 years. Last spring they swapped it for a short skills test, and I got to see both shortlists for the same 60 applicants. The old list was mostly people who stuffed their resumes with the exact job title words, and the new one pulled in folks with gaps in their work history who actually passed the test. The weird part is the number of women and older workers who made the cut jumped a lot, like from 8 out of 60 to 21. Has anyone else watched a hiring tool get swapped out and seen the same people keep winning no matter what?

Free To Speak

Loading…

Watched my old company's hiring algorithm switch from keyword scores to skills tests, and the shortlist flipped completely | Algorithmic Fairness Debate - Free To Speak