F
11

Blew $200 on a bias audit tool that flagged everything as fair

I paid $200 for an algorithmic bias checker last month and it literally gave every input a 95% fairness score no matter what data I fed it. Even when I tested it with a dataset that had obvious gender gaps, it kept saying "no significant bias detected." Has anyone else run into scammy fairness tools that just print green checkmarks?
3 comments

Log in to join the discussion

Log In
3 Comments
nelson.vera
Random number generator behind a shiny dashboard" pretty much sums up half the tech products I've bought this year, including a "smart" scale that told me I was 15% body fat no matter how much pizza I ate. I'm starting to think the only bias these tools detect is the one towards keeping my $200.
7
riverh49
riverh491mo ago
Did your friend try a full refund? I had a buddy buy one of those audit tools and it turned out it was just a random number generator behind a shiny dashboard. He spent a week testing it with intentionally biased data and got the same green checkmark every time.
4
the_drew
the_drew1mo ago
So @riverh49, that reminds me of when my cousin bought a "smart" coffee mug that just flashed random temperatures and he never noticed.
0