AI hiring tools may be filtering out the best job applicants

As firms increasingly rely on artificial intelligence-driven hiring platforms, many highly qualified candidates are finding themselves on the cutting room floor.

  • Stamets@lemmy.world
    link
    fedilink
    English
    arrow-up
    18
    arrow-down
    1
    ·
    10 months ago

    There was a story not long ago of an AI hiring bot that was dismissing every candidate of color. Turns out if you try and build these things off of inherently racist jobs the AI learns to become stupidly racist. This was a surprise to some people. Same thing with motion sensor sinks. There are way too many that don’t work for people with darker skin because they were only ever tested on white people.

    It’s almost like if you build your systems off of extremely narrow data and profiles then the system will keep that. It isn’t a person. There’s no reasoning or empathy or stepping outside of the lines yet. It’s going to do what you tell it, for better or for worse.

    • Moneo@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      10 months ago

      Same thing with motion sensor sinks. There are way too many that don’t work for people with darker skin because they were only ever tested on white people.

      Epitomizes white privilege for me. The white male is considered default and as a result we enjoy benefits on the daily without even realizing it. The book Invisible women does a great job pointing out many ways in which the “male default bias” (idk if thats the correct terminology) negatively effects women. Some of these are ‘trivial’, like how women’s bathrooms can serve fewer people at a time because stalls are less space efficient than urinals. So instead of giving womens bathrooms more space we just laugh at how womens bathrooms always have long lines. Many are obviously not so trivial.