this post was submitted on 07 Aug 2023
421 points (97.5% liked)

Technology

59296 readers
3965 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

In every reported case where police mistakenly arrested someone using facial recognition, that person has been Black::Facial recognition software has always had trouble telling Black people apart, yet police departments are still using it.

all 20 comments
sorted by: hot top controversial new old
[–] dbilitated@aussie.zone 45 points 1 year ago

to be fair that happened a lot before AI existed

[–] Mic_Check_One_Two@reddthat.com 35 points 1 year ago (2 children)

This isn’t new. It’s been a known problem for a long time, because facial recognition software is trained using white people. So it gets really really good at differentiating between white people. But with black people as a tiny fraction of the sample data, it basically just learns to differentiate them with broad strokes. It’s good at telling them apart from white people, but not much else.

[–] phx@lemmy.ca 34 points 1 year ago* (last edited 1 year ago) (1 children)

It's not just a training issue. Lighter (color) tones reflect. Dark tones absorb. There have been lots of issues with cameras or even just sensors having issues with people having dark skin tones because the lower reflectivity/contrast of dark tones. 3D scanners - even current models - have similar issues with objects having black parts for similar reasons. Training on more models can help, but there's still an overall technical difficulty to overcome as well (which is also a good reason that using facial recognition in this manner is just bullshit, period).

[–] Shihali@sh.itjust.works 4 points 1 year ago

As a technological problem it could have a technological partial solution: the darker the skin, the higher the threshold to declare a match. This would also mean more false negatives (real matches not caught by the software) but not much to do about that.

[–] Chunk@lemmy.world 6 points 1 year ago (1 children)

I'm interested what dataset they're using because simply adding more black people to the training set seems like a pretty straightforward fix.

[–] elephantium@lemmy.world 2 points 1 year ago

It seems like past mugshots would be an ideal part of the training set. Are they not using those?

Personally, I'm leaning towards "It's not the image recognition program that's the problem here."

[–] Obsession@sh.itjust.works 21 points 1 year ago (3 children)

Isn't face recognition just going to be inherently rly less reliable on darker skinned people? Their features would certainly have less contrast on darker skin, no?

[–] charles@lemmy.world 4 points 1 year ago (1 children)

Why not expose pictures longer to get better features of darker skinned people and less accurate of lighter skinned people, leading to more false arrests of lighter skinned people?

[–] SlopppyEngineer@lemmy.world 5 points 1 year ago* (last edited 1 year ago)

And remove the convenient excuse to harass black people? These are cops we're talking about.

[–] firadin@lemmy.world 4 points 1 year ago (1 children)

Doesn't the fact that a technology is fundamentally discriminatory mean we should question the use of that technology? Not just shrug our shoulders and say too bad?

[–] Blamemeta@lemm.ee 1 points 1 year ago (1 children)

Shouldn't use it at all, but the tech isn't intentionally malicious, just a fact of the tech.

[–] charles@lemmy.world 1 points 1 year ago (1 children)

Exposure is a dial, not a technology. People are choosing to use it this way.

[–] Blamemeta@lemm.ee 1 points 1 year ago

Hell of a lot easier when its a white dude on a dark background than a black dude on a dark background. The technology is just not being used in the way it should be.

[–] Diplomjodler@feddit.de 17 points 1 year ago

Who could possibly ever have foreseen that.

[–] Nacktmull@lemm.ee 10 points 1 year ago

Fuck the police!

[–] Blackdoom@lemmy.world 9 points 1 year ago (1 children)
[–] DoomBot5@lemmy.world 3 points 1 year ago

If white, politely ask

[–] Ensign_Crab@lemmy.world 4 points 1 year ago

So it's acting like real cops and lying about black people "fitting the description."