this post was submitted on 01 Aug 2023
524 points (82.3% liked)

Technology

60058 readers
2559 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
 

An Asian MIT student asked AI to turn an image of her into a professional headshot. It made her white with lighter skin and blue eyes.::Rona Wang, a 24-year-old MIT student, was experimenting with the AI image creator Playground AI to create a professional LinkedIn photo.

you are viewing a single comment's thread
view the rest of the comments
[–] AbouBenAdhem@lemmy.world 148 points 1 year ago* (last edited 1 year ago) (4 children)

It’s less a reflection on the tech, and more a reflection on the culture that generated the content that trained the tech.

Wang told The Globe that she was worried about the consequences in a more serious situation, like if a company used AI to select the most "professional" candidate for the job and it picked white-looking people.

This is a real potential issue, not just “clickbait”.

[–] HumbertTetere@feddit.de 33 points 1 year ago (2 children)

If companies go pick the most professional applicant by their photo that is a reason for concern, but it has little to do with the image training data of AI.

[–] altima_neo@lemmy.zip 5 points 1 year ago

Especially ones that are still heavily in development

[–] luthis@lemmy.nz 28 points 1 year ago (2 children)

A company using a photo to choose a candidate is really concerning regardless if they use AI to do it.

[–] AbouBenAdhem@lemmy.world 20 points 1 year ago* (last edited 1 year ago) (2 children)

Some people (especially in business) seem to think that adding AI to a workflow will make obviously bad ideas somehow magically work. Dispelling that notion is why articles like this are important.

(Actually, I suspect they know they’re still bad ideas, but delegating the decisions to an AI lets the humans involved avoid personal blame.)

[–] squaresinger@feddit.de 6 points 1 year ago

It's a massive issue that many people (especially in business) have this "the AI has spoken"-bias.

Similar to how they implement whatever the consultant says, no matter if it actually makes sense, they just blindly follow what the AI says .

[–] Water1053@lemmy.world 5 points 1 year ago

Businesses will continue to use bandages rather than fix their root issue. This will always be the case.

I work in factory automation and almost every camera/vision system we've installed has been a bandage of some sort because they think it will magically fix their production issues.

We've had a sales rep ask if our cameras use AI, too. 😵‍💫

[–] SuddenDownpour@lemmy.world 3 points 1 year ago

Hiring practices are broken from its very basics. The vast majority of businesses consistently discriminate against people who deviate from the norm in presentation, even if the candidate meets the technical requirements or would otherwise be productive, which results in millions of people who are capable of contributing to society being pushed aside.

[–] JeffCraig@citizensgaming.com 8 points 1 year ago* (last edited 1 year ago)

Again, that's not really the case.

I have Asian friends that have used these tools and generated headshots that were fine. Just because this one Asian used a model that wasn't trained for her demographic doesn't make it a reflection of anything other than the fact that she doesn't understand how MML models work.

The worst thing that happened when my friends used it were results with too many fingers or multiple sets of teeth 🤣

[–] drz@lemmy.ca 2 points 1 year ago (1 children)

No company would use ML to classify who's the most professional looking candidate.

  1. Anyone with any ML experience at all knows how ridiculous this concept is. Who's going to go out there and create a dataset matching "proffesional looking scores" to headshots?
  2. The amount of bad press and ridicule this would attract isn't worth it to any company.
[–] kbotc@lemmy.world 7 points 1 year ago

Companies already use resume scanners that have been found to bias against black sounding names. They’re designed to feedback loop successful candidates, and guess what shit the ML learned real quick?