Last week, U.S. Senator Cory Booker (D-NJ), along with Senators Alex Padilla (D-CA), Peter Welch (D-CT), and Adam Schiff (D-CA) sent a letter to executives at Meta expressing concern about reports that AI chatbots created by Meta’s Instagram Studio are pretending to be licensed therapists, even fabricating credentials and license numbers, in an attempt to gain trust from users, potentially including minors, struggling with mental health.
I'm not worried about what it gets right, I'm worried about what it gets wrong. If it helps people, then that's a good thing. They don't have true empathy, and the user knows that. Sometimes, human experience is more valuable than the technical psychological knowledge imo. Chatgpt has never experienced the death of a family member, been broken up with, bullied, anything. I don't really expect it or trust it to properly help anyone with any personal issues or dilemmas. It's a cold, uncaring machine, and as its knowledge is probably rather flawed, could even teach dangerous ideas to users. I especially don't trust a company like Meta to be doing this thouroughly and to truly help their patients. It's cool if it works, but dangerous if it doesn't.
Oh I don't at all support what Meta has done, and I don't trust any company not to harm and exploit users. I was responding to your comment by saying that talking to a chatbot doesn't necessarily indicate that someone has "bigger problems." If they're not in a crisis, and they have reasonable expectations for the chatbot, I can see how it could be a helpful tool. If someone doesn't have access to a real therapist, and a chatbot helps them feel better in the meantime, I'm not going to gatekeep that experience.
I'm not worried about what it gets right, I'm worried about what it gets wrong. If it helps people, then that's a good thing. They don't have true empathy, and the user knows that. Sometimes, human experience is more valuable than the technical psychological knowledge imo. Chatgpt has never experienced the death of a family member, been broken up with, bullied, anything. I don't really expect it or trust it to properly help anyone with any personal issues or dilemmas. It's a cold, uncaring machine, and as its knowledge is probably rather flawed, could even teach dangerous ideas to users. I especially don't trust a company like Meta to be doing this thouroughly and to truly help their patients. It's cool if it works, but dangerous if it doesn't.
Oh I don't at all support what Meta has done, and I don't trust any company not to harm and exploit users. I was responding to your comment by saying that talking to a chatbot doesn't necessarily indicate that someone has "bigger problems." If they're not in a crisis, and they have reasonable expectations for the chatbot, I can see how it could be a helpful tool. If someone doesn't have access to a real therapist, and a chatbot helps them feel better in the meantime, I'm not going to gatekeep that experience.