144
submitted 8 months ago by L4s@lemmy.world to c/technology@lemmy.world

Klarna says its AI assistant does the work of 700 people after it laid off 700 people::undefined

you are viewing a single comment's thread
view the rest of the comments
[-] Lmaydev@programming.dev 2 points 8 months ago

What could they possibly cite?

[-] JackFrostNCola@lemmy.world 22 points 8 months ago* (last edited 8 months ago)

"I'm glad we could solve your problem. Please rate you experiance with our customer support today"
Closes support chat window
Klarna: "Customers rate the AI assistant the same as the Human support workers" [all non-responses]

[-] snek@lemmy.world 9 points 8 months ago

@Lmaydev@programming.dev exactly this in the comment above!

When Klarna says "customer ratings of the AI are the same as for human workers", what on earth do they mean?

It also contradicts the experiences people have been having with GPT powered chatbots recently. A model that takes a few prompts to start hallucinating is better than a living breathing human being? Really? I'd be curious to give it a try.

I worked for large companies before, and I even interviewed for Klarna (they have been hiring lots recently, maybe for different tasks/positions), and they always lie. Always.

At one company I worked at before, some KPI was calculated incorrectly and had been for years. When we informed the relevant person of this, they got very defensive and refused to change it. Only our team knew the calculation was total BS. It was become success/money was at stake for him. This person continued to send the fake KPI calculations to everyone every week.

I got laid off from the company where I work with absolutely ZERO motivation as to how me being laid off would increase "efficiency" (even though that was their claim


they are slimming down the company to increase "efficiency"). The company ignored every piece of evidence I provided to show that me and my team are completely overworked and that they should probably cut jobs elsewhere if they don't want all of our data ingestions and ML models to collapse.

I don't think companies have enough to motivate such a layoff if they can't solidify their numbers and make then transparent to the public. I'd certainly like to see the union fights Klarna will have with the Swedish worker unions now. I have never been to such a meeting though, but I've provided motivation for the union to use to oppose layoffs in such meetings - my understanding is that it's a bit of a shit show.

[-] ozymandias117@lemmy.world 12 points 8 months ago

Yeah… we’re having this with one of our suppliers right now…

We’re showing them all the issues they aren’t solving and they’re saying “look all our KPI numbers look amazing”

So now we have to explicitly go into each ticket and mark it as dissatisfied, since they don’t take into account how long the ticket was open, how many meetings had to be called over the ticket, etc. just whether it was closed without clicking the extra “we’re dissatisfied” button

[-] snek@lemmy.world 6 points 8 months ago* (last edited 8 months ago)

So now we have to explicitly go into each ticket and mark it as dissatisfied, since they don’t take into account how long the ticket was open, how many meetings had to be called over the ticket, etc. just whether it was closed without clicking the extra “we’re dissatisfied” button

That sucks. A rigid KPI that is never open to change and only made to show some BLING in meetings, it will always lead to failure.

And when the KPIs are bad, they blame us. We had lots of failures in streaming videos on our platform and it was growing across a range of mobile OSs and devices, and they would just say, very sternly, "We need you to deliver better results!". Meanwhile, they had us do a huge migration and rebuild the entire UI across all devices all while maintaining the legacy systems that are sometimes riddled with bugs. Fucking idiots! They shouldn't expect X performance with Y² the number of tasks (I would have said 2*Y if it was "double" the work... it was more like being on steroids, it was Y² the work, everyone was burnt out, people barely took the summer off). We met those KPIs by a margin previously, and we're not about to meet them now unless they hire more staff or give us more time until their new UI launch. Spoiler: the launch did not go well.

[-] ozymandias117@lemmy.world 4 points 8 months ago

Yeah, that’s always been my experience with KPIs, too.

It’s always turned into a game for managers - they don’t have the ability to actually improve the product, so the measurements change or they add an extra field in the ticket…

My first job was as a cashier and we were trained to press the calculate button on the register after each item we scanned. Did that make the checkout go faster? Nope. Did it make their measurement look better? Yeah, since that wasn’t “checkout time” in their report

At another job, patches weren’t merged fast enough. So, instead of making any changes that would improve the product, we were ordered to make one ticket for investigating the problem and a second for integrating the fix. It made fixing issues slower, but their KPIs went up…

[-] iopq@lemmy.world 6 points 8 months ago

You assume support agents don't hallucinate

[-] snek@lemmy.world 4 points 8 months ago

🤣 yeah true

I feel like customer service has been on a decline for the past 10 years or so. I owe it to being underpaid and treated badly as an employee. .

[-] Kusimulkku@lemm.ee 1 points 8 months ago

Well clearly they should've done two decades long peer reviewed studies and even then we'd scoff and say they're obviously corrupted by *waves hands* you know, money, capitalism, you know, the system

[-] snek@lemmy.world 1 points 8 months ago

700 people deserve some kind of study at least before their livelihood is cut off.

[-] Kusimulkku@lemm.ee 0 points 8 months ago

I'm sure they have some metrics of their own they use to follow the efficiency of their workers that they've used to compare

[-] snek@lemmy.world 1 points 8 months ago

I'm sure your blind trust in Klarna is totally reasonable.

[-] Kusimulkku@lemm.ee 0 points 8 months ago* (last edited 8 months ago)

It's not blind trust to think companies probably try to make the most money out of the available resources. It's sorta what they do

[-] snek@lemmy.world 2 points 8 months ago* (last edited 8 months ago)

It’s not blind trust to think companies probably try to make the most money out of the available resources. It’s sorta what they do

Okay, just to be clear here, we're talking about the belief that Klarna has sufficiently motivated this decision to lay these people off and actually has good KPIs that measure the performance, specifically that of customer care agents... not that companies make money with resrouces.

Usually people with this kind of opinion like yours maybe haven't experienced work at a large company or maybe don't understand that office politics are alive and kicking. But I'd still like to hear why... Let me ask you, what makes you think Klarna is being honest about their measurements?

[-] Kusimulkku@lemm.ee 0 points 8 months ago* (last edited 8 months ago)

You don't think a big company like Klarna has metrics to follow the efficiency of their workers? Even small businesses where I live that and every single big corporation. What makes you think Klarna would be different?

not that companies make money with resrouces.

You misunderstood. I said try to make most money out of the resources, so efficiency. That's what we're talking about...

Usually people with this kind of opinion like yours maybe haven't experienced work at a large company or maybe don't understand that office politics are alive and kicking

Lol.

Let me ask you, what makes you think Klarna is being honest about their measurements?

It's not very hard to believe what they're saying here and they'd be the ones to have those metrics. So simple 1+1.

[-] snek@lemmy.world 1 points 8 months ago

You don’t think a big company like Klarna has metrics to follow the efficiency of their workers? Even small businesses where I live that and every single big corporation. What makes you think Klarna would be different?

I never said they have no KPIs. What I said is their KPIs are likely broken, just like almost every other large company in existence.

You misunderstood. I said try to make most money out of the resources, so efficiency. That’s what we’re talking about…

I think you're the one who misunderstood. So for reference again, I am talking about this: about the belief that Klarna has sufficiently motivated this decision to lay these people off and actually has good KPIs that measure the performance, specifically that of customer care agents…

I don't see why or how I would want to discuss that a company is an entity that makes money through products from resources... think that'd be a bit too basic, no?

Lol.

?

It’s not very hard to believe what they’re saying here and they’d be the ones to have those metrics. So simple 1+1.

But can you explain what makes you trust them? What gives a company like Klarna a high trust ratio in your eyes? They don't seem to have provided those metrics in any way, just spelling it out in words. So how can we trust them?

It’s not very hard to believe what they’re saying here

Maybe not for you, but the rest of us are skeptics and would like to know what exactly makes this easy for you to believe. Thanks for explaining in advance.

[-] Kusimulkku@lemm.ee 1 points 8 months ago

You started the discussion off from my joke comment saying that they deserve a study for them to be laid off. Consider where this started.

It’s not very hard to believe what they’re saying here and they’d be the ones to have those metrics. So simple 1+1.

But can you explain what makes you trust them?

would like to know what exactly makes this easy for you to believe

butwhymalemodels.avif

I just explained why their claim isn't hard to believe. You even quoted it??

Maybe not for you

Well no shit, not like I'm claiming to speak on someone else's behalf

[-] snek@lemmy.world 1 points 8 months ago

I just explained why their claim isn’t hard to believe. You even quoted it??

Sorry, let's pretend I'm a total idiot, could you quote it for me?

[-] Kusimulkku@lemm.ee 1 points 8 months ago

It’s not very hard to believe what they’re saying here and they’d be the ones to have those metrics. So simple 1+1.

Easy to believe them when the claim itself is easy to believe and they'd be the ones to have those metrics. So you take the easy to believe claim (1) and you take them being in the position to have those metrics (another 1, but let's call it 2 to differentiate) so simple 1+2.

[-] snek@lemmy.world 1 points 8 months ago

Easy to believe them when the claim itself is easy to believe and they’d be the ones to have those metrics. So you take the easy to believe claim (1) and you take them being in the position to have those metrics (another 1, but let’s call it 2 to differentiate) so simple 1+2.

Ummm, sorry but how is this an explanation?

"Why are they easy to believe?".... "Oh, it's just not very hard to believe, they have the metrics, they said so! 1+1!"

It's easy to believe because they are a big company and big companies have metrics?

But, what about the trust part? How does that make you trust them? What part of that is "enough" evidence for you to rationalize that they have a good motivation for laying off 700 people?

[-] Kusimulkku@lemm.ee 1 points 8 months ago

It's easy to believe because the claim (AI replacing the work of tons of workers) is easy to believe and out of anyone they'd be post positioned to know how well the AI compares to their workers. So not much of a leap to believe them here, that the AI can, could or has replaced the work of 700 people. Klarna seems to have something like 7000 workers so 10% being replaced by AI, for a company like Klarna? Yeah, I can see that happening. I'm honestly not sure why you are having such hard time with this. Maybe you don't understand those two as separate things, the claim (AI could replace a ton of workers) and the data the company would have (knowing exactly how many it could replace).

But, what about the trust part?

You've been the only one talking about trust.

[-] snek@lemmy.world 1 points 8 months ago

Hmmm, okay, but let's take this one step further, what makes you believe that an AI can replace 700 customer care agents?

Yeah, I can see that happening. I’m honestly not sure why you are having such hard time with this.

I have skepticism about all large companies, especially having worked for many, and especially having seen how far they will go with lies to lay people off. Klarna lays off hundreds of employees as a frequent occurrence.

In my opinion, both as an ML professional and as a chatbot professional who has built such systems or finetuned them for such tasks, it's extremely unlikely that chatbots would be able to replace 700 employees unless those employees were just doing simple zombie tasks.

The only sentence we get from Klarna in the article is this:

with the virtual assistant earning customer satisfaction ratings at the same level as human agents. Klarna

But nothing to elaborate. What was the satisfaction rating prior? No idea. So excuse my doubt when I don't want to believe a large company that lives to make money.

The idea of AI fully replacing a large workforce seems to be a bunch of BS driven forth by big companies like Klarna. Others in the field seem to be more careful about what AI can "help in" vs "replace". Have they A/B tested this? What is their KPI? Can we trust that KPI?

You’ve been the only one talking about trust.

I invite you to read the rest of the comments under the thread. I think you're wrong.

[-] Kusimulkku@lemm.ee 1 points 8 months ago

what makes you believe that an AI can replace 700 customer care agents?

Simple job + having ton of examples of it already + it's just another case of automation taking jobs that has been a thing for centuries + predictions from 4 years ago that automation would take away one third of jobs by the end of the decade and so on.

with the virtual assistant earning customer satisfaction ratings at the same level as human agents.

But nothing to elaborate. What was the satisfaction rating prior? No idea.

The number doesn't really matter if they're fine with just achieving the same result with less workers (less money). Customer care especially in English is already dogshit so AI achieving dogshit results is not hard to believe.

The idea of AI fully replacing a large workforce seems to be a bunch of BS driven forth by big companies like Klarna

It's customer care we're talking about. Chatbots have already replaced a lot of it. First they outsourced to the who knows where and didn't care if the customer service sucked, now they just give it to AI and don't care if it sucks.

[-] snek@lemmy.world 1 points 8 months ago

Simple job + having ton of examples of it already + it’s just another case of automation taking jobs that has been a thing for centuries + predictions from 4 years ago that automation would take away one third of jobs by the end of the decade and so on.

Okay, thanks. I think I understand your opinion better now.

The number doesn’t really matter if they’re fine with just achieving the same result with less workers (less money). Customer care especially in English is already dogshit so AI achieving dogshit results is not hard to believe.

I guess we disagree here. If the number doesn't matter, then they could just make it all up and move on. Seems like Klarna had no real number to share anyway, and depend on people believing that "it's easy for AI to take over any such job".

It’s customer care we’re talking about. Chatbots have already replaced a lot of it.

Yeah, but only to its detriment. Tricky problems go unsolved and chatbots are used by companies to create a wall between themselves and their clients. Revolut is one example that comes to mind. If customers cannot ever even reach a human being to tell them what's going on, then there's no problem!

I suspect Klarna is doing a similar thing. I also suspect that the worker unions in Sweden will not be satisfied with this reason for layoffs. Not sure if these layoffs are taking place globally or in Europe.

[-] Kusimulkku@lemm.ee 0 points 8 months ago

I guess we disagree here. If the number doesn’t matter, then they could just make it all up and move on.

I meant that the number doesn't matter as long as it's the same number for both. They're talking about differences between the two and that's really the main point, whether the AI is any less shit than the people doing the job.

“it’s easy for AI to take over any such job”.

It's customer service. A lot of it has been taken over already and the rest outsourced to the lowest bidder in the third world. It's a very simple job without not much qualifications and it's very formulaic. Only requirement seems to have been some language skills and let's be honest, even that bar was very very low. So AI swooping in and making those jobs obsolete, I can see that.

A switch from a human insisting you reboot your router because that's what the sheet tells them to say to AI insisting you reboot your router because that's what the programming tells them to say, I can see customers thinking it's equally dogshit and since cost is the #1 thing for these companies, might as well go with the cheaper option. It's not like they cared about the quality of the customer service to begin with, otherwise they wouldn't have run it to the ground before this.

Mind you, if these were 700 highly professional workers fluent in English (or whichever language we're talking about) with deep knowledge of the problems their customers face and high social and problem solving skills, it's a harder claim to believe that the ratings would be the same. If it was your average customer service where someone who is paid nothing, who is given ridiculous performance goals, who barely speaks the language and just goes through the checklist without any care for your individual problem, with no actual knowledge about the situation, it might even change for the better.

[-] snek@lemmy.world 1 points 8 months ago* (last edited 8 months ago)

Mind you, if these were 700 highly professional workers fluent in English (or whichever language we’re talking about) with deep knowledge of the problems their customers face and high social and problem solving skills, it’s a harder claim to believe that the ratings would be the same.

But they probably are... or a large chunk of them. I disagree with that customer service is a useless job with no skill set.

Here's another article on the same topic btw:

https://gizmodo.com/klarna-ceo-ai-chatbot-customer-service-700-jobs-layoffs-1851293200

Klarna CEO Sebastian Siemiatkowski bragged on Tuesday that his company’s new OpenAI-powered customer service chatbot was doing the work of 700 people—nearly two years after Klarna laid off about 700 people.

Specifying the number of human jobs that could be done by AI didn’t seem to be a good decision on Siemiatkowski’s part, however. Fast Company quickly pointed out that Klarna just so happened to have laid off approximately 700 people in 2022, which raised questions over whether the company had replaced those workers with AI.

To his credit, Siemiatkowski also pointed this out in his post on X, though he did not explain why the company felt the need to equate AI work to human work or how it made its calculations.

Seems like they decided this KPI two years after laying people off lol

To me, it looks like Klarna is just full of shit.

[-] Kusimulkku@lemm.ee 1 points 8 months ago* (last edited 8 months ago)

I really, really, really doubt they are considering what the situation with customer service of large companies is. But I suppose without either of us knowing more about the nature of these customer service workers, it's just a agree to disagree situation.

I disagree with that customer service is a useless job with no skill set.

It's not useless job at all or rather the service customer service is supposed to deliver isn't. It's just that often large companies have cut costs so much on customer service that they're less able to provide a good service, to such a degree that it starts to feel useless and something you might as well replace by some AI.

Basically the point is that companies have made it so that their customer service is that robotic and shit and useless that you wouldn't even notice if it was replaced it with robotic and shit and useless AI.

this post was submitted on 28 Feb 2024
144 points (97.4% liked)

Technology

59161 readers
2183 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS