this post was submitted on 27 May 2024
1101 points (98.1% liked)

Technology

59378 readers
3072 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

You know how Google's new feature called AI Overviews is prone to spitting out wildly incorrect answers to search queries? In one instance, AI Overviews told a user to use glue on pizza to make sure the cheese won't slide off (pssst...please don't do this.)

Well, according to an interview at The Vergewith Google CEO Sundar Pichai published earlier this week, just before criticism of the outputs really took off, these "hallucinations" are an "inherent feature" of  AI large language models (LLM), which is what drives AI Overviews, and this feature "is still an unsolved problem."

(page 2) 50 comments
sorted by: hot top controversial new old
[–] mp3@lemmy.ca 27 points 5 months ago* (last edited 5 months ago) (1 children)

They polluted their model with the sewage of the Internet.

The only worse thing they could have done is base their entire LLM dataset on 4chan.

[–] Sabata11792@kbin.social 18 points 5 months ago

The only worse thing they could have done is base their entire LLM dataset on 4chan.

It went as expected.

https://en.wikipedia.org/wiki/GPT4-Chan

[–] Metype@lemmy.world 25 points 5 months ago (5 children)

So you have a product that you've made into a system for getting answers. And then you couldn't be bothered to try and sanitize training data enough to get your answer system's new headline feature from spreading blatantly incorrect information? If it doesn't work, maybe don't ship it.

load more comments (5 replies)
[–] unreasonabro@lemmy.world 25 points 5 months ago* (last edited 5 months ago)

That's ok, we were already used to not getting what we wanted from your search and are already working on replacing you since you opted to replace yourselves with advertising instead of information, the role you were supposed to fulfill which you betrayed.

die in ignominy. Open source is the only way forward.

[–] flop_leash_973@lemmy.world 25 points 5 months ago (1 children)

Then it sounds like the "web" tab should be the default and the AI Overview should be the optional tab the user has to choose to go click on.

load more comments (1 replies)
[–] Sarmyth@lemmy.world 24 points 5 months ago

I mean yeah... if he had a solution they would be actually have the revolutionary AI tool the tech writers write about.

It's kinda written like a "gotcha" but it's really the fundamental problem with AI. We call it hallucinations now but a few years ago we just called it being wrong or returning bad results.

It's like saying we have teleportation working in that we can vaporize you on the spot but are just struggling to reconstruct you elsewhere. "It's halfway there!"

Until the AI is trustworthy enough to not require fact checking it afterwards it's just a toy.

[–] Arkaelus@lemmy.world 22 points 5 months ago

Let's turn that frown upside down! Instead of saying "Google failed to generate a useful LLM to bolster its search feature," say "Google successfully replicated the output of an average Reddit troll!"

[–] Baggie@lemmy.zip 21 points 5 months ago (2 children)

God I'm fucking sick of this loss leading speculative investment bullshit. It's hit some bizarre zenith that has infected everybody in the tech world, but nobody has any actual intention of being practical in the making of money, or the functionality of the product. I feel like we should just can the whole damned thing and start again.

load more comments (2 replies)
[–] tills13@lemmy.world 20 points 5 months ago

Then fucking turn it off

[–] HarleyAnzuck@pawb.social 20 points 5 months ago (1 children)

Google really thinks they have no competition. Like, fuck, even Bing improved a lot with time.

load more comments (1 replies)
[–] Kolanaki@yiffit.net 20 points 5 months ago* (last edited 5 months ago) (1 children)

This is what competition is now.

Putting out worthless things simply because everyone else is doing it.

Hey, Google: if your big tech friends jumped off a cliff, would you join 'em?

(Also why is the AI assistant on my phone opening up just by typing "hey Google?" 😡)

load more comments (1 replies)
[–] RelativeArea0@lemmy.world 19 points 5 months ago

All I know when a publicly offered company slaps "AI" on their products, then its most likely a money launderi..i mean liquidation strat.

[–] kakes@sh.itjust.works 18 points 5 months ago

Well, according to an interview at The Vergewith Google CEO Sundar Pichai published earlier this week, just before criticism of the outputs really took off, these "hallucinations" are an "inherent feature" of  AI large language models (LLM), which is what drives AI Overviews, and this feature "is still an unsolved problem."

That's a lot of """quotation marks""" for something that is a very well established fact, and absolutely should not be a shock to anyone.

Yes, it's an unsolved problem. It always will be, because there is no algorithm for truth. All we can do is get incrementally better.

[–] exanime@lemmy.world 17 points 5 months ago (1 children)

Neither does ChatGPT... they over-hyped this tech so hard, I am afraid they are makers of their own demise...

load more comments (1 replies)
[–] bappity@lemmy.world 17 points 5 months ago (1 children)

obviously not.
this isn't some innovation of theirs. it's a slapped together duct taped copy of other people's work, trained on other people's work.

load more comments (1 replies)
[–] brbposting@sh.itjust.works 16 points 5 months ago

"Are we making progress? Yes, we are," he added. "We have definitely made progress when we look at metrics on factuality year on year. We are all making it better, but it’s not solved."

Let’s be fair with our headlines!

CEO of Google Says It Is Still Solving for Its AI Providing Wildly Incorrect Information [and is okay with people dying from rattlesnake bite misinformation in the meantime]

[–] JasSmith@sh.itjust.works 16 points 5 months ago

Google is on a tear. First Bard, then Gemini, now snippets injected into search results. All spectacular failures.

[–] InternetUser2012@midwest.social 15 points 5 months ago (3 children)

How about turn it the fuck off since it sucks and eventually will kill someone.

load more comments (3 replies)
[–] Simulation6@sopuli.xyz 15 points 5 months ago (1 children)

So is google going to initiate a reverse class action law suit and sue the internet for creating flawed trading data?

load more comments (1 replies)
[–] ThePyroPython@lemmy.world 15 points 5 months ago (6 children)

What y'all are forgetting is that when it comes to dominating a technology space, historically, it's not proving the better product, is providing the cheapest/widest available product. With the goal being to capture enough of the market to get and retain that dominant position. Nobody knows what the threshold is for that until years later when the dust has settled.

So from Google's perspective if a new or current rival is going to get there first, then just push it out and fix it live. What are people going to do? Switch to Bing?

So is you want Google to stop doing this dumb broken LLM shite, use the network effect against them. Switch to a different search provider and browser and encourage all of your friends and family to do so as well.

load more comments (6 replies)
[–] dumbass@leminal.space 14 points 5 months ago (1 children)

We fucked up and we fired the people who could probably solve it and now they won't talk to us.

load more comments (1 replies)
[–] StaySquared@lemmy.world 14 points 5 months ago* (last edited 5 months ago)

Maybe Google should put a disclaimer... warning people it's not 100% accurate. Or.. just take down the technology because clearly their AI is chit tier.

load more comments
view more: ‹ prev next ›