this post was submitted on 17 Dec 2024
563 points (92.7% liked)

memes

10636 readers
2625 users here now

Community rules

1. Be civilNo trolling, bigotry or other insulting / annoying behaviour

2. No politicsThis is non-politics community. For political memes please go to !politicalmemes@lemmy.world

3. No recent repostsCheck for reposts when posting a meme, you can only repost after 1 month

4. No botsNo bots without the express approval of the mods or the admins

5. No Spam/AdsNo advertisements or spam. This is an instance rule and the only way to live.

Sister communities

founded 2 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] NikkiDimes@lemmy.world 2 points 7 hours ago* (last edited 7 hours ago) (1 children)

Wait, when did you do this? I just tried this for my town and researched each aspect to confirm myself. It was all correct. It talked about the natives that once lived here, how the land was taken by Mexico, then granted to some dude in the 1800s. The local attractions were spot on and things I've never heard of. I'm...I'm actually shocked and I just learned a bunch of actual history I had no idea of in my town 🤯

[–] FinishingDutch@lemmy.world 2 points 4 hours ago (1 children)

I did that test late last year, and repeated it with another town this summer to see if it had improved. Granted, it made less mistakes - but still very annoying ones. Like placing a tourist info at a completely incorrect, non-existent address.

I assume your result also depends a bit on what town you try. I doubt it has really been trained with information pertaining to a city of 160.000 inhabitants in the Netherlands. It should do better with the US I’d imagine.

The problem is it doesn’t tell you it has knowledge gaps like that. Instead, it chooses to be confidently incorrect.

[–] NikkiDimes@lemmy.world 1 points 1 hour ago

Only 85k pop here, but yeah. I imagine it's half YMMV, half straight up luck that the model doesn't hallucinate shit.