Technology

60058 readers

1679 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 2 years ago

MODERATORS

300

Someone Made a Dataset of One Million Bluesky Posts for 'Machine Learning Research' (www.404media.co)

submitted 3 weeks ago by Stopthatgirl7@lemmy.world to c/technology@lemmy.world

88 comments fedilink hide all child comments

A machine learning librarian at Hugging Face just released a dataset composed of one million Bluesky posts, complete with when they were posted and who posted them, intended for machine learning research.

Daniel van Strien posted about the dataset on Bluesky on Tuesday:

“This dataset contains 1 million public posts collected from Bluesky Social's firehose API, intended for machine learning research and experimentation with social media data,” the dataset description says. “Each post contains text content, metadata, and information about media attachments and reply relationships.”

The data isn’t anonymous. In the dataset, each post is listed alongside the users’ decentralized identifier, or DID; van Strien also made a search tool for finding users based on their DID and published it on Hugging Face. A quick skim through the first few hundred of the million posts shows people doing normal types of Bluesky posting—arguing about politics, talking about concerts, saying stuff like “The cat is gay” and “When’s the last time yall had Boston baked beans?”—but the dataset has also swept up a lot of adult content, too.

you are viewing a single comment's thread
view the rest of the comments

[–] Brumefey@sh.itjust.works 27 points 3 weeks ago (2 children)

I don’t know why social media are used for training. It’s like the worst quality of data ever and it results to answers like « go kill youself » when prompted about something sad…

[–] EngineerGaming@feddit.nl 11 points 3 weeks ago (2 children)

IDK if this is accurate, but it's absolutely my headcanon as to why Glados decided to murder everyone almost immediately after she was turned on. She just vacuumed up the collective stupidity of the Internet.

[–] TriflingToad@sh.itjust.works 2 points 3 weeks ago

oh my God you are so right

[–] Infomatics90@lemmy.ca 0 points 3 weeks ago (1 children)

Its good headcanon, but it omits the fact that GLADOS isn't aware of the combine, and for some reason the combine haven't even found Aperture labs.

[–] EngineerGaming@feddit.nl 2 points 3 weeks ago (1 children)

I was under the impression that she knew and was deliberately laying low... Also, wasn't she built before these events?

[–] Infomatics90@lemmy.ca 1 points 3 weeks ago (1 children)

I could be wrong. I just don't remember her mentioning anything about them or seeing anything about them in the game.

[–] EngineerGaming@feddit.nl 2 points 3 weeks ago (1 children)

There have been suggestions that this line references them: "Are you trying to escape? Things have changed since the last time you left the building. What's going on out there will make you wish you were back in here. I have an infinite capacity for knowledge, and even I'm not sure what's going on outside. All I know is I'm the only thing standing between us and them. Well, I was".

She might just be lying like she usually does, but it still wouldn't be surprising if it indeed was that time period.

[–] Infomatics90@lemmy.ca 1 points 3 weeks ago

oh, i missed that. been awhile since i played.

[–] foremanguy92_@lemmy.ml 7 points 3 weeks ago (1 children)

They are used because they are "real life" (not really but you know) conversation example

[–] Pandemanium@lemm.ee 4 points 3 weeks ago

But why do we need to recreate "real life?" Don't we already do this relatively well in books, TV, and movies? People keep saying we won't use AI to replace creative writing, but this (and propaganda, making bot conversations seem like real people) are the only use cases for this kind of data. LLMs don't need to improve their conversation skills. What they really need is to stop hallucinating, and this kind of data won't help with that.