52
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 02 Aug 2023
52 points (89.4% liked)
No Stupid Questions
35699 readers
1076 users here now
No such thing. Ask away!
!nostupidquestions is a community dedicated to being helpful and answering each others' questions on various topics.
The rules for posting and commenting, besides the rules defined here for lemmy.world, are as follows:
Rules (interactive)
Rule 1- All posts must be legitimate questions. All post titles must include a question.
All posts must be legitimate questions, and all post titles must include a question. Questions that are joke or trolling questions, memes, song lyrics as title, etc. are not allowed here. See Rule 6 for all exceptions.
Rule 2- Your question subject cannot be illegal or NSFW material.
Your question subject cannot be illegal or NSFW material. You will be warned first, banned second.
Rule 3- Do not seek mental, medical and professional help here.
Do not seek mental, medical and professional help here. Breaking this rule will not get you or your post removed, but it will put you at risk, and possibly in danger.
Rule 4- No self promotion or upvote-farming of any kind.
That's it.
Rule 5- No baiting or sealioning or promoting an agenda.
Questions which, instead of being of an innocuous nature, are specifically intended (based on reports and in the opinion of our crack moderation team) to bait users into ideological wars on charged political topics will be removed and the authors warned - or banned - depending on severity.
Rule 6- Regarding META posts and joke questions.
Provided it is about the community itself, you may post non-question posts using the [META] tag on your post title.
On fridays, you are allowed to post meme and troll questions, on the condition that it's in text format only, and conforms with our other rules. These posts MUST include the [NSQ Friday] tag in their title.
If you post a serious question on friday and are looking only for legitimate answers, then please include the [Serious] tag on your post. Irrelevant replies will then be removed by moderators.
Rule 7- You can't intentionally annoy, mock, or harass other members.
If you intentionally annoy, mock, harass, or discriminate against any individual member, you will be removed.
Likewise, if you are a member, sympathiser or a resemblant of a movement that is known to largely hate, mock, discriminate against, and/or want to take lives of a group of people, and you were provably vocal about your hate, then you will be banned on sight.
Rule 8- All comments should try to stay relevant to their parent content.
Rule 9- Reposts from other platforms are not allowed.
Let everyone have their own content.
Rule 10- Majority of bots aren't allowed to participate here.
Credits
Our breathtaking icon was bestowed upon us by @Cevilia!
The greatest banner of all time: by @TheOneWithTheHair!
founded 1 year ago
MODERATORS
It's important to be clear what kind of actual system you're using when you say "AI".
If you're talking about something like ChatGPT, you're using an LLM, or "Large Language Model". Its goal is to produce something that reasonably looks like a human wrote it. It has reviewed a ridiculous amount of human text, and has a metric assload of weights associating the relationships between these words.
If the LLM sees your question and associates a particular compound with superconductors, it's because it's seen these things related in other writings (directly or indirectly) or at least sees the relationship as plausible.
It's important not to ascribe more intent behind what your seeing than exists. It can't understand what a superconductor is or how materials can achieve the state, it's just really good at relaying related words in a convincing manner
That's not to say it isn't cool or useful, or that ML(Machine Learning) can't be used to help find answers to these kinds of questions.
Exactly. It’s just text prediction software that is really good at making itself sound plausible. It could tell you something completely false and have no idea it’s stating a lie. There’s no intelligence here. It’s a very precise word guesser. Which is great for specific settings. But there’s a huge amount of hype associated with this tool and it’s very much by design (by tech companies).
I'm not convinced of this. LLMs haven't been just spitting out prior art, despite what some people seem to suggest. It's not just auto-complete, that's just a useful analogy.
For instance, I'm fascinated by the study that got GPT4 to draw a unicorn using LaTeX. It wasn't great, but it was recognizable to us as a unicorn. And apparently that's gotten better with iterations. GPT (presumably) has no idea what a unicorn looks like, except through text descriptions. Who knows how it goes from written descriptions of a mythical being to a 2d drawing with a markup language without being trained on images, imagery, or any concept of what things look like.
But also, this is true as well. I'm trying hard not to anthropomorphize this LLM but it sure seems like there's some emergent effect that kind of looks like an intelligence to a layman like myself.
To be clear, I'm not trying to make the argument that it can only produce exactly what it's seen, I recognize that this argument is frankly overstated in media. (The interviews with Adam Conover are great examples; he's not wrong per se, but he does oversimplify things to the point that I think a lot of people misunderstand what's being discussed)
The ability to recombine what it's seen in different ways as an emergent property is interesting and provocative, but isn't really what OP is asking about.
A better example of how LLMs can be useful in research like what OP described would be asking it to coalesce information from multiple existing studies about what properties correlate with superconducting in order to help accelerate research in collaboration with actual material scientists. This is all research that could be done without LLMs, or even without ML, but having a general way to parse and filter these kinds of documents is still incredibly powerful, and will be a sort of force multiplication for these researchers going forward.
My favorite example of the limitation on LLM's is to ask it to coin a new word, then google that word. It physically is unable to produce a combination of letters that it doesn't have indexed, and it doesn't have an index for words it hasn't seen. It might be able to create a new meaning for a word that it's seen, but that isn't necessarily the same.