this post was submitted on 14 Apr 2025
218 points (92.2% liked)
Technology
68916 readers
4847 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
It's just a custom LLM for records management and regulatory compliance. Literally just for paperwork, one of the few things that LLMs are actually good at.
Does anyone read more than the headline? OP even said this in the summary.
I agree with you but you could see the slippery slope with the LLM returning incorrect/hallucinate data in the same way that is happening in the public space. It could be trivial for documentation until you realize the documentation could be critical for some processes.
If you've never used a custom LLM or wrapper for regular ol' ChatGPT, a lot of what it can hallucinate gets stripped out and the entire corpus of data it's trained on is your data. Even then, the risk is pretty low here. Do you honestly think that a human has never made an error on paperwork?
I do and even contained one do return hallucination or incorrect data. So it depends on the application that you use it. It is for a quick summary / data search why not? But if it is for some operational process that might be problematic.
It depends what purpose that paperwork is intended for.
If the regulatory paperwork it's managing is designed to influence behaviour, perhaps having an LLM do the work will make it less effective in that regard.
Learning and understanding is hard work. An LLM can't do that for you.
Sure it can summarise instructions for you to show you what's more pertinent in a given instance, but is that the same as someone who knows what to do because they've been wading around in the logs and regs for the last decade?
It seems like, whether you're using an LLM to write a business report, or a legal submission, or a SOP for running a nuclear reactor, it can be a great tool but requires high level knowledge on the part of the user to review the output.
As always, there's a risk that a user just won't identify a problem in the information produced.
I don't think this means LLMs should not be used in high risk roles, it just demonstrates the importance of robust policies surrounding their use.
NOOOOOO ITS DOING NUCLEAR PHYSICS!!!!!!!!111
It's eating the rods, it's eating the ions!
I unfortunately don't can someone explain?
This
Oh shit had already forgotten about this amid so many other scandals. The guy who said this is running the whole of US like a fucking medieval kingdom, another reality slap in the face. At that time I was like, "surely no one right in the mind would vote for this scammer".
Don't blame the people who just read the headline.
Blame the people who constantly write misleading headlines.
There is literally no "artificial intelligence" here either.