42, 47, and 50 all make sense to me. What’s the significance of 37, 57, and 73?
this post was submitted on 10 Apr 2024
435 points (100.0% liked)
Technology
37746 readers
222 users here now
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
I'm curious, is there actually so many 42's in the system? (more than 69 sounds unlikely)
What if the LLM is getting tripped up because 42 is always referred to as the answer to "the Ultimate Question of Life, the Universe, and Everything".
So you ask it a question like give a number between 1-100, it answers 42 because that's the answer to "Everything", according to it's training data.
Something similar happened to Gemini. Google discouraged Gemini from giving unsafe advice because it's unethical. Then Gemini refused to answer questions about C++ because it's considered "unsafe" (referring to memory management). But Gemini thinks C++ is "unsafe" (the normal meaning), therefore it's unethical. It's like those jailbreak tricks but from its own training set.
I’m curious, is there actually so many 42’s in the system?
Sort of, it's not actually picking a random number. It does not know what "random" means. It is analyzing the number of times the question "pick a random number" was asked and what the most common responses to that question looked like.
load more comments
(2 replies)
So what? It figured out The Answer, big whoop.
Get back to me when it figures out The Question.
What's the y axis?
Temperature is basically how creative you want the AI to be. The lower the temperature, the more predictable (and repeatable) the response.
load more comments
(1 replies)
load more comments
(6 replies)
I petition to rename ChatGPT to DeepThought based on these results.
I spent an afternoon once playing Infinite Craft, which uses some sort of LLM behind the scenes to do it's combinations.
At one point I got 007, and found 007+007 = 0014.
The maths gets wild though, and because it's been trained on text, it has no idea when it comes to combinations of numbers it hasn't seen before. I spent ages trying to get it to 69420 and just couldn't, although I could get 42069.