196

People saying LLMs are a singularity don't know how LLMs work.

When you feed ChatGPT some text, what you get out wasn't the result of the text being processed by a neural network. It's the result of the text being processed by a deterministic algorithm, one part of which was decided on by a neural network far in advance. That's what neural nets do, they contribute to other algorithms that, while often complicated, are deterministic. If ChatGPT were to become sentient somehow, it would be happening behind the scenes with a neural network you've literally never interacted with before.