Late Stage Capitalism

I mean, AI as a word has been used in tons of different ways. We still say "NPC AI" in video games and that's just a whole bunch of if statements, no LLM involved. And on the other end of the spectrum we still talk about AI in movies like I, Robot, with fully sentient machines. My line when I say "AI" with no qualifier is neural networks, the parameters that we hear so much about.

And I don't think GenAI is "the" grift like the tweet implies, because the AI they describe (machine learning, ML) is the exact same - neural networks with trained models. They talk about the Kinect using ML - you can do machine learning without the neural network - but was the Kinect not "wasteful", "unethical", and "useless", to use their words? It was an expensive system that worked okay (on some tech demos) but barely had 3 games. The EyeToy for the PS2 was more fun.

A lot of the conversation around Generative AI surrounds image generation and I feel that's harmfully reductive. It centers a lot around artists and the purity of their art (as if they're the only people impacted by AI) when there's so much more to talk about; GenAI can do code - there was a whole discussion around it here the other day, and maybe it's not super great code, but it can do code nonetheless and for people who don't code and need something, it gets the job done.

Yes, there is also a whole lot of stuff you can do with AI without LLMs. In fact, I'm not sure how LLMs specifically became so ubiquitous because you can do neural network AI stuff without ever needing an LLM. I remember back when AI became big (2022 or so), China announced they'd used an AI to map the wiring on a new ship model. What took an engineer one year to do was done by the AI in 24 hours.

GenAI including LLMs have hard limitations that I think are, conversely, overlooked. LLM AI will not do everything, but it can get you part of the way there. The grift is moreso tech companies trying to pretend their toy is a panacea. When asked about AI making stuff up in an interview, OpenAI's CTO "well you know, it's very human in that regard [emphasis mine], because when we don't know something, what do we do? We make stuff up". They admit it themselves that they have a bullshit generator. But when it works, it works - you can use GPT 4o or o4 or whatever the new model is called as a tutor, for example, for photoshop, guitar, or whatever other hobby you have. It works great! You can ask it any question you have like a tutor, instead of being limited to what the page cares to tell you about! And yes I could ask someone, but: a- people are not necessarily available the moment I have a question and b- google is crap now and if you ask on most forums they will tell you to google it. So chatGPT it is. We just have to take into account that it might be making stuff up to the point that you need to double-check, and that OpenAI clearly has no plans to fix that (not that they even could).

For coding my choice nowadays is start with chatGPT then pass it over to deepseek once I have the prototype, it works great.