A "Showerthought" is a simple term used to describe the thoughts that pop into your head while you're doing everyday things like taking a shower, driving, or just daydreaming. The most popular seem to be lighthearted clever little truths, hidden in daily life.
Here are some examples to inspire your own showerthoughts:
If you made it this far, showerthoughts is accepting new mods. This community is generally tame so its not a lot of work, but having a few more mods would help reports get addressed a little sooner.
Whats it like to be a mod? Reports just show up as messages in your Lemmy inbox, and if a different mod has already addressed the report, the message goes away and you never worry about it.
AI LLMs have been pretty shit, but the advancement in voice, image generation, and video generation in the last two years has been unbelievable.
We went from the infamous Will Smith eating spaghetti to videos that are convincing enough to fool most people... and it only took 2-3 years to get there.
But LLMs will have a long way to go because of how they create content. It's very easy to poison LLM datasets, and they get worse learning from other generated content.
LOL... you did make me chuckle.
Aren't we 18months until developers get replaced by AI... for like few years now?
Of course "AI" even loosely defined progressed a lot and it is genuinely impressive (even though the actual use case for most hype, i.e. LLM and GenAI, is mostly lazier search, more efficient spam&scam personalized text or impersonation) but exponential is not sustainable. It's a marketing term to keep on fueling the hype.
That's despite so much resources, namely R&D and data centers, being poured in... and yet there is not "GPT5" or anything that most people use on a daily basis for anything "productive" except unreliable summarization or STT (which both had plenty of tools for decades).
So... yeah, it's a slow take off, as expected. shrug
how do you grow zero exponentially
Things just don't impend like they used to!
Nobody wants to portend anymore.
It has slowed exponentially because the models get exponentially more complicated the more you expect it to do.
The exponential problem has always been there. We keep finding tricks and optimizations in hardware and software to get by it but they're only occasional.
The pruned models keep getting better so now You're seeing them running on local hardware and cell phones and crap like that.
I don't think they're out of tricks yet, but God knows when we'll see the next advance. And I don't think there's anything that'll take this current path into AGI I think that's going to be something else.
I'd argue it has. Things like ChatGPT shouldn't be possible, maybe it's unpopular to admit it but as someone who has been programming for over a decade, it's amazing that LLMs and "AI" has come as far as it has over the past 5 years.
That doesn't mean we have AGI of course, and we may never have AGI, but it's really impressive what has been done so far IMO.
If you've been paying attention to the field, you'd see it's been a slow steady march. The technology that LLMs are based in were first published in 2016/2017, ChatGPT was the third iteration of the same base model.
Thats not even accounting for all the work done with RNNs and LSTMs prior to that, and even more prior.
Its definitely a major breakthrough, and very similar to what CNNs did for computer vision further back. But like computer vision, advancements have been made in other areas (like the generative space) and haven't followed a linear path of progress.
Agreed. I never thought it would happen in my lifetime, but it looks like we’re going to have Star Trek computers pretty soon.
I think we might not be seeing all the advancements as they are made.
Google just showed off AI video with sound. You can use it if you subscribe to thier $250/month plan. That is quite expensive.
But if you have strong enough hardware, you can generate your own without sound.
I think that is a pretty huge advancement in the past year or so.
I think that focus is being put on optimizing these current things and making small improvements to quality.
Just give it a few years and you will not even need your webcam to be on. You could just use an AI avatar that look and sounds just like you running locally on your own computer. You could just type what you want to say or pass through audio. I think the tech to do this kind of stuff is basically there, it just needs to be refined and optimized. Computers in the coming years will offer more and more power to let you run this stuff.
How is that an advance ? Computers have been able to speak since the 1970s. It was already producing text.
Computers are still advancing roughly exponentially, as they have been for the last 40 years (Moore's law). AI is being carried with that and still making many occasional gains on top of that. The thing with exponential growth is that it doesn't necessarily need to feel fast. It's always growing at the same rate percentage wise, definitionally.
We once again congratulate software engineers for nullifying 40 years of hardware improvements.
Moore's law is kinda still in effect, depending on your definition of Moore's law. However, Dennard Scaling is not so computer performance isn't advancing like it used to.
Moore’s law is kinda still in effect, depending on your definition of Moore’s law.
Sounds like the goal post is moving faster than the number of transistors in an integrated circuit.
It has taken off exponentially. It’s exponentially annoying that’s it’s being added to literally everything
Humanity may achieve an annoyance singularity within six months
How do you know it hasn't and us just laying low? I for one welcome our benevolent and merciful machine overlord.
Duly noted. 🤭 🤫
It has definitely plateaued.
Well, the thing is that we're hitting diminishing returns with current approaches. There's a growing suspicion that LLMs simply won't be able to bring us to AGI, but that they could be a part of or stepping stone to it. The quality of the outputs are pretty good for AI, and sometimes even just pretty good without the qualifier, but the only reason it's being used so aggressively right now is that it's being subsidized with investor money in the hopes that it will be too heavily adopted and too hard to walk away from by the time it's time to start charging full price. I'm not seeing that. I work in comp sci, I use AI coding assistants and so do my co-workers. The general consensus is that it's good for boilerplate and tests, but even that needs to be double checked and the AI gets it wrong a decent enough amount. If it actually involves real reasoning to satisfy requirements, the AI's going to shit its pants. If we were paying the real cost of these coding assistants, there is NO WAY leadership would agree to pay for those licenses.
Yeah, I don't think AGI = an advanced LLM. But I think it's very likely that a transformer style LLM will be part of some future AGI. Just like human brains have different regions that can do different tasks, an LLM is probably the language part of the "AGI brain".
That's only if the exponent is greater than 1.