this post was submitted on 08 Jun 2025
960 points (97.6% liked)

Microblog Memes

7974 readers
3403 users here now

A place to share screenshots of Microblog posts, whether from Mastodon, tumblr, ~~Twitter~~ X, KBin, Threads or elsewhere.

Created as an evolution of White People Twitter and other tweet-capture subreddits.

Rules:

  1. Please put at least one word relevant to the post in the post title.
  2. Be nice.
  3. No advertising, brand promotion or guerilla marketing.
  4. Posters are encouraged to link to the toot or tweet etc in the description of posts.

Related communities:

founded 2 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] finitebanjo@lemmy.world 2 points 6 hours ago* (last edited 5 hours ago) (2 children)

The diminishing returns from the computing power scale much faster than the very static rate (and in many sectors plateauing rate) of growth in computing power, but if you believe OpenAI and Deepmind then they've already proven INFINITE processing power cannot reach it from their studies in 2020 and also in 2023.

They already knew it wouldn't succeed, they always knew, and they told everyone, but we're still surrounded by people like you being grifted by it all.

EDIT: I must be talking to a fucking bot because I already linked those scientific articles earlier, too.

[–] abruptly8951@lemmy.world 1 points 2 hours ago

Can you go into a bit more details on why you think these papers are such a home run for your point?

  1. Where do you get 95% from, these papers don't really go into much detail on human performance and 95% isn't mentioned in either of them

  2. These papers are for transformer architectures using next token loss. There are other architectures (spiking, tsetlin, graph etc) and other losses (contrastive, RL, flow matching) to which these particular curves do not apply

  3. These papers assume early stopping, have you heard of the grokking phenomenon? (Not to be confused with the Twitter bot)

  4. These papers only consider finite size datasets, and relatively small ones at that. I.e. How many "tokens" would a 4 year old have processed? I imagine that question should be somewhat quantifiable

  5. These papers do not consider multimodal systems.

  6. You talked about permeance, does a RAG solution not overcome this problem?

I think there is a lot more we don't know about these things than what we do know. To say we solved it all 2-5 years ago is, perhaps, optimistic

[–] davidagain@lemmy.world 1 points 5 hours ago* (last edited 5 hours ago)

Thanks for the abuse. I love it when I'm discussing something with someone and they start swearing at me and calling me names because I disagree. Really makes it fun. /s You can fuck right off yourself too, you arrogant tool.