Tech

1549 readers

155 users here now

A community for high quality news and discussion around technological advancements and changes

Things that fit:

New tech releases
Major tech changes
Major milestones for tech
Major tech news such as data breaches, discontinuation

Things that don't fit

Minor app updates
Government legislation
Company news
Opinion pieces

Community Wiki

founded 1 year ago

MODERATORS

Vacant@programming.dev

The first GPT-4-class AI model anyone can download has arrived: Llama 405B (arstechnica.com)

submitted 1 year ago by sabreW4K3@lazysoci.al to c/tech@programming.dev

10 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] xionzui@sh.itjust.works 9 points 1 year ago* (last edited 1 year ago) (1 children)

You can get usable performance on a CPU with good memory bandwidth. Apple studios are the best way to get that right now, but a good Epyc with 256GB of RAM works too.

Of course, you could also just run 5 GPUs

[–] IsThisAnAI@lemmy.world 4 points 1 year ago

"usable" sure if you want to wait 10 minutes a word.