this post was submitted on 12 Mar 2025

20 points (100.0% liked)

LocalLLaMA

2739 readers

25 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago

MODERATORS

SkySyrup@sh.itjust.works

pax@sh.itjust.works

noneabove1182@sh.itjust.works

Smokeydope@lemmy.world

MonsterBug@sh.itjust.works

20

New release: Gemma 3 family of models (huggingface.co)

submitted 1 week ago* (last edited 1 week ago) by Lantier@jlai.lu to c/localllama@sh.itjust.works

3 comments fedilink hide all child comments

GGUF quants are already up and llama.cpp was updated today to support it.

top 3 comments

sorted by: hot top controversial new old

[–] brucethemoose@lemmy.world 1 points 3 days ago

I tested these out and found they are really bad at longer context... at least in settings that can sanely fit on most GPUs.

Seems the Gemma family is mostly for short-context work, still.

[–] Picasso@sh.itjust.works 1 points 5 days ago

Im especially interested in its advanced OCR capabilities. Will be testing this one out on lm studio

[–] Smokeydope@lemmy.world 3 points 1 week ago

Im happy for the Gemma enjoyers who get something out of it. I hear the real world domain knowledge is good. I never tried the Gemma models myself. Apparently its very overly censored and anything google puts out just gives me the icky feeling through association. Anyone remember when they still had "Don't Be Evil" as a motto? Good times.