LocalLLaMA

2590 readers

14 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago

MODERATORS

SkySyrup@sh.itjust.works

pax@sh.itjust.works

noneabove1182@sh.itjust.works

Recommend models for GTX 1660 Super (6GB) (lemmy.sdf.org)

submitted 1 week ago by Disonantezko@lemmy.sdf.org to c/localllama@sh.itjust.works

6 comments fedilink hide all child comments

I have an GTX 1660 Super (6 GB)

Right now I have ollama with:

deepseek-r1:8b
qwen2.5-coder:7b

Do you recommend any other local models to play with my GPU?

you are viewing a single comment's thread
view the rest of the comments

[–] TheHobbyist@lemmy.zip 2 points 1 week ago (1 children)

Deepseek is good at reasoning, qwen is good at programming, but I find llama3.1 8b to be well suited for creativity, writing, translations and other tasks which fall out of the scope of your two models. It's a decent all arounder. It's about 4.9GB in q4_K_M.

[–] Disonantezko@lemmy.sdf.org 1 points 1 week ago

It's not out of my scope, I'm just learning what can I do locally with my current machine.

Today I read about RAG, maybe I'm gonna try an easy local setup to chat with a PDF.