this post was submitted on 24 Mar 2025
71 points (89.9% liked)
Privacy
36281 readers
688 users here now
A place to discuss privacy and freedom in the digital world.
Privacy has become a very important issue in modern society, with companies and governments constantly abusing their power, more and more people are waking up to the importance of digital privacy.
In this community everyone is welcome to post links and discuss topics related to privacy.
Some Rules
- Posting a link to a website containing tracking isn't great, if contents of the website are behind a paywall maybe copy them into the post
- Don't promote proprietary software
- Try to keep things on topic
- If you have a question, please try searching for previous discussions, maybe it has already been answered
- Reposts are fine, but should have at least a couple of weeks in between so that the post can reach a new audience
- Be nice :)
Related communities
much thanks to @gary_host_laptop for the logo design :)
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
You don't actually have to have a beefy computer to self host. I know with deepseek there's a 1.5b model which is optimized for low end hardware. I self hosted it on a desktop from 2012 and it worked alright. 8gb RAM, i5 processer, quad core. Was the GPU usage high? Yep. Still worked tho.
Obligatory: you're not running deepseek 1.5B. You're running some other distilled model which was finetuned by the deepseek folks
Wait, what? How does that work?
Deepseek 1.5B doesn't exist. I don't know why the Deepseek team named the models on Huggingface like this, but what is labelled as "Deepseek 1.5B" is actually not the OG Deepseek 70B model distilled to 1.5B, it's a different model either trained or finetuned by the Deepseek team. My theory is some sort of intentional manipulation on their part so people stay confused on whether they are actually running the Deepseek model or not. There is a lot of commentary on this online, sorry I don't have the links from the top of my head.
Oh wow, that’s awesome. I’m gonna have to try that model out. I have an old XFX 7950 I can try burning out lmao.