this post was submitted on 24 Mar 2025
71 points (89.9% liked)
Privacy
36281 readers
688 users here now
A place to discuss privacy and freedom in the digital world.
Privacy has become a very important issue in modern society, with companies and governments constantly abusing their power, more and more people are waking up to the importance of digital privacy.
In this community everyone is welcome to post links and discuss topics related to privacy.
Some Rules
- Posting a link to a website containing tracking isn't great, if contents of the website are behind a paywall maybe copy them into the post
- Don't promote proprietary software
- Try to keep things on topic
- If you have a question, please try searching for previous discussions, maybe it has already been answered
- Reposts are fine, but should have at least a couple of weeks in between so that the post can reach a new audience
- Be nice :)
Related communities
much thanks to @gary_host_laptop for the logo design :)
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
You could check out localllama on lemmy to run foss ai models locally, or you could check out duck.ai as someone else mentioned. Your mental health should come first so do what you can for privacy but don't feel bad about making compromises.
Yes, you can use an locally hosted LLM, but these never can be so powerfull as an AI with a lot of servers supporting. We have to difference it, between mere Chatbots, relying on its own database, often outdated and with the tendece to invent answers, and AI supported search engines, like Andi, You, DDG AI and others, which retrieve informations in realtime from the Web. But there is important that these are capable to difference trustworth sources from those which are not. Andi does a very good job here, because compare informations from several sites for the answer.
Ollama can pull info from the web using multiple sites, but yes local AIs are more prone to hallucination. Google did release Gemma3 which has a 27B model which is probably the most cost effective way to get into local models that rival chatgpt (if you can call about 2k cost effective). That was why I recommended duck.ai as well, as it has access to gpt and llama3.3:70b which will do a lot better.
The problem is privacythis don't change if the AI uses sources from big bompany - Google GPTs. I tested several free AIs from Hugging face, Futurepedia and Futuretools, and since over two years I use Andi as main search, I didn't find anything better. It use an own LLM, because Andi was the first AI search ever, former LazyWeb, long before the others released AI searches.