They support Claude, ChatGPT, Gemini, HuggingChat, and Mistral.
Unpopular opinion, I think they're doing it right as well as it can be at least. It's completely optional and doesn't seem to be intrusive.
this post was submitted on 27 Nov 2024
169 points (93.3% liked)
Firefox
17952 readers
386 users here now
A place to discuss the news and latest developments on the open-source browser Firefox
founded 4 years ago
MODERATORS
yeah its not google chrome level which i'm thankful about.
I'm way more pissed about restarting my PC after an update and having Copilot installed without my permission.
Wow, great job Firefox. Thanks.
If I wanted unreliable bullshit like AI, I'd use Chrome.
Didn't want it in Opera, don't want it in Firefox. I mean they can keep trying and I'll just keep on ignoring this shit :/
This happened ages ago, didn't it? Am I missing something new?
Yeah, it did. That feature has been there at least since when Mozilla enabled "Firefox labs" section in settings by default a few months ago, and maybe even earlier than that
TIL a month is an age.
Well, this month in particular....
I only saw it now, maybe it happened before on a different version.
If they do it in a privacy-preseeving way, this could help them get back market share which will generally benefit an open internet.
I really wish there was another way.
Why would anybody want to have AI in their browser? It's a fucking browser.
But it's gonna be very difficult when you've got Google and OpenAI up there.
I will say, the Le Chat provider is pretty decent. You really can use it more natural language. "Rewrite it with a better rhyme scheme" "remove the last line" and it just got it.
Why no local option though? Why no anonmysing option?
Edit: There is a right click option which does make this officially actually useful for me now (summarize this!).
Other models do have RAG options and Mist real supports making agents with specified documentation too to at least fine tune too (not as good as full grounding though IMHO)
I don't understand the hate. It's just a sidebar for the supported LLMs. Maybe I'm misunderstanding?
Yes, I would prefer Mozilla focus on the browser, but to me, this seems like it was done in an afternoon.
It seems like common cynicism. Mozilla add this feature, as not to yield major features to other browsers. Mozilla's lets you natively have lots of different AI solutions to pick from.
Not every feature is for everyone. Not every feature is done being improved on at release.
And in spite of popular opinions, organizations don't do just one thing and then do just the next thing and the thing after that. Organizations can and do focus on and prioritize many things at the same time.
And for people who are naysaying AI at every mention, it has a lot of great and fascinating uses, and if you think otherwise, you really should try them more. I've used it plenty for work and life. It's not going away, might as well do some nice things with it.
I want my browser to be a browser. I don't want Pocket, I don't want AI, I don't want bullshit. There are plugins for that.
oh good. hurray.
I mean, if you're going to do it, where's the Ollama love?
I was disappointed there was no local option...
load more comments
(4 replies)
Now add support for GPT4All and everyone is happy again.
Thing is, for your average user with no GPU and whp never thinks about RAM, running a local LLM is intimidating. But it shouldn't be. Any system with an integrated GPU, and the more RAM the better, can run simple models locally.
The not so dirty secret is that ChatGPT 3 vs 4 isn't that big a difference, and neither are leaps and bounds ahead of the publically available models for about 99% of tasks. For that 1% people will ooh and aah over it, but 99% of use cases are only seeing marginal gains on 4o.
And the simplified models that run "only" 95% as well? They can use 90% fewer resources give pretty much identical answers outside of hyperspecific use cases.
Running a a "smol" model as some are called, gets you all the bang for none of the buck, and your data stays on your system and never leaves.
I've been yelling from the rooftops to some stupid corporate types that once the model is trained, it's trained. Unless you are training models yourself, there is no need for the massive AI clusters, just for the model. Run it local on your hardware at a fraction of the cost.
Idk I noticed pretty significant differences between models of various sizes. I mean there are lots of metrics on this
There's the tragedy with this new feature: they fast-tracked this past more popular requests, sticking it into Release Firefox.
But they only rushed the part that connects to third parties. There was also a "localhost" option which was originally alongside the Big Five corporate offerings, but Mozilla ultimately decided to bury that one inside of the about:config settings.
I'm guessing that the reason (and a good one at that) is that simply having an option to connect to a local chatbot leads to just confused users because they also need the actual chatbot running on their system. If you can set up that, then you can certainly toggle a simple switch in about:config to show the option.
load more comments
(8 replies)
Thanks for nothing, Mozilla.
They should raise the ceo's pay some more to celebrate.
And fire a few employees just cause.
For a second I thought it said "experimental failure". Would be more accurate, I think.
why a fucking chatbot? translate a page better for me you fucking losers, all the translation options suck for privacy outside of specifically trained local AIs. this is the BEST use case for a small local LLM yet mozilla with all its brains and resources couldnt rub two neurons together for this.
or they could do character prediction on your typing to make typing faster. just some legit examples, why waste resources to build a chat ai into my browser when i can just open a website???
load more comments
(1 replies)
That was there before 133, don’t remember the exact release that added it.
view more: next ›