this post was submitted on 27 Nov 2024
213 points (94.6% liked)

Firefox

18050 readers
100 users here now

A place to discuss the news and latest developments on the open-source browser Firefox

founded 5 years ago
MODERATORS
 

They support Claude, ChatGPT, Gemini, HuggingChat, and Mistral.

top 50 comments
sorted by: hot top controversial new old
[–] davel@lemmy.ml 111 points 3 weeks ago
[–] that_leaflet@lemmy.world 59 points 3 weeks ago

That was there before 133, don’t remember the exact release that added it.

[–] nu11@sh.itjust.works 41 points 3 weeks ago (7 children)

I don't understand the hate. It's just a sidebar for the supported LLMs. Maybe I'm misunderstanding?

Yes, I would prefer Mozilla focus on the browser, but to me, this seems like it was done in an afternoon.

[–] PrefersAwkward@lemmy.world 9 points 3 weeks ago* (last edited 3 weeks ago)

It seems like common cynicism. Mozilla adds this feature, as not to yield major features to other browsers. Mozilla's lets you natively have lots of different AI solutions to pick from.

Not every feature is for everyone. Not every feature is done being improved on at release.

And in spite of popular opinions, organizations don't do just one thing and then do just the next thing and the thing after that. Organizations can and do focus on and prioritize many things at the same time.

And for people who are naysaying AI at every mention, it has a lot of great and fascinating uses, and if you think otherwise, you really should try them more. I've used it plenty for work and life. It's not going away, might as well do some nice things with it.

load more comments (6 replies)
[–] JokeDeity@lemm.ee 38 points 3 weeks ago (2 children)

Unpopular opinion, I think they're doing it right as well as it can be at least. It's completely optional and doesn't seem to be intrusive.

[–] potentiallynotfelix@lemmy.fish 8 points 3 weeks ago (1 children)

yeah its not google chrome level which i'm thankful about.

[–] JokeDeity@lemm.ee 14 points 3 weeks ago (1 children)

I'm way more pissed about restarting my PC after an update and having Copilot installed without my permission.

load more comments (1 replies)
load more comments (1 replies)
[–] cmnybo@discuss.tchncs.de 35 points 3 weeks ago (1 children)

They better not decide to enable it by default.

[–] metaStatic@kbin.earth 27 points 3 weeks ago (2 children)

it's not enabled by default ... it's opt out by default

[–] Vincent@feddit.nl 36 points 3 weeks ago* (last edited 3 weeks ago)

I think that means that it's opt-in.

[–] adarza@lemmy.ca 10 points 3 weeks ago

if third-party accounts are needed, it'll have to stay that way.

[–] ocassionallyaduck@lemmy.world 32 points 3 weeks ago (8 children)

Thing is, for your average user with no GPU and whp never thinks about RAM, running a local LLM is intimidating. But it shouldn't be. Any system with an integrated GPU, and the more RAM the better, can run simple models locally.

The not so dirty secret is that ChatGPT 3 vs 4 isn't that big a difference, and neither are leaps and bounds ahead of the publically available models for about 99% of tasks. For that 1% people will ooh and aah over it, but 99% of use cases are only seeing marginal gains on 4o.

And the simplified models that run "only" 95% as well? They can use 90% fewer resources give pretty much identical answers outside of hyperspecific use cases.

Running a a "smol" model as some are called, gets you all the bang for none of the buck, and your data stays on your system and never leaves.

I've been yelling from the rooftops to some stupid corporate types that once the model is trained, it's trained. Unless you are training models yourself, there is no need for the massive AI clusters, just for the model. Run it local on your hardware at a fraction of the cost.

[–] LWD@lemm.ee 30 points 3 weeks ago (1 children)

There's the tragedy with this new feature: they fast-tracked this past more popular requests, sticking it into Release Firefox.

But they only rushed the part that connects to third parties. There was also a "localhost" option which was originally alongside the Big Five corporate offerings, but Mozilla ultimately decided to bury that one inside of the about:config settings.

[–] MrOtherGuy@lemmy.world 11 points 3 weeks ago

I'm guessing that the reason (and a good one at that) is that simply having an option to connect to a local chatbot leads to just confused users because they also need the actual chatbot running on their system. If you can set up that, then you can certainly toggle a simple switch in about:config to show the option.

[–] ilhamagh@lemmy.world 4 points 3 weeks ago (2 children)

Can you point me to some resources to running smol llm?

My use case prob just to help "typing" miscellaneous idea I have or check for my grammatical error, in english.

Thanks, in advance.

load more comments (6 replies)
[–] fibojoly@sh.itjust.works 26 points 3 weeks ago (2 children)

Didn't want it in Opera, don't want it in Firefox. I mean they can keep trying and I'll just keep on ignoring this shit :/

load more comments (2 replies)
[–] Eiri@lemmy.ca 23 points 3 weeks ago (3 children)

I wish I had telemetry on such features.

I really doubt a significant number of people use AI chatbots often enough that having it in a dedicated sidebar is worth it.

[–] possiblylinux127@lemmy.zip 4 points 3 weeks ago (1 children)

I wish I had telemetry

I'm sure they do as Mozilla is an ad company

[–] davel@lemmy.ml 5 points 3 weeks ago (5 children)

This is apparently either not widely known or some people just like to shoot the messenger.

load more comments (5 replies)
load more comments (2 replies)
[–] thingsiplay@beehaw.org 17 points 3 weeks ago

https://support.mozilla.org/en-US/kb/ai-chatbot

Note that you need an account to use one of these supported systems. HuggingChat allows for a few connections as a gues before cutting the access; basically a trial version, so you have to create an account.

[–] eleitl@lemm.ee 17 points 3 weeks ago (1 children)

Thanks for nothing, Mozilla.

[–] Rozauhtuno@lemmy.blahaj.zone 24 points 3 weeks ago (1 children)

They should raise the ceo's pay some more to celebrate.

[–] piracysails@lemm.ee 11 points 3 weeks ago* (last edited 3 weeks ago)

And fire a few employees just cause.

[–] Sundial@lemm.ee 15 points 3 weeks ago (3 children)

Are any of these open source or trustworthy?

[–] 1rre@discuss.tchncs.de 11 points 3 weeks ago (1 children)

I think Mistral is model-available (ie I'm not sure if they release training data/code but they do release model shape and weights), huggingchat definitely is open source and model-available

load more comments (1 replies)
[–] thingsiplay@beehaw.org 9 points 3 weeks ago (1 children)

There are no open source ai models, even if they tell you that they are. HuggingFace is the closest thing to as something like open source where you can download ai models to run locally without internet connection. There are applications for that. In Firefox the HuggingChat uses models from HuggingFace, but I think it is running them on a server and does not download from?

The reason why they are not open source is, because we don't know exactly on what data they are trained on. We cannot rebuild them on our own. And for trustworthy, I assume you are talking about the integration and the software using the models, right? At least it is implemented by Mozilla, so there is (to me) some sort of trust involved. Yes, even after all the bullshit I trust Mozilla.

load more comments (1 replies)
load more comments (1 replies)
[–] marcie@lemmy.ml 15 points 3 weeks ago* (last edited 3 weeks ago) (1 children)

why a fucking chatbot? translate a page better for me you fucking losers, all the translation options suck for privacy outside of specifically trained local AIs. this is the BEST use case for a small local LLM yet mozilla with all its brains and resources couldnt rub two neurons together for this.

or they could do character prediction on your typing to make typing faster. just some legit examples, why waste resources to build a chat ai into my browser when i can just open a website???

[–] Midnitte@beehaw.org 7 points 3 weeks ago (1 children)

Perhaps Mozilla’s biggest "failure" is just communication...

Firefox actually has this now.

load more comments (1 replies)
[–] ohwhatfollyisman@lemmy.world 14 points 3 weeks ago (4 children)

as someone who's never dabbled with ai bots, what does this feature do? is it only to query for information like a web search?

[–] Furball@sh.itjust.works 14 points 3 weeks ago (1 children)

It just adds ChatGPT or similar to your sidebar. Chatbots can do a lot of things, they are mostly good for information research and technical help, although they have serious flaws like hallucinating false information sometimes

load more comments (1 replies)
[–] LWD@lemm.ee 9 points 3 weeks ago (4 children)

It is a sidebar that sends a query from your browser directly to a server run by a giant corporation like Google or OpenAI, consumes an excessive amount of carbon/water, then sends a response back to you that may or may not be true (because AI is incapable of doing anything but generating what it thinks you want to see).

Not only is it unethical in my opinion, it's also ridiculously rudimentary...

load more comments (4 replies)
[–] Ephera@lemmy.ml 5 points 3 weeks ago

From the description in the UI, it does sound like it. Theoretically, a chatbot could be created where you can ask questions about the webpage you have currently opened, so if you don't want to read a long article, for example. I guess, you could probably just throw a link into an existing chatbot either way, but yeah, direct integration might be convenient either way.

Well, or a chatbot could be created, which has access to your browser history, bookmarks and tabs, so you can ask it when you last saw certain information. However, you'd need a locally running chatbot for that, which makes it more difficult to implement.

load more comments (1 replies)
[–] fmstrat@lemmy.nowsci.com 13 points 3 weeks ago (5 children)

I mean, if you're going to do it, where's the Ollama love?

load more comments (5 replies)
[–] Treczoks@lemmy.world 12 points 3 weeks ago

Luckily, it seems to be disabled by default. At the moment.

[–] ilinamorato@lemmy.world 11 points 3 weeks ago (2 children)

This happened ages ago, didn't it? Am I missing something new?

[–] 2kool4idkwhat@lemdro.id 8 points 3 weeks ago (1 children)

Yeah, it did. That feature has been there at least since when Mozilla enabled "Firefox labs" section in settings by default a few months ago, and maybe even earlier than that

[–] victorz@lemmy.world 6 points 3 weeks ago (2 children)
load more comments (2 replies)
load more comments (1 replies)
[–] onlooker@lemmy.ml 9 points 3 weeks ago

For a second I thought it said "experimental failure". Would be more accurate, I think.

[–] Zementid@feddit.nl 9 points 3 weeks ago

Now add support for GPT4All and everyone is happy again.

[–] celeste@lemmy.blahaj.zone 7 points 3 weeks ago (5 children)

If they do it in a privacy-preseeving way, this could help them get back market share which will generally benefit an open internet.

load more comments (5 replies)
[–] fruitycoder@sh.itjust.works 7 points 3 weeks ago* (last edited 3 weeks ago)

I will say, the Le Chat provider is pretty decent. You really can use it more natural language. "Rewrite it with a better rhyme scheme" "remove the last line" and it just got it.

Why no local option though? Why no anonmysing option?

Edit: There is a right click option which does make this officially actually useful for me now (summarize this!).

Other models do have RAG options and Mist real supports making agents with specified documentation too to at least fine tune too (not as good as full grounding though IMHO)

[–] Mwa@lemm.ee 6 points 3 weeks ago (2 children)

Wasn't this there for a while, or just me.

load more comments (2 replies)
[–] Echolynx@lemmy.zip 6 points 3 weeks ago (1 children)

Sigh. I'm glad to have switched to LibreWolf.

load more comments (1 replies)
[–] EngineerGaming@feddit.nl 6 points 3 weeks ago

I wonder if this can be removed at compile time, like Pocket.

[–] Scrollone@feddit.it 6 points 3 weeks ago

Wow, great job Firefox. Thanks.

If I wanted unreliable bullshit like AI, I'd use Chrome.

load more comments
view more: next ›