this post was submitted on 31 Jan 2025
16 points (94.4% liked)

Firefox

20329 readers
102 users here now

/c/firefox

A place to discuss the news and latest developments on the open-source browser Firefox.

Rules

1. Adhere to the instance rules

2. Be kind to one another

3. Communicate in a civil manner

Reporting

If you would like to bring an issue to the moderators attention, please use the "Create Report" feature on the offending comment or post and it will be reviewed as time allows.

founded 5 years ago
MODERATORS
k_o_t@lemmy.ml
golden_zealot@lemmy.ml
16
[Answered] How can I use local LLM in the firefox AI chatbot (piefed.social)
submitted 5 months ago* (last edited 5 months ago) by astro_ray@piefed.social to c/firefox@lemmy.ml
2 comments fedilink hide all child comments
 

Today I saw the AI chatbot in the sidebar for the first time (I remember turning the setting of in the Labs settings, but they turned it on IG). Looking the options, it supports a number of models, but all of them seems to be on a remote servers. Is there any way to use an LLM run on my own machine?

you are viewing a single comment's thread
view the rest of the comments
[โ€“] MrOtherGuy@lemmy.world 9 points 5 months ago (1 children)

Go to about:config and set the pref browser.ml.chat.hideLocalhost to false Afterwards you can select localhost as the provider in Settings > Firefox Labs