Ollama - Local LLMs for everyone!

194 readers

1 users here now

A place to discuss Ollama, from basic use, extensions and addons, integrations, and using it in custom code to create agents.

founded 1 week ago

MODERATORS

catty@lemmy.world

What do you mostly use ollama for? (lemmy.world)

submitted 1 week ago by catty@lemmy.world to c/Ollama@lemmy.world

27 comments fedilink hide all child comments

Do you use it to help with schoolwork / work? Maybe to help you code projects, or to help teach you how to do something?

What are your preferred models and why?

you are viewing a single comment's thread
view the rest of the comments

[–] FrankLaskey@lemmy.ml 2 points 1 week ago (1 children)

It sounds like we’re on similar levels of technical proficiency. I have learned a lot by reading and going down wormholes on how LLMs work and how to troubleshoot and even optimize them to an extent but I’m not a computer engineer or programmer for sure.

I started with LM studio before Ollama/Open WebUI and it does have some good features and an overall decent UI. I switched because OWUI seems to have more extensibility with tools and functions etc and I wanted something I could run as a server and use on my phone and laptop elsewhere etc. OWUI has been great for that although setting up remote access for the server on the web did take a lot of trial and error. The OWUI team also develops and updates the software very quickly so that’s great.

I’m not familiar with text-generation-WebUI but at this point I’m not really wanting for much more out of a setup than my docker stack with Ollama and OWUI

[–] brendansimms@lemmy.world 1 points 1 week ago

Thanks for the excellent response! I'm going to give openwebui a try and do some of that trial and error as well - best way to learn!