Ollama - Local LLMs for everyone!

194 readers

1 users here now

A place to discuss Ollama, from basic use, extensions and addons, integrations, and using it in custom code to create agents.

founded 1 week ago

MODERATORS

catty@lemmy.world

What do you mostly use ollama for? (lemmy.world)

submitted 1 week ago by catty@lemmy.world to c/Ollama@lemmy.world

27 comments fedilink hide all child comments

Do you use it to help with schoolwork / work? Maybe to help you code projects, or to help teach you how to do something?

What are your preferred models and why?

you are viewing a single comment's thread
view the rest of the comments

[–] vhstape@lemmy.sdf.org 1 points 1 week ago

My Mac mini (32GB) can run 12B parameter models at around 13 tokens/sec, and my 3060 can achieve roughly double. However, both machines have a hard time keeping up with larger models. I'll have to look into some special-purpose models

permalink
fedilink
source
parent