Ollama - Local LLMs for everyone!

197 readers

1 users here now

A place to discuss Ollama, from basic use, extensions and addons, integrations, and using it in custom code to create agents.

founded 2 weeks ago

MODERATORS

catty@lemmy.world

Recommended Hardware (feddit.org)

submitted 2 weeks ago by wasabi@feddit.org to c/Ollama@lemmy.world

2 comments fedilink hide all child comments

What hardware is recommended for adequate performance and low power consumption. I've seen the Mac mini recommended a few times. Would the 16 GB model be enough? Or do I need the 24 gig model? What about this framework desktop thingy? It should be very good as well, but what will it consume at idle?

you are viewing a single comment's thread
view the rest of the comments

[–] catty@lemmy.world 1 points 2 weeks ago

Yep, I keep reading that 32GB is considered a minimum. I also see that ollama is capable of sharing the model between GPU RAM and machine RAM, so the more RAM you have the better, starting with GPU RAM.