this post was submitted on 28 Jun 2025
7 points (88.9% liked)

Ollama - Local LLMs for everyone!

197 readers
4 users here now

A place to discuss Ollama, from basic use, extensions and addons, integrations, and using it in custom code to create agents.

founded 2 weeks ago
MODERATORS
 

What hardware is recommended for adequate performance and low power consumption. I've seen the Mac mini recommended a few times. Would the 16 GB model be enough? Or do I need the 24 gig model? What about this framework desktop thingy? It should be very good as well, but what will it consume at idle?

you are viewing a single comment's thread
view the rest of the comments
[–] catty@lemmy.world 1 points 1 week ago

Yep, I keep reading that 32GB is considered a minimum. I also see that ollama is capable of sharing the model between GPU RAM and machine RAM, so the more RAM you have the better, starting with GPU RAM.