this post was submitted on 24 Jun 2025
9 points (73.7% liked)

Ollama - Local LLMs for everyone!

194 readers
1 users here now

A place to discuss Ollama, from basic use, extensions and addons, integrations, and using it in custom code to create agents.

founded 1 week ago
MODERATORS
 

Do you use it to help with schoolwork / work? Maybe to help you code projects, or to help teach you how to do something?

What are your preferred models and why?

you are viewing a single comment's thread
view the rest of the comments
[โ€“] seathru@lemmy.sdf.org 1 points 1 week ago (4 children)

I currently don't. But I am ollama-curious. I would like to feed it a bunch of technical manuals and then be able to ask it to recite specs or procedures (with optional links to it's source info for sanity checking). Is this where I need to be looking/learning?

[โ€“] brendansimms@lemmy.world 2 points 1 week ago (3 children)

you might want to look into RAG and 'long-term memory' concepts. I've been playing around with creating a self-hosted LLM that has long-term memory (using pre-trained models), which is essentially the same thing as you're describing. Also - GPU matters. I'm using an RTX 4070 and it's noticeably slower than something like in-browser chatgpt, but I know 4070 is kinda pricey so many home users might have earlier/slower gpu's.

load more comments (2 replies)
load more comments (2 replies)