Hah. Yeah, I'll do that as soon as you invent a way to freeze time.

For what it's worth, I'm pretty sure it's less energy efficient to run a local open source LLM than to offload the task to a data center, but the flexibility and privacy are too big of a deal to ignore.

In any case chatbots suck at finding accurate information reliably, but they are actually pretty good at reaching things you already know or can verify at a glance with suprisingly little information. The fact that a piece of tech is being misused often doesn't mean it's useless. This simplistic black-and-white stuff is so dumb and social media is so full of it. Speaking of often misused technology, I suppose.

To pull this off I'd need everything in audio form

Depends on what knowledge we are talking about. Personally, I'd be feeding it tons of manuals so that I could ask questions like "Which version of software x introduced feature y?" There's no extra context I need, I just need a version number to give to a customer. And in my industry, that type of info just doesn't show up on Google. So having an LLM that can answer the question in seconds saves me an hour of sifting through manuals.

Not true in all cases, yes if you want to read a novel you will enjoy reading it way more than reading a computer generated summary. But if you want to source information it's a whole other story. Also, you still need to use your brain to understand summaries

LMAO yea using an LLM to dig through things to find what I need faster so that I can read further on the non-summarized version for more depth is "outsourcing my thinking" 🙄