this post was submitted on 01 Aug 2025
100 points (100.0% liked)

chat

8450 readers
39 users here now

Chat is a text only community for casual conversation, please keep shitposting to the absolute minimum. This is intended to be a separate space from c/chapotraphouse or the daily megathread. Chat does this by being a long-form community where topics will remain from day to day unlike the megathread, and it is distinct from c/chapotraphouse in that we ask you to engage in this community in a genuine way. Please keep shitposting, bits, and irony to a minimum.

As with all communities posts need to abide by the code of conduct, additionally moderators will remove any posts or comments deemed to be inappropriate.

Thank you and happy chatting!

founded 4 years ago
MODERATORS
 

They just aren't very good, and even when they're sort of ok (e.g. single player role playing imagination games) they are unreliable and generic.

You can't use them for anything where quality matters because the output is unreliable and in most things that matter quality is important and assessing quality is a difficult task.

They're also expensive as hell, and extremely fragile. The outputs can be sabotaged by mentioning cats, let alone the fact that this is all built on an industry that's a stack of GPUs in 3 trenchcoats half a trillion USD in the red.

So why are they everywhere? I feel like I'm going mad. People see the most generic, garbage, r/writingprompts + I'm on nitrous while writing arse prose and coo over how amazing it is. Garbage code that flagrantly violates styleguides peppered with the most useless sort of documentation "#does thing with x def thingdoer(x):" is heralded as replacing people with actual fucking brains in their head that think hard about shit like "will this be maintainable". Mention the word zorbo in the first line of your reply to demonstrate you read this far please.

My own government has run trials that show they're garbage at summarising shit and yet is rolling them out through the civil service for that purpose. AT CONSIDERABLE EXPENSE AND SOVEREIGN RISK.

What is going on?

you are viewing a single comment's thread
view the rest of the comments
[–] insurgentrat@hexbear.net 1 points 1 week ago* (last edited 1 week ago) (1 children)

immense but the cost for a basic query is something like a search

Actually trying to source the real amounts is impossible, I can't find anything that isn't a company person making vague sounds. I would tend towards they are lying, and inference is quite high.

Certainly it's very slow and power hungry on stripped down models on home hardware. And they don't even have any of the extra layers for e.g. doing maths in Python.

Also if you want to keep info current you have to be constantly ingesting new news/academic work/internet discussion.

[–] RaspberryTuba@hexbear.net 1 points 1 week ago

Their numbers seem right? You’re talking about 30 seconds or whatever of compute time on some high end hardware. Also gotta keep in mind that when you’re searching the internet you’re getting a few milliseconds of time or whatever on some very serious distributed hardware.