this post was submitted on 01 Aug 2025
100 points (100.0% liked)
chat
8450 readers
39 users here now
Chat is a text only community for casual conversation, please keep shitposting to the absolute minimum. This is intended to be a separate space from c/chapotraphouse or the daily megathread. Chat does this by being a long-form community where topics will remain from day to day unlike the megathread, and it is distinct from c/chapotraphouse in that we ask you to engage in this community in a genuine way. Please keep shitposting, bits, and irony to a minimum.
As with all communities posts need to abide by the code of conduct, additionally moderators will remove any posts or comments deemed to be inappropriate.
Thank you and happy chatting!
founded 4 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Actually trying to source the real amounts is impossible, I can't find anything that isn't a company person making vague sounds. I would tend towards they are lying, and inference is quite high.
Certainly it's very slow and power hungry on stripped down models on home hardware. And they don't even have any of the extra layers for e.g. doing maths in Python.
Also if you want to keep info current you have to be constantly ingesting new news/academic work/internet discussion.
Their numbers seem right? You’re talking about 30 seconds or whatever of compute time on some high end hardware. Also gotta keep in mind that when you’re searching the internet you’re getting a few milliseconds of time or whatever on some very serious distributed hardware.