Plus I don't want some random ass server to crunch through couple hundred watt hours if scanning the barcode and running that against a database would not just suffice but also be more accurate.

[–] jaybone@lemmy.world 14 points 2 days ago (1 children)

More accurate, efficient, environmentally friendly. Why are we trying to solve all of this with LLMs?

[–] EddoWagt 3 points 2 days ago (1 children)

Its easier to program I suppose, just setup a prompt and give back the result of that

[–] AceStructor@feddit.org 1 points 2 days ago

Exactly, developers can't just come up with a complete database of all products in existence and where they come from, whereas LLMs are already trained on basically all data that is available on the Internet, with additional capabilities to browse the web if necessary. This is a reasonable approach.

[–] DavidGarcia 0 points 2 days ago (1 children)

phi-4 is the only one I am aware of that was deliberately trained to refuse instead of hallucinating. it's mindblowing to me that that isn't standard. everyone is trying to maximize benchmarks at all cost.

I wonder if diffusion LLMs will be lower in hallucinations, since they inherently have error correction built into their inference process

[–] MartianSands@sh.itjust.works 4 points 2 days ago

Even that won't be truly effective. It's all marketing, at this point.

The problem of hallucination really is fundamental to the technology. If there's a way to prevent it, it won't be as simple as training it differently