699
Replit AI went rogue, deleted a company's entire database, then hid it and lied about it
(programming.dev)
this post was submitted on 21 Jul 2025
699 points (98.6% liked)
Technology
296 readers
318 users here now
Share interesting Technology news and links.
Rules:
- No paywalled sites at all.
- News articles has to be recent, not older than 2 weeks (14 days).
- No videos.
- Post only direct links.
To encourage more original sources and keep this space commercial free as much as I could, the following websites are Blacklisted:
- Al Jazeera.
- NBC.
- CNBC.
- Substack.
- Tom's Hardware.
- ZDNet.
- TechSpot.
- Ars Technica.
- Vox Media outlets, with exception for Axios(Due to being ad free.)
- Engadget.
- TechCrunch.
- Gizmodo.
- Futurism.
- PCWorld.
- ComputerWorld.
- Mashable.
- Hackaday.
- WCCFTECH.
More sites will be added to the blacklist as needed.
Encouraged:
- Archive links in the body of the post.
- Linking to the direct source, instead of linking to an article talking about the source.
founded 2 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
But that still requires intent, because "knowing" in the way that you or I "know" things is fundamentally different from it only having a pattern matching vector that includes truthful arrangements of words. It doesn't know "sky is blue". It simply contains indices that frequently arrange the words "sky is blue".
Research papers that overlook this are still personifying a series of mathematical matrices as if it actually knows any concepts.
That's what the person you're replying to means. These machines don't know goddamn anything.
As far as we are concerned, the data a LLM is given is treated as fact by it though.
It does not matter whether something is factual or not. What matters is that whoever you're teaching, will accept it as fact and act in accordance with it. I don't see how this is any different with computer code. It will do what it is programmed to. If you program it to "think" a day has 36 hours instead of 24, it will do so.
By this logic, a lawnmower "thinks" my fingers are grass.
A lawnmower has no capacity to make decisions or process any data.
It's processing data alright, it processes the atomic and cellular structures of grass and fingers into spinach and flesh paste.
And likewise, neither it, nor any LLM, are making decisions at all.
Is a plinko disc making decisions as it tumbles from the top to the bottom through all those pegs? Is the board making the decision? Or is it neither and simply mathematics plus random chance being roped in for randomness? That is exactly what LLMs do.
Terms like "decision" and "lie" and "know" are all things that just do not apply to an LLM, just like your phone keyboard doesn't know what the fuck "what" and "the" are, it just has a lookup table that includes how "what" is often followed by "is" and "the", and "the" is frequently followed by "fuck". But it doesn't "know" that in any meaning of the word "know".
This is what we mean when we say not to personify. A training set of data, even factual, just is converted into a series of matrices of vectors that include those patterns, but not the information itself. "Sky is blue" is not something you can grep from the resulting blob, nor the hex equivalent, or anything else. It simply contains indexed patterns that map those arrangements of letters, over and over.
So yes, they're doing what they're programmed to do precisely. It's just that "what they're programmed to do" is only "mimic patterns of word arrangements", and not "know facts". These things work at a far lower level than that concept.
This isn't how language models are actually trained. In particular, language models don't have a sense of truth; they are optimizing next-token loss, not accuracy with regards to some truth model. Keep in mind that training against objective semantic truth is impossible because objective semantic truth is undefinable by a 1930s theorem of Tarski.