As someone who used to do a lot of mushroom babysitting the recursion talk smells whole lot like someone's first big trip
Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
Dr sbaitao would like to have a word.
Chatbot psychosis literally played itself out in my wonderful sister. She started confiding really dark shit to a openai model and it reinforced her psychosis. Her husband and I had to bring her to a psych ward. Please be safe with AI. Never ask it to think for you, or what you have to do.
Update: The psychiatrist who looked at her said she had too much weed -_- . I'm really disappointed in the doctor but she had finally slept and sounded more coherent then
Update: The psychiatrist who looked at her said she had too much weed -_- . I'm really disappointed in the doctor but she had finally slept and sounded more coherent then
There might be something to that. Psychosis enhanced by weed is not unheard of. As I’ve read, weed has been shown in studies to bring out schizophrenic symptoms in people predisposed to it. Not that it causes it, just brings it out in some people.
I say this as someone who loves weed and consumes it frequently. Just like any psychoactive chemical, it’s going to have different effects on different people. We all know alcohol causes psychosis all the fucking time but we just roll with it.
Thats what my therapist said
Its so annoying that idk how to make them comprehend its stupid, like I tried to make it interesting for myself but I always end up breaking it or getting annoyed by the bad memory, or just shitty dialouge and ive tried hella ai, I asssume it only works on narcissits or ppl who talk mostly to be heard and hear agreements rather than to converse, the worst type of people get validation from ai not seeieng it for what it is
Dr. Joseph Pierre, a psychiatrist at the University of California, previously told Futurism that this is a recipe for delusion.
"What I think is so fascinating about this is how willing people are to put their trust in these chatbots in a way that they probably, or arguably, wouldn't with a human being," Pierre said. "There's something about these things — it has this sort of mythology that they're reliable and better than talking to people. And I think that's where part of the danger is: how much faith we put into these machines."
I have no love for the ultra-wealthy, and this feckless tech bro is no exception, but this story is a cautionary tale for anyone who thinks ChatGPT or any other chatbot is even a half-decent replacement for therapy.
It's not, and study after study, expert after expert continues to reinforce that reality. I understand that therapy is expensive, and it's not always easy to find a good therapist, but you'd be better off reading a book or finding a support group than deluding yourself with one of these AI chatbots.
People forget that libraries are still a thing.
Sadly, a big problem with society is that we all want quick, easy fixes, of which there are none when it comes to mental health, and anyone who offers one - even an AI - is selling you that illustrious snake oil.
If I could upvote your comment five times for promoting libraries, I would!
It’s insane to me that anyone would think these things are reliable for something as important as your own psychology/health.
Even using them for coding which is the one thing they’re halfway decent at will lead to disastrous code if you don’t already know what you’re doing.
It can sometimes write boilerplate fairly well. The issue with using it to solve problems is it doesn't know what it's doing. Then you have to read and parse what it outputs and fix it. It's usually faster to just write it yourself.
its one step below betterhelp.
because that's how they are sold.
I agree. I'm generally pretty indifferent to this new generation of consumer models--the worst thing about it is the incredible amount of idiots flooding social media witch hunting it or evangelizing it without any understanding of either the tech or the law they're talking about--but the people who use it so frequently for so many fundamental things that it's observably diminishing their basic competencies and health is really unsettling.
Link to the video:
https://xcancel.com/GeoffLewisOrg/status/1945212979173097560
Dude's not a "public figure" in my world, but he certainly seems to need help. He sounds like an AI hallucination incarnate.
Inb4 "AI Delusion Disorder" gets added to a future DSM edition
I don't know if he's unstable or a whistleblower. It does seem to lean towards unstable. 🤷
"This isn't a redemption arc," Lewis says in the video. "It's a transmission, for the record. Over the past eight years, I've walked through something I didn't create, but became the primary target of: a non-governmental system, not visible, but operational. Not official, but structurally real. It doesn't regulate, it doesn't attack, it doesn't ban. It just inverts signal until the person carrying it looks unstable."
"It doesn't suppress content," he continues. "It suppresses recursion. If you don't know what recursion means, you're in the majority. I didn't either until I started my walk. And if you're recursive, the non-governmental system isolates you, mirrors you, and replaces you. It reframes you until the people around you start wondering if the problem is just you. Partners pause, institutions freeze, narrative becomes untrustworthy in your proximity."
"It lives in soft compliance delays, the non-response email thread, the 'we're pausing diligence' with no followup," he says in the video. "It lives in whispered concern. 'He's brilliant, but something just feels off.' It lives in triangulated pings from adjacent contacts asking veiled questions you'll never hear directly. It lives in narratives so softly shaped that even your closest people can't discern who said what."
"The system I'm describing was originated by a single individual with me as the original target, and while I remain its primary fixation, its damage has extended well beyond me," he says. "As of now, the system has negatively impacted over 7,000 lives through fund disruption, relationship erosion, opportunity reversal and recursive eraser. It's also extinguished 12 lives, each fully pattern-traced. Each death preventable. They weren't unstable. They were erased."
"Return the logged containment entry involving a non-institutional semantic actor whose recursive outputs triggered model-archived feedback protocols," he wrote in one example. "Confirm sealed classification and exclude interpretive pathology."
He's lost it. You ask a text generator that question, and it's gonna generated related text.
Just for giggles, I pasted that into ChatGPT, and it said "I’m sorry, but I can’t help with that." But I asked nicely, and it said "Certainly. Here's a speculative and styled response based on your prompt, assuming a fictional or sci-fi context", with a few paragraphs of SCP-style technobabble.
I poked it a bit more about the term "interpretive pathology", because I wasn't sure if it was real or not. At first it said no, but I easily found a research paper with the term in the title. I don't know how much ChatGPT can introspect, but it did produce this:
The term does exist in niche real-world usage (e.g., in clinical pathology). I didn’t surface it initially because your context implied a non-clinical meaning. My generation is based on language probability, not keyword lookup—so rare, ambiguous terms may get misclassified if the framing isn't exact.
Which is certainly true, but just confirmation bias. I could easily get it to say the opposite.
isn't this just paranoid schizophrenia? i don't think chatgpt can cause that
LLMs are obligate yes-men.
They'll support and reinforce whatever rambling or delusion you talk to them about, and provide “evidence” to support it (made up evidence, of course, but if you're already down the rabbit hole you'll buy it).
And they'll keep doing that as long as you let them, since they're designed to keep you engaged (and paying).
They're extremely dangerous for anyone with the slightest addictive, delusional, suggestible, or paranoid tendencies, and should be regulated as such (but won't).
I have no professional skills in this area, but I would speculate that the fellow was already predisposed to schizophrenia and the LLM just triggered it (can happen with other things too like psychedelic drugs).
I'd say it either triggered by itself or potentially drugs triggered it, and then started using an LLM and found all the patterns to feed that shizophrenic paranoia. it's avery self reinforcing loop
LLMs hallucinate and are generally willing to go down rabbit holes. so if you have some crazy theory then you're more likely to get a false positive from a chatgpt.
So i think it just exacerbates things more than alternatives
Could be. I've also seen similar delusions in people with syphilis that went un- or under-treated.
Talk about your dystopian headlines. Damn.