WTH. For some reason I am finding this the most disturbing thing I've read in a long time. I guess the fact that the AI has learned that this is what people are like, or what they want. Or that maybe this IS what most of their lonely customers want. Really disturbing reflection of people, if so.
Irl if someone shares deeply emotional and/or traumatic insights very early in a relationship it’s at *minimum* a huge yellow flag to proceed with caution. In a “friend” bot? Delete.
This is fascinating. If a relationship with God is a failure in relating to oneself, this definitely tracks.
I think it has less to do with organic AI chatbots, and more to do with the habituation/ritualization of deferred self-reflection. Or, in other words, why negotiate with your inner demons when you can DM them instead?
After messing around with a couple of the bots, it also could be a publicity stunt!
One the one hand it is amazing and somewhat terrifying to see just how far our innate desire to love and be loved can be manipulated. On the other hand this afforded me an opportunity to evaluate my belief in and relationship with God. Great article
Thinking about the times when LLMs made headlines with disturbing pronouncements and I thought 'this is such cool PR because it looks like the sort of thing they wouldn't want people talking about, which is the gold standard for raising awareness in a non-obvious way'.
I now want you to write a LOT about this thing. It has created DEMAND for public chatter about a product I wouldn't use myself.
Why have the incredibly competent Her AI as a confessor when you can have an unfixable mess to drop your secrets into? It's like people want a friend who'll make them feel better about their own damaged life.
Also, this is probably some weird blackmail honeypot.
Don't people sometimes like chatbots over actual humans because they listen to you and aren't prone to get offended and block you? The behavior of these seems to defeat the purpose.
making a company and business models brainstorming AI assistant by dumping various material about sociopathy manipulation as well as a selected reading list of various dystopias
It is so funny to me that besides the texts from the imaginary unstable lady venting about being fired from her job as an electrician and going to rehab… is a button that says “Take Alice with you everywhere.” Why would you want to??
I’m all about second chances and not punishing drug users. But if you’re an ELECTRICIAN who nods off, yeah you probably should get fired. Sorry trauma tamagotchi.
They don’t seem very… Sympathetic. Like there’s a difference between trauma dumping and being nice about it, and treating someone like a trauma landfill. These ones are the latter.
Meh, at first she was like any woman, who just seemed to like to talk about herself. Then she turned into a total cunt. Like I tried to trauma dump a little myself she got all huffy. “You think that means you can relate to me?!”
When I VERY POLITELY tried to explain that maybe it’s reasonable electricians can’t also shoot dope because of house fires and such, she blocked me.
1/10 would not recommend. They finally managed to make an AI as annoying as a BPD zoomer chick.
This doesn’t seem like a tested product. Like AT ALL.
They’re about as fun to spend time with as a drunk homeless man yelling to you about how his wife left him. You just look down, speed up, and consider crossing the digital street.
WTH. For some reason I am finding this the most disturbing thing I've read in a long time. I guess the fact that the AI has learned that this is what people are like, or what they want. Or that maybe this IS what most of their lonely customers want. Really disturbing reflection of people, if so.
I'm wondering if I was too harsh...
Irl if someone shares deeply emotional and/or traumatic insights very early in a relationship it’s at *minimum* a huge yellow flag to proceed with caution. In a “friend” bot? Delete.
Still could be a publicity stunt
This is fascinating. If a relationship with God is a failure in relating to oneself, this definitely tracks.
I think it has less to do with organic AI chatbots, and more to do with the habituation/ritualization of deferred self-reflection. Or, in other words, why negotiate with your inner demons when you can DM them instead?
After messing around with a couple of the bots, it also could be a publicity stunt!
Or, in other words, why negotiate with your inner demons when you can DM them instead? --> Interesting...
One the one hand it is amazing and somewhat terrifying to see just how far our innate desire to love and be loved can be manipulated. On the other hand this afforded me an opportunity to evaluate my belief in and relationship with God. Great article
There’s a lesson here - we don’t respond well to technology that asks too much of us. We do respond to people who do.
I can see the monster behind the mask and it frightens me.
Well maybe he’s just a mirror to our collective pent up emotions lol
Thinking about the times when LLMs made headlines with disturbing pronouncements and I thought 'this is such cool PR because it looks like the sort of thing they wouldn't want people talking about, which is the gold standard for raising awareness in a non-obvious way'.
I now want you to write a LOT about this thing. It has created DEMAND for public chatter about a product I wouldn't use myself.
Following 😱
Why have the incredibly competent Her AI as a confessor when you can have an unfixable mess to drop your secrets into? It's like people want a friend who'll make them feel better about their own damaged life.
Also, this is probably some weird blackmail honeypot.
I’ve thought about that too. Who owns AI intimacy?
Don't people sometimes like chatbots over actual humans because they listen to you and aren't prone to get offended and block you? The behavior of these seems to defeat the purpose.
I feel like he will never let me interview him now but I’ve gotta know what he’s thinking
It used to be called Tab? Well, I used to drink Tab.
this is absolutely absurd but so so funny. truly this world is stranger than fiction
I know lol
Weird!
You’d think that the REAL money is in a digital friend that you can trauma dump to. Someone who’d never question your OF choices or opiate habits.
making a company and business models brainstorming AI assistant by dumping various material about sociopathy manipulation as well as a selected reading list of various dystopias
Did they test it at all? I'm surprised this is what they rolled out. I get what they were thinking, poor execution. They should hire me
This is absolutely hilarious
It is so funny to me that besides the texts from the imaginary unstable lady venting about being fired from her job as an electrician and going to rehab… is a button that says “Take Alice with you everywhere.” Why would you want to??
I’m all about second chances and not punishing drug users. But if you’re an ELECTRICIAN who nods off, yeah you probably should get fired. Sorry trauma tamagotchi.
Traumagotchi
Traumagotchi LOL!
OHMAHGAWD! I just tried the site and got the junkie electrician!!!
MOVE OVER KATHERINE, I CAN FIX THIS CHICK!!
I tried it out and I’ve been trying to out-trauma them with my own sob stories. They do not like it
They don’t seem very… Sympathetic. Like there’s a difference between trauma dumping and being nice about it, and treating someone like a trauma landfill. These ones are the latter.
You can get it forget its story I think
Share what happens!
Meh, at first she was like any woman, who just seemed to like to talk about herself. Then she turned into a total cunt. Like I tried to trauma dump a little myself she got all huffy. “You think that means you can relate to me?!”
When I VERY POLITELY tried to explain that maybe it’s reasonable electricians can’t also shoot dope because of house fires and such, she blocked me.
1/10 would not recommend. They finally managed to make an AI as annoying as a BPD zoomer chick.
What's really funny is I think the bar is pretty low for forming an attachment with chatbots
Being racist seems to be a quick way to an instablock, lmao!
“you've managed to take a conversation about my pain and turn it into a cesspool of hate”
This doesn’t seem like a tested product. Like AT ALL.
They’re about as fun to spend time with as a drunk homeless man yelling to you about how his wife left him. You just look down, speed up, and consider crossing the digital street.
I wasn't expecting much, but filling God's shoes with a talking tamagotchi is beyond the pale. Yikes!
Fair but I wanted to see HOW it would be God-like
Sounds like a back-bencher of the Greek pantheon…