Caroline Orr Bueno, Ph.D Profile picture
Aug 5 12 tweets 3 min read Read on X
I have reported on and studied some incredibly dark topics, but there’s a rabbit hole underneath the practice of AI resurrections (ie, trying to recreate dead people through AI personas) that makes QAnon look like a fun walk through the park. And no one is paying attention.
The practice of creating AI personas to represent dead people — including using their likeness, image, voice, and words — is disturbing enough on its face, and of course very rarely involves consent. But it’s also totally unregulated. Because no one is paying attention.
There are researchers out here, warning that they have seen AI resurrections stalk their family members online beyond the point that their family members want to interact with them. Imagine an AI persona of your dead loved one begging to talk to you… and having to say no.
Imagine realizing that you created something that you don’t want to exist anymore & having to make the decision to kill the AI persona of your dead loved one. Do you talk with them before you pull the plug? Do you have a funeral? Or do you just turn off the computer & walk away?
And I’m sorry, but if you send your dead kid’s AI persona to try to convince me to support some policy, i’m probably going to call the psych ward at the local hospital because you need help if you would even consider doing that.
I understand why these parents want their children to have a voice in certain discussions, like the gun control debate. But at the end of the day, their dead children are not voting members of society, and do not have to live with the consequences of their advocacy. We do.
And although their children certainly understand better than anyone else what it’s like to stare down the barrel of a gun, that doesn’t mean they know the best ways to prevent other children from the same fate, and it’s inappropriate to put them on a pedestal above reproach.
In one instance, Parkland shooting victims were made into AI griefbots and forced to make robocalls. Some of them ended up threatening to harass members of Congress until they gave into their demands. Is that how democracy is supposed to work? Dead people forcing Congress’ hand?
And who gets to decide who is allowed to have a posthumous AI persona and who doesn’t? Can Jeffrey Epstein have one? Jeffrey Dahmer? Can they lobby Congress, too? Who makes that call and how do they get appointed to that position? No answers. No one is paying attention.
And also, what happens when someone trains another AI model on the data that your dead kid’s persona was trained on? Are you OK with having digital clones of your dead kid running around the Internet? If not, what do you plan to do about it?
And that’s what I mean when I say there’s a rabbit hole that goes down much, much farther than anyone wants to travel. Perhaps we will find a totally healthy use for griefbots one day. But right now, I see desperate, grieving parents being exploited by tech giants for profit.
More of my thoughts, plus links to research, here:
open.substack.com/pub/weaponized…Image

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Caroline Orr Bueno, Ph.D

Caroline Orr Bueno, Ph.D Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @RVAwonk

Aug 5
You’ve probably heard by now that Jim Acosta interviewed an AI depiction of a dead school shooting victim on Monday. Beyond the uncanny valley stuff, there are actual harms associated with so-called griefbots — some researchers even warn of “digital hauntings” that prolong grief.
Beyond the implications for individuals, there are also profound societal implications that are not being addressed, as tech companies push these disturbing creations out there with no policies to regulate them or deal with accompanying harms.
There are also serious questions about how these AI creations are being used. For example, the father of Joaquin Oliver said he plans to create social media accounts for his AI son so he can use his voice to advocate for gun control. This is a totally new form of influence. Image
Read 8 tweets
Aug 4
To follow up on my recent article about Trump’s covert manipulation of the algorithms that curate our reality, I published a 10-step guide for resisting the tyranny of the algorithm.

You have a lot of power here, but you have to learn to use it. Image
This is the first piece of advice I offer in the survival guide for resisting algorithmic tyranny. Until you learn the difference between entertainment and education vs covert psychological manipulation, you will remain a slave to the algorithm.

Learn the difference. Act on it. Image
Algorithms serve up content you like b/c they know that’s how they can hook you and get you to keep clicking, keep scrolling, and keep making them more money. They’re like digital drug dealers — and I’d argue that the effects are more insidious and corrosive than actual drugs. Image
Read 6 tweets
Aug 3
Just to put a fine point on it, remember that Trump dismantled our entire cybersecurity workforce so there’s no one around to stop his algorithmic manipulation — and those who are around and might consider doing know that their job is on the line if they do. Image
Image
As a reminder, within 2 months of taking office, Trump had fired over half of the government’s AI workforce. The ones who were there to put up guardrails.

Link to the piece I wrote about this in March: weaponizedspaces.substack.com/p/trump-is-set…Image
Image
And then there’s DOGE. They were given essentially unrestricted access government systems, including artificial intelligence systems. The way they used those systems was conceptually indistinguishable from the way a AI system would behave. It’s a worst case scenario. Image
Read 8 tweets
Aug 1
Today, I published what is probably my most important article in quite a long time. In this piece, I revealed how the Trump administration is covertly manipulating social media platforms & algorithms to boost the administration’s narrative and suppress opposing lines of thought.
Now, there’s no secret program or code that they’re using to do this. It’s being done through a process that I call reverse algorithmic capture.™

Instead of calling for censorship or bans directly, the Trump admin is reshaping the architecture of digital platforms in its favor.
By engineering incentives that guide algorithms to amplify preferred narratives and suppress dissent, they don’t have to issue any direct orders. They can stay at a seemingly safe distance, maintaining possible deniability, all the while pulling the strings of public algorithms.
Read 16 tweets
Jul 25
Remember the Facebook Files from 2021 — internal research that was leaked, revealing that FB’s algorithm was designed to amplify divisive & emotionally charged content in order to maximize engagement? Well, those files also revealed the underpinnings of modern disinformation.
Basically, much like FB’s algorithm, disinformation isn’t designed to inform or educate. It persuades through emotional appeals and tapping into the unconscious, not by making logical arguments or providing helpful facts. This is rooted in scientific research.
Conspiracy theories like Pizzagate, the Plandemic movie, and Trump‘s claims about election fraud are designed to tap into aspects of people’s identities and morals in a way that provokes an emotional response outside of conscious awareness. The point is to make people NOT think.
Read 8 tweets
Apr 2
Claiming that vaccination is an issue of “personal choice” — as HHS Secretary Kennedy often does — disregards the fact that choosing not to get vaccinated strips *other* people of their personal *choice* to stay healthy or live a normal life.

My latest: open.substack.com/pub/weaponized…Image
My then-9-month-old infant didn’t choose to be exposed to a vaccine preventable disease, nor did she have the choice to be vaccinated against it (because she was too young). Someone else made a choice not to get vaccinated, yet she was forced to pay for their costly decision.
When you tell people that vaccination is an individual choice, they don’t think about how their decision will impact the most vulnerable members of our society – the ones who can’t speak up and say how unfair it is that they have to suffer for someone else’s “individual choice“. Image
Read 4 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(