GUYS THE STORY HERE IS NOT ABOUT THE RESEARCHERS IT’S ABOUT THE RESEARCH RESULTS
https://twitter.com/jason_koebler/status/1916866751750607039
The lack of informed consent is bad.
But these results are crazy
But these results are crazy
the tl;dr is that comments from personalized AI bots comments are 6x more persuasive than comments from the average user.
personalized = inferred as much as they can from users posting history
personalized = inferred as much as they can from users posting history
this puts personalized bots in the top 1% of most persuasive users in r/changemymind
the study hasn’t been peer-reviewed so take this with a grain of salt.
but they pre-registered it 5 months ago which makes me think the basics are legit
but they pre-registered it 5 months ago which makes me think the basics are legit
I get some of the outrage about this happening without users knowledge.
but humans still oversaw every post. and I can understand why researchers didn’t want to announce this study in advance.
but humans still oversaw every post. and I can understand why researchers didn’t want to announce this study in advance.
the results suggest a present day where immoral, powerful people can persuade others of their views. I don’t think influence operations will be asking for informed consent either!
I guess AI-enabled persuasion isn't exactly new. but the effectiveness of these personalized AI bots relative to human baseline is making me internalize what this means for our near future.
we need to develop a stronger societal immune response to persuasion bots
we need to develop a stronger societal immune response to persuasion bots
• • •
Missing some Tweet in this thread? You can try to
force a refresh
