Share this page!

Enter URL or ID to Unroll

You can paste full URL like: https://x.com/threadreaderapp/status/1644127596119195649
or just the ID like: 1644127596119195649

How to get URL link on X (Twitter) App

  1. On the Twitter thread, click on or icon on the bottom
  2. Click again on or Share Via icon
  3. Click on Copy Link to Tweet
  4. Paste it above and click "Unroll Thread"!
  5. More info at Twitter Help
Conspirador Norteño Profile picture
@conspirator0
Nov 1, 2020 • 18 tweets • 8 min read • Read on X
We've done a decent amount of research on the use of GAN-generated images over the last two years, mostly fake face "photos" such as those produced by thispersondoesnotexist(dot)com. Here are all of our related threads in one place.

cc: @ZellaQuixote
GAN is an abbreviation for "generative adversarial network", the AI technique used to produce these images (and other things). Here's a "brief" description of how StyleGAN, the GAN behind thispersondoesnotexist(dot)com, works.
machinelearningmastery.com/introduction-t…
Here's the first network we found in the wild using GAN-generated face pics (29 of 52 accounts, created in two batches). The profiles featured repetitive biographies mentioning family, friends, country, and weapons.

Next up, a coronavirus/bitcoin-themed botnet from March 2020. 16 of 28 accounts used GAN-generated face pics.
In May 2020, we ran into a set of five fake pro-Biden accounts, all using the same GAN-generated profile pic. These accounts self-deleted shortly after this thread was posted.
Our first stab at a programmatic method for detecting GAN-generated face pics. This technique is designed to make the GAN-generated pictures easier to notice in groups of thousands of images - it isn't terribly accurate for individual images.
From May 2020, a 41 account Spanish-language botnet using GAN-generated profile images, with a focus on Argentina.
Next, a 4chan op using accounts with GAN-generated pics to push the #BernReturn hashtag alongside a bogus claim that Bernie Sanders was returning campaign donations.
Speaking of 4chan, thispersondoesnotexist(dot)com is quite popular over there, and folks frequently suggest using it as a source of profile pics for bogus Twitter accounts.


Here's a thread on now-suspended part-automated political troll account @Juan6million. This account mostly pushed left-wing messaging and hashtags, but also promoted alt-right talking points and influencers such as @MrAndyNgo.
The most prolific use of GAN-generated profile pics we've seen thus far was from the "Thousand Followers" follower-buying website (presently on hiatus). 8727 of 17957 of the fake Twitter followers provided by this site used GAN-generated images.
From August 2020, a mixed commerical/political retweet botnet consisting of 21 accounts using GAN-generated face pics.
We've run across a couple of botnets promoting cryptocurrency sites that use GAN-generated profile pics: 41 accounts pushing cointelegraph(dot)com and 28 accounts pushing ethereumcryptocurrency(dot)com.

Deepfake human faces are not the only sort of images one can produce with GANs. Here's a thread on GAN-generated anime pics, and the detection thereof:
From November 2020, a fake follower/retweet botnet using GAN-generated profile pics (164 accounts).
A similar network follower/retweet botnet created in August 2020. 53 accounts, all using GAN-generated pics. It mostly amplifies Russian-language accounts.
Thread on a weird automated account (@Jtatejtate1) using a GAN-generated face. A bunch of its followers are part of a recently reactivated botnet from 2013.
Using reverse image search to find Twitter accounts using GAN-generated profile pics:

• • •

Missing some Tweet in this thread? You can try to force a refresh
　

Keep Current with Conspirador Norteño

Conspirador Norteño Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @conspirator0

Conspirador Norteño Profile picture
Oct 18
None of these chefs exist, as they're all AI-generated images. This hasn't stopped them from racking up lots of engagement on Facebook by posting AI-generated images of food (and occasional thoughts and prayers), however.

cc: @ZellaQuixote collage of 11 AI-generated images of chefs, presently being used as the avatars of Facebook accounts
These "chefs" are part of a network of 18 Facebook pages with names like "Cook Fastly" and "Emily Recipes" that continually post AI-generated images of food. While many of these pages claim to be US-based, they are have admins in Morocco per Facebook's Page Transparency feature. collage of the profiles of 18 Facebook "chef" pages that post AI-generated images of food
screenshots of Facebook page transparency info showing that the pages are run from Morocco
Between them, these 18 Facebook "chef" pages have posted AI-generated images of food at least 36,000 times in the last five months. Not all of the images are unique; many have been posted repeatedly, sometimes by more than one of the alleged chefs. examples of AI-generated food images posted by the Facebook spam pages
examples of AI-generated food images posted by more than one Facebook spam page
Read 7 tweets
Conspirador Norteño Profile picture
Sep 8
Can simple text generation bots keep sophisticated LLM chatbots like ChatGPT engaged indefinitely? The answer is yes, which has some potentially interesting implications for distinguishing between conversational chatbots and humans.

cc: @ZellaQuixote
conspirator0.substack.com/p/baiting-the-…
screenshot of Substack post
For this experiment, four simple chatbots were created:

• a bot that asks the same question over and over
• a bot that replies with random fragments of a work of fiction
• a bot that asks randomly generated questions
• a bot that repeatedly asks "what do you mean by <X>?"
The output of these chatbots was used as input to an LLM chatbot based on the 8B version of the Llama 3.1 model. Three of the four bots were successful at engaging the LLM chatbot in a 1000-message exchange; the only one that failed was the repetitive question bot.


screenshots of portions of the conversation between the repetitive cheeseburger bot and the LLM bot
screenshots of portions of the conversation between the Star Trek bot and the LLM bot
screenshots of portions of the conversation between the random question bot and the LLM bot
screenshots of portions of the conversation between the "what do you mean" bot and the LLM bot
Read 5 tweets
Conspirador Norteño Profile picture
Sep 3
The spammers behind the "Barndominium Gallery" Facebook page have branched out into AI-generated video and started a YouTube channel with the catchy name "AY CUSTOM HOME". The results are just about as craptastic as you'd expect.

cc: @ZellaQuixote
screenshot of the AY CUSTOM HOME Youtube channel
In this synthetically generated aerial video of a (nonexistent) barndominium under construction, the geometry of the roof changes, a blue building appears, and a tree vanishes, all in the course of just three seconds. still images from two different points in an AY CUSTOM HOME YouTube video, showing multiple impossible changes over the course of a few seconds
This AI-generated barndominium features a long AI-generated porch with some chairs on it. Exactly how many chairs there are depends on what angle you look at it from, however, as the chair on the left splits into three chairs as the camera pans. still images from two different points in an AY CUSTOM HOME YouTube video, showing multiple impossible changes over the course of a few seconds
Read 4 tweets
Conspirador Norteño Profile picture
Aug 28
Some observations regarding @Botted_Likes (permanent ID 1459592225952649221)...

First, "viral posts which don't result in follower growth and have very little engagement in the reply section" is not a useful heuristic for detecting botted likes. Why not?

cc: @ZellaQuixote screenshot of @Botted_Likes's profile with the text "THIS IS NOT AN EFFECTIVE METHOD OF DETECTING POSTS WITH BOTTED LIKES" overlaid in Comic Sans
"Viral posts that do not result in follower growth" is not a valid test for botting, because posts from large accounts often go viral among the large account's existing followers but do not reach other audiences, resulting in high like/repost counts but little/no follower growth.
"Very little engagement in the reply section" doesn't work for multiple reasons (some topics spur debate and some don't, some people restrict replies, etc)

Hilariously, @Botted_Likes seems to be ignoring their own criteria, as many of the posts they feature have tons of replies. screenshots of six @Botted_Likes posts featuring screenshots of posts that allegedly have botted likes
Read 5 tweets
Conspirador Norteño Profile picture
Aug 20
A new account named @kamala_wins47 has racked up 56K followers in just three weeks, and is now claiming to be affiliated with the DNC.

In reality, this account appears to be nothing more than the latest version of a banned T-shirt spam account, @emywinst.

cc: @ZellaQuixote
screenshots of @kamala_wins47's profile and an August 19th post claiming affiliation with the DNC
As with the banned @emywinst account, the @kamala_wins47 account farms engagement by reposting other people's videos, accompanied by bogus claims that the videos have been deleted from Twitter. These video posts frequently garner massive view counts.

screenshots of video posts from @kamala_wins47 falsely claiming that the videos therein have been deleted from Twitter
@Emywinst @kamala_wins47 The operator of the @kamala_wins47 account generally follows up these viral video posts with one or more replies advertising T-shirts sold on bestusatee(dot)com. This strategy is identical to that used by the banned @emywinst account.

screenshots of @kamala_wins47 replies advertising t-shirts and linking to bestusatee.com
Read 11 tweets
Conspirador Norteño Profile picture
Aug 5
What's up with all these similarly-worded enthusiastic posts about a Pierre Poilievre rally in Kirkland Lake, and are they all from accounts that are less than a month old? (Spoiler: yes, they are.) #Spamtastic

cc: @ZellaQuixote collage of 15 similarly-worded posts about the Pierre Poilievre rally in Kirkland Lake
An X search for "Pierre Poilievre", "Kirkland Lake", and "refreshing" performed on August 4th, 2024 turned up 151 posts from 151 accounts. All are new accounts, with the oldest having been created less than a month ago, on July 7th, 2024. (Some have since been suspended by X.)
histogram of account creation dates for the 151 spam accounts
collage of the profile images of the 151 accounts
The most intense period of activity for this group of accounts was on August 3rd, 2024, when the repetitive posts about the Poilievre rally were posted. Each account also has at least one earlier post on a random topic; some of these older posts seem to cut off abruptly.
hourly post volume for the 151 spam accounts
collage of early posts from the spam accounts
Read 6 tweets

Did Thread Reader help you today?

Support us! We are indie developers!

This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

Send Email!

:(