Share this page!

Enter URL or ID to Unroll

You can paste full URL like: https://x.com/threadreaderapp/status/1644127596119195649
or just the ID like: 1644127596119195649

How to get URL link on X (Twitter) App

  1. On the Twitter thread, click on or icon on the bottom
  2. Click again on or Share Via icon
  3. Click on Copy Link to Tweet
  4. Paste it above and click "Unroll Thread"!
  5. More info at Twitter Help
Conspirador Norteño Profile picture
@conspirator0
Jul 24, 2022 • 11 tweets • 8 min read • Read on X
Scrolly
It's a great day for a quick look at a variety of suspicious Twitter accounts with GAN-generated faces. #SundayShenaniGANs

(GAN = "generative adversarial network", the technology used by thispersondoesnotexist.com and similar sites to produce fake faces)

cc: @ZellaQuixote
First up, we have @DrAdamAneevit, an antivax account with 38K followers and a GAN-generated face. Although this account's bio states that it is a "pArOdY", plenty of people are eating up its misleading tweets about COVID and vaccines.
As it turns out, @DrAdamAneevit (permanent ID 949263131800424449) wasn't always called @DrAdamAneevit. Wayback machine archives reveal that this account was previously a "news" account named @/ForFactsSake101.

(archive: )
Next up is @RowcliffeAndy (permanent ID 1545105573997252608), an account created in July 2022 with a GAN-generated face. @RowcliffeAndy's greatest achievement thus far is spamming a meme until Dilbert creator @ScottAdamsSays amplified it.
Third on today's list of dodgy GAN-faced Twitter accounts is @ViktorKoval9 (ID 1497503918695530497). This account tweeted an image of a nonexistent tweet from a nonexistent blue-check account. The fake tweet contains a GAN-generated face, falsely represented as a boy in Ukraine.
Last, and possibly least, we have @StevieDougie (ID 324652265), a right-wing Twitter account that disapproves of Marxism and communism and has therefore (allegedly) moved from the United States to Vietnam, a country with a communist government.
How can we tell these four images are GAN-generated? There are a few tells: nonsensical backgrounds, mismatched/missing ears, weird artifacts where the hair meets the skin or background, and identical placement of the major facial features (as seen here: )
Some tips on identifying GAN-generated faces:


Additional threads about GAN-generated faces and their use on (mostly) Twitter:
Note: the four accounts in this thread are presented as distinct examples of accounts that have GAN-generated face pics combined with other suspicious attributes. We found no evidence that the four accounts are related or run by the same entity.
The operator of the @DrAdamAneevit account was apparently not a fan of this thread.
The @RowcliffeAndy account has left a few replies to this thread. The attempt at falsely equating the use of a fake human face with the use of a cartoon avatar that no one would mistake for human has become a somewhat common tactic of bad-faith actors.

• • •

Missing some Tweet in this thread? You can try to force a refresh
　

Keep Current with Conspirador Norteño

Conspirador Norteño Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @conspirator0

Conspirador Norteño Profile picture
Jan 24
As Bluesky approaches 30 million users, people who run spam-for-hire operations are taking note. Here's a look at a network of fake Bluesky accounts associated with a spam operation that provides fake followers for multiple platforms.

cc: @ZellaQuixote screenshots of 12 Bluesky accounts with the biography "Praticante de esportes radicais"
This fake follower network consists of 8070 Bluesky accounts created between Nov 30 and Dec 30, 2024. None has posted, although some have reposted here and there. Almost all of their biographies are in Portuguese, with the exception of a few whose biographies only contain emoji. hourly creation volume chart for the 8070 accounts in the spam network
table of 30 example spam accounts
The accounts in this fake follower network use a variety of repeated or otherwise formulaic biographies, some of which are repeated dozens or hundred of times. Some of the biographies begin with unnecessary leading commas, and a few consist entirely of punctuation. table of biographies most frequently used by the network
screenshots of six accounts with malformed biographies
Read 8 tweets
Conspirador Norteño Profile picture
Jan 10
It's presently unclear why, but over the past year someone has created a network of fake Facebook accounts pretending to be employees of the Los Angeles Dodgers. Many of the accounts in this network have GAN-generated faces.

cc: @ZellaQuixote Screenshots of the profiles of 12 fake LA Dodger employee Facebook accounts
This network consists of (at least) 80 Facebook accounts, 48 of which use StyleGAN-generated faces as profile images. The remaining 32 all use the same image, a real photograph of a random person sitting in an office. collage of 48 GAN-generated faces used as profile images by the fake accounts
collage of 32 identical photos used as profile images by the fake accounts
As is the case with all unmodified StyleGAN-generated faces, the main facial features (especially the eyes) are in the same position on all 48 AI-generated faces used by the network. This anomaly becomes obvious when the faces are blended together.
Read 6 tweets
Conspirador Norteño Profile picture
Oct 18, 2024
None of these chefs exist, as they're all AI-generated images. This hasn't stopped them from racking up lots of engagement on Facebook by posting AI-generated images of food (and occasional thoughts and prayers), however.

cc: @ZellaQuixote collage of 11 AI-generated images of chefs, presently being used as the avatars of Facebook accounts
These "chefs" are part of a network of 18 Facebook pages with names like "Cook Fastly" and "Emily Recipes" that continually post AI-generated images of food. While many of these pages claim to be US-based, they are have admins in Morocco per Facebook's Page Transparency feature. collage of the profiles of 18 Facebook "chef" pages that post AI-generated images of food
screenshots of Facebook page transparency info showing that the pages are run from Morocco
Between them, these 18 Facebook "chef" pages have posted AI-generated images of food at least 36,000 times in the last five months. Not all of the images are unique; many have been posted repeatedly, sometimes by more than one of the alleged chefs. examples of AI-generated food images posted by the Facebook spam pages
examples of AI-generated food images posted by more than one Facebook spam page
Read 7 tweets
Conspirador Norteño Profile picture
Sep 8, 2024
Can simple text generation bots keep sophisticated LLM chatbots like ChatGPT engaged indefinitely? The answer is yes, which has some potentially interesting implications for distinguishing between conversational chatbots and humans.

cc: @ZellaQuixote
conspirator0.substack.com/p/baiting-the-…
screenshot of Substack post
For this experiment, four simple chatbots were created:

• a bot that asks the same question over and over
• a bot that replies with random fragments of a work of fiction
• a bot that asks randomly generated questions
• a bot that repeatedly asks "what do you mean by <X>?"
The output of these chatbots was used as input to an LLM chatbot based on the 8B version of the Llama 3.1 model. Three of the four bots were successful at engaging the LLM chatbot in a 1000-message exchange; the only one that failed was the repetitive question bot.


screenshots of portions of the conversation between the repetitive cheeseburger bot and the LLM bot
screenshots of portions of the conversation between the Star Trek bot and the LLM bot
screenshots of portions of the conversation between the random question bot and the LLM bot
screenshots of portions of the conversation between the "what do you mean" bot and the LLM bot
Read 5 tweets
Conspirador Norteño Profile picture
Sep 3, 2024
The spammers behind the "Barndominium Gallery" Facebook page have branched out into AI-generated video and started a YouTube channel with the catchy name "AY CUSTOM HOME". The results are just about as craptastic as you'd expect.

cc: @ZellaQuixote
screenshot of the AY CUSTOM HOME Youtube channel
In this synthetically generated aerial video of a (nonexistent) barndominium under construction, the geometry of the roof changes, a blue building appears, and a tree vanishes, all in the course of just three seconds. still images from two different points in an AY CUSTOM HOME YouTube video, showing multiple impossible changes over the course of a few seconds
This AI-generated barndominium features a long AI-generated porch with some chairs on it. Exactly how many chairs there are depends on what angle you look at it from, however, as the chair on the left splits into three chairs as the camera pans. still images from two different points in an AY CUSTOM HOME YouTube video, showing multiple impossible changes over the course of a few seconds
Read 4 tweets
Conspirador Norteño Profile picture
Aug 28, 2024
Some observations regarding @Botted_Likes (permanent ID 1459592225952649221)...

First, "viral posts which don't result in follower growth and have very little engagement in the reply section" is not a useful heuristic for detecting botted likes. Why not?

cc: @ZellaQuixote screenshot of @Botted_Likes's profile with the text "THIS IS NOT AN EFFECTIVE METHOD OF DETECTING POSTS WITH BOTTED LIKES" overlaid in Comic Sans
"Viral posts that do not result in follower growth" is not a valid test for botting, because posts from large accounts often go viral among the large account's existing followers but do not reach other audiences, resulting in high like/repost counts but little/no follower growth.
"Very little engagement in the reply section" doesn't work for multiple reasons (some topics spur debate and some don't, some people restrict replies, etc)

Hilariously, @Botted_Likes seems to be ignoring their own criteria, as many of the posts they feature have tons of replies. screenshots of six @Botted_Likes posts featuring screenshots of posts that allegedly have botted likes
Read 5 tweets

Did Thread Reader help you today?

Support us! We are indie developers!

This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

Send Email!

:(