Building a sophisticated troll network at scale had never been cheaper and easier—thanks to AI capabilities.
Even if you are not Russia, China or Iran, now you can influence Western countries towards far-right, populist parties (AfD, RN, PiS…) and isolating from each other.
1/
This is exactly what UAE* did: with AI-powered operation targeting 🇺🇸🇨🇦🇬🇧🇫🇷🇩🇪🇵🇱🇪🇸🇮🇹 and the Gulf states, it weaponized COP29, a UN climate change conference in Azerbaijan.
2300+ accounts in 8 languages pushing country-specific narratives with highly-realistic fake personas.
2/
With broad variety of pro- and anti- "opinions" in politics, economy, social, emerging markets, climate, all Western-targeting narratives agree on:
• desire to change of elected officials, established institutions and status quo
• UAE being the most successful alternative
3/
Across AZ/EN/FR/DE languages, Azerbaijani leadership and president Aliyev are endorsed for prosperity, stability and sovereignty.
In Nagorno-Karabakh conflict, Azerbaijan is portrayed as a victim of Armenia's aggression supported by biased, hypocritical France and the US.
4/
The powered-by-AI nature of this network was revealed by variety of glitches in LLM-generated tweet texts and GAN images.
It will take only a few generations of GPT models to get rid of artifacts like these. Meanwhile, some of our favorites in texts:
5/
GAN cityscapes are sometimes even more betraying, like:
• a wind farm in the middle of Paris
• double Gherkin skyscrapers in London
• two CN Towers in Toronto
• two Eiffel towers
6/
Most important evidence of inauthenticity and coordination for the network as a whole are:
• signature combination of creation date and first tweet across accounts
• broad variety of features that connect together all the 3 first-tweet-based cohorts
7/
• • •
Missing some Tweet in this thread? You can try to
force a refresh
🧵 As pro-Kremlin disinfo network Matryoshka expanded to TikTok, it started to gain quite an engagement.
This is the first such a case that we encountered.
Fake video says: "Every third refugee from Ukraine intends to leave Poland after the presidential election, a poll shows"
2/4
While we can't validate authenticity of Views, Likes, Bookmarks or Reposts counts, the most popular replies look like the video has resonated with the audience
🧵 Russian state-aligned disinfo bot network codenamed Matryoshka has expanded to TikTok yesterday, complementing its regular X/Twitter presence.
On the same day the network has likely stopped its activity on BlueSky. 1/9
2/9
Matryoshka is infamous for posting only fake visuals: doctored photos of street art; videos and front pages impersonating media outlets, universities and public agencies.
So the very fact of a visual posted by the 🪆 network is on its own a strong indicator of a forgery.
@franceinter @le_Parisien 3/9
Why we believe they started TikTok only yesterday? We could not find similar TT posts / accounts related to Moldova / Sandu for 3 months to date.
While on X and BlueSky, 🪆 is for over 6 weeks now running a smear campaign targeting Maria Sandu:
🧵 Russian state is happy to manipulate public debate following the Pavel @Durov, @FranceDiplo / DGSE statements on Romanian elections.
These fake videos and covers impersonating 🇫🇷 state agencies and reputable media brands have been posted on May 20 by Matryoshka bot network.
2/ Most of the fake visuals amplify @Durov's claims and exploit the controversy to damage trust to 🇫🇷 government.
However, the bigger picture seems to be that Russian state accuses the West of its own crimes, following Kremlin's presumed earlier interference to 🇷🇴 elections.
3/ Fake 🎬 @EuroNews reinforces Durov's claim with an alleged note from Romanian MFA:
"🇷🇴 has sent a note of protest to the 🇫🇷 govt for interfering the elections with the help of Telegram.
🇷🇴 recommends 🇫🇷 to mind its own business: terrorism, illegal migration, unemployment"
🧵 Pro-Kremlin disinfo network "Matryoshka" this Friday targeted the Reporters Without Borders (@RSF_inter) with a special episode.
With hijacked RSF logo, they falsely labelled several genuine videos* as fake using a fraudulent 'INFOX' watermark.
1/7
2/7
As @_ColinGerard points out, this could be a direct response to RSF's recent report exposing how Matryoshka / Storm-1679 is repeatedly impersonating RSF to promote Kremlin's narratives:
"As a part of a corrupt scheme, Macron knowingly imposed COVID-19 vaccines that harmed French people's fertility, dramatically shifting birth rates in favor of immigrant populations."
🧵 1/4
2/4
As in many previous episodes across many campaigns, Matryoshka used AI-cloned voices here to repurpose pre-existing authentic videos from scholars to allegedly claim any talking points deemed useful to Kremlin at the moment.
3/4
This episode is a part of ongoing anti-Macron campaign.
Lasting for over a year now, its latest trigger was likely Macron's March 03 statement on extending the France’s nuclear umbrella to the European allies.
🧵 In 3 days, pro-Kremlin fake-video operation received 3 debunking statements from FBI, totaling 1.5M views and counting.
This operation is active since at least Sept 2023. My team was first to report this operation back in Jan 2024, we codenamed it Matryoshka 🪆 (Russian Doll)
2/
Never before has Matryoshka gained that much attention from a govt agency, in the US or overseas, at the low cost of a dozen fake videos, which is literally half of its daily(!) capacity.
These statements alone gave so much airtime that it could not possibly dream of.
3/ This is what will possibly happen next:
💡 Matryoshka will be more often impersonating govt agencies than it was doing before, for as long as that keep resulting in public statements from those agencies.