Building a sophisticated troll network at scale had never been cheaper and easier—thanks to AI capabilities.
Even if you are not Russia, China or Iran, now you can influence Western countries towards far-right, populist parties (AfD, RN, PiS…) and isolating from each other.
1/
This is exactly what UAE* did: with AI-powered operation targeting 🇺🇸🇨🇦🇬🇧🇫🇷🇩🇪🇵🇱🇪🇸🇮🇹 and the Gulf states, it weaponized COP29, a UN climate change conference in Azerbaijan.
2300+ accounts in 8 languages pushing country-specific narratives with highly-realistic fake personas.
2/
With broad variety of pro- and anti- "opinions" in politics, economy, social, emerging markets, climate, all Western-targeting narratives agree on:
• desire to change of elected officials, established institutions and status quo
• UAE being the most successful alternative
3/
Across AZ/EN/FR/DE languages, Azerbaijani leadership and president Aliyev are endorsed for prosperity, stability and sovereignty.
In Nagorno-Karabakh conflict, Azerbaijan is portrayed as a victim of Armenia's aggression supported by biased, hypocritical France and the US.
4/
The powered-by-AI nature of this network was revealed by variety of glitches in LLM-generated tweet texts and GAN images.
It will take only a few generations of GPT models to get rid of artifacts like these. Meanwhile, some of our favorites in texts:
5/
GAN cityscapes are sometimes even more betraying, like:
• a wind farm in the middle of Paris
• double Gherkin skyscrapers in London
• two CN Towers in Toronto
• two Eiffel towers
6/
Most important evidence of inauthenticity and coordination for the network as a whole are:
• signature combination of creation date and first tweet across accounts
• broad variety of features that connect together all the 3 first-tweet-based cohorts
7/
• • •
Missing some Tweet in this thread? You can try to
force a refresh
1/ As the UK experiences its most significant riots since 2011, the Kremlin is happy to exploit the situation to its benefit by:
🔥 adding fuel to the fire of the #UKriots
🔥 inciting similar tensions in France¹⁶
🔥 weakening support for Ukraine¹⁷
🧵 Thread:
2/ Since Aug 7, Matryoshka, a pro-Kremlin network, uses bots to flood X/Twitter with fake visuals (videos, street art, and doctored covers) related to the Southport events.
The goal is to overload fact checkers with illegitimate reports and to boost virality of false narratives.
3/ Matryoshka uses fake visuals to better serve its goal. Compared to genuine news, they:
🎯have a greater disinfo impact if they go viral
🎯keep fact-checkers busy longer
That's why a visual promoted by Matryoshka is, by itself, a strong marker of its intentional false nature.
🧵 "Lea Thompson congratulated Brigitte Macron on 40th anniversary of her gender transition"
Such a video was first published by Telegram channel BelShkvarka, in a series "Sent in by a subscriber" that is a frequent source of fake videos for Matryoshka bots.
1/
The most likely origin of that is @BookCameo where one can order a personalized video from a celebrity; for Lea Thompson it's only $125 with earliest delivery in 24h.
@LeaKThompson never mentioned Macron, so it could look like a innocent order with no political implication.
2/
This is exactly how it worked back in summer 2023 when Telegram channels (and major Kremlin-loyal traditional media) promoted a series of celeb videos allegedly suggesting Zelensky to go to rehab.
See report by @daithaigilbert that we contributed to.
🧵 Russian state-sponsored RRN, a signature site of Doppelgänger influence operation, and its bots are amplifying and legitimizing the fake site suggesting that Emmanuel Macron and his party are (were) buying votes for €100 for the snap election to National Assembly (France)
1/
Tweets and the article machine-translated to English.
I only kept text part of the article to fit into a single image. Full article available at:
As previously exposed by @gnidaproject, ensemble-24[.]fr mimicking the official ensemble-2024[.]fr, was registered on June 19 2024 with an email address at @ProtonMail--which is one of the most popular servers for those looking to hide their identity.