JChoe Profile picture
May 19 21 tweets 8 min read Twitter logo Read on Twitter
My #NAFO story started two years ago hunting Nazis for @Meta.

My team recorded 3,500+ accounts on Facebook and Instagram neo-Nazi, accelerationist, or just plain old garden variety extremist assholes.

I didn't really think much of it until I bothered counting them.

(🧵) Image
In June of '21 I sampled 491 accounts we'd sent for deplatforming over the past six months.

When I did the math and saw that less than 8% of them were getting removed, that's when that job really ended, I realize now.

Because that job was basically a lie. Image
What was happening then, and still is now, is no better than a rather large game of whack-a-mole played by Palantir alumni and wannabes inside Meta.

This would be fine, if they were actually removing the bad shit.

They aren't. They actually hide it. Image
So, this is the type of pattern you see all across Facebook & Instagram, still.

Let me translate this out of bureaucratese:

Facebook *purposefully* made its German law reporting form hard to use so that its complaint numbers stay artificially low. Image
This is basic, basic business logic for a publicly traded company.

It is so inordinately expensive to do content moderation correctly that it is actually cheaper just to eat the bad PR, lost goodwill and legal penalties that go with half-assed content moderation.
Twitter, under Elon, is no different, just more up-front about not giving a fuck.

Look, the man isn't (that) stupid. Callow, immature, lacking in common sense or consideration, classless, trashy, yes, but stupid, no.

He knows this is happening.

He just doesn't care. ImageImage
When the war hit in February of last year, my lawyer and I sat down, and said, look, we gotta do something.

This Facebook Nazi stuff is fine, but what do you have on Ukraine? Can you help make a difference right now? Are there, say, Russian propagandists on Facebook you found?
To which I replied, YUP.

It's probably not going to be a surprise to anyone in NAFO, but even nowadays, if you want to find Russian agitprop on Facebook or Insta all you need to do is throw a damn rock in the air, it'll land on someone either believing or repeating the lies.
The list of L/DPR accounts I found, some of the flagrant sanctions violators, and the disclosure we wrote from it, targeting OFAC, the FBI National Security Division and the State Department earned me my first substantive mention in the Washington Post.

washingtonpost.com/technology/202…
I should mention, since it probably isn't clear:

This is all hustle for me at this point, I'm not contracting in private intelligence anymore.

Calling out your client as incompetent at handling Nazis is not a great way of getting those jobs, hence:
patreon.com/joohn
So when someone finally invited me to NAFO in September (I made a slightly annoying, in retrospect, point about being invited rather than just joining), I saw two things I could do.

One, hopefully, get some more attention to the research I was doing, at that point...
...not just the Nazis I found for Facebook, not just the (pardon me) fucking L/DPR Instagram militants I found bragging about the Ukrainians they'd killed, but also sanctions designations against the L/DPR's pension fund, which pays Nazis...

...and the illegal shipment of plunder from Ukraine, which is STILL GOING ON, in plain view of the world.

Hey, @USTreasury, again, hate to be THAT taxpayer, but...

Where we at on this

Because here is a chart showing you who to sanction
observablehq.com/@joohn/smuggle…
Here is the letter I sent you explaining who to sanction, how I know, and where they are down to their street addresses and GPS coordinates, which accompanied a spreadsheet with three independent sources for every person I identify.

@USTreasury? @DOJNatSec?

Bueller? Image
Two, and I've spoken of this extensively, what I saw happening with #NAFO was the first really active, growing online counter-disinfo movement I think has ever existed.

I don't think people see this in perspective: #jagahar only had at most a few thousand people.
The Lithuanian "elves" counter-disinfo movement was a few dozen people and their supporters, most of whom were hackers - not culture hackers or influence hackers, like, hacker-hackers who write assembly and figure out the pin-outs for router serial ports.
time.com/6155060/lithua…
NAFO as a movement is actually more important than any of the windmills I was tilting, I think, and it's real simple why.

Just read the other stories of how people came to #NAFO today.

No one is, like, "durr I wanted to fit in".

Every single one is a story of conscience.
The difference is, having people actually CARE - to the point that other people call it 'cringe', which is, I'm realizing, a success indicator given how bad those people are at being anything meaningful.

This is the "secret", if there is one, to anti-disinfo ops that way I know.
It's real simple: you just gotta make people care about the truth enough to get out and fight for it.

Not that you CAN control anything else, but to the extent you can, the rest of it either falls in place or ends up unimportant.
The virtuous cycle that starts happening when people care, and get other people to care, and put their energy into something...

That's how you escape the whack-a-mole game that Facebook is still trying to play, which Twitter doesn't even bother really doing.

The answer is NAFO.
Anyway. Happy NAFO day, all that.

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with JChoe

JChoe Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @JoohnChoe

May 18
A family member in college told me the other day they were going into public health with a focus on misinformation.

I said, that's great. You're joining an incredibly important front of, basically, a civil information war over defining reality.

🧵
What you really want to read, I said, unsolicited, because offering unsolicited advice that you literally did not ask for is what annoying uncles do (👋), is Cialdini, on influence.

I had to look it up today to prove a point about conformity and hatred.
www2.psych.ubc.ca/~schaller/Psyc…
Fun fact: exposure to social approval of prejudice has a near-perfect correlation with expressions of prejudice in an N = 1,504 study (Crandall, et al., 2002).

pubmed.ncbi.nlm.nih.gov/11902622/
Read 9 tweets
May 17
I think there needs to be a public-interest influence ops & anti-disinfo institution.

I've been going through the basis in my head the past few days, let me see what people think.

(🧵)
Start with the idea that disinformation & digital radicalization move fast and unpredictably.

Narratives shift in days, sometimes hours; in the past week in #NAFO, we've seen disinfo about Russian strikes on underground bunkers, Patriot batteries and downed Russian aircraft.
As a social problem disinformation belief cuts across government, media, private industry and NGOs.

This is, I think, by design. It's not just "flooding the zone" vertically, it's also horizontally, so that it's always someone else's problem or area of expertise.
Read 17 tweets
May 16
Friendly reminder:

If the entirety of your politics is shitting on everything the government does to make society safer, more equal and more just without having a practical alternative, that doesn't make you a "conservative".

It makes you a gullible, illiberal coward.
Conservatism in all its value-neutral definitions means simply a political philosophy centered on traditional values.

In America, those traditions are post-Enlightenment ones founded by rationalist, if slave-owning, rebels. Image
They include a respect for reasoned debate over rabble-rousing populism, a belief in the sovereignty of the individual, and the fundamentally liberal (again, in the value-neutral definition) idea that the government exists to help people, instead of the other way around.
Read 11 tweets
May 16
Five years down the road it's interesting to look at Bodine-Baron, et al. 2018 and look at how their predictions have shaken out.

This is a 65-page report written by scientists, a lawyer and an engineer, I'm not going to summarize it all, but there are some highlights.

(🧵) Image
Bodine-Baron, et al. start by sketching out a fairly familiar, well-corroborated picture of the disinfo ecosystem that all of us in #NAFO have come to know and love.

It's somewhat of a fine point but note how they distinguish media "useful idiots" (#3) from ordinary chumps (#4). Image
On their account, what NAFO does might be located in that third category - amplification channels - as a counter-measure, with some potential impact on the fourth category, by affecting how other consumers view disinformation. Image
Read 11 tweets
May 15
The case is Dunphy v. Giuliani:
eddsa.blob.core.usgovcloudapi.net/public/650033_…

There are shocking, salacious, and two really really startling moments here. This is one.

Trump was selling pardons for $2 million.

(🧵)
Thanks to sworn testimony from McEntee and Hutchinson, we knew already that there was a flurry of pardon requests from Republicans involved in spurring the January 6th insurrection, including Giuliani himself.
nytimes.com/2022/12/27/us/…

Per Dunphy, a secondary market also existed. ImageImageImage
The second really interesting thing going on here is the mention of Lev Parnas and Rudy Giuliani planning the election-denialist movement before the election, at "several business meetings" per Dunphy.

Read 9 tweets
May 15
I actually talked to Christopher Miller once on the phone back in 2020, about hunting neo-Nazi Ukrainian accounts on Instagram & Facebook.

I told him, this is off the record, we don't want anything from you, we're basically hunting Nazis for Facebook, what you got?

(🧵)
At time, Miller was working on his story about U.S. veterans involved in MMA events with Azov people.

He said there were people in Azov the actual military org, and people who were basically on the social media side of it, and those were two different sets of people.
This tracks, I think, more than year into the war.

The people that we see, for instance, speaking for the heroes of Azovstal (they are, don't @ me) are different than the people we saw posting sonnenrads and SS bolts two years ago.

Like, Tik-Tok Azov is not the real Azov.
Read 8 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(