Profile picture
Actually, @eaton
, 8 tweets, 2 min read Read on Twitter
One of the biggest failures of the tech industry in my generation is treating destructive patterns of targeted abuse as a context-free content categorization challenge— "objectionable language" in a specific tweet, or "referring to a distinct group" in a FB message, etc.
The obvious problem is the whack-a-mole dynamic. A *quarter of a century ago* AOL tried to enforce banned words and topics to keep their chats from veering into PR-nightmare-and-FBI-stings territory. It was always a losing battle and the chat guides knew it.
Less obvious is the problem of legal responsibility for content. Dumb-but-consistent "topic/ideology neutral" rules make it easy for a platform to argue that it is not legally responsible for what happens on the platform — it makes a 'best effort' to prevent illegal acts.
That gives us Twitter banning people who swear at neo-nazis, but not the neo-nazis who are better at dancing on the edge of the rules. It gives us Youtube hutting down home videos because a Beatles song is on in the background, but leaving MRA harassment of public figures online.
The bigger, deeper problem, though, is that technology solutionists — and to a larger extent the neoliberal political consensus that drives perception of "acceptable discourse" — is unwilling to grapple with the *impact* of actions in their real social context.
Distributed harassment campaigns being coordinated outside a social network, while the targets of harassment are framed as the aggressors because they respond angrily? "Both sides are name-calling."
White supremacists evangelize eugenics, and a black person sumarizes it as "White people are the worst?" Same thing, says the neoliberal solutionist who's terrified of anyone thinking he is taking a side.
Our industry has built platforms that repeatedly amplify structural violence, but insists on treating the resulting impact on vulnerable peoples' lives as a content categorization problem.

I'm pissed, and I'm just ranting now, but lord. What a mess.
Missing some Tweet in this thread?
You can try to force a refresh.

Like this thread? Get email updates or save it to PDF!

Subscribe to Actually,
Profile picture

Get real-time email alerts when new unrolls are available from this author!

This content may be removed anytime!

Twitter may remove this content at anytime, convert it as a PDF, save and print for later use!

Try unrolling a thread yourself!

how to unroll video

1) Follow Thread Reader App on Twitter so you can easily mention us!

2) Go to a Twitter thread (series of Tweets by the same owner) and mention us with a keyword "unroll" @threadreaderapp unroll

You can practice here first or read more on our help page!

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just three indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member and get exclusive features!

Premium member ($3.00/month or $30.00/year)

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!