Cory Doctorow NONCONSENSUAL BLUE TICK Profile picture
Sep 18, 2020 22 tweets 5 min read Read on X
Writing for @wired, @pomeranian99 gets a first-of-its-kind behind-the-scenes look at Youtube's algorithm development team, in order to document the company's attempt to reduce the service's role in spreading and reinforcing conspiracy theories.

wired.com/story/youtube-…

1/
Thompson traces the origin of the crisis to the company's drive for more "engagement" that led them to tune their recommendation system to identify and propose more specialized, esoteric versions of the video you'd just watched.

2/
The idea was to lead you down a rabbit hole of ever-more-specific versions of your interests, helping you discover niches you never knew existed.

3/
This dynamic in recommendation systems has gotten a lot of attention lately, and most of it is negative, but let's pause for a moment and talk about what this means for non-conspiratorial beliefs.

4/
Say you happen upon a woodworking video, maybe due to a friend's post on social media. You watch a few of them and you find yourself interested in the subject and tuning in more often.



5/
The recommendation system presents an array of possible next-views, but tilted away from general-interest woodworking videos, instead offering you a menu of specialized woodworking styles, like Japanese woodworking.



6/
You sample one of these and find it fascinating, so you start watching more of these. The recommendation system clues you in to Japanese nail-free joinery:



7/
And from there, you discover the frankly mesmerizing "Niju-mizu-kumi-tsugi" style of joinery, and you start to seek out more. You have found this narrow, weird, self-reinforcing community.



8/
This community could not exist without the internet and its signature power to locate and connect people with shared, widely dispersed, uncommon interests.

This power isn't just used to push conspiracies and woodworking techniques, either.

9/
It's how people who know that their gender identity doesn't correspond to the gender they were assigned at birth find each other, and acquire a vocabulary for describing their views, and foment change.

10/
It's how people who believe #BlackLivesMatter find one another, it's how the #GreenNewDeal movement came together.

It's also how people who wanted to cosplay Civil War soldiers in Charlottesville, waving tiki torches, chanting "Jews will not replace us" found each other.

11/
And that is the conundrum of the recommendation engine. Helping people find others who share their views, passions and concerns is not, in and of itself, bad. It is vital. It's the thing that made the internet delightfully weird. It's also what made the world terribly weird.

12/
Thompson takes us inside Youtube's algorithm team as they try to balance three priorities:

I. Increasing their traffic and profits

II. Helping people find others with common interest

III. Stopping conspiracies from spreading

13/
And he traces how they try, with limited success, to manage these competing goals by creating extremely fine-grained rules that define what is banned on the platform.

14/
But naturally, this just gives rise to a new kind of content: stuff that is ALMOST bad enough for blocking, but not quite. The problem is that this stuff is indistinguishable (in all but the narrowest, technical way) from banned content.

15/
So then Youtube has to create a new set of moderation guidelines: "What is so close to prohibited content that it, too, is prohibited?"

Naturally, this is creating a new kind of content: "Stuff that is not close-to-bannable, but is close-to-close-to-bannable."

16/
This dynamic should be familiar to anyone who's watched the moderation policies of Big Tech platforms evolve: what is "hate speech?" "What is 'almost-hate-speech?'" "What is almost-almost-hate-speech?'"

17/
Ultimately, this ends up creating thick binders of pseudo-law that delivers advantages to the worst people: they can study the companies' policies and figure out how to skate RIGHT UP to the cliff's edge (no matter how it is defined).

18/
And at the same time, they can goad their adversaries - the people they torment - into crossing these fractally complex lines and then nark them out, so that over time, these speech policies preferentially block good speech and leave bad speech untouched.

19/
I am increasingly convinced that the problem isn't that Youtube is unsuited to moderating the video choices of a billion users - it's that no one is suited to this challenge.

20/
Remedies that put moderation choices closer to the user - breaking up monopolies, allowing interoperable recommendation systems - solve the problem of scaling up AND covering edge cases by eliminating scale altogether, and letting the edge cases make their own calls.

21/
Image:
Mark Sargent


eof/

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Cory Doctorow NONCONSENSUAL BLUE TICK

Cory Doctorow NONCONSENSUAL BLUE TICK Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @doctorow

Sep 9
Broadly speaking, the role of an establishment economist is to come up with new ways of saying, "actually, your boss is right."

1/ Two suited business-men sit knee-to-knee in a luxuriously paneled boardroom, smiling broadly at one another. They are tinted green and limned with green. Behind them stands a rank of child laborers in 19th century workwear, looking miserable. Behind the laborer, a sack of gold coins looms into the frame, spilling a cascade of gold coins. On the coffee table before the men is a tiny guillotine with a tiny aristocrat about to lose his head while two tiny Jacobins look on.
If you'd like an essay-formatted version of this thread to read or share, here's a link to it on , my surveillance-free, ad-free, tracker-free blog:



2/pluralistic.net
pluralistic.net/2024/09/09/low…
In other words, the world we're living in is the best possible world, and the fact that you got contact burns from collapsing on the scorching sidewalk outside of the grocery store where you couldn't afford your weekly shopping is unfortunate, but unavoidable.

3/
Read 46 tweets
Aug 19
*Corporate Bullshit: Exposing the Lies and Half-Truths That Protect Profit, Power, and Wealth in America* is @NickHanauer, @joanwalsh and @donaldrcohen12's 2023 book on the history of corporate apologetics; it's great:



1/ thenewpress.com/books/corporat…
The New Press cover for 'Corporate Bullshit,' by Nick Hanaeur, Joan Walsh and Donald Cohen.
If you'd like an essay-formatted version of this thread to read or share, here's a link to it on , my surveillance-free, ad-free, tracker-free blog:



2/pluralistic.net
pluralistic.net/2024/08/19/apo…
I found out about this book last fall when @ddayen reviewed it for the @TheProspect; Dayen did a great job of breaking down its thesis, and I picked it up for my newsletter.

3/
Read 37 tweets
Aug 17
Last weekend, I was at @Defcon 32, where I had the privilege of giving a talk: "Disenshittify or die! How hackers can seize the means of computation and build a new, good internet that is hardened against our asshole bosses' insatiable horniness for enshittification."

1/ A photo of me at a podium at Defcon 32, giving my speech.   Image: https://twitter.com/igama/status/1822347578094043435/ (cropped)  CC BY 4.0 https://creativecommons.org/licenses/by/4.0/deed.pt
If you'd like an essay-formatted version of this thread to read or share, here's a link to it on , my surveillance-free, ad-free, tracker-free blog:



2/pluralistic.net
pluralistic.net/2024/08/17/hac…
This was a followup to last year's talk, "An Audacious Plan to Halt the Internet's Enshittification," a talk that kicked off a lot of international interest in my analysis of platform decay ("enshittification"):



3/
Read 204 tweets
Aug 16
Once you learn about the "collective action problem," you see it everywhere. Democrats - including elected officials - wanted Biden to step down, but no one wanted to be the first one to take a firm stand, so for months, his campaign limped on: a collective action problem.

1/ A shelf of thick scientific tomes, protected by a gridwork of foreboding, rusting bars.
If you'd like an essay-formatted version of this thread to read or share, here's a link to it on , my surveillance-free, ad-free, tracker-free blog:



2/pluralistic.net
pluralistic.net/2024/08/16/the…
Patent trolls use bullshit patents to shake down small businesses, demanding "license fees" that are high, but much lower than the cost of challenging the patent and getting it revoked.

3/
Read 68 tweets
Aug 15
Every performer and creator on Patreon is about to get screwed out of 30% of their gross earnings, which will be diverted to Apple, the most valuable company on Earth. Apple contributes nothing to their work, but it can steal a third of their wages:



1/ news.patreon.com/articles/under…
A Vaudeville dancer on an old-fashioned stage, caught mid-dance-step, standing in front of a Patreon logo.. His pockets bulge with cash. He has been decapitated and blood fountains from the stump of his neck. His decapitated, bloody head lies in a pool of blood on the stage next to him. Over the stump of his neck is an original six-color Apple logo, modified so that the 'bite' is actually a bloody, fang-filled mouth. The scene is surmounted by the Apple 'Think different' wordmark.
If you'd like an essay-formatted version of this thread to read or share, here's a link to it on , my surveillance-free, ad-free, tracker-free blog:



2/pluralistic.net
pluralistic.net/2024/08/15/pri…
How is this possible? Enshittification:



Enshittification starts with companies being good to end users. In this case, Apple made a quality product - Iphones - and carefully tended its App Store.

3/pluralistic.net/2024/01/30/go-…
Read 65 tweets
Aug 14
Walmart didn't just *happen*. The rise of Walmart - and Amazon, its online successor - was the result of a specific policy choice, the decision by the Reagan administration not to enforce a key antitrust law.

1/ An early 20th century grocery counter before tall shelves stacked with dry-goods. A woman grocer turns to pluck an item off the shelves. Attached to the shelves in three places are binder clips supporting small notes; each note is emblazoned with a dark red guillotine blade. To the left of the image stands a shouting millionaire with a top hat and a money-bag.
If you'd like an essay-formatted version of this thread to read or share, here's a link to it on , my surveillance-free, ad-free, tracker-free blog:



2/pluralistic.net
pluralistic.net/2024/08/14/the…
Walmart may have been founded by Sam Walton, but its success (and the demise of the American Main Street) are down to Reaganomics.

3/
Read 53 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(