Cory Doctorow Profile picture
Aug 22 35 tweets 8 min read
Mark's toddler had a painful, swollen penis; the nurse asked him to email a picture for a telemedicine consultation. Gmail automatically detected the picture of a child's penis and contacte the SFPD, accusing Mark of molesting his son.… 1/ A desk with an open laptop ...
If you'd like an essay-formatted version of this thread to read or share, here's a link to it on, my surveillance-free, ad-free, tracker-free blog:… 2/
Mark and his wife took several pictures of their son's penis, including one that contained Mark's hand. The child had a bacterial infection, which was quickly alleviated with antibiotics that the doctor prescribed via telemedicine. 3/
Google refused to listen to Mark's explanation. Instead, they terminated his account, seizing more than a decade's worth of personal and business email, cloud files, and calendar entries. 4/
He lost all the family photos he'd synched with Google Photos (including all the photos of his toddler from birth, on). He even lost his mobile plan, because he's a Google Fi user. 5/
He lost access to Google Authenticator and couldn't sign into any of his other online accounts to tell them that he had a new, non-Gmail email address. 6/
Mark received an envelope from the SFPD telling him that Google had contacted the police department, accusing him of producing child sexual abuse material (#CSAM). 7/
He learned that Google had secretly given the police full access to all of his files and data, including his location and search history, as well as all his photos and videos. 8/
The reason the police had to mail him all this stuff? Google had shut down his phone number and so they couldn't reach him.

To SFPD's credit, they'd figured out what was going on and decided Mark wasn't a child molester. 9/
To Google's shame, they continue to hold all his data hostage - including his address book with the contact info for everyone he is personally or professionally connected to, denying him access to it. 10/
Google says they won't give Mark his account back because they found another "problematic" image in his files: "a young child lying in bed with an unclothed woman." 11/
Mark doesn't know which picture they mean (he no longer has access to any of his photos), but he thinks it was probably an intimate photo he captured of his son and wife together in bed one morning ("If only we slept with pajamas on, this all could have been avoided."). 12/
Writing for the @nytimes, @kashhill discusses another, similar case, involving a Houston dad called Cassio, whose doctor asked him to send in photos of his child's genitals for diagnostic purposes. 13/
Like Mark, Cassio was cleared by police, and, like Mark, Cassio is locked out of his Gmail account, along with all the services associated with it. 14/
Hill spoke with my @EFF colleague @joncallas, who criticized Google, saying that private family photos should be a "private sphere" and not subject to routine scanning by algorithms or review by moderators. 15/
Google claims that they only scan your photos when you take an "affirmative action" related to them, but this includes automatically uploading your photos to Google Photos, which is the default behavior on Android devices. 16/
Also cited in the article is Kate @Klonick, a cyberlaw prof and expert on content moderation, who says this was "doubly dangerous in that it also results in someone being reported to law enforcement." 17/
She suggest that this could have resulted in a loss of custody if the police had been a little less measured.

Klonick criticized Google for the lack of a "robust process" for handling this kind of automated filter error. 18/
Hill describes the "AI" tools Google uses to automatically flag potential CSAM. As is so often the case with automated filtering tools, the flagging takes place in a nanosecond, while the process for questioning its judgment takes months or years, or forever. 19/
Last summer, I called Google and its Big Tech competitors "utilities governed like empires."… 20/
The companies deliberately pursued a strategy of becoming indispensable to us, declaring mission statements like "organize all the world's information" and backing them up with vertical stacks of products designed to capture your whole digital life. 21/
That is, the tech giants set out to become utilities, as important to your life as your electricity and water - and they succeeded. 22/
However, they continue to behave as though they are simply another business, whose commercial imperatives - including the arbitrary cancellation of your services without appeal - are private matters. 23/
Some people say this means we should just turn these companies into *actual* utilities, but I think that's the wrong impulse. 24/
The problem with (say) Facebook, isn't merely that Zuck is monumentally unqualified to be the unaccountable self-appointed dictator of three billion peoples' digital lives. The problem is that *no one should have that job*. We should *abolish that job*. 25/
Which is why I'm so interested in interoperability - including a mix of state-imposed interop obligations and protecting interoperators' self-help measures like reverse-engineering, scraping and bots.… 26/
That is a path to pluralizing power over the necessities of our lives - use the power of the state to set limits on the conduct of online platforms (say, by passing strong privacy laws with a private right of action). 27/
That way, no matter which choice a user makes, they won't be exploited by online companies. 28/
Use government power to guarantee interop so users who don't like the way an online host uses its discretion can easily leave, without surrendering their data or their social connections:… 29/
Rather than entrusting the US government - including its policing and espionage arms - to run our digital lives, and the digital lives of non-Americans around the world whom the US government explicitly disclaims any duty to, we can ask the state to do a much narrower job. 30/
We can ask it to prevent companies from harming us, and we can ask it to force companies not to take our data and social connections hostage. 31/
That way, we *don't* have to ask the government - which might be run by e.g. Ron Desantis in a couple years - to decide which conversations are lawful to have:… 32/
Instead, we can create our own, community run and community managed online spaces and services. 33/
Correction: I misstated a technical detail; Mark didn’t email his photo to his doctor; rather, he took the photo with his phone and the image was automatically synched to his Google Photos account, triggering a scan

• • •

Missing some Tweet in this thread? You can try to force a refresh

Keep Current with Cory Doctorow

Cory Doctorow Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!


Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @doctorow

Aug 24
Today's Twitter threads (a Twitter thread).

Inside: Trump gave Moderna all the patent-waivers it needed to make a vaccine; and more!

Archived at:…

#Pluralistic 1/ The Earth, floating in spac...
I'm Kickstarting a DRM-free audiobook of Chokepoint Capitalism, the book @rgibli and I wrote about how tech- and entertainment monopolies rip off artists, and how to unrig those terrible labor markets:…

("This book really gets it" - @stephenfry) 2/
I'm leaving for Burning Man early tomorrow morning and I'll be offline until Sept 7. See you then! 3/ Image
Read 21 tweets
Aug 24
There's a *lot* of competition for the title of "Most On-The-Nose Symbol of Late Stage Capitalism," but I think there's a strong case for awarding the crown to #VaccineApartheid - the decision to deny covid vaccines to billions of poor people in the Global South. 1/ The Earth, floating in spac...
If you'd like an essay-formatted version of this thread to read or share, here's a link to it on, my surveillance-free, ad-free, tracker-free blog:… 2/
Here's how that went down: poor countries were arm-twisted into signing up to WTO on pain of being shut out of global trade (former colonies were forcibly converted to export crop economies that relied on rich-world countries for seed/agtech, so opting out wouldn't work). 3/
Read 42 tweets
Aug 24
Bebe Daniels and Harold Lloyd in The Big Idea (1917)…
Bebe Daniels and Harold Lloyd in The Big Idea (1917)…
Bebe Daniels and Harold Lloyd in The Big Idea (1917)…
Read 4 tweets
Aug 24
Twin City Motel, Bristol, Tennessee… Image
1950 National Association of Ice Industries… Image
Brand of the Werewolf by Kenneth Robeson (Bantam, 1965)… Image
Read 4 tweets

Did Thread Reader help you today?

Support us! We are indie developers!

This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!


0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy


3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!