Rachel Coldicutt Profile picture
Careful innovation, community tech and networked care @carefultrouble. now on Bluesky, not here. Newsletter: https://t.co/SiYu6P83Yu.

Sep 15, 2020, 7 tweets

On why GPT-3 is the language generator we (unfortunately) deserve: ”At its core, GPT-3 is an artificial bullshit engine—and a surprisingly good one at that ... like a human bullshitter, it also has no intrinsic concern for truth or falsity.”

I’m not sure it’s necessarily recognised among people who publish web content - but language generating tools need open access content to learn from, which means the kind of content that is open access is a massively important part of the machine-learning ecosystem.

Common Crawl commoncrawl.org and Wikipedia are two of the many sources that GPT-3 learns from. Gender bias on Wikipedia is such a well-known phenomenon that there is even, wait for it, a Wikipedia page on gender bias on Wikipedia en.wikipedia.org/wiki/Gender_bi…

There is a massively complex bit of the social contract to be negotiated here - what is a representative body of content, who enforces use of that representative content, who supports the creation of it, how is profit earned and distributed? It goes on and on.

And we’re headed to more automated content moderation, and not just at Facebook - the @DCMS Data Strategy refers to creating "a competitive commercial market in tools able to detect online harms such as cyberbullying, harassment or suicide ideation” gov.uk/government/new…

Anyway, sorry, I’m not sure where I’m headed with all this woe, except that, idk, this is why good global governance is simultaneously so important and so impossible.

Sigh.

(Mild lol)

Share this Scrolly Tale with your friends.

A Scrolly Tale is a new way to read Twitter threads with a more visually immersive experience.
Discover more beautiful Scrolly Tales like this.

Keep scrolling