My Authors
Read all threads
Today @GordPennycook & I wrote a @nytimes op ed

"The Right Way to Fix Fake News"
nytimes.com/2020/03/24/opi…

tl;dr: Platforms must rigorously TEST interventions, b/c intuitions about what will work are often wrong

In this thread I unpack the many studies behind our op ed

1/
Platforms are under pressure to do something about misinformation. Would be simple to rapidly implement interventions that sound like they would be effective.

But just because an intervention sounds reasonable doesn’t mean that it will actually work: Psychology is complex!

2/
For example, its intuitive that emphasizing headline's publisher (ie source) should help people tell true vs false Low quality publisher? Question the headline.

But in a series of experiments, we found publisher info to be ineffective!

Details:

3/
What about warnings on articles factcheckers mark as false? Seems like that should reduce belief- and it does!

The problem: Most false headlines never get checked (fact-checking doesnt scale) & users may see lack of warning as implying verification!



4/
Another example: General warnings to "Watch out for fake news!" Should help keep users on their toes, right?

But this can lead to people not just disbelieving false headlines, but also rejecting TRUE headlines (ie being generally suspicious)

link.springer.com/article/10.100…

5/
These are cases where intuitively compelling interventions may actually be problematic. Its essential for platforms to test if the results from these experiments generalize to actual behavior on-platform

But also, intuitively UNappealing interventions may actually work well!

6/
Take crowdsourcing: When Facebook announced they would promote content from news outlets that users said they trusted, everyone thought it was a terrible idea!

But turns out layperson source ratings actually agree quite well with fact-checkers:


7/
Crowdsourcing also robust against "gaming":
1) Poll random/selected users rather than allowing anyone to contribute their opinion-Prevents coordinated attacks
2) Knowing ratings will influence ranking≠gamed responses-Most ppl dont care about politics
psyarxiv.com/z3s5k/

8/
And of course, sometimes experiments find that interventions DO work the way intuition suggests

For example, when people think more carefully, they are less likely to believe false headlines (but not less likely to believe true headlines)


9/
Similarly, nudging people to think about the concept of accuracy makes them less likely to share misinformation

This is the case in survey experiments (eg looking at sharing intentions for false and true headlines about COVID-19)



10/
...and also in an actual field experiment on Twitter where we sent an accuracy nudge message (asking them to rate the accuracy of a random headline) to over 5k users and found an increase in the quality of the news they subsequently shared



11/
TAKE-HOME

Platforms need to do rigorous tests- and if they can show they are doing so, the public needs to be patient

The key: Platform transparency about evaluations they conduct internally, and collaboration with outside independent researchers who publish

12/
My group, w @j_a_tucker and Paul Resnick's groups, are having a great experience in such a collaboration with Facebook around crowdsourcing axios.com/facebook-fact-…

I hope FB, and other platforms, will do more of these!

13/
Finally, if you want to learn more, below is an always-updating doc with links to ALL of the papers @GordPennycook and I have written about misinformation / fake news (most of which also have Twitter thread summaries)

docs.google.com/document/d/1k2…

end/
Missing some Tweet in this thread? You can try to force a refresh.

Enjoying this thread?

Keep Current with David G. Rand

Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

Twitter may remove this content at anytime, convert it as a PDF, save and print for later use!

Try unrolling a thread yourself!

how to unroll video

1) Follow Thread Reader App on Twitter so you can easily mention us!

2) Go to a Twitter thread (series of Tweets by the same owner) and mention us with a keyword "unroll" @threadreaderapp unroll

You can practice here first or read more on our help page!

Follow Us on Twitter!

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just three indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3.00/month or $30.00/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!