Multiple comparison problem, illustrated. #metascience

Bearded men more likely to be sexist. It's science!
How did they find that out?

By doing analysis until p < .05.

However, not everyone is this honest about the reporting. Most researchers don't tell you all the steps that led up to the magical number .05.
What about replications?

They found nothing, of course.
And which study do researchers remember and cite?

The cool study that find something interesting of course, not the boring replication. After all, science is about finding new and interesting things, not about finding things that are true! (End of sarcasm.)

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Peter Dahlgren

Peter Dahlgren Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @peterdalle

4 Mar 20
Under internationella kvinnodagen 8 mars kommer ofta, som på beställning, feltolkningar av statistik.

Den vanligaste är den om att kvinnor jobbar gratis efter ett visst klockslag (jämfört med männen).
Exempel från Aftonbladet:

"Kvinnors heltidslöner är i genomsnitt 10,7 procent lägre än mäns. [...] Omräknat till tid betyder det att kvinnor jobbar gratis efter klockan 16.09 varje dag, medan män får betalt för hela sin arbetsdag."

aftonbladet.se/debatt/a/70wrW…
Statistiken syftar på Medlingsinstitutets siffror som vägt samman alla mäns löner och alla kvinnors löner.

Löneskillnaden är mycket riktigt 10,7 procent.

Det här är riktigt bra data eftersom det är ett totalurval av hela statsapparaten! Privat sektor = mindre urval dock.
Read 24 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!

Follow Us on Twitter!