Profile picture
Tom Stafford @tomstafford
, 11 tweets, 4 min read Read on Twitter
Many Analysts, One Data Set: Making Transparent How Variations in Analytic Choices Affect Results journals.sagepub.com/doi/10.1177/25… our 65 author collaboration is finally published in Advances in Methods and Practices in Psychological Science
As featured in this from @FiveThirtyEight "Science Isn’t Broken :It’s just a hell of a lot harder than we give it credit for." fivethirtyeight.com/features/scien…
And Nature News nature.com/news/crowdsour…
Full author list for yuks: R. Silberzahn, E. L. Uhlmann, D. P. Martin, P. Anselmi, F. Aust, E. Awtrey, Š. Bahník, F. Bai, C. Bannard, E. Bonnier, R. Carlsson, F. Cheung, G. Christensen, R. Clay, M. A. Craig, A. Dalla Rosa, L. Dam, M. H. Evans, I. Flores Cervantes, N. Fong,
M. Gamez-Djokic, A. Glenz, S. Gordon-McKeon, T. J. Heaton, K. Hederos, M. Heene, A. J. Hofelich Mohr, F. Högden, K. Hui, M. Johannesson, J. Kalodimos, E. Kaszubowski, D. M. Kennedy, R. Lei, T. A. Lindsay, S. Liverani, C. R. Madan, D. Molden, E. Molleman, R. D. Morey,
L. B. Mulder, B. R. Nijstad, N. G. Pope, B. Pope, J. M. Prenoveau, F. Rink, E. Robusto, H. Roderique, A. Sandberg, E. Schlüter, F. D. Schönbrodt, M. F. Sherman, S. A. Sommer, K. Sotak, S. Spain, C. Spörlein, T. Stafford, L. Stefanutti, S. Tauber, J. Ullrich,
M. Vianello, E.-J. Wagenmakers, M. Witkowiak, S. Yoon & B. A. Nosek.
Which includes @FrederikAust @mathewe @richarddmorey @EJWagenmakers and @BrianNosek (apologies to those who twitter handles I don't know)
4 years in the making - massive props to Raphael Silberzahn to leading us all through the process
Also, a great advert for preprints. Not only was the paper available years ahead of journal publication, but it already has 18 citations (according to google scholar). Think how valuable that speed of dissemination and credit is to ECRs
My two minute explainer on preprints tomstafford.staff.shef.ac.uk/?p=644
Missing some Tweet in this thread?
You can try to force a refresh.

Like this thread? Get email updates or save it to PDF!

Subscribe to Tom Stafford
Profile picture

Get real-time email alerts when new unrolls are available from this author!

This content may be removed anytime!

Twitter may remove this content at anytime, convert it as a PDF, save and print for later use!

Try unrolling a thread yourself!

how to unroll video

1) Follow Thread Reader App on Twitter so you can easily mention us!

2) Go to a Twitter thread (series of Tweets by the same owner) and mention us with a keyword "unroll" @threadreaderapp unroll

You can practice here first or read more on our help page!

More from @tomstafford see all

Profile picture
Thread, top five drone takedowns.
#5 Shotgun - simple, effective. A classic
#4 Eagle - Dutch authorities *were* training eagles to take down drones, but have since given up on this idea (either due to risk of injury, or difficulty training the eagles, reports vary) theverge.com/2017/12/12/167…
#3 Spear - thrown by medieval warrior at reenactment in central Russia. Link for full video:
Read 5 tweets
Profile picture
Facebook research: despite improvements in statistical techniques for causal inference from observational data, and even with massive statistical power, observational methods fail to capture causal effects revealed by direct experiment kellogg.northwestern.edu/faculty/gordon…
"Using data from 15 US advertising experiments at Facebook comprising 500 million user-experiment observations and 1.6 billion ad impressions..."
" The observational methods often fail to produce the same effects as the randomized experiments, even after conditioning on extensive demographic and behavioral variables"
Read 5 tweets

Related threads

Profile picture
Bright and early at the Presidential Strand, 'Are We Part of the Problem or the Solution?: Using Systems Approaches to Speak Truth(s) to Power(s) for Better or Worse.' #Eval18
Bob Williams: How could we make a system that speaks truth to power? We are trying to do that in real time this morning. We need to focus on boundaries. Setting the boundary is what speaks truth to power.
Many people think holism is about thinking and including everything, that is not a system, that is cosmology (history and study of universe), and even cosmologists have boundaries.
Read 57 tweets
Profile picture
Let's try something new: *7 days, 7 statistical misconceptions*.
Over the next 7 days I'll post about 1 statistical misconception a day. Curious to hear your favorite #statsmisconceptions, so feel free to add you own to this thread
Day 1: "Sample size has nothing to do with bias"
👆 is something I still hear regularly. This misconception seems to be based on the oversimplified idea that sample size only affects precision - something I was told repeatedly in the first years of my studies
Read 93 tweets
Profile picture
OK here is my take on the 'grievance studies hoax.' I think it shows that generally poorly reasoned, largely unfalsifiable papers with apparently absurd conclusions can get published in top journals in critical-studies-type fields. Fair enough. But it does NOT show a special ...
... kind of 'deep corruption' in such fields as compared to many other fields the hoax authors presumably regard as more 'reason and evidence based' or 'less ideological/political' (e.g., medicine? experimental psychology?). A whole thrust of the "replication crisis" in ...
... psychology, for example, has been that (a) seemingly absurd claims based on (b) insufficiently robust evidence to support such claims can get regularly published in (c) top journals (including Science! and Nature!), insofar as authors 'play the game' of the dominant ...
Read 33 tweets
Profile picture
Would a #PeoplesVote lead to social unrest? @johnmcdonnellMP claims that it will, but on what is this based?

theguardian.com/politics/2018/…

Let's look at some things that DO cause social unrest according to research 1/
Probably the most comprehensive study on social unrest in Europe, studying the period 1919-2008 this paper finds a link between austerity and social unrest. 2/

papers.ssrn.com/sol3/papers.cf…
"Using a panel data for 24 European countries covering the period 1919 to 2008, we show a clear link between the magnitude of expenditure cut-backs and increases social unrest. With every additional percentage point of GDP in spending cuts, the risk of unrest increases" 3/
Read 9 tweets
Profile picture
So, this morning @BarbicanCentre @Create_London & @artsemergency launch a report bringing together academic work on specific aspects of inequality in cultural jobs barbican.org.uk/whats-on/event… & createlondon.org/event/panic201… The news is not good
In the report createlondon.org/wp-content/upl… @OrianBrook @markrt & I look at a variety of data to think about why the cultural sector in the UK is so exclusive. We focus on class, with some intersections of gender and ethnicity, but obviously thats not every form of inequality!
First off we show many cultural occupations are marked by significant inequalities of class, gender & ethnicity, pay gaps based on gender and class, and regional inequalities with London as a major problem for inequality in the sector
Read 25 tweets
Profile picture
So #musicleeds is finishing up. Was in Leeds yesterday, shame I couldn’t stay. Looks like a great day which, in the shadow of the ECoC withdrawal debacle, was a real achievement to make happen.
But with “Music Cities” again being discussed, I want to sound a note of caution. To make the case for some critical reflection. And perhaps to read some of the findings from the last two decades (plus!) of “Creative City” experiences.
So – I don’t normally do this – but here’s a #thread alert.

And hey, executive summary: more research needed. So maybe others can pitch in on that.
Read 34 tweets

Trending hashtags

#troll #ChildRaising #openaccess #BrexitDeal #BlackIslamSyllabus #NACRISSISM #Brexit #NATO #LawnmowerParents #NoDealBrexit #SELFESTEEM #ibd #Eval18 #NeuroScience #crohns #SocialMedia #ulcerativecolitis #MALIGNANTNARCISSIST #statsmisconception #FightFatigue #NarcissisticPersonalityTraits #SPPS #EMPATHY #OpenData #statsmisconceptions

Did Thread Reader help you today?

Support us! We are indie developers!

This site is made by just three indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member and get exclusive features!

Premium member ($3.00/month or $30.00/year)

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!