A long thread about the meandering, winding road to an accepted paper. Hope you have patience because this tale nearly starts 10 years ago with @DermotLynott.
In early 2013, I was a brand new assistant professor, just into my first tenure track gig. A call for replication studies had come out, which would ultimately become the special issue in Social Psychology (2014), which was the first all #RegisteredReports endeavor.
Nov 19, 2018 • 12 tweets • 3 min read
As a #ML2 author, very excited to see this paper finally out! The headline that 50% of effects replicate buries the lead a bit. For me, the major finding here concerns heterogeneity. What's heterogeneity, you ask? Gather round...
Heterogeneity describes how much effects being replicated vary from lab to lab, *beyond* sampling error. Sampling error says we expect that by chance, some labs overestimate the true effect size, others underestimate. Heterogeneity says how much more we expect effects to vary.
