Discover and read the best of Twitter Threads about #replicability

Most recents (5)

Join us at #SIPS2022 tomorrow to help make rock solid tools for transparent neuroscience!
We believe the right kind of tools can make methods reporting smoother and less error-prone.
We’ll introduce the ARTEM-IS Web-App (beta) for you to try, and we can work on improving it! 🧵 A logo for ARTEMIS shows a ...
Accurate methods reporting is super important because different processing pathways can lead to different results, as we’ve shown in one multiverse analysis of N400s 🤔
(see how the Related version Reversed comparison has different outcomes in different pathways) Schematic showing the garde...
If we want to improve #reproducibility and #replicability in our field, we need to make sure we can accurately report what has been done - which path was taken through the Garden of Forking Paths?
Lots of reporting guidelines currently exist but… graph showing increase in n...
Read 8 tweets
Now out! New report examines Reproducibility and Replicability in Science, with recommendations for researchers, agencies, policy makers, journals, etc.
@theNASEM Terms like “reproducibility” and “replicability” are sometimes used as an umbrella word to encompass all related concerns. But often, researchers use each term to refer to a distinct concept. #ReproducibilityInScience
@theNASEM The committee defined #reproducibility as obtaining consistent computational results using the same input data, computational steps, methods, code, and conditions of analysis as an original study.
Read 9 tweets
Commentary by Dijksterhuis, author of original study on behaviour priming that failed to replicate in most recent @RegReports, falls into usual post hoc explanations and lack of falsifiability. 1/n… #replicability #opensciecne
All degrees of freedom that are required to make the effect significant post hoc were foreseeable a priori. Eg exclude those who reporting being suspicious of the study's intent. If this data was collected + the original theory state it's an unconscious effect, 2/n
then why wasn't this employed as an exclusion criterion? Author reports not expecting such a high rate of suspicion, but it if was a priori relevant the rate wouldn't matter or could have had a design contingency. 3/n
Read 5 tweets

Related hashtags

Did Thread Reader help you today?

Support us! We are indie developers!

This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3.00/month or $30.00/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!