Profile picture
Chris Chambers @chrisdc77
, 3 tweets, 2 min read Read on Twitter
The Reproducibility Project: Cancer Biology, which set out to replicate 50 studies, will complete with 18.

A major pitfall was that many of the original studies were so vaguely reported that replication became practically impossible. Just process that.

sciencemag.org/news/2018/07/p…
Expect a lot of hemming & hawing by the cancer bio community over this, & a huge amount of special pleading. But the fact is that failing to get replicability out of the gates casts a long shadow on the field. Hopefully this will prompt leaders w/ vision in that community to act.
It's time for psychologists to help biologists w/ reproducibility

TOP guidelines cos.io/top/
Registered Reports cos.io/rr/
OSF Badges osf.io/tvyxz/wiki/hom…
PRO Initiative opennessinitiative.org

All created by psychologists, for everyone. Use them.
Missing some Tweet in this thread?
You can try to force a refresh.

Like this thread? Get email updates or save it to PDF!

Subscribe to Chris Chambers
Profile picture

Get real-time email alerts when new unrolls are available from this author!

This content may be removed anytime!

Twitter may remove this content at anytime, convert it as a PDF, save and print for later use!

Try unrolling a thread yourself!

how to unroll video

1) Follow Thread Reader App on Twitter so you can easily mention us!

2) Go to a Twitter thread (series of Tweets by the same owner) and mention us with a keyword "unroll" @threadreaderapp unroll

You can practice here first or read more on our help page!

More from @chrisdc77 see all

Profile picture
Delighted to be able to announce, at last, the official launch of our Replications policy at @RoyalSociety Open Science, modelled on @hardsci's Pottery Barn rule for scientific journals blogs.royalsociety.org/publishing/rep…
The aim of this initiative is two-fold: 1st to provide a home for methodologically sound replications, regardless of results, for both planned & already-conducted studies. And 2nd, to ensure that journals are held to account for the replicability of the research they publish.
In doing so we want to unlock the vast unpublished filedrawer of methodologically sound replication studies that have already been conducted in psychology & cognitive neuroscience. If you do research then you probably have at least one of these yourself.
Read 5 tweets
Profile picture
@BrianWansink Hi Brian. I think the claim that you only made “mistakes” is questionable, and in the interests of posterity I’m now going to explain why, using a documented example of our interaction with you. /1
@BrianWansink Back in March 2017, @sTeamTraen noticed strange inconsistencies in a paper you published the previous year in Frontiers in Psychology called “How traumatic violence permanently changes shopping behavior”
steamtraen.blogspot.com/2017/03/cornel… /2
@BrianWansink @sTeamTraen We requested the data from you on 16 March 2017. We did this because Frontiers was a TOP guidelines signatory and has a policy stating that “materials, data, and code described in published works should be made available, without undue reservation, to any qualified researcher” /3
Read 19 tweets
Profile picture
Thread on two research transparency initiatives we are launching today at the journal Cortex, where I serve as an editor. This is a big day for us, in preparation for a long time. /1
The initiatives are the Transparency and Openness Promotion (TOP) guidelines and Badges for Open Practices /2
The TOP guidelines are a self-certification scheme in which journals declare their adherence to a series of modular standards for enabling research transparency & reproducibility. In short, TOP is about being transparent about the level of transparency the journal requires. /3
Read 12 tweets

Related threads

Profile picture
“Major cause of Poverty is Corruption” - VP Osinbajo #NEDG #BON #VPDebate. This is a grave lie. I have addressed this before. Corruption is everywhere in the world including in USA. Lack of productivity is what causes Poverty. This admin weaponize Poverty & lies a lot.
If the current admin mean well for Nigeria and have kept their promises to Nigerians, this debate is done already. All they need do is point to what they have done and justify the need to complete their work. It is as easy as that. They have failed. Simple. #NeverAgain
Corruption is not about stealing public funds alone. Nepotism, Abuse Of Office, subjugation of the rule of Law, religious bigotry etc are part of the catalytic factors that promote poverty and cripple productivity. The deliberate weakening of our institution is a critical factor.
Read 40 tweets
Profile picture
Many Labs 2: 28 findings, 60+ samples, ~7000 participants each study, 186 authors, 36 nations.

Successfully replicated 14 of 28 psyarxiv.com/9654g

ML2 may be more important than Reproducibility Project: Psychology. Here’s why...

@michevianello @fredhasselman @raklein3
ML2 minimized boring reasons for failure. First, using original materials & Registered Reports cos.io/rr all 28 replications met expert reviewed quality control standards. Failure to replicate not easily dismissed as replication incompetence. psyarxiv.com/9654g
Second, the total ML2 replication median sample size (n = 7157) was 64x original median sample size (n = 112). If there was an effect to detect, even a much smaller one, we would detect it. Ultimate estimates have very high precision. psyarxiv.com/9654g
Read 15 tweets
Profile picture
I stand by what I've said on racism in the Labour Party and won't be bullied into silence, not least because my family have experienced racism too. Jeremy Corbyn himself has said it is a problem Labour has not properly dealt with. If Len McCluskey doesn't like that, so be it. /1
Len McCluskey asks for "serious evidence" of institutional discrimination in the Labour Party against Jewish people - I set out in detail why it is wholly justified to reach this conclusion many weeks ago here independent.co.uk/voices/labour-… /2
Instead of attacking the victims of racism, our values dictate that we stand up for them -that is what I have done. Its shameful the General Secretary of the union of which I am a member should make a personal and political attack against me instead of facing up to this issue. /3
Read 4 tweets
Profile picture
Cancer is sustained abnormal growth, the loss of tightly regulated mechanisms to control cell division and growth.

Every species of multicellular organism gets #cancer.
Sharks.
Naked mole rats.
Lobsters.
even trees.

Let's talk about tree cancer.
When a tree is injured, infected, or stressed, the cells affected can undergo a loss of normal function and out of control growth. These outgrowths show poor cellular organization, producing odd wood-grain patterns and blobby outgrowths we call burls.
The similarities to mammalian cancer is obvious in a side-by-side comparison of tumor and burl.
Read 6 tweets
Profile picture
Five hours in @Reagan_Airport and still here; twice rebooked due to thunderstorms—hope I make it to Boston tonight for tomorrow's IEEE #reproducibility workshop.
As the @IEEEorg steps into the #reproducibility discussion, I'm really hoping they'll pay attention to terminology—"Terminologies for Reproducible Research" arxiv.org/abs/1802.03311
My assessment after reviewing literature from more than a dozen fields is that the predominant usage for #reproducibility is “same data+same methods=same results.”
Read 10 tweets
Profile picture
FASCINATING analysis of the landscape of immuno-oncology trials, from @Annals_Oncology. h/t @nickhaining watermark.silverchair.com/mdx755.pdf?tok…
Remarkable findings: >2000 agents, >900 in clinical stage, against 300 targets, from >800 companies.
>3000 trials with combined target accrual of over half a million (you read that right) patients.
Read 8 tweets

Trending hashtags

#Syria #disability #Metoo #BigData #ACA #AccidentsWillHappen #healthcare #blockchain #NeilGorsuch #MegynKelly #yourewelcome #SaudiArabia #Erdogan #racism #WhiteHouse #PepeAguilar #millionaires #startup #Resistance #Kill #cancer #CarlosSalinas #neighbors #CollateralDamage #strangerswithempathy

Did Thread Reader help you today?

Support us! We are indie developers!

This site is made by just three indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member and get exclusive features!

Premium member ($3.00/month or $30.00/year)

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!