Something I think about a lot is that studies don't get retracted because they're bad, they get retracted because they are famous
Don't get me wrong, they are ALSO bad. It takes a truly awful study to get a scientific journal to wrest itself free of apathy and inertia to take some action
But there are 1,000s of woeful papers
Thing is, no one is paid to catch bad research. It is a thankless, time-consuming task that at best earns you the mistrust of most of your peers
And so, no one does it methodically
I don't have a ton of free time, and I don't go out searching for every error-filled study. I suspect most other people involved in this area are the same based on various conversations
For someone to notice a bad paper, it has to be spread around quite a bit. In the news. Causing a social media storm
Most bad research isn't popular like that. It never gets read by more than a handful of people
Moreover, if the study is not getting news, NO ONE CARES
Journals aren't quick to act when the study is literally impacting policy in a way that could kill thousands - imagine how slow they move when it's a nothing of a study that's been read twice in 10 years
And that's why I say only famous research gets retracted. There are exceptions to the rule, of course, but generally it holds surprisingly well
Anyway, when people get mad about how the papers that are retracted tend to be the big flashy studies I just think that they are ignorant about how the whole error-checking in science thing works
Also, I cannot stress enough how foolish it makes you look if you say "why are you only going after THESE studies and not all the bad ones?"
Error detection in science is a job that pays in sleepless nights and ennui. No one pays us to do any of this
• • •
Missing some Tweet in this thread? You can try to
force a refresh
Very interesting study out of Denmark looking at SARS-CoV-2 reinfections:
- 0.65% symptomatic reinfections after 7 months
- in sensitivity analysis this doubled to 1.2%
- estimated ~80% short-term protection against reinfection
Studies like this make me very jealous of my Nordic colleagues. The authors had access to linked data for *the entire country of Denmark*, which is a pretty enormous strength of the research
Basically, they looked at every PCR test done in the first wave, and followed up every person to see if they had tested positive in the first, second, or both waves
The basic explanation here is that the original article looked at whether Google "residential" mobility data was correlated with COVID-19 death rates, and found no association
There are significant drawbacks with that methodology, some of which I outlined in a thread
Your daily reminder that "I'm pro-vaccine except for THIS one" is literally the most common anti-vax line there is
The second most common line is "I'm pro-vaccine but I'm also pro informed choice" usually followed by a slew of lies and misinformation portraying vaccines as dangerous
So many replies missing the point. There's a big difference between common talking points and actions - most anti-vaccine advocates SAY they are only against one vaccine but then come up with similar arguments against ALL of them
Interesting update on this paper published that purported to show that staying at home doesn't reduce COVID-19 deaths: less than a week after publication it already has a warning from the editors
Also, the authors appear to have responded to my twitter thread that was automatically uploaded to Pubpeer, which is pretty fantastic. Not sure this helps their case tho
"This is the best data available" is not really a defense about using inadequate data. If you don't have the data to answer a question, then it's not a surprise that your study fails to find an effect I think