The reception of this post has been very positive, thanks a lot to everyone for your kind words and for sharing it, but I also got some of the same criticisms I get every time I publish something, so I wanted to address them quickly. 1/n
So one complaint I get almost every time is that, if I think I'm right, then I should try to get my work published in a peer reviewed journal. The suggestion is often that, if I don't, it's because I'm afraid it wouldn't stand up to scrutiny. 2/n
There are many reasons why I generally don't want to submit my work to peer reviewed journals, some of which I discuss below, but let me start by saying that my fear of the towering intellects who run Nature and saw no problems with Flaxman et al.'s paper is not one of them. 3/n
First, if you follow me, you know that I regard pre-publication peer review as the eleventh plague of Egypt, the one that was so terrible that the Bible's authors thought preferable to omit it, lest it give God a bad name for unleashing it on mankind. 4/n
I think pre-publication peer review is terrible for science. It's a massive waste of resources, prevents interesting ideas from being published and getting discussed, makes various biases worse, etc. 5/n
Eventually, I plan to make the case against pre-publication peer review at length, but in the meantime you can read this excellent blog post by @RichardHanania (cspicenter.org/welcome-to-csp…) which explains many of the things I don't like about pre-publication peer review. 6/n
For instance, in my post on Flaxman et al.'s paper, I didn't shy away from most of the nasty details, but I also tried to write it in such a way that even people without a technical baggage could follow the argument. This would have been impossible in a scientific journal. 7/n
For another take on why pre-publication peer review is bad, you can also have a look at @lastpositivist and @remcoheesen's paper on the topic. There is no lack of arguments against this antiquated system! 8/n academic.oup.com/bjps/advance-a…
In any case, if my ideas don't stand up to scrutiny, anyone is welcome to criticize them. There is no need for pre-publication peer review for that. But if I were you, I wouldn't be holding my breath... 9/n
I'm not going to waste my time writing a paper that will not be as good as what I can publish on my blog because I would have to deal with bullshit constraints and will most likely be rejected for bad reasons anyway. I prefer to do something more productive with my time. 10/n
There are some things I plan to write and submit to peer reviewed journals, but that's just because I want them to have an impact on policy and, given the irrational fetishism of peer review among scientists and journalists, they won't unless I do that. 11/n
As some people suggested, I could just send a letter to Nature and explain the problems I found in Flaxman et al.'s paper. This would not take as much time as writing a whole paper and it could still help correct the record. 12/n
I did think about that, and I'm still not ruling that out entirely, but I'm not sure I will because I fear it will also be a waste of time. I just don't trust Nature's editors to judge my work on the merits, especially since it's not flattering for them and I'm a nobody. 13/n
Note that I did send a letter to the editor of the New England Journal of Medecine a few months ago to explain my concerns about Boulware et al.'s study on HCQ, but it was rejected even though I was clearly right, so I just wasted my time. 14/n necpluribusimpar.net/hydroxychloroq…
If someone with the relevant credentials wanted to co-author a letter to Nature, I might consider it because then we'd be taken seriously, but nobody is paying me to do this stuff and I can't spend too much time on something that I think has a very low chance of success. 15/n
Anyway, I understand scientists who submit to journals, they just have to play this game if they want to have a career in academia. But I have no desire to become a professional epidemiologist, and don't care enough about this topic to invest more time in it, so I won't. 16/n
Finally, there is the inevitable "you're a philosopher and you're arguing against scientists who published in one of the most prestigious scientific journals in the world" argument. 17/n
I agree with the critics that it doesn't seem fair for a philosopher to criticize epidemiologists. However, I was alone and there were 15 of them, so I'd say the game was, if not equal, at least not as unequal as this initial description made it sound 😏 18/n
More seriously, I get this "argument" every time I publish technical work that's critical of the published literature. Every. single. time. If you don't have anything interesting to say, just don't say anything, don't embarrass yourself like that. 19/n
I could point out that many philosophers do technical work and are totally capable of understanding scientific papers, which is true but irrelevant, because the truth is that any intelligent person who is sufficiently interested in a scientific question can do that. 20/n
Obviously, I'm not saying that credentials don't mean anything (though I think in some fields they're actually a negative signal of quality, as @knrd_z was saying recently), I'm just saying that the ad hominem fallacy is, well, a fallacy 🤷♂️ 21/21
By the way, I said that nobody is paying me for that stuff, but it's not strictly true since I put a tipping form at the end of my post the other day and several people have sent me something, so let me take this opportunity to thank them all.
Yes, I completely agree with this, like I said above I don’t think credentials mean *nothing*. But some people think not having any is automatically disqualifying and that's just stupid.
It's a critique of Flaxman et al.'s paper, which is constantly cited as proof that lockdowns are the only interventions that really works. It's already been cited almost 450 times even though it was only published in June. 2/n nature.com/articles/s4158…
It found that only lockdowns really had a meaningful effect on transmission in Europe during the first wave. Here is a chart that show the results in a few countries that were included in the study. 3/n
Unfortunately, this piece will only strengthen the myth that China engaged in massive and systematic fudging of COVID-19 data, when if you read it carefully it shows no such thing and doesn't tell us anything important that we didn't already know. 1/n
In particular, when the tweet says that China underreported COVID-19 numbers, what the article shows is just that, as there weren't enough tests, the authorities at times only reported cases that had been laboratory-confirmed by PCR but not cases identified by symptoms. 2/n
This is not new, I already discussed this at length in my essay back in September. We have known for *months* that the definition of a case used by the authorities changed several times, which affected the numbers. 3/n quillette.com/2020/09/06/the…
Wow, I hadn't actually read the Nature paper that allegedly showed that lockdowns had saved more than 3 million lives in Europe last Spring, but now that I have I'm utterly shocked this worthless piece of garbage was published. nature.com/articles/s4158…
Also, something didn't make sense about the results and the only explanation I could think of implied that the conclusion people drew from that study was totally unwarranted, but it was impossible to tell from their description of the results whether my hypothesis was correct.
So I downloaded the code and ran the analysis myself so I could take a closer look at the results and, surprise, it confirmed that my hypothesis was right, which presumably is why they neglected to describe this particular result in the paper or the supplementary materials...
Je suis contre le confinement, mais la baisse du nombre de morts en Suède est un artefact du délai d'enregistrement des morts. Compte tenu de l'évolution du nombre de cas, ça va inévitablement augmenter rapidement dans les jours qui viennent, il n'y a pas de magie. 1/n
D'ailleurs, quand on fait un simple ajustement pour tenir compte du délai dans l'enregistrement des morts, on voit très clairement qu'en réalité ça augmente rapidement. Encore une fois, je suis contre le confinement, mais il ne faut pas se raconter d'histoire. 2/n
De la même façon, le nombre de morts par million peut sembler faible, mais c'est le nombre par jour. En France, si on prend le nombre de morts cumulés sur l'année, ça va représenter au moins 10% de la mortalité normale à la fin de l'année. Ce n'est quand même pas rien. 3/n
The curve shows the daily number of cases, the dashed green line shows the start of the curfew in Paris and 8 other cities, the dashed purple line the extension of that curfew to 54 departments and the orange dashed line the start of the lockdown.
It's pretty clear that incidence started to fall before the lockdown was implemented, so while it may have accelerated the process, it would most likely have happened without it. It's even clearer when you look at what happened in Paris. The curfew may have played a role though.
The curfew made it illegal to leave your home between 9pm and 6am, but if it was responsible for the fall in incidence (which in my opinion it likely was at least to some extent), it's probably because bars and restaurants were closed, not because people couldn't go out per se.
This study relied on a crude approximation because we only have data on deaths by age buckets and it used life expectancy conditional on age without taking into account comorbidities or race. I would be amazed if the actual figure were more than half of this estimate.
And yes, I know that he shared another study for the UK that claims to take into account comorbidities and found an even higher estimate, but have you actually checked this paper? The authors lack data about so many things that they have to make wild guesses all over the place.
Even if we had individual data on age, race, sex and comorbidities, I think it would be problematic to use this methodology, because if you ask me the fact that someone died of COVID-19 indicates that his life expectancy was lower than people with the same age, comorbities, etc.