My Authors
Read all threads
This hot take has been getting some attention today, so I think it's worth talking about why I think it's specious, and why the headline it comes with ("Lockdowns don't work") is probably wrong (and irresponsible) given the current empirical evidence.🧵
First off, @lymanstoneky asserts that no nationwide evidence from the US currently exists that lockdowns are effective. This is materially false. Here's our nationwide analysis showing lockdowns are associated w/dramatic declines in county infection growth rates in the raw data.
Here are the results once we control for all time-invariant features of counties, like baseline population health, & time-varying factors, like the availability of testing nationally, as well as state-level testing when we can.
Our analysis suggests that stay-at-home orders are highly effective, w/approx an 8.6% percentage point reduction in infection growth rates after two weeks. By 3-4 weeks out growth rates go negative, meaning the disease is receding. Updated preprint here: medrxiv.org/content/10.110…
Why the different results? The main reason is that the Lyman's analysis is focused on the effect of lockdowns on *deaths* (internationally), while we look at new *infections* (in the US). But looking just at deaths is problematic, for several reasons.
First, notice that Lyman does not use COVID19 death data in the analysis, but rather excess all-cause mortality. Probably b/c there's good reason to think that COVID deaths are heavily underreported internationally, both due to under-diagnosis & due to political pressures.
So even if we agreed that we should just look at COVID19 deaths, that variable is being measured here indirectly and with noise. This is especially a concern if lockdowns are associated with changes in deaths for other reasons (traffic accidents, pollution, domestic violence).
Second, deaths lag infections, and it's not clear by how much. Contrary to what the article asserts, we do not yet have a strong handle on the typical progression of the disease. That makes using deaths data for short-term policy analysis tricky at best.
Not to mention that the "peaks" that are being identified here are based off of extremely noisy data. Confidence bands (are these 95%? 90%? 80%? can't tell) around the estimates are broad. It's hard to know if the peaks even exist, let alone be sure of exactly when they occur.
Bottom line: should you draw strong conclusions from the fact that the peak of all-cause mortality is maybe earlier than could be attributable to lockdowns alone? Probably not.
Third, & this is particularly important: deaths data only capture *at best* the mortality costs of COVID, ignoring morbidity. It's likely that morbidity costs are high as well. Some of the reported side effects, even for those who recover, are horrifying: washingtonpost.com/health/2020/04…
So deaths data is no panacea. Is infection data perfect? No! We have problems with testing in this country. New infections are measured w/ substantial noise. But acting as if that this data is completely useless is specious as well.
But let's say for a sec you don't believe our results. *Even on its own terms*, the article's conclusion is misleading. The analysis argues no evidence for the efficacy of lockdowns exists. It does not follow that "lockdowns don't work". Absence of evidence != evidence of absence
@lymanstoneky does get one big thing right: stay-at-home orders come as a package with other social distancing measures. It's hard to disentangle the different effects of different measures. Our results should be interpreted as the effects of this bundle of policies as a whole.
Which is why the least convincing part of his analysis is the attempt to disentangle the effects of the different measures. We're going to need some fancy identification for this to be credible, & simply regressing lagged deaths on different interventions is not going to cut it.
What we definitely need to understand going forward is which policies are effective and which ones can be relaxed. Given the patchwork of government responses in this country we are likely to get much more evidence on this sooner rather than later.

/fin
I should also mention (and would have last night if I wasn't half asleep writing this thread) that the paper is joint work with my amazing co-authors James Fowler, @seth_j_hill, and Nick Obradovich.
Missing some Tweet in this thread? You can try to force a refresh.

Enjoying this thread?

Keep Current with Remy Levin

Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

Twitter may remove this content at anytime, convert it as a PDF, save and print for later use!

Try unrolling a thread yourself!

how to unroll video

1) Follow Thread Reader App on Twitter so you can easily mention us!

2) Go to a Twitter thread (series of Tweets by the same owner) and mention us with a keyword "unroll" @threadreaderapp unroll

You can practice here first or read more on our help page!

Follow Us on Twitter!

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3.00/month or $30.00/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!