Out in @TheLancet, results from the Oxford/AZN trials, including more detail on the low dose results. Notably, the low dose recipients "received their second dose after a substantial gap." Only 0.8% received a second dose within 8 weeks of the first. 1/5 thelancet.com/lancet/article…
Recall that the low dose results were only from adults 18-55, only during a short time window, and only in the UK. Per reviewer request, they restricted the standard dose analysis to a similar group. We still see separation (middle rows), but with more uncertainty. 2/5
Overall, the 62% result for the standard dose regimen appears robust, and meets pre-specified criteria (>50%). But I am still not sure what to make of the low dose result. Is it the longer gap between doses? The low dose? Both? And there remains no data for older adults. 3/5
Per the commentary, we will need more prospectively collected data on the low dose group, both to confirm a true biological effect, and to generate safety/efficacy data in older adults. Remember, these vaccines have big-time policy implications. 4/5 thelancet.com/lancet/article…
A final comment.... the paper is complicated. I fully recognize the complexities of doing science in a pandemic, but there is something to be said for standardization of trial protocols in advance, transparency, and simple study methods. Makes for a cleaner result. 5/5
Addendum. There are a few other things I could flag, like the procedures for combining results across trials.
But I have to go finish preparing a final exam for my survival analysis students! TTYL.
• • •
Missing some Tweet in this thread? You can try to
force a refresh
With respect to the AstraZeneca vaccine, I am guessing people think my objection is to science by press release, and that I want a peer-reviewed publication. But no, not really. What I want is reliable and definitive evidence to inform policies impacting millions. 1/4
If the answer is that AstraZeneca needs to go back and add a new half-dose arm to their trials so that they can prospectively evaluate its efficacy in diverse subgroups, then we have to carefully consider the value of a peer-reviewed publication at this moment. 2/4
We’ve written about this in @NEJM. Basically, there are risks to publishing results that are “promising but inconclusive.” Though it seems slower at the time, in the long run it is better to generate the conclusive evidence while we still can. 3/4 nejm.org/doi/full/10.10…
Astrazeneca/Oxford get a poor grade for transparency and rigor when it comes to the vaccine trial results they have reported. This is not like Pfizer or Moderna where we had the protocols in advance and a pre-specified primary analysis was reported. 1/5
AZN is evaluating their vaccine in multiple trials across the world, yet these are not embedded under a unified protocol. In fact, the trials seem to be quite different by country, in terms of populations, subgroups, etc. Based on the publicly available details I've seen. 2/5
With the exception of the US-based trial, I am not aware of details on how these trials are being monitored. Is there a centralized DSMB? Are they combining the accrued data? They seem to have combined events across Brazil and UK. Why not the other countries? 3/5
A short thread on vaccine efficacy versus vaccine effectiveness, covering:
- Idealized vs. real-world effects
- Direct vs. indirect effects
- Individual-level vs. population-level effects
- Phase III vs. Phase IV trials
👇👇👇
Phase 3 trials are conducted under idealized conditions. Everyone receives all doses on time, that have been properly stored, etc. The primary analysis is restricted, like to people without antibodies at baseline. We call the resulting estimate "vaccine efficacy." 2/8
Think "vaccine efficacy" as our best guess at the biological protection of the vaccine. When we talk about "vaccine effectiveness," this can refer to a few different things. One is "real-world effectiveness." If conditions are less than ideal, how well does the vaccine work? 3/8
One question I had with the Pfizer results - is it possible that all cases were in younger (risk-taking) adults? Unlikely, but I couldn't tell. So it's great to see a breakdown of those 95 cases across different subpopulations. Representation is important! 6/10
Nice safety profile, and participants will continue to be followed. Remember - evaluation of vaccine safety never stops, even after vaccines are approved and deployed. We have an adverse event reporting system to continually monitor all vaccines. 7/10
Another key point - the Moderna vaccine has been formulated to not require the same intensive cold chain as Pfizer's vaccine (mRNA is unstable!). This has the potential to greatly simplify the logistics of rolling out the vaccine. 8/10
Of course, I'll start with the topline result of 94.5% efficacy (90 placebo cases, 5 vaccinated cases). For a high efficacy vaccine, 95 cases is a lot of data. In event-driven trials, the number of cases matters more than the number of participants. 2/10
Both Pfizer and Moderna's vaccines are mRNA-based. Thus, it's reasonable that results are similar. Still great to see! This is exciting because mRNA vaccines are designed for pandemics but were previously unproven. Adding a new tool to our toolbox! 3/10
Big news from Pfizer, with apparent high efficacy (>90%) based on 94 confirmed COVID-19 cases at their interim analysis.
A thread on how I interpret this news. Briefly:
"Celebrate, but let the process play out over time as intended." 1/8 pfizer.com/news/press-rel…
Vaccine trials are "event-driven." They continue until enough endpoints have accrued (here, lab-confirmed *symptomatic* infections). Statisticians can take planned "early looks" at the data, and so allow us to tell if a product is working exceptionally well (or not at all). 2/8
When the vaccine is highly effective, we need less data to see it. While trials are planned for 150+ total events, this is what we need for a 60% efficacy vaccine. I say this because 94 events is a lot of data for a vaccine trial, and even more so when efficacy exceeds 90%. 3/8