A serious reasoning error that is particularly common among educated people is to argue that if a study hasn't been done on a particular question we have 'no data', and therefore no basis on which to form beliefs or act.

This is incorrect and dangerous. 1/
There is almost always a reference class we can use to make a sensible prediction, and often we can reason about the causal mechanism directly.

To see how this is clearly wrong, consider these two extreme cases: 2/
a. Before a vaccine trial is conducted we have 'no data' on how likely it is to work.

But we can estimate the likelihood just fine! To start with we can just check the base rate of all vaccine trials.

What fraction of all vaccine trials in history have had +ve results? 3/
That gives a much better estimate than pure agnosticism.

b. Imagine now that the vaccine trial results have come back positive. But by chance all the vaccines were given in a blue room.

So, will the vaccine still work if given in a red room? I guess we have 'no data'.

So can we say nothing about about whether vaccines work in red rooms?

That is plainly ridiculous — we understand the causal mechanism and it doesn't involve room colour, so in fact we can give a near definitive answer to that question. 5/
I think this confusion is encouraged by people who study a bit of science but never study philosophy of science, so end up with a garbled epistemology — one more peculiar and foolish than whatever they started with. 6/
It is also encouraged by bureaucratized thinking, where the key is to avoid responsibility by never making personal 'judgement calls', and instead robotically following a cover-your-ass process

The error does most damage when we need to move fast in an uncertain environment. 7/
I've been thinking about it this week because I keep reading people on Twitter saying we have 'no data' and no ability to say whether COVID vaccines work after a single dose, because a trial studying a single dose hasn't been conducted.

What complete bollocks! 8/
To start with the Pfizer vaccine shows new infections crashing a week before patients received the second dose.

But even if they didn't, we could look at the base rate among all vaccines — what fraction of all vaccines offer protection for ~6 months after the first dose? 9/
More than half? Less than half? That is super informative!

Furthermore, we know how vaccines work, and people who are experts in immune reactions probably have a trained intuition on how likely one is to get immunity after a first exposure to an antigen. 10/
They'll also have a sense of how strong human immune reactions are to COVID surface proteins as compared to those on other viruses.

If they think one shot will work with 70% probability or 30% probability, that's a big update either way. 11/
Where something hasn't been studied extensively, the resulting probabilities are likely to fall between 20-80% rather than near 0% or 100%.

But that's normal and fine, and they can go in an expected value calculation nonetheless. 12/
(The folks above are separately making an error where they neglect risks in the status quo.

They call giving one dose 'risky' but if we were already planning to give one dose we could equally say two doses is wildly risky — because you only vaccinate half as many people!) 13/
All estimates are subjective probabilities.

No two cases are exactly the same, and we always have to reason from nearby analogies — which means we always have relevant information we can use to guide a decision. 14/
On top of that, inaction or 'going with the default' is as much an action as choosing the alternative!

Either way you're making an implicit estimate about how good the alternative is. 15/
If you go with the default you're not actually remaining agnostic until the 'data' come in — you're actively deciding that the alternative has a lower expected value.

So, don't let people get away with dodging the responsibility to choose using confused philosophy. 16/
Added: Some people are reading the above as an argument for the UK's one-dose-first vac approach.

As it happens I do think the UK is making the right call but nothing I've said above demonstrates that. I'm just saying you can and must decide using all the available evidence. a/
To support the UK's approach we'd look at all the evidence and conclude the prob of one dose working for 3-6 months is >50%, either 'cos this is true of most vaccines or we have reason to think it's true of this one.

Also need to address concerns around evolved immunity, etc. b/

• • •

Missing some Tweet in this thread? You can try to force a refresh

Keep Current with Robert Wiblin

Robert Wiblin Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!


Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @robertwiblin

10 Sep 20
'Ugh Fields' are a really useful concept. The existing write-up isn't targeted at ordinary readers so I'll have a go:

Have you ever had an overdue task, a task which isn't so bad in itself, but which you can't bring yourself to think about without feeling awful? 1/25
Most people experience this from time to time. Here's how things reach that dire point.

The first day the task is on your to-do list you don't end up starting it, because the short-term reward isn't large enough to overcome the psychological cost of doing so. 2/25
Maybe you feel low energy, maybe you're insecure about whether you can do a good job, maybe the task involves a bit of social awkwardness — it doesn't matter. You delay.

Unfortunately this task is one that only gets more unpleasant over time. 3/25
Read 25 tweets
5 Aug 20
I haven't written about COVID19 for a while. Here's some random updates on things I think we've learned and how my best guesses have changed: 🧵

a. I suspect official opposition to masks will be looked back on as both unjustified on the evidence we had, and very harmful. 1/n
In retrospect one could have figured this out at the time by giving more weight to:

i) the common-sense notion that physical barriers reduce the spread of germs, & ii) the views of authorities in the countries that were already doing the best job of controlling the disease. 2/n
But the issue is not entirely settled, and there's still a ~15% chance masks will be shown not to have helped, or even to have hurt.

That said, please for heaven's sake wear a face-mask everywhere you can, especially if you have to go indoors. 3/n
Read 36 tweets

Did Thread Reader help you today?

Support us! We are indie developers!

This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!

Follow Us on Twitter!