Nate Cohn Profile picture
10 Nov, 14 tweets, 3 min read
Some early theories on went went wrong with the pre-election polling this year
nytimes.com/2020/11/10/ups…
Before we go into what went wrong, let's just call a spade a spade here: this was a bad polling error. It's comparable to 2016 in size, but pollsters don't have the excuses they did last time.
This year's polls would have been *way* worse than 2016 with a 2016 methodology
There are really two halves of polling: the quality of the sample you get, and the adjustments you take to improve the representativeness of your sample.
Since 2016, pollsters got better at the adjustments, but the underlying sample got worse
To my mind, the easiest way to see it: the crosstabs on white voters nationwide, particularly whites without a degree
In 2016, the polls *did* show Trump doing way better among those voters.
In 2020, they did not. And they were dead wrong.
Same story with seniors.
So what happened? How did the samples get that much worse over the last four years, especially among white voters without a degree and seniors?
At this stage, it's really just speculation. We'll know more later--it's too early for an autopsy.
But here's some early speculation
Let's start with the most interesting bit of theorizing I encountered, from always interesting @davidshor.
He thinks it's the pandemic: Dems took it seriously, stayed home and started responding to polls more. GOP did not.
This theory's almost too smooth to be true, but it's elegant and fits a lot of things together.
Remember those studies that said Biden does better in a COVID hotspot?
Well, Biden didn't do better in COVID hotspots.
So maybe... that just means the polls were biased by COVID
Another interesting thing it helps explain.
Our 10/19 battleground polls were... pretty accurate!
So were the state polls conducted from Jan-Mar 20.
Now, maybe these polls were just as bad--and Trump actually led big back then!
Or maybe... the bias started since then Image
Shor also put forward some data that's at least plausibly consistent with it. The increase in Dem response clearly happens before the pandemic, in the primary. But maybe it held because of the primary Image
There are some other theories worth consideration, too.
It's possible that four more years of Trump did four more years worth of damage to the credibility of media/polls, creating a 'hidden Trump' vote that didn't really exist in 2016
On the flip side, another possibility is the resistance: the huge surge of political activism on the left. We know political engagement is correlated with survey response. Maybe the folks now donating 100 millions to Senate races are now taking polls way more than four years ago
And a final possibility--and ultimately a falsifiable one--is the turnout.
There were a lot of polls showing no LV/RV gap or even a D turnout edge. Not sure that will hold up with final data.
It certainly didn't hold up in FL, where we have great data already.
Anyway, I do think it will take a while to get some better answers here. If you're looking for a polling autopsy, then I'd say the 'body' of polling is still at the scene of the crime and won't make it to the morgue for a bit.
But the fact that we don't have an autopsy wouldn't stop the police from acknowledging the existence of a dead body, and we don't need to shy away from the obvious, either: the poll results were quite bad, and the final numbers won't fundamentally change that

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Nate Cohn

Nate Cohn Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @Nate_Cohn

11 Nov
I have no doubt--based on great data in FL/NV, and fuzzier data elsewhere--that GOP beat our final turnout estimates, and perhaps by a lot
Whether that's only a modest or big part of the polling error is still an open question
As an aside, I do wonder whether Democrats will rethink whether mail/early voting is a great deal, given how badly they get clobbered on Election Day--the time when low propensity, election winning voters go to the polls.
What if 'GOTV efforts' are a lot less powerful in mobilizing turnout than, say, everyone around you going to vote. Election Day being a nonevent in your neighbrhood/community/peer group may be demobilizing
Read 4 tweets
10 Nov
I haven't tweeted much about NC since Election Night, but with Cunningham conceding today let's take a look in at what's going on there
As far as I can tell, there are not nearly enough provisional and absentee ballots left for Ds to have a credible chance of making up their deficit.
Biden's down 75k votes; but there are 40k provisionals (won't all count) and maybe another 35k absentee ballots. Doesn't add up.
I do have pause about one thing, though, and I wonder whether it's a factor for any of the decision desks: some of the oddities in the results that I was tweeting about on Election Night
Read 8 tweets
10 Nov
Let's look at the change in turnout *so far,* based on number of votes cast compared to 2016 turnout.
Let's start nationwide, at a high level: areas in purple have counted *fewer votes* than 2016. Most of those areas still just have lots of votes left to count Image
As you can see, there's a ton of vote left to count in Chicago, New York state, and parts of MD/CA. I'd guess these ballots generally break Democratic, padding Biden's national lead.
One thing you might have overlooked: Philly.
For all the complaints about the count there... it's still the only place in PA that's counted fewer ballots than 2016 Image
Read 10 tweets
10 Nov
Biden's lead in Pennsylvania is up to .7 points--or about 45,000 votes. Biden could still be on track to approach a lead of about 100,000 votes when all of the votes are tallied up
nytimes.com/interactive/20…
Biden's lead will be padded by two main factors:
--there are still another 50k absentee ballots, predominantly in Philly and Pittsburgh, which will break overwhelmingly to Biden
--there are a large number provisional ballots, which will also break big for Biden
Earlier, there was ambiguity about just how Biden would fare in provisionals--based on data from overwhelmingly GOP counties. That ambiguity is gone.
Lancaster and Beaver county data shows Biden doing far better among provisionals. Allegheny County reported provs breaking 75-25
Read 5 tweets
8 Nov
Maricopa only adds about 7k ballots tonight, but they're Biden+11--assuming I did this right.
Obviously that's the wrong direction for the president, though many ballots still remain.
As always, the key is what kind of ballots we're looking at: late mail, election day drop off, provisional, or cured ballots. I haven't seen any clear indication of what this is, and absent that it's hard to be too sure of what to make of it
Given their typical sequence, this ought to be the last of the election day dropoff. If so, that's a very bad sign for Trump.
Read 8 tweets
7 Nov
There was a point on Tuesday night--not sure the time, you can probably find the tweet--when the eastern Ohio counties came in and I think I would have thought very hard about calling Trump the favorite
There was some conflicting info among white northerners at that point: MN/ME/NH were fine for Biden, WI was close, and rural OH/IA were worse than 2016. IDK how I would have sorted it out if forced.
But there was no way to know that this red wasn't bleeding to PA
I guess by that point we did have the AZ early vote, which would have kept the non-Rust Belt path alive. But it's not like Biden was an overwhelming favorite in WI at that point either, and I do think this was well before the needle came around on Georgia
Read 14 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!

Follow Us on Twitter!