The problem with 538's definition of "polling error" goes back to experimental design
That is, does this thing measure what we're saying it does?
In the case of "poll margin - election margin = poll error" they're assuming poll attempts to measure the final outcome. It doesn't!
If you're not a science person, and you're like "what does this mean?" Here's how I break it down
Polls measure *preferences* of decided voters, and *how many* undecided voters. That's it!
Elections, unlike polls, don't include undecideds. This means variables have changed!
Check out these polls from NV, 2018. How about NV-2? Poll is 16-23. Meaning ~61% undecided
Does this poll suggest that Amodei will probably win? Debatable. Does it suggest he'll probably win by about 7? No! Why? It tells us *nothing* about the 61% undecided. (He won 58-42)
First up, the general election forecast. This is basically a blended model of my lean-Trump and lean-Biden undecided models, with weight to the lean-Biden because there's evidence to suggest the undecideds - while fewer - will break D
Notably, in this forecast, Biden relatively easily wins the major swing states.
The most contentious states are Iowa, Ohio, Texas, and Georgia with Biden narrowly winning Iowa and Georgia and narrowly losing Iowa and Texas.
Remember, these are just probabilities, not concrete
Put another way, my forecast comes out like this.
I wouldn't be shocked if Trump held Iowa and Georgia, nor if Biden took Ohio and Texas. Beyond that, a close election in NC, PA, or FL? Not really seeing it being closer than 2-3 pts as of now
Who's ready for an election thread and a (statistically literate) poll analysis & update?
There's an OBSESSION with "what the polls missed" in 2016. If you follow me, you'd know: the polls weren't wrong - people just read them wrong.
2/x
That's part of why @FiveThirtyEight's statistically invalid analysis of
"poll margin - election margin = poll error"
Is so damaging. Not only is it logically and statistically invalid, it leads them/the public to believe the POLLS were wrong when that's likely not true.
3/x
In 2016, Hillary had a decent lead, IF YOU ONLY LOOKED AT MARGIN
But you'll note - this is important -IN NO SWING STATE DID SHE POLL ABOVE 47%
Compare that to 2020
Biden is polling at ABOVE 49% in MI, PA, WI, NH, MN, ME, FL, NC, NV (and above 50% in the first 6 of those)
1/x The polls weren't wrong, you just read them wrong.
The spread in a poll matters some. But a 50-47 lead (+3) is FAR MORE ROBUST than a 46-40 lead (+6)
People see a poll avg at 46-40, and when the result is 47-49, they say "pOlL wAS WrONg"
From +6 to -2?!? Off by 8!!!
Nope.
2/x
If the polls were "off" by 3 or 4 but the result of the election didn't swing because of it, no one would care, except pollsters. We wouldn't be talking about it.
Here's the most important question: what do polls measure?
3/x
This seems like a silly question, but think about it. What do polls measure?
Polls measure preference and plans.
What do polls not measure?
How/if undecided voters will vote.
It seems that people are criticizing polling for not measuring things it doesn't attempt to.