Andrew Ho Profile picture
Charles William Elliot Professor of Education, Harvard @hgse Testing, Measurement, Psychometrics, Statistics
Oct 23, 2022 13 tweets 5 min read
On NAEP Eve, my 3rd thread, on "learning loss." At 12AM, people expect NAEP will find "learning loss."
Are results about "learning loss" essential to inform us as we move forward?
Or is the concept of "learning loss," itself, damaging and hurtful?
To me, the answer is: Both. 🧵1/ When I say "learning loss," I try to create a "firewall" between what I say about systems and what I say about kids.
Evidence of "learning loss" shows the debts our society owes to kids. For kids and their parents & teachers, we must build from their strengths, their assets. 2/
Oct 22, 2022 18 tweets 9 min read
Let's talk "misNAEPery": Common misues of #NAEP results. Here are 3 types of misNAEPery to look out for on Monday's "NAEP Day":
1) correlation-is-causation (@EduGlaze's original definition)
2) psychometric misNAEPery
3) one-true-outcome misNAEPery.
🧵 1/ For each of these misNAEPeries, I try to distinguish between "high crimes" and "misdemeanors."
I used to get a little too gleeful in pointing out misNAEPery.
I now try to ask, "does it really matter?" or "what's the end goal?" before calling someone out for something "wrong." 2/
Oct 21, 2022 9 tweets 6 min read
Why is Monday’s “NAEP Day” so important? Don’t we already know about “learning loss” after our @CRPE_edu report and the September 1 @NAEP_NCES release? Here are three reasons why NAEP Day matters. 🧵1/
CRPE Report: crpe.org/wp-content/upl…
Sept 1 NAEP LTT: Reason #1: This is NAEP’s ONE JOB: Assessing Educational Progress. Below is my “four quadrants” framework for test purposes. NAEP sits in the upper left: monitoring progress.
scholar.harvard.edu/files/andrewho… 2/ Image
Mar 24, 2021 5 tweets 3 min read
Over 540 of my colleagues in education and measurement signed this letter asking @SecCardona for blanket state testing waivers.

I usually agree with them. Here, I do not.

Am I Charlie Brown trying to kick Lucy's football? Or do they not see that we have another placeholder? Image In this @FutureEdGU essay, I argue that state tests have a valuable role to play when stakes are low and funding is plentiful. future-ed.org/a-smart-role-f…
Mar 23, 2021 8 tweets 4 min read
State testing programs are heading for an iceberg. We can still turn the ship. I wrote a short essay at @FutureEdGU about how. There is even an 8-step plan. 1/8 The anti-accountability movement has earned a well-deserved victory. I am glad! But its momentum has it poised to strike state tests at exactly the time when tests can be most useful--for allocating unprecedented federal support. 2/8
Feb 26, 2021 4 tweets 2 min read
Monday's @usedgov test-score mandate leaves states drifting into a validity buzz saw.

Let's talk solutions. I propose 3 metrics that all states should report for every school:

1) The Match Rate
2) The Fair Trend
3) The Blind Spot

Feedback welcome.

scholar.harvard.edu/files/andrewho… Image Without metrics like these, valid interpretations of school and district test scores will be impossible. States trying to "target resources and supports" per @usedgov intentions will fail. Image