I spend most of my time these days helping extremely frustrated UX leaders try desperately to push past the “research=validation” boundary with their leadership.
It’s really a dangerous mindset to let grow.
There are better ways to position research. We’re much smarter now.
User research ≠ usability testing.
Teams using usability testing as their only research method limit their value.
(If I accomplish anything in this lifetime, it will be to get people to stop saying “user testing.” We’re not testing users. We’re testing designs.)
When every respondent brings their own meaning and context to a question, you can’t aggregate the answers. You’re aggregating apples, oranges, watermelons, and bees. What’s the average of all that mean?
Satisfaction measures are literally garbage measures.