Pat Kua Profile picture
27 Jan, 13 tweets, 3 min read
A question I hear a lot from engineering manager is, "How should I measure my software teams?" My initial answer, "I think you're asking the wrong question." Why? 👇
Many engineering leaders feel they should be measuring *something*, but it doesn't make sense to measure *anything* unless you know *why* you are measuring. This is the question to start with, "What do you care most about?"
Unfortunately, the answer to this is not easily distilled into a single number (or at least not that I've found). It's a subjective, biased and context-based answer which requires judgement
When you know what you care most about, then you might find a metric that might be an indicator. But be careful you don't use the metric as a short-hand for your goal
Because it's easy to make it a target... cue Goodhart's Law ("When a measure becomes a target, it ceases to be a good measure") en.wikipedia.org/wiki/Goodhart%… and people are *very* clever at gaming systems.
When I was studying #lean I remember a story of a call centre who wanted good customer service. They measured how long customers waited and made it a target to keep customers waiting no longer than 5 minutes on the telephone? Sounds good, right?
The number trended in the right direction. They managed to shorten the wait time for customers and over 3 months hit their target.
Customer waiting time fell, but overall customer satisfaction dropped dramatically. Why?
In order to answer quickly, customer service reps answered the telephone, but when they couldn't quickly resolve an issue, they had one of two responses 1) Escalate it or forward it to another colleague (not counted in initial waiting time), or to simply hang up 😱
I've been on the end of a telephone where it feels like this, bouncing from person to person, and sometimes simply being disconnected. The result? Higher customer frustration *and* more load on the overall system (I have to call back several times to get my query answered)
A single metric resulted in systematic degradation.
If you seek more guidance on this, this article I wrote still seems relevant: martinfowler.com/articles/useOf…
As put in the words of @simonsinek, "Start with Why" before jumping into the what

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Pat Kua

Pat Kua Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @patkua

15 Oct 20
I had an interesting question for the talk I did today for @agilesgorg about my view on developer productivity like BlueOptima. I hadn't heard of it before but doing some reading now and 😱. Here's a quick thread with some initial thoughts
First there's a reminder about en.wikipedia.org/wiki/Goodhart%… (When a measure becomes a target, it ceases to be a good measure), or the #TOC version of this, "Tell me how you measure me and I'll tell you how I behave"
Leaders and managers need to think really, really, really hard about the metrics they use and the obtuse ways that people will game them. Also... engineers have an astounding talent for gaming the system, so beware... but back to the tool
Read 14 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!

Follow Us on Twitter!