🧡 Mistakes In Defining Metrics 🧡

This is not an exhaustive list by any means, but these are 6 mistakes I see in defining metrics over and over....
1 - Metrics before Strategy

Your metrics are a reflection of your strategy. They help answer, is the strategy working? Metrics without strategy is looking at a bunch of random numbers. Define the strategy before you define your metrics.
2a - Definition Is More Important Than A Dashboard

People focus on "building a dashboard." 10X more important is choosing which metrics are important and defining those metrics well. Defining is more complicated than people think...
2b - For example, there are many ways to define a retention metric depending on your product. Your dashboard is a method to communicate your metrics, which is important, but useless if you choose and define them poorly.
3a - Outputs vs Inputs

Most metrics like a retention metric or revenue metric are output metrics. These are metrics you should monitor. Giving output metrics to teams as goals can be dangerous. They need to break them down into input metrics to make them actionable...
3b - When output metrics are given as goals, teams can often focus on the wrong inputs or thrash between inputs.
4 - Usage First not Revenue First

This is the most common version of outputs vs inputs. Usage creates revenue, revenue does not create usage. As a result, the most important metrics in terms of creating growth are not your revenue metrics, they are your usage metrics.
5a - Mixing Up Retention and Engagement

I see a lot of teams think retention and engagement are the same things. They are not. Retention is binary. It answers the question, was this person active within my defined time period? Yes or no. Engagement is...
5b - Engagement is depth. It answers the question, how active were they within the defined timed period? 0β†’N. Engagement is one of three major inputs into driving retention.
6a - Customers vs Users

A customer and a user is not the same thing in most business models. A customer is defined as the person/group that is paying you. A user is a person using the product.
6b - In subscription products, oftentimes there are multiple users associated with a single customer. Or people are users before they are a customer. You need to separate the definition and language between these two things for teams to clearly act on them.
Full list of these mistakes here -> brianbalfour.com/quick-takes/co…

What are some other ones you see often?

β€’ β€’ β€’

Missing some Tweet in this thread? You can try to force a refresh
γ€€

Keep Current with Brian Balfour

Brian Balfour Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @bbalfour

1 Oct 20
Almost every team I talk to says "Our data is mess!"

@crystalwidjaja (Fmr SVP BI & Growth at Gojek and @reforge Partner) wrote an excellent piece on the real root causes of analytics failures, and a step by step process on how she thinks about it: reforge.com/blog/why-most-…

πŸ§΅πŸ‘‡
First, if you don't know @crystalwidjaja and the story of Gojek, it's impressive. Crystal joined at 30 people and helped them scale to complete more daily food orders than Grubhub, Uber Eats, and DoorDash combined, and more trips than Lyft per day 🀯
There are a lot of symptoms of bad analytics/data:

1. Lack of shared language
2. Slow transfer of knowledge
3. Lack of trust
4. Inability to act on data quickly

...
Read 13 tweets
16 Sep 20
The Entertainment Value Curve - Awesome post by @ravi_mehta (Former CPO Tinder, FB, TripAdvisor) on product strategy in the social space and why TikTok is on πŸ”₯ and Quibi is πŸ“‰

Post -> reforge.com/blog/entertain…

Summary Thread πŸ‘‡πŸ‘‡πŸ‘‡
1/ Social content products are driven by entertainment value. Entertainment value is a combo of:

a: Social Value = the personal connection the viewer has with the content.

b: Production Value = quality of content relative to genre.

This creates The Entertainment Value Curve
2/ Different products live along this curve.

Snapchat on one end of the spectrum. Production value is low, but social value is very high with personal connection to everyone making the content.

Netflix on the other end. Production value high, social value low.
Read 11 tweets
14 Aug 20
Word of Mouth is critical, but notoriously hard to measure and therefore hard to influence. @ybhaijee (Former VP Growth @ Eaze) wrote an excellent post on @reforge about The Word of Mouth Coefficient with some analysis: reforge.com/blog/word-of-m…

Full Thread πŸ‘‡πŸ‘‡πŸ‘‡
When @ybhaijee and @tomaspueyo worked at Zynga together, they wanted a metric for Word of Mouth that was:

1. Based on Active Users
2. Stable enough to be used in forecasting
3. Could be influenced with product/marketing initiatives

The result was the Word of Mouth Coefficient Image
WOM Coefficient: Says that for every X active user, you will bet Y new organic users in that time period.

One key πŸ”‘ is that rather than basing the metric on new users (like K-Factor) they based it on active users. Retention is at the foundation of every growth loop...
Read 9 tweets
25 Jun 20
All product work is not equal. There is a common issue of over-applying one process, measure of success, and strategy to all product problems. @far33d and @onecaseman wrote a monster post talking that is well worth the read -> reforge.com/blog/product-w…

Full thread πŸ‘‡
"A common conflict I've seen is when product leaders try to apply a single process to all product work...growth and feature work are different and energy is wasted trying to force-fit into the same process, success metric, and approach." - @far33d
There are four types of product work beyond product-market fit:

1. Feature Work
2. Growth Work
3. Scaling Work
4. Product Market Fit Expansion

... Image
Read 18 tweets
17 Jun 20
"What got you here, won't get you there." @onecaseman and @far33d broke down the transition from Product Manager to Product Leader. Excellent insights from @iambangaly and @ravi_mehta as well.

Article -> reforge.com/blog/crossing-…

Thread πŸ‘‡πŸ‘‡πŸ‘‡
Great execution as a Senior Product Manager, does not mean you will make a good Product Leader.

"You can continue to put wins on the board and still not make the jump."

Four key transitions that Fareed and Casey talk about...
Transition #1: Depth in one type of product work β†’ Breadth across multiple types of product work

You need to go from being excellent at one type of product work, to having a wider vision of all product problems...
Read 16 tweets
12 Jun 20
It seems we are shifting into a new phase of this new world. @far33d and I wrote a piece on how to think about your retention strategy should shift with it (w/ contributions from @iambangaly @ElenaVerna @danhockenmaier )πŸ‘‡

reforge.com/blog/2020/6/2/…
There will be different strategies depending on where you sit on the headwind/tailwind spectrum.

Extreme Headwinds = habit has been broken w/ majority of your customers.

Extreme Tailwinds = habit has been accelerated w/majority of target customers and new audiences.
No matter where you are at on the spectrum, don't forget the principles of retention:

1. Retention is about building and deepening habits.
2. Retention is about usage, not revenue.
3. Retention is an output. To move retention, you need to focus on an input.
Read 15 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!

Follow Us on Twitter!