This is not an exhaustive list by any means, but these are 6 mistakes I see in defining metrics over and over....
1 - Metrics before Strategy
Your metrics are a reflection of your strategy. They help answer, is the strategy working? Metrics without strategy is looking at a bunch of random numbers. Define the strategy before you define your metrics.
2a - Definition Is More Important Than A Dashboard
People focus on "building a dashboard." 10X more important is choosing which metrics are important and defining those metrics well. Defining is more complicated than people think...
2b - For example, there are many ways to define a retention metric depending on your product. Your dashboard is a method to communicate your metrics, which is important, but useless if you choose and define them poorly.
3a - Outputs vs Inputs
Most metrics like a retention metric or revenue metric are output metrics. These are metrics you should monitor. Giving output metrics to teams as goals can be dangerous. They need to break them down into input metrics to make them actionable...
3b - When output metrics are given as goals, teams can often focus on the wrong inputs or thrash between inputs.
4 - Usage First not Revenue First
This is the most common version of outputs vs inputs. Usage creates revenue, revenue does not create usage. As a result, the most important metrics in terms of creating growth are not your revenue metrics, they are your usage metrics.
5a - Mixing Up Retention and Engagement
I see a lot of teams think retention and engagement are the same things. They are not. Retention is binary. It answers the question, was this person active within my defined time period? Yes or no. Engagement is...
5b - Engagement is depth. It answers the question, how active were they within the defined timed period? 0βN. Engagement is one of three major inputs into driving retention.
6a - Customers vs Users
A customer and a user is not the same thing in most business models. A customer is defined as the person/group that is paying you. A user is a person using the product.
6b - In subscription products, oftentimes there are multiple users associated with a single customer. Or people are users before they are a customer. You need to separate the definition and language between these two things for teams to clearly act on them.
Almost every team I talk to says "Our data is mess!"
@crystalwidjaja (Fmr SVP BI & Growth at Gojek and @reforge Partner) wrote an excellent piece on the real root causes of analytics failures, and a step by step process on how she thinks about it: reforge.com/blog/why-most-β¦
π§΅π
First, if you don't know @crystalwidjaja and the story of Gojek, it's impressive. Crystal joined at 30 people and helped them scale to complete more daily food orders than Grubhub, Uber Eats, and DoorDash combined, and more trips than Lyft per day π€―
There are a lot of symptoms of bad analytics/data:
1. Lack of shared language 2. Slow transfer of knowledge 3. Lack of trust 4. Inability to act on data quickly
The Entertainment Value Curve - Awesome post by @ravi_mehta (Former CPO Tinder, FB, TripAdvisor) on product strategy in the social space and why TikTok is on π₯ and Quibi is π
Word of Mouth is critical, but notoriously hard to measure and therefore hard to influence. @ybhaijee (Former VP Growth @ Eaze) wrote an excellent post on @reforge about The Word of Mouth Coefficient with some analysis: reforge.com/blog/word-of-mβ¦
Full Thread πππ
When @ybhaijee and @tomaspueyo worked at Zynga together, they wanted a metric for Word of Mouth that was:
1. Based on Active Users 2. Stable enough to be used in forecasting 3. Could be influenced with product/marketing initiatives
The result was the Word of Mouth Coefficient
WOM Coefficient: Says that for every X active user, you will bet Y new organic users in that time period.
One key π is that rather than basing the metric on new users (like K-Factor) they based it on active users. Retention is at the foundation of every growth loop...
All product work is not equal. There is a common issue of over-applying one process, measure of success, and strategy to all product problems. @far33d and @onecaseman wrote a monster post talking that is well worth the read -> reforge.com/blog/product-wβ¦
Full thread π
"A common conflict I've seen is when product leaders try to apply a single process to all product work...growth and feature work are different and energy is wasted trying to force-fit into the same process, success metric, and approach." - @far33d
There are four types of product work beyond product-market fit:
1. Feature Work 2. Growth Work 3. Scaling Work 4. Product Market Fit Expansion
"What got you here, won't get you there." @onecaseman and @far33d broke down the transition from Product Manager to Product Leader. Excellent insights from @iambangaly and @ravi_mehta as well.
It seems we are shifting into a new phase of this new world. @far33d and I wrote a piece on how to think about your retention strategy should shift with it (w/ contributions from @iambangaly@ElenaVerna@danhockenmaier )π
There will be different strategies depending on where you sit on the headwind/tailwind spectrum.
Extreme Headwinds = habit has been broken w/ majority of your customers.
Extreme Tailwinds = habit has been accelerated w/majority of target customers and new audiences.
No matter where you are at on the spectrum, don't forget the principles of retention:
1. Retention is about building and deepening habits. 2. Retention is about usage, not revenue. 3. Retention is an output. To move retention, you need to focus on an input.