>50% of PM interviews now ask metrics questions.
But not all metrics questions are the same.
5 categories + 16 sub-categories to know:
But not all metrics questions are the same.
5 categories + 16 sub-categories to know:
๐ฆ๐๐ฐ๐ฐ๐ฒ๐๐ ๐ ๐ฒ๐๐ฟ๐ถ๐ฐ๐ (๐ฎ๐ญ% ๐ผ๐ณ ๐พ๐๐ฒ๐๐๐ถ๐ผ๐ป๐)
Three major flavors here:
Product launch success: Measuring launching GPT-5.
Feature success: Measuring a mobile payment feature.
Business model success: What would you look at if we launched a marketplace?
Three major flavors here:
Product launch success: Measuring launching GPT-5.
Feature success: Measuring a mobile payment feature.
Business model success: What would you look at if we launched a marketplace?
๐๐ถ๐ฎ๐ด๐ป๐ผ๐๐๐ถ๐ฐ๐ (๐ฎ๐ฎ% ๐ผ๐ณ ๐พ๐๐ฒ๐๐๐ถ๐ผ๐ป๐)
Investigating issues when metrics drop.
Sudden drops: IG Stories dropped 5% overnight. Approach?
Gradual declines: Monthly retention declining 6 mos. Why?
Unexpected changes: Feature 30% โ 60% engagement. WDYD?
Investigating issues when metrics drop.
Sudden drops: IG Stories dropped 5% overnight. Approach?
Gradual declines: Monthly retention declining 6 mos. Why?
Unexpected changes: Feature 30% โ 60% engagement. WDYD?
๐๐
๐ฝ๐ฒ๐ฟ๐ถ๐บ๐ฒ๐ป๐๐ฎ๐๐ถ๐ผ๐ป (๐ญ๐ต% ๐ผ๐ณ ๐พ๐๐ฒ๐๐๐ถ๐ผ๐ป๐)
A/B testing and measurement strategy.
A/B test design: How design A/B test for new onboarding flow?
Measurement strategy: Testing social feature, etc
Statistical rigor: A/B results show conflicting signals?
A/B testing and measurement strategy.
A/B test design: How design A/B test for new onboarding flow?
Measurement strategy: Testing social feature, etc
Statistical rigor: A/B results show conflicting signals?
๐ ๐ฒ๐๐ฟ๐ถ๐ฐ ๐๐ฒ๐ณ๐ถ๐ป๐ถ๐๐ถ๐ผ๐ป (๐ฎ๐ฐ% ๐ผ๐ณ ๐พ๐๐ฒ๐๐๐ถ๐ผ๐ป๐)
Defining metrics to measure success:
- User engagement on video (engagement)
- Customer support success (business)
- Search relevance (technical)
- Fortnite's new season launch (design)
Defining metrics to measure success:
- User engagement on video (engagement)
- Customer support success (business)
- Search relevance (technical)
- Fortnite's new season launch (design)
๐ง๐ฟ๐ฎ๐ฑ๐ฒ-๐ข๐ณ๐ณ ๐๐ป๐ฎ๐น๐๐๐ถ๐ (๐ญ๐ต% ๐ผ๐ณ ๐พ๐๐ฒ๐๐๐ถ๐ผ๐ป๐)
Balancing priorities and constraints:
1. Increase premium revenue, how measure trade-offs?
2. Lower signup friction attracts worse users, evaluate?
3. Slow app to add complex feature, evaluate trade-off?
Balancing priorities and constraints:
1. Increase premium revenue, how measure trade-offs?
2. Lower signup friction attracts worse users, evaluate?
3. Slow app to add complex feature, evaluate trade-off?
A lot of people get good at 1-2 types (eg success metrics + diagnostics) but they aren't good at all 5.
Make sure your practice covers every type.
Should I share all my interview cheatsheets?
Make sure your practice covers every type.
Should I share all my interview cheatsheets?
โข โข โข
Missing some Tweet in this thread? You can try to
force a refresh
ใ
