Series · Part 8 of 11
The Startup Building Series
The Metrics That Actually Matter: Retention, PMF Signals, and Monetisation
Most startup dashboards track the wrong things. Here's how to build a metrics framework that tells you whether you're actually building a business — not just a product.
There are two types of startup metrics: the kind that tell you how you're doing, and the kind that help you feel like you're doing fine.
Most dashboards are full of the second type. Downloads. Signups. Page views. Social followers. These numbers grow with effort regardless of whether you're building a business. They're easy to improve and easy to celebrate. They tell you almost nothing about whether the product is actually working.
The metrics that matter are uncomfortable. They measure whether users are choosing to come back when they don't have to. Whether they're changing their behavior because of your product. Whether they're willing to pay something meaningful for it.
The core framework: three layers of signal
Layer 1: Acquisition — are people finding you and trying the product?
Layer 2: Retention — are people who tried it coming back?
Layer 3: Monetization — are the right people willing to pay, and at what price?
Most founders over-invest in measuring Layer 1 because it's the most visible and easiest to improve. But Layer 2 is where the truth lives. A product with great acquisition and poor retention is a leaky bucket — you're filling it constantly and it never gets full.
Retention: the most important metric you probably aren't measuring correctly
Retention isn't "are people still in the database." It's "are people actively choosing to use the product?"
The right retention metric depends on the natural usage frequency of your product. For a daily-use app, measure Day 1, Day 7, and Day 30 retention. For a weekly workflow tool, measure Week 1, Week 4, and Week 12. For a monthly subscription, monthly active retention.
Rough benchmarks: a consumer product with 40%+ Day 30 retention is showing early PMF signal. A B2B tool with 80%+ Month 3 retention is showing strong PMF signal.
The flattening retention curve. This is the most important concept in early-stage metrics. When you plot retention over time, you'll see it drop from 100% on Day 0. The question is: does it keep dropping until it reaches zero, or does it flatten out and stabilize?
If it keeps dropping to near-zero, you don't have PMF. Everyone who tries it eventually leaves.
If it flattens — even at 20%, even at 15% — some cohort of users has decided this product is part of their life. That's the nucleus of a business. Your job is to understand who those people are and why they stayed, then build the product toward more of them.
Engagement: what are users actually doing?
Define your "core action" — the thing a user does when they're getting real value from your product. Not "logged in." The specific action that represents genuine use.
Then track it: what percentage of retained users are completing the core action in a given period? If this number is low, you have a product experience problem — users are coming back but not getting to the value.
Activation rate is the related metric at the start of the journey: what percentage of new users complete the core action in their first session? Low activation rates almost always come back to onboarding and the time-to-value question.
PMF signal metrics
The Sean Ellis test. Survey your active users: "How would you feel if you could no longer use this product?" Options: Very disappointed / Somewhat disappointed / Not disappointed. If 40%+ say "very disappointed," you have PMF signal. Below 40% and you're still searching.
Organic referral rate. What percentage of new users are coming from referrals from existing users, without incentive? Even a small organic referral rate — 10–15% — is a meaningful signal. It means users care enough to tell other people.
Monetization metrics: are you building a business?
Revenue is not the right early metric. The right early monetization metric is willingness to pay — evidence that users would pay, at a price point that makes the business model viable.
Once you're charging:
- Conversion rate from free to paid (for freemium models)
- Average revenue per user (ARPU) and its trend over time
- Churn rate — monthly and annual — and whether it's improving
- LTV:CAC ratio — customer lifetime value divided by cost to acquire. Above 3x is generally healthy for a SaaS model; below 1x means you're destroying value with every new customer
The metric to build your weekly review around
For most early-stage companies, the single most useful weekly metric is: weekly active users who have completed the core action in the last 7 days, by cohort.
If this number is growing and the retention curve is flattening, you're moving in the right direction. If this number is flat or declining despite new signups, you have a retention problem that no amount of acquisition spend will fix.
The dashboard that matters is small. The founder who deeply understands three metrics beats the founder who tracks forty.