Product Analytics Basics
Level 5 Β· Shipping and measuring
What product analytics measures, and how events turn into charts. Why one north star number beats a page of numbers that only go up.
Course contentsLesson 12 of 13
Level 1 Β· The job
Level 2 Β· Where the product is going
Level 3 Β· Finding the right problem
Level 4 Β· Choosing what goes first
Level 5 Β· Shipping and measuring
After this lesson you can
- Pick the few events worth tracking
- Choose a north star metric
- Spot a vanity metric
12 mincovers 3 glossary entries
Worth reading first: Feature Launch and Adoption
What product analytics can and cannot tell you
Product analytics is measuring what users do inside a product. The product records events, such as signing up, tapping a button or buying. Charts then show how many people do each step, where they stop and who comes back. If 1,000 people start sign-up each week and 400 finish, it shows where the other 600 stopped.
Start from a question, not from the events. Which step of sign-up loses the most people? Do users who save a search come back more often? Each question needs two or three events. Tracking every click with no question in mind gives you a huge pile of data and no answers.
Name events clearly and the same way every time. Signed up, search saved, order placed. A year later, nobody will remember what btn_click_7 meant. A short list of events, each with a plain name and a note on when it fires, is worth more than a thousand vague ones.
A north star metric is the one number that best shows the value users get. For a home rental site, it might be nights booked. When it grows, the business usually grows with it. Under it sit input numbers each team can push, such as new guests, repeat guests and homes listed.
A vanity metric is a number that goes up and tells you nothing about what to do. Page views and total sign-ups since launch are the classic ones. Total sign-ups can only ever rise, even while every new user leaves after a day. Ask: if this number fell, what would we change? If nothing, it is vanity.
Analytics shows what people do, not why. A chart says 60% stop at the phone number step. It cannot say whether they found the field confusing, did not trust the app with their number, or just got called away. That is where user talks and feedback come back in, and the two together give the full picture.
Worked example
Lucy finds the leaking step
Lucy's analytics show 1,000 people start sign-up each week and 400 finish. 450 of the 600 who quit stop at the phone number step.
She makes the phone number optional. Finished sign-ups rise to 640 a week. Her north star, weekly active teams, rises 9% over the next month.
The words for this lesson3
Check yourself
Why is the total of sign-ups since launch a vanity metric?
Finished this lesson?
Marking it complete also marks its 3 glossary entries learned, which updates your roadmap and your saved page. 0 are already marked.