Skip to content
Topics and reading paths

Growth & updates

Roblox launch cohorts: measure an update without mixing sources

Launch-day CCU shows load and momentary scale, but not release quality. Product decisions need version cohorts, acquisition sources, and measures that have matured.

Focused deep dive

Concepts and tools in this topic 8
Original MARPLA conceptual illustration: Roblox launch cohorts: measure an update without mixing sources
Original conceptual diagram. Not a product interface or measured results.

Time and source matrix

Separate Home, Sponsored, Search, Friends, Teleport, and unique share links. Other does not identify an outside channel. Record build and release time, then compare matching weekdays and complete windows. A funnel can reveal a blocker quickly, ad attribution lags, D1 needs the next day, and D7 needs a week.

Blended D1 can move because source shares changed while each source remains stable. For a new build, inspect completion, errors, and performance immediately, D1 after maturity, and D7 later. Do not wait for D7 before rolling back data loss.

WhenDecisionMeasures
Opening minutes/hoursSafety and availabilityJoin, errors, receipts, persistence
Complete dayFirst loop and deliveryFunnel, source mix, reporting coverage
Mature D1New-cohort returnD1 by version/source
Mature D7+DurabilityD7, playtime, monetization with limits

Postmortem as a decision

Suppose an update and Sponsored campaign start together, CCU doubles, and blended D1 falls. Home D1 is stable, Sponsored is weaker, and the funnel shows pre-combat loss only for the new version on phones. The release has a mobile FTUE problem, while paid mix also lowers the average; advertising does not receive all the blame.

Use a MARPLA milestone, hypothesis note, and traffic comparison. Separate facts, limits, decisions, and one owner in the postmortem. Before/after does not establish causality when price, creative, and content changed together.

  1. Record build, release time, and channels.
  2. Review early safety measures.
  3. Compare sources in equally mature windows.
  4. Decompose mix and within-source change.
  5. Mark concurrent changes.
  6. Assign one decision and review date.

Primary sources

Put this into practice in MARPLA

Discussion0

Loading comments…