Back to Home
Case Study

Retention & A/B Test Metrics

I modeled retention curves from raw variant data, calculated DAU and cumulative revenue for each, stress-tested an ARPDAU spike scenario, and arrived at a clear shipping recommendation.

2

Variants

3

Decision Scenarios

5

Data Points

Log

Trendline Model

08

Setup & Data

10K

Daily installs/variant

$0.50

ARPDAU (baseline)

5

Data points given

Log

Trendline model

DayVariant AVariant BDifference
141.00%46.00%B +5.00%
339.46%41.28%B +1.82%
738.28%37.63%A +0.65%
1437.31%34.65%A +2.66%
2836.33%31.67%A +4.66%

Variant A

R(d) = 0.41 − 0.014 × ln(d)

Slow start, flat decay — “the steady one”

Variant B

R(d) = 0.46 − 0.043 × ln(d)

High start, fast decay — “the flashy one”

Crossover at Day ~5.6: Before this day, B retains more users. After this day, A takes over and the gap keeps widening.

09

Results

Question A

Maximize DAU on Day 15

Variant A

63,874 vs 63,567

Older cohorts (6–14 days) dominate the Day-15 DAU calculation, and A is superior in all of them.

Question B

Maximize cumulative revenue (15d)

Variant B

$284,401 vs $279,802

Stronger early retention creates more total “user-days” in the first 15 days, generating $4,599 more revenue.

Question C

ARPDAU spike ($0.70 → $0.50, Day 15–25)

Variant A

$783,313 vs $775,751

Higher ARPDAU × growing DAU gap = multiplier effect. A’s long-tail retention wins by $7,562.

The Bottom Line

Short-term campaign? Choose B. Its strong early retention generates more revenue in a 15-day window.

Long-term game? Choose A. My model shows A overtakes B at Day ~5.6 and never looks back. By Day 15, A leads by 307 DAU; by Day 30 the gap reaches thousands. Combined with $4,599 higher cumulative revenue (15d) and a $7,562 advantage under the ARPDAU spike scenario, A is the clear choice for any product built to last.

thanks to Peak Games

Interested in working together?

I’m looking for PM internship opportunities where I can learn fast and contribute from day one.