L13Course · Practitioner
A/B Evaluation
Statistically defensible product decisions.
Design doc, run, analysis, decision. Statistically defensible product decisions.
- 01
Design an A/B test.
- 02
Choose the metric.
- 03
Handle novelty effects.
- 04
Read the result honestly.
Prerequisites
- — Metrics for AI Products.
Pacing
The Lab.
- IModule
The lab
The design and analysis.
A Note from the Faculty
An A/B test without a statistical plan is a coin flip.