Last Chance to Join Data Science Interview MasterClass (this week) 🚀 | Just 2 spots remaining...

Practice SQL interview questions with our interactive SQL editor.

Solve Data & ML coding challenges in our online code editor.

Learn interview frameworks for stats, coding, machine learning, product cases

AI/ML Engineering

Learn interview frameworks for ML coding, system design, ML System design

Back to Course Home

AB Testing

Downloadable Code Files
Getting Started with Code Files

1
Introduction
2
Experiment Goals
3
Key Members
4
Product KPI
The North Star Metric
6
Driver Metric
Guardrail Metrics
Secondary Metrics
Segmentation Metrics
Launch Criteria
Experiment Data
Amazon AB Testing: Question
Amazon AB Testing: Solution
Code Walkthrough

State the Experiment Hypothesis
2
Hypothesis Statement
Chi-Squared Test of Independence: Question
Hypothesis Statement: Question 1
Hypothesis Statement: Solution 1
Hypothesis Statement: Question 2
Hypothesis Statement: Solution 2
Significance Level
Significance Level: Question
Significance Level: Solution
Statistical Power
Statistical Power: Question 1
Statistical Power: Solution 1
Statistical Power: Question 2
Statistical Power: Solution 2
Minimum Detectable Effect (MDE)
Minimum Detectable Effect: Question
Minimum Detectable Effect: Solution
Code Walkthrough

Design the Experiment
Randomization Unit
Sample Size Calculation
Sample Size Calculation: Question
Sample Size Calculation: Solution
Experiment Duration
Experiment Duration: Question
Experiment Duration: Solution
Code Walkthrough

Run the Experiment
Experiment Platform
Peeking at P-Values
Code Walkthrough

Assess Validity Threats
Stable Unit Treatment Value Assumption
Survivorship Bias
Sample Ratio Mismatch
Primacy Effect
Novelty Effect
Holiday Effect
Other Effects to Consider
AA Test
Code Walkthrough

Conduct Statistical Inference
Chi-Squared Test of Independence
Chi-Squared Test of Independence: Solution
Z-Test for Proportions
Z-Test for Proportions: Question
Z-Test for Proportions: Solution
T-Test for Means
T-Test for Means: Question
T-Test for Means: Solution
Code Walkthrough

Decide Whether to Launch
Interpret Test: Relative Difference
Launch Decisions
Decision Rule
Confidence Interval
Holdout Set
Code Walkthrough

Peeking at the P-Value
Failed to Generalize
Multiple Testing
No Statistical Signifiance
Statistical Parameters

Amazon Testing Recommender System
Improve Driver Enrollments on Uber

Home
/
courses
/
ab testing interview
/
hypothesis statement

Hypothesis Statement

Dan LeeDS/ML Instructor | Ex. Googler

Footer

Subscribe to our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Email address

Products

Courses
Coaching
SQL Pad

Support

Pricing
Blog

Legal

Terms
Privacy

© 2025 DataInterview, LLC. All rights reserved.