Data Scientist Interview Prep

Data scientist interviews at 74 companies converge on a surprisingly narrow core: A/B testing, statistics, ML, and product sense make up over 55% of questions. The candidates who bomb aren't missing technical chops. They're the ones who can't walk a PM through a SHAP waterfall plot and land on a concrete product recommendation in under two minutes.

What Data Scientists Actually Do

The title covers a wide band depending on where you land. At big tech you're embedded in a product team running experiments on millions of users; at fintech you might spend most of your time on causal inference and fraud detection; at startups you're writing Airflow DAGs, building Looker dashboards, and presenting to the CEO in the same week. Success after year one means owning an experiment or analysis end-to-end that visibly changed a product decision.

A Typical Week

Writing eats more of the week than coding does. Experiment design docs, methodology write-ups, status updates: if you pictured the job as heads-down Jupyter notebooks all day, recalibrate. The other surprise is how a single broken upstream ETL job (a silently changed column schema, say) can hijack an entire afternoon and bleed into the next morning.

Skills & What's Expected

Data architecture and pipeline knowledge is the most underrated skill in DS prep. Most candidates can't explain how Spark handles a skewed join or what happens when a Snowflake warehouse auto-scales mid-query, yet companies weight it just as heavily as ML. Python and SQL are table stakes; R still appears at pharma and social-science-heavy orgs but is rarely the primary language. GenAI (RAG, embedding retrieval, prompt engineering) sits at medium importance today, with no explicit requirements showing up in most job descriptions, so don't over-index on it at the expense of nailing experiment design and causal inference.

Levels & Career Growth

Most hires land at entry or mid level, and the promotion to senior is where you prove you can frame ambiguous problems, not just solve well-scoped ones. The real bottleneck is the jump to staff: that transition demands cross-team influence (setting experiment frameworks, defining what the org should measure, shaping hiring bar) rather than pure technical excellence. Principal roles exist at fewer than a third of companies and often blur into "head of DS" territory, so if you're optimizing for top-of-ladder comp, where you work matters as much as how well you work.

Data Scientist Compensation

Company tier is the biggest comp variable hiding behind those national averages. Public tech companies lean heavily on 4-year RSU grants (some front-loaded, some evenly spread), and refresh grants for strong performers can run 20-30% of the initial award annually, meaning your Year 3 comp may actually beat Year 1. Pre-IPO startups grant stock options with a 1-year cliff instead, and those options carry real liquidity risk, so push for a larger initial grant or a written refresh policy before you sign.

Negotiation leverage is strongest in the senior-to-staff band, where companies compete most aggressively for candidates who can operate cross-functionally. Competing offers from adjacent roles (MLE, analytics engineer) work well here because hiring managers worry about losing hybrid talent. Base salary bands tend to be rigid, but equity and bonus targets often have more room, especially when a recruiter knows you're weighing multiple offers.

Data Scientist Interview Process

Five weeks is the median timeline from recruiter call to offer, based on patterns across 68 companies. Big tech loops (Google, Meta) can stretch to eight weeks because of hiring committee reviews, while Series B-C startups sometimes compress everything into two weeks by combining rounds or swapping live sessions for take-homes. If you get a take-home, budget at least double the stated time estimate so you can add proper documentation and edge-case handling.

The case study round is one of the toughest for candidates because it demands end-to-end reasoning: scoping a vague problem, choosing between an A/B test and a quasi-experimental method like difference-in-differences, defining metrics (say, 7-day retention or revenue per user), and stating what evidence would change your recommendation. Something most candidates underweight: the behavioral round often carries hire/no-hire veto power, especially at senior+ levels, because the interviewer is frequently your future skip-level manager evaluating whether you can drive alignment across PMs and engineers without clear authority.

Data Scientist Interview Questions

A/B Testing & Experiment Design

Most candidates underestimate how much rigor you need around experiment design, metric definition, and interpreting ambiguous results. You’ll need to defend assumptions, power/variance drivers, and guardrails in operational/product settings.

What is an A/B test and when would you use one?

EasyFundamentals

Sample Answer

An A/B test is a randomized controlled experiment where you split users into two groups: a control group that sees the current experience and a treatment group that sees a change. You use it when you want to measure the causal impact of a specific change on a metric (e.g., does a new checkout button increase conversion?). The key requirements are: a clear hypothesis, a measurable success metric, enough traffic for statistical power, and the ability to randomly assign users. A/B tests are the gold standard for product decisions because they isolate the effect of your change from other factors.

Overwatch rolls out a new leaver-penalty warning UI to 50% of players, but the UI is only shown after a player has left at least one match in the last 7 days. How do you design the evaluation so you do not bias the estimated impact on leave rate and match completion?

Blizzard EntertainmentMediumExperiment Design, Selection Bias

Sample Answer

Most candidates default to comparing post-treatment leave rates between exposed vs unexposed players, but that fails here because exposure is triggered by prior leaving, so you condition on a collider and bake in regression to the mean. You need an intention-to-treat design at a randomization unit that is eligible for exposure, for example randomize players at login, then measure leave rate over a fixed future window regardless of whether the UI was shown. Use clear eligibility rules (all active players, or all players entering matchmaking), and report both ITT and treatment-on-the-treated with proper instrumentation for who actually saw the UI.

You roll out a pricing recommendation badge to Hosts, but the metric is Guest booking conversion and there is interference via shared listings and market-level price competition. How do you design the experiment to get a causal estimate, specify the unit of randomization, and define a primary metric and guardrails?

AirbnbHardInterference, Cluster Randomization, and Marketplace Metrics

Sample Answer

Unlock the full solution

View detailed answers and practice in our question bank

View Solution

Practice more A/B Testing & Experiment Design questions

Statistics

Most candidates underestimate how much you’ll be pushed on statistical intuition: distributions, variance, power, sequential effects, and when assumptions break. You’ll need to explain tradeoffs clearly, not just recite formulas.

What is a confidence interval and how do you interpret one?

EasyFundamentals

Sample Answer

A 95% confidence interval is a range of values that, if you repeated the experiment many times, would contain the true population parameter 95% of the time. For example, if a survey gives a mean satisfaction score of 7.2 with a 95% CI of [6.8, 7.6], it means you're reasonably confident the true mean lies between 6.8 and 7.6. A common mistake is saying "there's a 95% probability the true value is in this interval" — the true value is fixed, it's the interval that varies across samples. Wider intervals indicate more uncertainty (small sample, high variance); narrower intervals indicate more precision.

You run an A/B test on a new search ranking change and measure guest conversion (booking sessions divided by search sessions) daily for 14 days, with strong weekend seasonality. How do you compute a 95% interval for lift that is valid under day-to-day correlation and seasonality, and what unit of analysis do you choose?

AirbnbMediumUncertainty Estimation

Sample Answer

Reason through it: You need an interval that matches the randomization unit, so start by checking whether assignment is at user, session, or market level, then aggregate metrics to that unit before inference. Daily ratios are autocorrelated and seasonality breaks i.i.d., so treating 14 days as 14 independent samples underestimates variance. Use a cluster-robust approach (cluster by randomized unit, and optionally block by day-of-week) or a block bootstrap that resamples randomized units while preserving the calendar structure. If you must use time as the unit, use a paired design by day-of-week (or a regression with day-of-week fixed effects and robust SEs) so weekends do not inflate or deflate the lift estimate.

You forecast next month’s total nights booked for a set of cities to plan customer support staffing, and you know price changes and host cancellations can cause structural breaks. Describe a forecasting approach that outputs both a point forecast and a calibrated 80% prediction interval, and how you would detect and handle cannibalization across nearby cities.

AirbnbHardForecasting and Uncertainty

Sample Answer

Unlock the full solution

View detailed answers and practice in our question bank

View Solution

Practice more Statistics questions

Product Sense & Metrics

Most candidates underestimate how much crisp metric definitions drive the rest of the interview. You’ll need to pick north-star and guardrail metrics for shoppers, retailers, and shoppers, and explain trade-offs like speed vs. quality vs. cost.

How would you define and choose a North Star metric for a product?

EasyFundamentals

Sample Answer

A North Star metric is the single metric that best captures the core value your product delivers to users. For Spotify it might be minutes listened per user per week; for an e-commerce site it might be purchase frequency. To choose one: (1) identify what "success" means for users, not just the business, (2) make sure it's measurable and movable by the team, (3) confirm it correlates with long-term business outcomes like retention and revenue. Common mistakes: picking revenue directly (it's a lagging indicator), picking something too narrow (e.g., page views instead of engagement), or choosing a metric the team can't influence.

You suspect Instant Book increased bookings but also increased host cancellations due to calendar conflicts. What metric would you optimize, what are your top two guardrails, and what decision rule would you use if bookings go up but cancellations also rise?

AirbnbMediumTradeoffs and Decision Criteria

Sample Answer

Optimize completed stays per eligible session, with guardrails on host-initiated cancellation rate and guest support contact rate per completed stay. Bookings alone is a vanity metric here because cancellations create downstream harm and marketplace churn that appears later. Use a utility function like $$U = \Delta \text{CompletedStays} - \lambda_1 \Delta \text{HostCancelRate} - \lambda_2 \Delta \text{SupportContacts}$$ and set $\lambda$ using historical cost estimates (coupon spend, rebooking ops time, guest refunds). If $U \le 0$ for key segments (new hosts, high-demand markets), you do not ship broadly, you iterate or gate eligibility.

A company changes search ranking to push cheaper listings higher to improve affordability. How do you measure impact on marketplace health when guest conversion improves but host earnings and long-term supply might drop?

AirbnbHardMarketplace Health Metrics

Sample Answer

Unlock the full solution

View detailed answers and practice in our question bank

View Solution

Practice more Product Sense & Metrics questions

Machine Learning & Modeling

Expect questions that force you to choose models, features, and evaluation metrics for noisy real-world telemetry and operations data. You’re tested on practical tradeoffs (bias/variance, calibration, drift) more than on memorized formulas.

What is the bias-variance tradeoff?

EasyFundamentals

Sample Answer

Bias is error from oversimplifying the model (underfitting) — a linear model trying to capture a nonlinear relationship. Variance is error from the model being too sensitive to training data (overfitting) — a deep decision tree that memorizes noise. The tradeoff: as you increase model complexity, bias decreases but variance increases. The goal is to find the sweet spot where total error (bias squared + variance + irreducible noise) is minimized. Regularization (L1, L2, dropout), cross-validation, and ensemble methods (bagging reduces variance, boosting reduces bias) are practical tools for managing this tradeoff.

You built a purchase-propensity model for the company Marketing and the AUC is strong, but the campaign team needs a top-1% list to maximize incremental orders within a fixed budget. Which evaluation metrics do you report, how do you choose an operating threshold, and how do you check calibration before launch?

AmazonMediumModel Evaluation

Sample Answer

The standard move is to report AUC and maybe log loss, then pick a threshold like $0.5$. But here, ranking quality at the extreme tail matters because the business action is top-k targeting, so you report precision@k, recall@k, lift, and expected value under the budget constraint. Then you select the threshold by maximizing expected incremental orders or profit using a cost-benefit table, and you verify calibration with reliability curves and Brier score (or isotonic/Platt scaling) so scores map to real purchase probabilities.

Your search ranker uses an embedding feature built from the past 30 days of guest to listing interactions, and offline AUC jumps 8 points but online bookings drop and cancellation rate rises. What specific leakage or feedback-loop checks do you run, and what redesign would you propose to prevent the issue while keeping personalization?

AirbnbHardLeakage, Feedback Loops, and Feature Design

Sample Answer

Unlock the full solution

View detailed answers and practice in our question bank

View Solution

Practice more Machine Learning & Modeling questions

Causal Inference

The bar here isn’t whether you know terminology, it’s whether you can separate correlation from causation and propose a credible identification strategy. You’ll be pushed to handle selection bias and confounding when experiments aren’t feasible.

What is the difference between correlation and causation, and how do you establish causation?

EasyFundamentals

Sample Answer

Correlation means two variables move together; causation means one actually causes the other. Ice cream sales and drowning rates are correlated (both rise in summer) but one doesn't cause the other — temperature is the confounder. To establish causation: (1) run a randomized experiment (A/B test) which eliminates confounders by design, (2) when experiments aren't possible, use quasi-experimental methods like difference-in-differences, regression discontinuity, or instrumental variables, each of which relies on specific assumptions to approximate random assignment. The key question is always: what else could explain this relationship besides a direct causal effect?

A company rolls out a new cancellation policy that applies only to listings with flexible cancellation and only in specific EU countries, and you need the causal impact on booking conversion and host earnings. What identification strategy do you use, and what are the top two assumption checks you run before trusting the estimate?

AirbnbMediumDifference-in-Differences

Sample Answer

You could do a difference-in-differences using treated countries and untreated countries, or a matching plus regression adjustment using similar listings across all markets. DiD wins here because you have a clear policy shock and rich pre-period data, so you can difference out stable cross-country and listing-level confounding. You then check parallel trends using pre-policy event-time coefficients, and you probe composition changes (like listings entering, leaving, or changing cancellation settings) that can fake treatment effects.

Trust & Safety introduces an automated identity verification flow, but it is triggered only when a risk score exceeds a threshold and the score also drives manual review intensity. How do you estimate the causal effect of verification on chargebacks while separating it from the risk score and manual review effects?

AirbnbHardRegression Discontinuity and Policy Thresholds

Sample Answer

Reason through it: you have a forcing variable (risk score) and a discontinuous jump in treatment probability at a known cutoff, so you start by plotting treatment take-up and outcomes versus score to confirm the discontinuity. Then you fit a local RD around the cutoff with a bandwidth choice and covariate balance checks, estimating the intent-to-treat and, if compliance is imperfect, a fuzzy RD using assignment above cutoff as an instrument. Next, you test for manipulation with a density test near the cutoff and check that manual review does not itself jump in a way that breaks the exclusion, if it jumps you model it explicitly or redefine the estimand to the bundled policy effect. Finally, you run placebo cutoffs and sensitivity to bandwidth and polynomial order because RD is fragile and most people overfit the functional form.

Practice more Causal Inference questions

Business & Finance

You’ll need to translate modeling choices into trading outcomes—PnL attribution, transaction costs, drawdowns, and why backtests lie. Candidates often struggle when pressed to connect a statistical edge to execution realities and risk constraints.

What is ROI and how would you calculate it for a data science project?

EasyFundamentals

Sample Answer

ROI (Return on Investment) = (Net Benefit - Cost) / Cost x 100%. For a data science project, costs include engineering time, compute, data acquisition, and maintenance. Benefits might be revenue uplift from a recommendation model, cost savings from fraud detection, or efficiency gains from automation. Example: a churn prediction model costs $200K to build and maintain, and saves $1.2M/year in retained revenue, so ROI = ($1.2M - $200K) / $200K = 500%. The hard part is isolating the model's contribution from other factors — use a holdout group or A/B test to measure incremental impact rather than attributing all improvement to the model.

You build a monthly cross-sectional signal on US equities and it looks great in backtest, but live it decays after you add realistic costs and market impact. What diagnostic checks do you run to distinguish alpha decay from microstructure bias (bid-ask bounce, stale prices) and from cost model misspecification?

AQRMediumBacktest Diagnostics and Trading Costs

Sample Answer

Most candidates default to blaming market regime or saying the signal is "overfit", but that fails here because the gap between paper and live is usually a measurement and implementation problem first. You check whether returns are computed with executable prices (next open, VWAP) and whether the signal uses any same-day information that is not tradable at your assumed time. You decompose performance by predicted turnover, liquidity, and spread buckets, then see if the entire edge is coming from names where $\text{spread}$ and impact dominate. You stress the cost model by scaling costs like $\text{cost} \propto \text{ADV}^{-\alpha}$, varying $\alpha$, and verifying that net alpha is not just a fragile artifact of one parametrization.

You have two equity signals: one is strongly correlated with value and one is strongly correlated with momentum, each has positive standalone Sharpe, and they are negatively correlated with each other. In an-style multi-signal portfolio, do you neutralize both to known factors before combining, or combine first then neutralize, and why?

AQRHardFactor Neutralization and Signal Combination

Sample Answer

Unlock the full solution

View detailed answers and practice in our question bank

View Solution

Practice more Business & Finance questions

LLMs, RAG & Applied AI

What is RAG (Retrieval-Augmented Generation) and when would you use it over fine-tuning?

EasyFundamentals

Sample Answer

RAG combines a retrieval system (like a vector database) with an LLM: first retrieve relevant documents, then pass them as context to the LLM to generate an answer. Use RAG when: (1) the knowledge base changes frequently, (2) you need citations and traceability, (3) the corpus is too large to fit in the model's context window. Use fine-tuning instead when you need the model to learn a new style, format, or domain-specific reasoning pattern that can't be conveyed through retrieved context alone. RAG is generally cheaper, faster to set up, and easier to update than fine-tuning, which is why it's the default choice for most enterprise knowledge-base applications.

You are evaluating an Services writing assistant that drafts App Store review replies, and you need a human rubric for helpfulness, policy compliance, and tone across en-US, es-ES, and ja-JP. How do you design the rubric and sampling plan so scores are comparable across locales, and how do you quantify rater reliability and drift over time?

AppleMediumHuman Evaluation Design

Sample Answer

This question is checking whether you can turn a fuzzy UX goal into an auditable evaluation that survives localization and rater noise. You define a rubric with anchored examples per label, explicit fail conditions (policy, safety), and separate dimensions to avoid conflating tone with correctness. You stratify samples by locale, intent, and difficulty, then measure reliability with Krippendorff’s $\alpha$ (ordinal if using graded scales) and monitor per-rater confusion matrices to catch drift. If $\alpha$ is low, you fix the rubric and training before you trust model deltas.

Siri search is adding an LLM answer card, and offline human ratings (0 to 4 utility) look better for Model B, but online you care about session success rate and downstream clicks without increasing harmful or incorrect answers. How do you set acceptance gates for launch, and how do you diagnose when offline gains do not translate to online wins?

AppleHardLLM Metrics and Launch Gating

Sample Answer

Unlock the full solution

View detailed answers and practice in our question bank

View Solution

Practice more LLMs, RAG & Applied AI questions

Data Pipelines & Engineering

Strong performance comes from showing you can onboard and maintain datasets without breaking research integrity. You’ll discuss incremental loads, alerting, schema drift, and how to make pipelines auditable for systematic model inputs.

What is the difference between a batch pipeline and a streaming pipeline, and when would you choose each?

EasyFundamentals

Sample Answer

Batch pipelines process data in scheduled chunks (e.g., hourly, daily ETL jobs). Streaming pipelines process data continuously as it arrives (e.g., Kafka + Flink). Choose batch when: latency tolerance is hours or days (daily reports, model retraining), data volumes are large but infrequent, and simplicity matters. Choose streaming when you need real-time or near-real-time results (fraud detection, live dashboards, recommendation updates). Most companies use both: streaming for time-sensitive operations and batch for heavy analytical workloads, model training, and historical backfills.

A new Mobile release changes trade logging so that "order_filled" is emitted twice for some sessions, and your Trading Conversion funnel spikes 8% overnight. What concrete steps do you take to validate, patch, and backfill the pipeline without breaking downstream experimentation reads?

CoinbaseMediumIncident Response and Backfills

Sample Answer

Get this wrong in production and you ship a fake growth story, then product decisions and experiment readouts get permanently contaminated. The right call is to quantify the duplication rate by app version and event id, then hotfix with an idempotent dedupe key (for example $\text{order\_id} + \text{fill\_id} + \text{event\_source}$) at the earliest reliable layer. Freeze downstream tables or pin experiment queries to the last known good partition while you reprocess affected dates. Backfill with a versioned table or snapshot so analysts can reproduce results, then publish a metric change note and a postmortem with the exact impacted time window.

You need a trustworthy daily metric for "Net New Funded Accounts" where funding can happen via ACH, card, crypto deposit, or internal transfers, and events can arrive late or be reversed. How do you design the pipeline so the metric is stable, reconciles to finance, and remains usable for experimentation within 24 hours?

CoinbaseHardLate Data, Reversals, and Metric Stabilization

Sample Answer

Unlock the full solution

View detailed answers and practice in our question bank

View Solution

Practice more Data Pipelines & Engineering questions

The spread across eight areas is narrow enough that ignoring any one of them is a real risk. The biggest prep mistake is treating this like an ML interview with some stats sprinkled in, when in reality, experiment design and product sense questions demand a different muscle: you need to decompose metrics on the fly, name specific techniques like CUPED for variance reduction or diff-in-diff when randomization breaks down, and defend your choices out loud. Most failed loops, from what candidates report, trace back to freezing on a causal inference or metric decomposition question they never practiced, not to bombing a scikit-learn walkthrough.

Practice questions across all eight areas, organized by difficulty and topic, at datainterview.com/questions.

How to Prepare

Spend your first two weeks on SQL and statistics, because most interview pipelines front-load these screens. Solve two SQL problems daily that require window functions, self-joins, or multi-step CTEs at datainterview.com/coding. For stats, pair every concept with a scenario: "your A/B test shows p=0.04 but the effect size is 0.1%, what do you recommend?" forces you to connect hypothesis testing mechanics to real decision-making.

Once SQL and stats feel automatic, layer in ML and product sense. For ML, practice a model selection rubric: pick a business problem (say, predicting churn), argue why you'd choose logistic regression over XGBoost, then reverse your position and argue the opposite. This builds the judgment muscle interviewers actually probe, things like bias-variance tradeoffs and when simplicity beats accuracy.

Product sense prep needs a concrete framework. Run AARRR (acquisition, activation, retention, referral, revenue) against a product you use daily, define a north-star metric for one stage, then sketch how you'd detect if a new feature cannibalized another. Company-specific guides on the DataInterview blog help you calibrate which categories a particular employer weights most heavily once you're targeting specific roles.

Try a Real Interview Question

1WITH host_first_confirmed_start AS (
2  SELECT
3    l.host_id,
4    MIN(b.start_date) AS first_confirmed_start_date
5  FROM listings l
6  JOIN bookings b
7    ON b.listing_id = l.listing_id
8  WHERE b.status = 'confirmed'
9  GROUP BY 1
10), host_conversion AS (
11  SELECT
12    h.host_id,
13    DATE_TRUNC('week', h.signup_date) AS signup_week,
14    CASE
15      WHEN f.first_confirmed_start_date IS NOT NULL
16       AND f.first_confirmed_start_date >= h.signup_date
17       AND f.first_confirmed_start_date <= h.signup_date + INTERVAL '14 day'
18      THEN 1 ELSE 0
19    END AS converted_14d
20  FROM hosts h
21  LEFT JOIN host_first_confirmed_start f
22    ON f.host_id = h.host_id
23)
24SELECT
25  signup_week,
26  COUNT(*) AS hosts_signed_up,
27  SUM(converted_14d) AS hosts_converted,
28  1.0 * SUM(converted_14d) / NULLIF(COUNT(*), 0) AS conversion_rate
29FROM host_conversion
30GROUP BY 1
31ORDER BY 1;

SQL screens reward candidates who've practiced under time pressure against unfamiliar schemas, not just those who know the syntax. The gap between "I can write a query" and "I can scope, write, and sanity-check a query in 25 minutes" is where most people underperform. Build that muscle with more problems at datainterview.com/coding.

Test Your Readiness

Use your results to target weak spots with focused practice at datainterview.com/questions before your first live screen.