Back to glossary

Incrementality Testing

An experimental method that measures the true causal impact of a marketing activity by comparing outcomes between a group exposed to marketing and a control group that is not. Incrementality testing reveals whether marketing activities drive additional conversions or just capture ones that would have happened anyway.

Incrementality testing answers the fundamental question: did this marketing spend actually cause additional conversions, or would those conversions have happened without it? By randomly holding out a control group from seeing an ad or receiving a campaign, you can measure the true lift (incremental conversions) versus the baseline (conversions that occur without the marketing).

For growth teams, incrementality testing is the gold standard for marketing measurement because it establishes causation rather than correlation. Common applications include geo-based holdout tests for brand campaigns, PSA (public service announcement) tests for digital ads, and email holdout tests for lifecycle campaigns. The results often challenge conventional attribution data: channels that appear highly effective in attribution may show low incrementality because they are converting people who would have converted anyway. Run incrementality tests on your largest spend channels first to validate that budget is driving real impact. The practical challenge is sample size: you need sufficient volume to detect meaningful lift, which means incrementality testing works best for high-volume campaigns and channels.

Related Terms