Gross Margin
The percentage of revenue remaining after subtracting the direct costs of delivering the product (hosting, infrastructure, support, AI inference costs), measuring fundamental business model efficiency.
Gross margin determines how much of each revenue dollar is available for growth, R&D, and profit. Traditional SaaS businesses target 70-85% gross margins. AI-powered products face margin pressure from inference costs, which can be substantial: running LLM queries at scale might consume 10-30% of revenue, reducing gross margins to 50-70%.
For AI products, gross margin management is a critical competency. Every AI feature interaction has a cost (API calls, GPU compute, data processing) that scales with usage. Without careful optimization, popular AI features can erode margins. The key strategies are model routing (cheaper models for simpler queries), caching (reusing responses for common questions), batching (processing in bulk for efficiency), and quantization (smaller, cheaper models).
Gross margin also determines how much you can spend on customer acquisition. A company with 80% gross margins can afford higher CAC than one with 50% margins and still achieve attractive unit economics. For growth planning, the formula is: maximum acceptable CAC = LTV times gross margin divided by target LTV:CAC ratio. Understanding your gross margin is essential for setting acquisition budgets and pricing strategy.
Related Terms
Growth Loop
A self-reinforcing cycle where each cohort of users generates inputs (data, content, referrals) that attract the next cohort, creating compounding growth.
Churn
The rate at which customers stop using or paying for a product over a given period, typically measured as monthly or annual churn percentage.
Activation Rate
The percentage of new signups who complete a key action (the 'aha moment') that correlates with long-term retention and product value realization.
Product-Led Growth (PLG)
A go-to-market strategy where the product itself drives acquisition, activation, and expansion through self-serve experiences rather than sales-led motions.
Viral Coefficient (K-Factor)
The average number of new users each existing user brings to the product, where a K-factor above 1.0 indicates self-sustaining viral growth.
Net Revenue Retention (NRR)
The percentage of recurring revenue retained from existing customers over a period, including expansion, contraction, and churn — where 100%+ indicates growth without new customers.