Beyond Open Rates: The Three KPIs That Reveal Whether a Marketing Campaign Actually Pays Off

Open rates, click-through rates, recovered abandoned carts, database growth… The dashboards built into marketing automation platforms are packed with flattering metrics. These indicators are certainly useful, but they don't answer the question that matters most: what is the actual business impact? It's time to widen the measurement toolkit and pay closer attention to three other metrics — LTV, CAC, and retention.

Escaping the "Vanity Metrics" Trap

Imagine a welcome campaign that has been running for months, an abandoned-cart flow recovering a few percentage points of lost sales, and win-back emails going out every 30 days to dormant customers. The dashboard shows strong numbers: open rates above 40%, double-digit click-through rates, and recovery rates climbing quarter after quarter. On paper, it looks like cause for celebration.

Open rates, click-through rates, and journey-level conversion rates shouldn't be dismissed. They offer real insight into how well the underlying mechanics are working — deliverability, message relevance, offer strength, segmentation quality. In that sense, they play an essential diagnostic role. But on their own, they do not constitute a business outcome.

None of these figures tells you whether you made more money than you spent. None shows whether customers come back and stay. And none measures the true cost of acquiring a customer who has a genuine chance of becoming profitable.

The problem isn't the data itself; it's which indicators get treated as proof of success. Brands need to shift their focus away from exposure and engagement metrics and toward three fundamental indicators: Customer Lifetime Value (LTV), Customer Acquisition Cost (CAC), and retention.

It's therefore useful to distinguish between three levels of measurement:

• Process metrics, such as open rates and click-through rates, which show whether a system is operationally healthy;
• Leading indicators, such as second-purchase rate, purchase frequency, or CAC payback period, which reflect changes in customer behavior;
• Business outcomes, such as LTV by cohort, the LTV/CAC ratio, or the share of revenue generated by repeat customers.

It's at this third level that the strategic contribution of marketing automation can truly be measured.

LTV: Measuring Value Beyond the First Purchase

Customer Lifetime Value (LTV) is what lets businesses move past a short-term view of performance. It estimates the value a customer generates over their entire relationship with a brand.

In simplified terms, it can be expressed as:

LTV = Average Order Value × Purchase Frequency × Customer Lifespan

Post-purchase sequences, personalized recommendations, cross-selling, and upselling can raise average order value. Replenishment reminders, relationship-building programs, and communications tailored to the customer's consumption cycle can encourage more frequent purchases. And onboarding, the quality of the customer journey, and reactivation campaigns can help extend the relationship's lifespan.

The question is therefore no longer simply: "How much revenue did this campaign generate?" It becomes: "Do customers exposed to this journey generate more value over time?"

Answering that requires tracking LTV by cohort. In practice, customers are grouped by when they made their first purchase, and their cumulative revenue is then monitored month by month. A new post-purchase sequence rolled out to a given cohort should, over time, produce a value curve that outpaces comparable cohorts never exposed to it.

This matters because the effects of relationship-focused automation are rarely immediate. Such automation doesn't necessarily transform the performance of a single campaign overnight — it gradually improves the quality, frequency, and duration of the customer relationship.

CAC: Looking Beyond the Cost of Paid Media

Customer Acquisition Cost (CAC) is traditionally calculated by dividing total acquisition spend by the number of new customers acquired over a given period.

At first glance, CAC can look like something brands have little control over — set by auction dynamics, competitive pressure, and the rules of media platforms. In reality, marketing automation can significantly reshape the economics of acquisition.

The reason is simple: acquiring a customer for the first time is expensive. Getting that customer to come back, trade up, or increase their average order value relies largely on channels the brand already owns — email, SMS, push notifications, customer accounts, loyalty programs. These channels are obviously not free: they require technology, content production, data, and expertise. But their marginal cost is generally far lower than buying another conversion through paid media.

The right metric, therefore, isn't gross CAC alone — it's also the CAC payback period:

CAC Payback Period = CAC ÷ (Monthly Revenue per Customer × Gross Margin)

An effective automation journey can shorten this period by accelerating the second purchase, raising average order value, or boosting purchase frequency. Without touching the initial acquisition cost, the brand speeds up how quickly it recoups its investment.

At executive or finance level, one of the most meaningful metrics remains:

LTV/CAC Ratio = Customer Lifetime Value ÷ Customer Acquisition Cost

Its usefulness lies in forcing the business to compare what it spends to acquire customers against the value those customers actually generate over time.

Retention: The Underrated Metric

Retention is often less spectacular than acquisition. A spike in traffic or new customers is immediately visible; a shift in loyalty is not. The second-purchase rate, however, is a particularly useful metric. It answers a simple question: what proportion of new customers makes a second purchase within a defined period?

It's a strong leading indicator because it sits close enough to marketing activity to be shaped by onboarding, post-purchase communications, replenishment campaigns, or personalization — and close enough to customer value to matter strategically.

Retention should also be analyzed by cohort. Comparing customers acquired in January with those acquired in June, then measuring their likelihood of returning within 30, 60, or 90 days, makes it possible to quickly spot whether the quality of the customer relationship is improving or deteriorating.

If the most recent cohorts perform worse than earlier ones, the issue may extend beyond marketing automation: misalignment between the advertising promise and the actual experience, a weak product experience, delivery delays, poor service quality, or excessive promotional pressure. Conversely, consistent improvement among recent cohorts is a strong signal that initiatives across the customer journey are genuinely creating value.

At company level, another metric deserves particular attention: the share of revenue generated by repeat purchases. It measures a brand's ability to avoid depending entirely on a constant, costly stream of new customers.

Attribution: Moving from Correlation to Incrementality

To avoid overstating performance, brands need to adopt a discipline that remains far too uncommon: control groups.

The principle is simple — randomly exclude a small share of the eligible audience from an automated journey, then compare the behavior of exposed and unexposed customers over the same period. What matters is no longer the revenue a platform attributes to itself, but the actual difference observed between the two groups.

This approach answers a far more meaningful question: how much additional revenue, purchase activity, or retention did the automation actually generate?

It requires accepting that a small portion of the customer base won't receive a given communication. But this apparent sacrifice is really an investment in better decision-making. Without incremental measurement, a team can end up pouring time, sales pressure, and creative resources into optimizing sales that would have happened anyway.

Where Marketing Automation Meets Business Performance

Marketing automation is not simply a machine for sending more messages; it is a tool for transforming the customer relationship. Its worth can't be measured by email volume, or even by the clicks and conversions a platform reports. It lies in its ability to create more profitable, more loyal customers who depend less on paid acquisition.

Open and click-through rates remain necessary — they're the warning lights and gauges on the dashboard. But they don't tell you whether the business is actually moving in the right direction. For that, companies need to look at LTV, CAC, and retention, and track how these metrics evolve across cohorts and over time.

Every automated journey should also be tied to an explicit business objective — not simply "generate revenue from email," but, for example: increase the second-purchase rate among new customers within 60 days of their first order, or reduce the CAC payback period for a specific cohort.

Only then does marketing automation stop being a collection of well-configured workflows and become what it should be: a driver of sustainable, measurable growth.