Refacto

Podcast episode

Episode 183: Ask Olivia Kory Whether AppLovin Ads Work & She Explains Attribution vs Incrementality

attribution incrementality measurement performance-marketing retail-media

TL;DR

Marketecture host Ari Paparo and co-host Eric Franchi bring back Olivia Kory (Chief Marketing Strategy Officer at Haus, an incrementality-testing company) to discuss whether AppLovin's e-commerce ads actually work, how attribution differs from incrementality, and the state of AI-driven budget allocation. The episode wraps with quick takes on Google's Q2 earnings, OpenAI's rumored ad network, and the broken state of podcast measurement.

What was covered

  • Attribution vs. incrementality: Olivia Kory explained that attribution measures correlation (saw ad → bought thing), while incrementality measures causation — what would have happened without the ad, modeled as a randomized holdout test. She noted that Meta's new product calling itself "incremental attribution" is, in her view, an oxymoron.

  • AppLovin e-commerce performance: Kory confirmed AppLovin works, specifically for low average order value (AOV), impulse-purchase categories such as apparel and footwear. She attributed its success to unusually fast, short-term ad effects — similar to Meta — which satisfy growth marketers who need to see immediate ROI. AppLovin also opened its platform to third-party incrementality testing from the start of its e-commerce pilot (late 2024), which she said made validation easy.

  • Affiliate and retail media incrementality gap: Kory said affiliate channels are among the hardest to test because partners resist geo-holdout designs and make it difficult to pause offers. In the handful of tests Haus has run, they saw little incremental lift — though she flagged the small sample size. She grouped affiliate, Amazon search, and RMNs (retail media networks — ad products sold by retailers) together as channels where lack of rigorous measurement is limiting advertiser investment.

  • CAPI vs. pixels and optimization signal: Conversion APIs (CAPIs — server-side data pipelines that send purchase signals back to ad platforms) are increasingly preferred over browser-based pixels for privacy and coverage reasons, but Kory framed them primarily as optimization vehicles rather than measurement tools. Some advertisers are experimenting with sending only predicted-incremental conversions through CAPI to improve platform ML training.

  • Haus's "Architect" agentic budget tool: Kory described Haus's product roadmap: combining incrementality experiments, multi-touch attribution (MTA), and media-mix modeling (MMM) into a single causal attribution model, then surfacing budget reallocation recommendations via an AI agent called Architect. Current state: it recommends moves (e.g., shift dollars from Google Search to YouTube) and can execute them via API connections, but does not autonomously place new insertion orders.

  • Google Q2 earnings: Ari Paparo cited total revenue of $119.8B; search and other at $63.3B (+17%); YouTube at $11.1B (+13%); cloud at $24.8B (up ~82% year-over-year from $13.6B). Capex guided to $195–205B for the year. First quarter of negative free cash flow in a long time; stock took a hit.

  • OpenAI ad network speculation: Following a Business Insider report (citing a job posting that OpenAI quickly edited), the panel debated whether OpenAI is building an ad network or audience-extension product. Kory noted advertisers are already running into scale limitations on ChatGPT's ad inventory. Paparo's theory: OpenAI may be building something analogous to Google's FAN (audience network) using paid-user behavioral data.

  • Podcast measurement: Paparo argued the shift of podcasts to video has worsened measurement — Spotify, Apple, and YouTube all use different video technologies, none robustly supports video ad insertion, and geo-holdout testing is nearly impossible for host-read buys. Kory confirmed Haus's best workaround is a time-based pre/post forecast comparison.

Notable claims & predictions

  • Olivia Kory: "AppLovin ads work fast — the effects are short-term and immediate. That is not the case with most ad platforms. I don't even recommend a CTV test under eight weeks." (Implication: AppLovin's ML model is optimized for speed in a way most DSPs are not.)

  • Olivia Kory: Advertisers with AOV under $50 spend three times more on TikTok than advertisers with AOV above $50 — Haus data point suggesting impulse-purchase categories dominate TikTok's ad mix.

  • Olivia Kory on affiliate/RMN incrementality: "I wonder if [affiliate, RMNs, Amazon search] are limiting their advertising TAM by not offering incrementality. Advertisers are holding back dollars because they're skeptical and we haven't had a way to get evidence."

  • Ari Paparo on Google's trajectory: Plugging Q2 cloud growth numbers into ChatGPT, Paparo was told Google's cloud revenue could surpass its advertising revenue in the "early 2030s" — raising the prospect of Google being thought of primarily as a cloud company.

  • Ari Paparo on OpenAI's ad strategy: "OpenAI may be building something like FAN (a publisher audience-extension network) using paid-user behavioral data — that could be pretty hot." He also noted the inventory constraint: GPT queries are so long and context-rich that there isn't enough ad inventory to absorb advertiser demand even today.

  • Ari Paparo on podcast measurement: "The podcast world is getting significantly worse [for measurement] because the movement to video has broken all of it." He argued streaming audio (e.g., Spotify programmatic) is meaningfully more measurable than podcast, and buyers should not conflate the two.

Fact check

  • Paparo: Google cloud revenue up ~82%, from $13.6B (Q2 prior year) to $24.8B (Q2 this year). The figures directionally match Alphabet's reported Q2 2025 Google Cloud segment results. The ~82% growth rate, however, is higher than consensus and deserves scrutiny — actual year-over-year growth was substantial but closer to the 28–30% range in recent quarters. The $24.8B figure Paparo cites as a Q2 2025 number is worth verifying; the show's figures may conflate annual or trailing figures with a single quarter. Verdict: the specific revenue figures and the ~82% growth rate are unverified from the transcript alone; listeners should confirm against Alphabet's official filing before repeating.

  • Paparo: "Google's total ad revenue is about a billion dollars a day" ($81.6B ads + $11.1B YouTube ≈ $90B / ~90 days in a quarter ≈ ~$1B/day). The arithmetic is roughly correct as a cocktail-party heuristic. Verdict: true as an approximation.

  • Kory: "Meta's new ad product for optimization is called incremental attribution." This appears to refer to Meta's "Incremental Attribution" optimization feature. Meta has indeed rolled out incrementality-oriented tools, but calling the product precisely "incremental attribution" and characterizing it as a contradiction may slightly misname or oversimplify the product. Verdict: unverified exact product name; the framing that it blurs correlation and causation is a contested opinion, not a verifiable fact.

  • Paparo (via Claude): "There are 1,960 FAST channels globally." This figure came from a Claude query, not a primary source, and was presented as such. FAST (Free Ad-Supported Streaming TV) channel counts vary widely by definition and data source. Verdict: unverified; self-disclosed as AI-generated estimate.

  • Incentive flag — Olivia Kory on affiliate/RMN incrementality: Kory's company sells incrementality testing. Her framing that affiliate, RMNs, and Amazon search are suppressing advertiser spend by not offering incrementality is plausible but also directly serves Haus's commercial interest. The claim that "advertisers are holding back dollars" from these channels due to measurement gaps is asserted without data. Listeners should weight accordingly.

Full analysis

Olivia Kory, Chief Marketing Strategy Officer at Haus, came back on Marketecture and said the quiet part out loud: AppLovin's e-commerce ads work, but only for a specific kind of advertiser, and the reason they "work" is speed, not magic. That distinction, plus her broader point that whole channels are leaving money on the table because they refuse to be measured, is the real content here. For any operator selling media or measurement, this is a map of where advertiser dollars are stuck and why.

What's being decided: nothing binary. This is a briefing on a shift in how sophisticated advertisers separate "ads that correlate with sales" from "ads that cause sales," and which channels win or lose as that lens spreads. Type 2, easily reversible for any single advertiser. But the direction of travel matters for whoever sells affiliate, retail media, and podcast inventory. Forcing function: budget-allocation season and the AI-agent tools now recommending where dollars move.

The Market Analyst. Kory's cleanest signal is a commercial one for the channels that won't open up. She groups affiliate, Amazon search, and retail media networks together as places where advertisers are "holding back dollars" because nobody can prove lift. For an informed outsider: retailers sell ads against their own shoppers and mostly grade their own homework. AppLovin did the opposite. It let third-party incrementality testers in from the start of its e-commerce pilot in late 2024, and that openness is a big reason it earned trust fast. The read for retail media operators: the ones who let independent holdout tests run will pull budget away from the ones who stall. Ari Paparo's Google numbers are a side dish, and the summary itself flags the ~82% cloud growth figure as unverified. Don't repeat it.

The Skeptic. The load-bearing assumption is that AppLovin "works," and Kory is careful, but the framing still needs a squeeze. She confirms it works for low average order value, impulse categories like apparel and footwear, driven by fast short-term effects. That is exactly the pattern you'd expect from a model optimized to harvest people already close to buying. Short-term lift is real lift, but it is also the easiest kind to over-credit. And the affiliate takeaway rests on a "handful of tests" with a small sample she flags herself. One more thing: Haus sells incrementality testing. The claim that affiliate and retail media are suppressing their own advertiser market by not offering it is plausible and also precisely the argument that grows Haus's business. True and self-serving can both hold. Weight it accordingly.

The Operator. Try to act on this Tuesday morning and you hit the wall Kory describes. She won't recommend a CTV test under eight weeks, but AppLovin shows lift in days. So a growth marketer staring at a dashboard rewards the fast channel and starves the slow one, even when the slow one is building demand that shows up later. That is a measurement artifact driving budget, not performance. The CAPI point is the practical trap for platform teams: conversion APIs, the server-side pipes that send purchase data back to ad platforms, are being sold as measurement when they are really optimization fuel. Feed them your conversions and you make the platform's model smarter at taking credit. Kory's tell is that some advertisers now send only predicted-incremental conversions through CAPI. Smart, and almost nobody is set up to do it.

The Customer / End User. The advertiser here is genuinely stuck, and the podcast segment is the sharpest illustration. Paparo argued the move to video has broken podcast measurement outright: Spotify, Apple, and YouTube each use different video tech, none supports video ad insertion well, and you can't run a geo-holdout on a host-read spot. Haus's best workaround is a crude before-and-after forecast. In plain terms: buyers pouring money into video podcasts are flying blind, and they should stop treating podcast like streaming audio, which Paparo says is meaningfully more measurable. The customer isn't asking for more channels. They're asking for proof, and most sellers still can't hand it over.

The CFO. Follow the dollars and the story is about where budget flows when proof is unequal. If affiliate and retail media can't demonstrate causal lift, a disciplined finance team caps spend there and routes it to channels that can. That's the mechanism behind Kory's "limiting their advertising TAM" line, and it's a warning to any retail media network booking growth on last-click credit. The other CFO item is Google's capex: $195 to $205 billion guided for the year, with the quarter's first negative free cash flow in a long time and a stock that took a hit. For operators, that's the tell that even Google is spending faster than the ad business alone can comfortably fund. The cloud bill is now shaping the ad company's discipline.

Where the council splits. The Operator and the Market Analyst agree AppLovin's openness is the winning move; the Skeptic says a low-AOV impulse engine flatters itself on short-term lift and we shouldn't generalize it into "AppLovin beats everyone." Second fault line: Kory says the unmeasured channels are throttling their own budgets, while the Customer view is that advertisers keep paying into unmeasured podcast video anyway. Skepticism and spend can coexist for a while. Third: is CAPI a measurement tool or an optimization tool? Kory says optimization, and most of the market still sells it as measurement.

What it hinges on. Whether independent incrementality testing becomes table stakes for a channel to keep growing its budget. AppLovin bet yes and got trust. Retail media, affiliate, and Amazon search are betting they can grow on their own attribution a while longer. The council leans toward the openness thesis, with the Skeptic's caveat that short-term-effect channels will always look better under fast-read tests than demand-building ones. Before anyone reallocates on an agent's say-so, verify the holdout design and check whether the "lift" is just harvested intent.

Prediction: By the Q1 2027 earnings and budget-planning cycle, at least one major retail media network will publicly announce support for third-party incrementality or independent holdout testing, following the openness playbook AppLovin used to win e-commerce trust.

Confidence: Medium — competitive pressure and advertiser skepticism both push the same way.

Why: Kory laid out the mechanism directly: advertisers are holding budget back from retail media, affiliate, and Amazon search because those channels grade their own homework, and AppLovin won trust fast by letting outside testers in from day one. Retail media networks are chasing growth into a maturing category and can't keep booking on last-click credit while a rival dangles independent proof. The opposite outcome, everyone staying closed, gets harder each quarter that a competitor demonstrates lift a CFO can defend. The likeliest holdouts are the ones with the weakest real incrementality, which is exactly why at least one confident player breaks ranks first.

Revisit by 2027-04-30: We're right if a top retail media network (Walmart Connect, Roundel, Kroger Precision Marketing, or Amazon Ads) publicly supports third-party incrementality or holdout testing by then. We're wrong if the major RMNs all still restrict measurement to their own attribution.

Comments