Refacto AI

Podcast episode

Software That Never Breaks: OutSystems CEO Woodson Martin on Building Enterprise-Grade Apps at ...

agents cost-compression enterprise inference model-pricing

Woodson Martin, CEO of OutSystems, joined Nathan Labenz on the Cognitive Revolution podcast to talk about building AI into enterprise software. The episode is really about two things: how much frontier-model spending is actually justified, and what's blocking deployment once the AI works.

Martin's most interesting data point is that OutSystems built an internal LLM router (software that looks at each job and sends it to the cheapest model capable of handling it). Spend peaked in June and July 2025, then fell even as usage grew. Martin also describes customers with fully built, tested agentic systems (AI that takes actions autonomously) sitting idle in legal backlogs, waiting for approval on whether a model's training data was "legally acquired." That compliance wall is the actual blocker, and the frontier labs haven't answered the questionnaire cleanly.

Martin is selling a 25-year-old platform, so take the pitch with skepticism. But the spending data is a CFO's bill, not a vendor slide. If enterprise rationing of top-tier models is a durable habit rather than a one-time cleanup, frontier-model revenue has a ceiling nobody priced in.

Full analysis

OutSystems CEO Woodson Martin went on Nathan Labenz's podcast and said the quiet part out loud: most enterprise AI work doesn't need the expensive frontier models, and the thing actually blocking deployment isn't capability, it's a legal review of where the model's training data came from. That's a story about inference economics and procurement, not about the next model release.

What's being decided here isn't one company's roadmap. It's two bets a lot of buyers are making right now: how much to spend on frontier models (the top-tier, priciest ones like Anthropic's Opus or OpenAI's best), and how to get agentic systems (AI that takes actions on its own, not just answers questions) past their own legal and compliance teams. Both are easy to undo. You can re-route traffic to a pricier model next week, and compliance rules loosen as the market sorts out training-data provenance. No hard deadline. So the move is to notice the pattern early, not to bet the company on it.

The Skeptic. Martin is selling a 25-year-old low-code platform, so "you don't need frontier models, you need our deterministic compliance layer" is exactly what he'd say regardless of whether it's true. Treat the pitch with suspicion. But the token-spend data is harder to wave off: peak spend in June and July 2025, now below the Q3 forecast, achieved by routing cheap jobs to cheap models. That's not a vendor talking point, that's a CFO who saw a bill. And the feature-velocity claim (4 to 26 major features a quarter) is self-reported with no definition of "major feature." Six times the output of what, exactly? I'd want the denominator before I believe the 6x.

The Compute Pragmatist. The real content is the spend curve. Martin built an internal gateway, an LLM router, that looks at each job and sends the easy ones to cheaper or older models instead of defaulting everything to Opus-class. Result: spend fell even as usage grew. This is the thing that should worry anyone whose revenue model assumes enterprises keep pouring work into top-tier models. Martin says it plainly: "almost none of enterprise workloads" need frontier models, and a chunk can be done with plain deterministic code for less than any model at all. He also named Microsoft and Meta pulling back from "AI first for everything" once CFOs saw the February and March bills. When your own biggest boosters start rationing, the per-query gravy train for the frontier labs is under pressure.

The Researcher. Strip the marketing and the architecture is a known, sound pattern: don't let the AI write the final code directly. Let it manipulate an abstract model, then generate the actual code deterministically, meaning the same input always produces the same output, with the security and privacy rules (role-based access, GDPR, HIPAA) baked in automatically. That's genuinely useful because it sidesteps the "AI wrote something subtly wrong and nobody caught it" problem by constraining what the AI can touch. It's not novel to OutSystems. It's the direction every serious enterprise dev platform is heading. The claim worth testing is whether a 25-year head start on compliance primitives is actually a moat or just a nice-to-have a well-funded startup replicates in 18 months.

The Enterprise Buyer. This is where the episode earns its keep. Martin describes customers who have fully built, tested, working agentic systems sitting idle in a compliance backlog, waiting for legal to approve a specific model, including a review of whether that model's training data was "legally acquired." Read that twice. The blocker isn't "does it work." It's "can we prove the vendor didn't train on stolen data." That is a procurement requirement the frontier labs have mostly not answered, because answering it honestly is awkward. Any lab selling into banking, insurance, healthcare, or government is about to meet a legal questionnaire its training process can't cleanly pass.

Where these part ways. The Compute Pragmatist and the Skeptic disagree on how much of the spend drop is structural versus one vendor getting its house in order. If it's structural, frontier-model revenue from enterprise has a ceiling nobody priced in. If it's just OutSystems optimizing, it's a footnote. The Researcher and the Enterprise Buyer split on the moat: the Researcher thinks the deterministic-code trick is replicable, the Buyer thinks 25 years of regulated-industry trust is the actual product and the code pattern is secondary. Both can't be the main thing.

What it hinges on. One belief: is enterprise frontier-model usage getting rationed as a durable habit, or is this a blip? The evidence in this episode leans toward durable. Martin, Microsoft, and Meta all independently pulled back after seeing bills, and the routing tools that make rationing easy are now standard. Before anyone rebuilds a cost model on this, the thing to verify is your own routing: measure what fraction of your agent jobs genuinely need a top-tier model versus a cheaper one. Most teams have never checked, and the answer is usually "far fewer than you're sending there."

Prediction: At least one of OpenAI, Anthropic, or Google will publicly publish training-data provenance documentation or a formal indemnification offer aimed at regulated-industry buyers, by Google Cloud Next in April 2027.

Confidence: Medium. The buyer demand is explicit, but labs move slowly on anything that exposes training practices.

Why: Martin describes real, built agentic systems stuck in compliance backlogs specifically over whether a model's training data was legally acquired, and he frames this as a bigger blocker than uptime or capability. That's a procurement requirement the labs currently can't answer, and regulated sectors (banking, insurance, healthcare, government) are exactly where the enterprise money is. When a named, high-margin customer segment is blocked on one specific document, a vendor eventually ships that document or an indemnity that makes the legal question moot, because the alternative is watching deals die in legal review. The opposite outcome, total silence, is less likely because at least one lab will treat provenance assurance as a sales wedge against the others rather than leave the money on the table.

Revisit by 2027-04-30: We're right if OpenAI, Anthropic, or Google publishes training-data provenance documentation or a formal regulated-industry indemnification offer by April 30, 2027. We're wrong if all three still offer only generic copyright indemnity with no provenance disclosure by that date.

One more thing worth saying plainly: Martin is bullish on junior, "AI-pilled" talent while the rest of the industry frets about AI replacing entry-level work. He's betting the people who grew up building with these tools out-innovate the veterans. That's the contrarian call in the episode, and he put his hiring where his mouth is.

Comments