Refacto AI

Podcast episode

The Real Future of AI and Work

agents build-vs-buy inference model-pricing orchestration

Nathaniel Whittemore walked through 25 essays from Dan Shipper's Every publication on how AI reshapes work. The organizing idea: as frontier models converge on similar capabilities, competing on model choice stops making sense, and the advantage moves to the coordination layer around the model.

The two claims worth keeping: Shipper's observation that models train on the "residue" of expertise, meaning the parts already written down, so their default output commoditizes fast and your edge becomes judgment about novel, underspecified situations nobody has documented yet. And Tom Critchlow's point that agents run in seconds while approval flows run weekly, so governance design matters as much as agent design. Tina Ha's vision of headless software agents autonomously canceling enterprise contracts at 2am is the splashy one, but agents don't hold credentials, budget authority, or liability yet.

The efficiency-vs-opportunity framing from Whittemore is worth stealing: if every AI pilot has to show ROI on day one, you'll only ever build cheaper versions of what you already do.

Analysis

Showing the shorter version.

Every published 25 essays on how AI reshapes work, and NLW walked through the best of them on a recent episode. The through-line: as models converge on capability, the moat moves off the model and onto the plumbing around it. Coordination speed, machine-to-machine APIs, workflow design.

The sturdiest idea in the episode

Dan Shipper's mechanism is worth keeping. Models train on the residue of expertise, the part that was already written down, so default AI output commoditizes fast and the premium shifts to judgment about what to do right now, in your specific situation, with context nobody documented. Frontier models crush static benchmarks and still flail on novel, underspecified problems. Your team's edge is the stuff nobody wrote down yet.

Tom Critchlow's coordination-latency point runs parallel. Your agents execute in seconds; your approval flow runs weekly. The agent sits idle waiting for a human to rubber-stamp. If you build the agent without redesigning the governance flow at the same time, the agent's speed is theater.

The efficiency-vs-opportunity split

NLW's framing here is a real prioritization tool. If every AI pilot has to clear an ROI gate on day one, you will only ever build cheaper versions of what you already do. That kills the exploratory work that finds net-new value. Strip the ROI gate from one pilot for 90 days and see what surfaces. That's the one claim in this episode you can actually test inside your own shop.

The claim to be skeptical of

Tina Ha argues that headless agents will become rational actors, canceling a $30K CRM contract at 2am because switching costs vanished. Concrete, falsifiable, and mostly wrong for now. Agents don't hold credentials, budget authority, or legal liability. No company hands a bot the sign-off on a five-figure commitment, because a wrong call is unrecoverable and unattributable. Every production agent deployment today keeps a human on any transaction that spends real money.

The call

No AI agent will autonomously cancel or switch a paid enterprise SaaS contract of $10K+ annual value, acting on its own authority without a human approving the specific transaction, in a documented production case by May 1, 2027. Confidence: medium. The blocker is governance and liability, not model capability. Revisit then: we're right if no documented case exists; we're wrong if a company publicly logs an agent doing exactly that in production.

Also covered this issue

Comments