Podcast episode
How to Help People Thrive with AI
ai-in-adtech build-vs-buy engineering
This episode of How to Help People Thrive with AI isn't reporting news — it's making an argument: the AI payoff isn't automating individual tasks, it's redesigning entire workflows. The hosts draw on a Section survey, an MIT study on AI and brain activity, and Uber's internal "agentic pods" program to build the case.
The Section data is the most credible piece here: 69% of organizations claim they're deploying AI agents (software that can take multi-step actions autonomously), but only 16% of workers have actually used one, and fewer than 10% can define what an agent is. That's a real adoption gap. Uber's numbers are flashier — "15 hours to 30 minutes," entire workflows rebuilt in two weeks — but those figures come from internal demos, not audited results. The MIT brain-connectivity findings are based on roughly 54 subjects and shouldn't be driving governance policy.
The pod model — pair an AI-fluent engineer with a domain expert, timebox to two weeks, redesign one full workflow — is the one actually copyable idea. The jaw-dropping speedups are marketing until someone shows you the error rate.
Full analysis
This episode isn't a news story — it's an editorial argument. The claim: the AI payoff isn't automating existing work, it's redesigning whole workflows and expanding what people can do. The evidence base spans a David Brooks essay on cognitive habits, an MIT study on brain-connectivity decline during AI use, Section's data showing a huge gap between orgs "doing AI agents" (69%) and workers actually using one (16%), and Uber's "agentic pods" program with eye-popping speedups. For a technical AI leader, the decision hidden inside is: how should you structure agent deployment inside your own org — task-level automation, or workflow-level redesign — and how much of the "readiness gap" is real versus a training-budget line item?
Reversibility: Type 2. Nothing here forces a commitment. It's an operating-model question you can pilot and reverse. That argues for fast, cheap experiments over deliberation.
Forcing function: None external. The only urgency is competitive — if Uber-style pod velocity is real, teams that don't restructure fall behind on internal tooling throughput.
The Skeptic — Uber's numbers are a CTO's tweet, not an audited case study. "15 hours to 30 minutes," "2 weeks to 50 minutes" — these are the exact shape of metrics that survive a demo and die in an audit. What's the error rate on the capital-allocation agent across 150 cities? Nobody says. "70% of pull requests attributed to agents" counts trivial diffs the same as hard ones. And the MIT "55% brain connectivity drop" study had ~54 subjects writing essays — it does not generalize to "your engineers get dumber." Two contradictory panics are being sold at once: agents are transformatively productive and they atrophy your brain. Pick one. For the PM: treat the jaw-dropping speedups as marketing until someone shows you the quality bar they cleared.
The Researcher — Separate the tiers of evidence. Section's proficiency survey is the credible, actionable finding: a 69%-vs-16% gap between organizational action and actual agent use, with <10% of workers able to define an agent. That's a real, measurable adoption bottleneck. The ActiveTrack/Berkeley finding — AI adopters' messaging time doubled and focused work fell 9% — is the genuinely interesting result, because it contradicts the productivity narrative: AI adopters got busier, not freer. The MIT and Possibility Sciences neuro-claims are small-n and over-extrapolated; don't build governance policy on a 40% gamma-wave delta. For the PM: the trustworthy takeaway is that buying agent tools ≠ people using them, not that AI rots brains.
The Builder — The pod model is the one genuinely copyable artifact here, and it maps directly onto what forward-deployed engineering already proved: pair someone fluent in the tools with someone who owns the domain, timebox to two weeks, ship one workflow. That works in ad-tech right now — campaign QA, financial pacing, taxonomy mapping, brand-safety review are all multi-step workflows begging for agent redesign, not single-task prompts. "Workflow as the unit of automation" is the correct pricing and scoping insight: point solutions ("summarize this") underdeliver against redesigning the pacing report end-to-end. For the PM: don't ask "what task can AI do?" Ask "what two-week workflow can a paired engineer-plus-expert rebuild?"
The Open-Source Advocate — Notice what's not in this episode: no frontier-model dependency. The Uber wins are agent orchestration and workflow plumbing, not GPT-5-class reasoning. That's the opening for open weights. Capital-pacing reports and QA loops run fine on a fine-tuned Llama or Qwen model behind your firewall — and for internal tooling touching financial and legal data, on-prem is a feature, not a compromise. The moat Uber built is 2,500 internal "agent skills," which is reusable tooling, not a model contract. For the PM: the readiness gap is a people-and-tooling problem, so vendor lock-in buys you little; keep the model layer swappable.
The Enterprise Buyer — The number that should scare a CTO isn't the brain study, it's that only 30% of employees at agent-deploying orgs got any agentic training. You're paying for seats nobody can use. The champions model (one law firm formalized ~60 internal super-users) is the actual procurement lesson: budget for enablement as a line item, not an afterthought. And the atrophy research, however shaky, will land in board and works-council conversations — especially in EU jurisdictions. Vendors who ship "augment, don't replace" workflows with audit trails win the contract over those pitching headcount reduction. For the PM: the buying committee will ask "what happens to our people?" long before "what's the token cost?"
Where the council splits:
-
Skeptic vs. Builder on the Uber numbers. The Builder wants to copy the pod template tomorrow; the Skeptic says the speedups are unaudited and quality-blind. They reconcile only if you copy the structure (paired sprints, workflow scope) while refusing to copy the claimed metrics as a target.
-
Researcher vs. everyone on the neuro-panic. The cognitive-atrophy studies are the episode's most viral hook and its weakest evidence. The Enterprise Buyer says it doesn't matter — it'll shape procurement regardless of whether it replicates. That tension is the real one: a weak result can become a strong buying criterion.
-
Open-Source Advocate vs. the implicit frontier assumption. The episode never asks what model powers the pods, because the value is in orchestration. If that's true, the whole "which lab" debate is a distraction for internal-tooling use cases.
What it hinges on: whether workflow-level redesign actually beats task-level automation on sustained, quality-adjusted output — not on a launch-week demo. And whether the adoption gap closes through training or stays stuck because most knowledge workers don't want to become agent-builders.
What to verify before you restructure: run one pod against one real ad-tech workflow (pacing, QA, or taxonomy mapping) for two weeks, and measure not the speedup but the rework rate — how often a human has to fix the agent's output over a full month. That's the number Uber's tweet omits and the one that decides whether this is a template or a demo.
Prediction: By the time Section (or a comparable firm like Gartner or Slack's Workforce Lab) publishes its next AI-proficiency/readiness survey in the first half of 2027, the reported gap between organizations "taking action on AI agents" and employees actually using an agentic tool at work will still be at least 30 percentage points wide.
Confidence: Medium — Tooling ships far faster than workforce behavior changes.
Why: The current data shows a 69%-vs-16% split — a 53-point gap — driven by the fact that under 30% of employees at agent-deploying orgs got any training, and fewer than 10% can even define an agent. Buying and announcing agent tools takes a quarter; retraining a workforce to redesign its own workflows takes years, and the ActiveTrack finding (adopters got busier, not freer) suggests the early experience often disappoints and stalls uptake. For the gap to close below 30 points by mid-2027, adoption would have to accelerate faster than any enterprise software behavior-change curve on record — while a fresh wave of cognitive-atrophy headlines gives cautious orgs a reason to slow-walk. The gap narrowing modestly is likely; collapsing is not.
Revisit by 2027-06-30: We're right if the next major workforce-AI readiness survey shows an "org action" vs. "actual agent usage" gap of 30+ points. We're wrong if that gap closes to under 30 points, or if actual agentic-tool usage among surveyed workers clears ~45%.
Comments