Podcast episode
How the 4 New AI Models Change How You Work
ai-in-adtech cost-compression engineering
TL;DR
A dense model-release episode covering four new AI systems dropped in one week: OpenAI's GPT Live (voice), xAI/Cursor's Grok 4.5 (coding/agents), Cognition's SWE-1.7 (fast implementation model), and OpenAI's GPT-5.6 "Sol" (daily-driver workhorse). The episode is primarily a practical evaluation of each model's capabilities, positioning, and workflow implications — high signal for AI practitioners choosing between frontier models.
What was covered
-
GPT Live (Live 1 & Live Mini): OpenAI's new voice model built on a "full duplex" architecture — meaning it listens and speaks simultaneously rather than waiting for silence to detect turn-ends. Prior cascaded system (speech-to-text → LLM → text-to-speech) has been retired; Live 1 offloads heavy reasoning to GPT-5.5/5.6 running in the background while maintaining continuous conversation. Optimized for consumer/Siri-style use cases; testers note impressive naturalness but limited deep reasoning in the voice layer itself.
-
Grok 4.5: First model from xAI post-Cursor acquisition, explicitly built for coding and agentic tasks. Benchmarks roughly match Claude Opus 4.8 and GPT-5.5 on TerminalBench 2.1, SWE-bench Pro, and DeepSWE 1.0, but at radically lower cost: 31 cents per task vs. $1.80 for Opus 4.8 and $2.75 for Fable 5 (host's names for Claude and GPT flagship models). Tops AutomationBench (xAI's tool-use/SaaS workflow benchmark) at 51.4% vs. Fable's 48.6%, at 34 cents per task vs. $1.35. Positioned as a strong implementation/sub-agent model rather than orchestrator.
-
Cognition SWE-1.7: Fine-tuned on Kimi K2.7 base; targets the "implementation tier" alongside Cursor's Composer 2.5. Benchmarks slightly above GLM 5.2 and Composer 2.5 at half-to-one-third the cost of frontier models. Key story: Cognition pushed RL (reinforcement learning — a technique where models learn by trial and reward) post-training on an already heavily trained base and saw unexpected gains, suggesting RL ceilings aren't yet hit. Notable for extreme inference speed ("eyes can't keep up").
-
GPT-5.6 "Sol": Early-access reviews now accumulating. Characterized as a highly diligent, fast "workhorse" — best for browser use, front-end design, legal research, marketing copy, and multi-step task completion. Consistently one-shots tasks where prior models fail. Compared unfavorably to Fable 5 on raw reasoning depth, but preferred for daily-volume work. Every (AI research firm) named it their default daily driver after a month of internal testing.
-
Model architecture shift: Emerging pattern of "orchestrator + sub-agent" stacks: a frontier reasoning model (Fable 5, GPT-5.6) directs cheaper, faster implementation models (Grok 4.5, SWE-1.7, Composer 2.5) for execution. GPT Live extends this pattern into voice interfaces.
-
Rumored near-term releases: Leaker "Leo" (synthwave on X) and commentator Andrew Curran both claim GPT-6 could arrive within ~4 weeks, built on a "significantly larger pre-train" than the 4-trillion-token base used for GPT-5.5/5.6. Fable 5.1 reportedly in late pipeline at Anthropic. Elon Musk said to have a 10-trillion-parameter Grok in training.
-
Enterprise positioning of Grok 4.5: Because Cursor already has enterprise penetration, Grok 4.5 effectively has a distribution channel inside corporate environments — framed as a competitive threat to Chinese open-weight models (Kimi, GLM) that offer similar cost/performance but face data-sovereignty concerns.
Notable claims & predictions
-
Sam Altman (OpenAI): "GPT Live launches today in ChatGPT — it feels magical and real. I have always preferred typing to talking to an AI. Now I think that's going to shift." — Signals OpenAI believes voice will displace text as the primary interaction mode.
-
Elon Musk (xAI): "In fairness, Fable is definitely better than Grok 4.5, but most tasks don't require Fable-level capability." — Rare public concession on relative model quality, deliberately positioning Grok 4.5 as the cost-efficient implementation layer.
-
Cognition founder Silas Alberti: On SWE-1.7's RL training: "At some point it suddenly started working and the model magically improved by much more than we expected. It also seems like the ceiling isn't obviously hit yet." — Challenges the prevailing industry narrative that RL post-training hits diminishing returns quickly on already-tuned models.
-
Peter Gostev (Arena AI): "Fable is a wise owl who is very thoughtful and well-spoken. GPT-5.6 Sol is like a rottweiler who will grab the problem by the throat and not let it go until it's done… It is an insanely capable workhorse. Nothing is beneath it." — Sharpest characterization of the Fable vs. Sol tradeoff circulating in practitioner circles.
-
Andrew Curran (commentator, non-anonymous): "GPT-6 is the next release from OpenAI. It's their true answer to Mythos [Fable 5] and it will arrive much sooner than people expect — possibly within the next four weeks… Both OpenAI and Anthropic see nothing above us but air. No ceiling." — Strong claim about capability trajectory and release timing, though subject to government-imposed delays as seen with prior releases.
-
Ethan Malik (AI researcher): "Both Sol and Fable represent jumps over previous models and have opened a large gap with the next best AIs. If you're doing any work where better intelligence matters, those two models are your only choices." — Frames the frontier as a two-model race, everything else a tier below.
Why this matters for AI operators
-
Orchestrator/sub-agent economics are crystallizing. The emerging stack — a frontier reasoning model as orchestrator directing cheaper, faster implementation models — is moving from architectural concept to deployable reality. Grok 4.5 at 31 cents/task vs. Opus at $1.80 means cost-sensitive production pipelines have a credible Western-built alternative that doesn't carry Chinese open-weight compliance risk. Operators building multi-agent systems should be repricing their inference budgets now.
-
Voice as a coordination layer, not just a consumer feature. GPT Live's full-duplex architecture with background model delegation mirrors the multi-agent orchestration pattern in text. For enterprise operators, voice-first interfaces become viable for workflows where users coordinate multiple AI tasks concurrently — internal tooling, customer service, field operations — rather than just consumer chatbot use.
-
Application-layer fine-tuning on open bases is a repeatable playbook. Cognition (SWE-1.7 on Kimi K2.7) and Cursor (Composer 2.5 on Kimi) both demonstrate that companies with proprietary UX/interaction data
Full analysis
Four frontier models dropped in one week, and the story underneath the release-note noise is an architecture shift: a expensive "thinker" model orchestrates cheaper, faster "doer" models that do the actual work. For anyone building AI into an ad-tech stack — bidding logic, creative generation, campaign agents — the question isn't "which model is smartest" anymore. It's "which model do I put in which slot, and what does the whole pipeline cost per task at production volume?"
Reversibility: Mostly Type 2. Swapping an implementation model behind an orchestrator is a config change, not a rewrite — if your abstraction layer is clean. The Type 1 risk is committing your agent architecture to a single vendor's orchestration pattern before the pattern stabilizes.
Forcing function: Real but soft. Grok 4.5 shipped in pydantic-ai v2.7.0 and GPT-5.6 is GA on Azure Databricks today — the tooling is live, so this isn't vaporware you can defer. But no contract is expiring this week.
The Skeptic — The benchmark that matters here isn't SWE-bench, it's AutomationBench — and it's xAI's own benchmark, where Grok 4.5 conveniently wins at 51.4%. Read that number the way you'd read a vendor's own case study. The "31 cents per task" figure is the seductive part, but per-task cost on a curated eval set tells you nothing about your task distribution, where a cheap model fails the hard 15% and your orchestrator burns tokens retrying. The real bill is retries plus the expensive model cleaning up. For a PM: the cheap model is cheap until it's wrong, and wrong is expensive in a bidding pipeline.
The Researcher — The genuinely new claim is Silas Alberti's: RL post-training on an already-saturated base (Kimi K2.7) produced gains "the ceiling isn't obviously hit yet." If that reproduces, it means small teams can keep squeezing capability out of open bases without a new pre-train — which is the whole reason SWE-1.7 and Composer 2.5 exist. Everything else is incremental. GPT Live's full-duplex voice (listens and speaks at once instead of waiting for silence) is an interaction upgrade, not a reasoning one — the heavy thinking is offloaded to GPT-5.5/5.6 in the background. For a PM: the voice model isn't smarter, it just talks more naturally while a bigger model does the thinking behind it.
The Open-Source Advocate — Note what the two most interesting new models are built on: Chinese open weights. SWE-1.7 fine-tunes Kimi K2.7; Composer 2.5 also rides Kimi. The proprietary layer isn't the base model — it's the interaction data Cognition and Cursor own. That's the repeatable playbook for ad-tech: your first-party auction logs, creative-performance data, and bid outcomes are the moat, not the model. The episode frames Grok 4.5 as the "Western alternative" to Kimi/GLM for data-sovereignty reasons — but that framing exists precisely because the open Chinese models are good enough to threaten. For a PM: the cheap models everyone's excited about are mostly Chinese open weights with a Western wrapper.
The Compute Pragmatist — The orchestrator/sub-agent split is really an inference-economics story. If Grok 4.5 matches Opus 4.8 on coding at 31¢ vs $1.80, that's ~6× cheaper for the execution tier — and execution is where the token volume lives. A campaign agent that runs a million task-steps a day pays for the expensive orchestrator only on the routing decisions, not every step. That's the number to model. But watch the second-order cost: full-duplex voice and always-listening agents mean continuous inference, not request-response bursts. Your bill stops being per-query and starts being per-minute-of-attention. For a PM: the pricing model is quietly shifting from "pay per question" to "pay to keep the AI awake."
The Builder — What actually ships Tuesday: your model router. The whole thesis collapses if you've hard-coded one provider's SDK. Ken's team already has the shape of this right — Claude with its own Jira identity posting to Slack, per-session cost analysis via merge request, a configurable "make it more adversarial" instruction knob. That's the orchestration substrate. Dropping Grok 4.5 or SWE-1.7 into the implementation slot behind that is a swap, not a project — pydantic-ai already supports Grok 4.5 as of v2.7.0. The trap: none of these models are drop-in equivalent on your evals. You need a task-level harness that scores each on your real workflows (bid optimization, brand-safety classification, creative copy) before you route production traffic. For a PM: build the switchboard first, pick the models second.
Where they disagree:
-
The Skeptic vs. The Compute Pragmatist on the 6× cost win. The Pragmatist sees a real repricing opportunity in the execution tier. The Skeptic says the headline per-task cost hides retry cascades and orchestrator cleanup, and that xAI's home-field benchmark inflates the case. This is the crux: the savings are real only if the cheap model's failure rate on your task mix is low enough that retries don't eat the margin.
-
The Open-Source Advocate vs. the "Western alternative" framing. The episode sells Grok 4.5 as the compliance-safe escape from Chinese open weights. But the Advocate points out the actual innovation (SWE-1.7, Composer 2.5) is built on those same Chinese weights — so the moat was never the base model. If your data is the moat, the sovereignty argument for paying a premium weakens considerably.
-
The Researcher vs. everyone on durability. If Alberti's "RL ceiling isn't hit" holds, the implementation tier gets cheaper and better every few months, and any model commitment you make now is a six-month asset. If it doesn't reproduce, today's price gaps are more stable and worth building around.
What this hinges on: Not "which model wins." It's three beliefs. (a) Does a cheap implementation model's failure rate on your task distribution stay low enough that the 6× cost gap survives retries? (b) Is your data — auction logs, creative performance — the real moat, making base-model choice a swappable commodity? (c) Does the RL-on-saturated-base result reproduce, meaning the cheap tier keeps improving?
The council leans toward: build the router, treat models as commodities, own your eval harness. The direct ad-tech impact of these specific releases is low — nobody's launching a new ad product because Grok 4.5 exists. The structural impact is real: the orchestrator/sub-agent stack is now the default shape, and it maps cleanly onto agentic-bidding architectures like the ones being positioned in the QuantumPath discussions. What to verify before repricing anything: run your top three real workflows through Grok 4.5 and SWE-1.7 as implementation models behind your existing orchestrator, measure end-to-end cost including retries and orchestrator escalation — not the vendor's per-task number.
Prediction: By OpenAI's next flagship release (GPT-6, which the episode's leakers place within ~4 weeks — so by 2026-09-30), the "orchestrator + cheap sub-agent" stack will be the explicitly documented default in at least two of the major agent frameworks (LangChain, pydantic-ai, OpenAI Agents SDK, or CrewAI), with built-in model-routing/tiering as a first-class feature rather than something you hand-roll.
Confidence: Medium — The tooling is already moving this direction; pydantic-ai and Agents SDK shipped multi-model support this week.
Why: The saved-reading releases show framework maintainers adding Grok 4.5 and GPT-5.6 support within days of launch, and the entire episode describes the tiered stack as an established pattern practitioners already run. Framework authors follow real usage, and multi-model routing is the obvious next abstraction once every team is manually splitting orchestrator and implementation roles.
Revisit by 2026-09-30: We're right if at least two major agent frameworks document first-class model-tiering/routing (orchestrator vs. implementation) as a supported feature. We're wrong if routing remains something developers assemble manually with no framework-native support.
Comments