Refacto AI

Podcast episode

The Most Important AI News This Week Is Getting Overlooked

agents gpu-supply inference model-pricing open-weights

Nathaniel Whittemore's AI news roundup for the week leads with two frontier-class models dropping on the same Thursday: Microsoft's MAI Base 2, trained with no borrowing from OpenAI, and Meta's Llama Spark Open, which ships with full downloadable weights so you can run it on your own hardware. Whittemore's read is that the number of labs capable of training at the frontier just went from two to six.

The substance is messier. MAI Base 2's benchmark came from Mustafa Suleyman's internal town hall, which is a morale tool before it is a data point. The model is also a base model, meaning it hasn't been through the refinement that makes it usable. Llama Spark Open scores 17th overall on Artificial Analysis, an independent benchmarking firm. "Most capable US open-weight model" and "17th overall" are both true at the same time, which tells you how narrow the win is.

The Replit signal is more concrete than any of it. Replit, a developer platform, publicly confirmed it stopped working with Anthropic the same week. When a buyer that size moves, frontier lock-in stops being a conference topic.

Full analysis

Two models dropped on the same Thursday, and together they say something worth more than either does alone: the group of companies that can train a frontier-class model from scratch just got bigger. Microsoft's MAI Base 2 (a 2.8-trillion-parameter model, though only 80 billion of those parameters actually fire on any given request) was trained with no borrowing from OpenAI's models. Meta's Muse Spark Open (816 billion parameters, 42 billion active) ships with the full weights downloadable, so you can run it on your own hardware. The through-line is enterprise choice. The question is whether that choice is real yet, or just real on paper.

This is hard to undo in one direction only. Testing a new base model costs you an eval and a weekend. Rebuilding your whole stack around "model sovereignty" because a town-hall slide impressed you is the expensive mistake. Nothing here sets a deadline. No contract is expiring. This is a "watch the floor move" story, not a "sign by Friday" one.

The Skeptic

Mustafa Suleyman told his own staff that MAI Base 2 beats the model behind GPT-5 at a quarter of the compute. That comparison used private Microsoft-OpenAI data and nobody outside has checked it. An internal town-hall number is a recruiting pitch and a morale tool before it is a benchmark. Treat it as such. And MAI Base 2 is a base model, meaning it hasn't been through the training that turns a raw model into something you'd actually use. "If post-training brings it to near-frontier" is doing all the lifting in NLW's "two labs to six" line. We have a strong raw ingredient and a hopeful sentence about the finished dish. Those are not the same thing.

The Researcher

Look at Muse Spark Open's actual public score. Ignore the press line. Artificial Analysis, an independent firm that benchmarks models, put it at 39 overall. That's tied with DeepSeek V4.1 Flash, 17th overall, 7th among open models. "Most capable US open-weight model to date" and "17th overall" are both true, which tells you how narrow the win is. Nathan Lambert, who tracks open models closely, is right that it halves the gap to the Chinese open models on agentic work, meaning multi-step tasks the model runs on its own. But GLM 5.3 and Kimi K3 still lead. And note the anti-library: a 501B open model called Beam, Apache-licensed, same 1-million-token context, same coding-and-agent target, landed the same week. The open-weight frontier now has three credible entrants arriving within days of each other.

The Open-Source Advocate

This is the genuinely good news. For the first time a US-origin open-weight model lands near the frontier on agentic tasks, with weights you can download and Apple's MLX toolkit tuned to run it on a Mac Studio. For any team that avoided Chinese base models over compliance or geopolitics, a door that was closed is now open: private inference, on-premise, or a quantized version (a compressed copy that trades a little accuracy for far less memory) on cheaper hardware. The caveat is the bill. The full model wants about a terabyte of memory, roughly $40,000 in Mac hardware. "You can own it" is true. "You can own it cheaply" is not, unless you quantize and accept the quality hit.

The Compute Pragmatist

The MAI Base 2 training run is the number I'd anchor on: 16,000 of NVIDIA's newest GB200 Blackwell chips, 38 days, a claimed 12x better pre-training efficiency than DeepSeek V4 Pro. If even half of that efficiency claim holds, the cost of reaching the frontier is falling fast, and that is what lets six labs exist where two did. But read it against the Newcomer piece in the anti-library: rising interest rates are squeezing the neoclouds (the smaller GPU-rental shops), and Ramp's data shows AI token spend leveling off. Cheaper-to-train frontier models arriving exactly as the money gets tighter is the real setup here. Cognition's move on Devin fits the same squeeze: it now hands you more token budget only if its AI judges you used the last batch efficiently, scoring your session against how long a human would have taken. Credit-scoring for compute. That only appears when compute stops feeling free.

The Builder

What ships Tuesday? Muse Spark Open does, today, across the major inference providers with weights you can pull down. That's a real option this week. Microsoft's Frontier Tuning, the product that lets you fine-tune on top of their base model, is the one to pressure-test before believing. The more useful signal is in the anti-library: Replit, an AI coding platform developers actually love, told TechCrunch on the same Thursday it has stopped working with Anthropic. That's not a slide. That's a real company moving its spend. When a buyer that size switches, the lock-in thesis stops being a panel topic and starts being a line in someone's budget.

Where they disagree

The Skeptic and the Open-Source Advocate split on what "arrived" means. One says a base model plus a hopeful sentence is not a frontier lab; the other says a downloadable near-frontier open model is a capability that didn't exist last week, finished product or not. Both are right about different things: Muse Spark Open is real and usable now, MAI Base 2's "parity" is a claim with no outside check.

The Researcher and the hype split on the scoreboard. "First US open model near the frontier" and "17th overall, behind the Chinese leaders" describe the same model. The gap narrowed. It did not close.

The Compute Pragmatist sees the tension nobody on the call quite named: training got cheaper the same week the capital got more expensive. Aaron Levy of Box says all this "dramatically increases token consumption." Cognition is building tools to rein token consumption in. They cannot both be the dominant force.

What it hinges on

Whether MAI Base 2 becomes a product you can buy, or stays an internal milestone. Whether the independent benchmarks confirm Microsoft's private "quarter of the compute" claim once there's a finished, post-trained model to test. And whether real buyers keep moving the way Replit just did. The first two are capability questions a benchmark will answer. The third is already happening. Before anyone rewrites a stack around "sovereignty," the thing to verify is simple: run your own eval on Muse Spark Open against whatever you pay for today, on your own tasks, and see if the gap is worth the $40,000 of memory or the quantization hit.

Prediction: When Artificial Analysis publishes its first independent benchmark of a post-trained, finished version of Microsoft's MAI Base 2, that model will score below the top-tier closed models (GPT-5-class, Claude Opus 5.5-class) on its overall index, by the end of Q1 2027.

Confidence: Medium Base-model promise rarely survives fully into a finished product.

Why: Suleiman's "beats GPT-5 at a quarter the compute" claim rests on private data nobody outside Microsoft has checked, and it describes a base model, the raw version before the training that makes a model usable. Microsoft's last attempt, the MAI-1 family, was described as underwhelming after a strong-sounding start, so the pattern of a good pre-training result not translating to a frontier finished product is already on the record here. Independent scoring is the test that matters: Muse Spark Open's own press line said "most capable US open-weight model" while Artificial Analysis put it 17th, which shows how far public framing runs ahead of the neutral scoreboard. The opposite outcome, MAI Base 2 landing in the top tier on an independent index, would require the one-quarter-compute claim to hold up unverified and the post-training to add no gap, which is the less likely of the two.

Revisit by 2027-03-31: We're right if Artificial Analysis's overall index places the finished, post-trained MAI model below GPT-5-class and Claude Opus 5.5-class closed models. We're wrong if it scores at or above either of them on that index.

One more thing the episode got right without saying it plainly: the story isn't Microsoft or Meta. It's that three open-weight frontier-class models landed in a single week while the money funding all of this got tighter. That combination is what diversifies the supply stack, whether or not any one of these models turns out to be the winner.

Comments