Refacto AI

Industry story

Chinese labs now lead open-weight AI models by widening margin

evals gpu-supply open-weights security

Nathan Lambert, a researcher who helped build the Allen Institute for AI's Olmo models, briefed Congressional members and staff on the state of open-weight AI models (models whose internal parameters are publicly available for download and reuse) in the context of U.S.-China competition. His central finding: Chinese open-weight models surpassed American ones roughly 18 months ago, and the gap is widening. On the Artificial Analysis Intelligence Index benchmark, the top Chinese models score 42–45 while the leading American open-weight models score 23–26. Chinese models now account for over 80% of usage on OpenRouter, a popular multi-model inference platform, up from ~70% a year earlier, and are mentioned in ~40% of AI academic papers versus ~30% for American models.

Lambert estimates that Chinese open-weight models sit roughly 2–5 months behind the closed American frontier (OpenAI, Anthropic), while American open-weight models are 6–9 months behind. He attributes China's lead partly to faster release cadences and a narrower task focus that flatters public benchmarks, but concludes the models are 'genuinely strong.' He also argues that distillation—training one AI model on outputs from a stronger one—explains only 1–2 months of China's advantage, meaning the gap is structural. The policy implication he draws: restricting Chinese open-weight models would primarily harm American businesses, not Chinese labs, and the better path is sustained U.S. investment in open models.

Analysis

Showing the shorter version.

Chinese open-weight models lead by a widening margin

Nathan Lambert, who helped build the Allen Institute's Olmo models, told Congress that Chinese open-weight models passed American ones roughly 18 months ago and the gap is still growing. Open-weight means you can download the model and run it yourself. On the Artificial Analysis Intelligence Index, top Chinese models score 42 to 45; the best American open models score 23 to 26. Chinese models now account for over 80% of usage on OpenRouter, a service that routes developer requests across many models.

The policy conclusion Lambert draws is that banning Chinese open models hurts American businesses more than Chinese labs. He's probably right on the economics. But the security argument deserves separate treatment, and his testimony largely skips it. You cannot recall a downloaded weight file. If a model crosses a real threshold for helping with bioweapons or cyberattacks, 3.2 billion downloads is a distribution event with no unwind. Funding American labs fixes the competitiveness problem. It does nothing about the capability compounds while the ability to restrict it decays.

Two things complicate the clean "China leads" headline. First, OpenRouter skews heavily toward developers and hobbyists. In production, where legal and compliance teams have a vote, Meta's Llama still wins because it comes with indemnification and audit trails that no Chinese open-weight model offers contractually. Second, Lambert's own caveat: Chinese models have a narrower task focus that flatters public benchmarks. Strong on evals, possibly weaker on the boring long-tail enterprise work that never shows up in a composite score.

The more interesting finding in the testimony is on distillation. Lambert says training on stronger models' outputs explains only one to two months of China's lead, meaning the rest is real engineering. The export controls on NVIDIA chips may have accelerated this rather than slowed it down, by forcing Qwen's team at Alibaba to obsess over data curation and architecture efficiency instead of throwing more compute at problems.

If you're running a pipeline built on Qwen and an export order lands, you're not swapping a config line. You're re-running training on a new base and re-validating outputs. That migration plan should exist now, before it's an emergency.

Prediction: At least one of Amazon, Microsoft, Google, or Meta will announce official first-party hosting or enterprise support for a Chinese open-weight model family (Qwen, DeepSeek, Kimi, or GLM) by mid-2027. Medium confidence. Developer demand is already measurable. The blocker is political optics, and that resolves the moment any one competitor moves first or a customer contract demands it.

Also covered this issue

Comments