Refacto AI

Industry story

Wave of AI Lab Defectors Testify at NYC Hearing on AI Danger

ai-in-adtech big-tech guardrails

New York City held an eight-hour public hearing on AI risk featuring sworn testimony from prominent AI safety defectors including Daniel Kokotajlo (ex-OpenAI) and Jacob Coxon (ex-Anthropic). Kokotajlo testified that even if AI labs maintain control of superintelligent AI systems, the CEOs should not be trusted with that level of power given the risk of enabling dictatorship or oligarchy. Coxon testified that he resigned after directly hearing from senior Anthropic researchers that 2027 is the expected inflection point for 'things getting crazy,' and that the model generation after next may be capable of autonomous idea generation at human-expert level.

New York Magazine simultaneously published a cover feature interviewing eight prominent AI lab defectors — including Miles Brundage, Rosie Campbell, Jacob Coxon, Jacob Hilton, Pamela Mishkin, Daniel Kokotajlo, Alex Turner, and Jeff Wu — exploring why they chose to leave and speak publicly. The piece is described as a strong introduction for general readers to the internal culture of frontier AI labs and the growing 'preference cascade' of employees publicly warning about the risks of their own employers' work.

Analysis

Showing the shorter version.

Eight former AI lab researchers testified under oath at an eight-hour New York City hearing on AI risk last week. The claim that travels furthest: Jacob Coxon, formerly at Anthropic, said senior researchers there told him 2027 is when "things get crazy."

For an operator, this isn't a product change or a price signal. It's a leading indicator on regulation and procurement pressure, and the lag before it costs you money is measured in quarters, not years.

What the testimony actually contains

Almost no new technical claims you can check. Coxon's 2027 line is secondhand. Daniel Kokotajlo's framing, that AI lab CEOs can't be trusted with superintelligence, is a philosophical position, not a measurable one. Eight people out of several thousand lab employees is a self-selected group, several with book deals ahead of them. The 2027 timeline is a repeat of dates that have slid before.

What is new: sworn, dated, on-the-record testimony. Congressional staff and EU AI Office officials read public hearing transcripts in ways they never read a Twitter thread. That creates a paper trail that procurement risk committees can actually cite.

Where it costs you money

If you sell AI into banks, insurers, or regulated firms, expect "AI risk attestation" language in vendor questionnaires within the next few cycles. New York is the right city for this to land, because the financial and media firms that feel procurement pressure first are headquartered there. The immediate compliance burden falls on whoever owns AI governance at your company. Most teams don't have that person yet. Superintelligence is the headline; that gap in your org chart is the bill.

The second-order consequence: regulation driven by hearings like this could hit compute licensing or reporting requirements, which would slow the large-scale training runs the safety advocates are most worried about. Safety advocacy potentially delays the research it claims to want to manage.

The call

No US federal AI safety law will be enacted as a direct result of this testimony before the 2027 window Coxon's claim points to. Washington will produce more hearings and voluntary frameworks. The 2023 Senate hearings with Sam Altman in the room produced executive orders and voluntary commitments, not statute, and this testimony landed at a municipal hearing, not a congressional one. That tells you the energy is at the city and state level, where enforcement reach is narrow. Labs prefer voluntary responsible-scaling policies precisely because they're unenforceable, and a divided Congress won't move faster on AI than it has on any technology in decades.

Medium confidence. The mechanism that changes the call is the EU AI Office, not Washington.

Also covered this issue

Comments