Amodei Asks Government for the Power to Block Unsafe Models

Anthropic has published Policy on the AI Exponential, a pair of proposed regulatory frameworks accompanied by an essay from chief executive Dario Amodei. The central request is unusually direct for an industry that has resisted binding rules. Anthropic wants government to hold the authority to block or deter dangerous deployments, a structure that VentureBeat compared to aviation safety regulation.

The Advanced AI Framework would apply only above defined thresholds, models trained on more than 10^25 floating-point operations (FLOP), built by companies earning more than 500 million dollars in AI revenue or spending more than 1 billion dollars on research and development. Covered models would face mandatory third-party testing across four risk areas, cybersecurity, biological weapons, loss of control, and automated research that could compound the other three. A companion Economic Policy Framework outlines a tiered response to AI-driven job loss, backed by a 350 million dollar pledge.

The timing invites scrutiny. Anthropic is calling for binding limits days after a government order pulled two of its own models offline, and a compute-and-revenue threshold conveniently draws the regulatory boundary around a small set of incumbents. The research behind these claims comes from the company's Societal Impacts and economics teams, not from independent evaluation.

The proposal is best read as a view of where governance is heading, not as settled policy. It concedes that voluntary transparency is no longer sufficient, which itself shows how far the regulatory conversation has moved.