Amodei Commits Anthropic to Embedded Outside Evaluators, and OpenAI Says It Will Match

Dario Amodei, the chief executive of Anthropic, published an essay on September 12 titled We Must Pace the Frontier, arguing that the AI industry should deliberately slow the pace at which it advances model capability. He set out a three-part plan and committed Anthropic unilaterally to the first part: giving third-party evaluators permanent, employee-level access so they can verify that the company follows its own safety commitments, report incidents, and assess model alignment during training rather than only after a model is finished.

The Russian-language technical channel AI ML Big Data summarized the reversal plainly: in 2023 Amodei considered slowing down premature, and he now considers it necessary. The essay identifies three risks that this pacing is meant to guard against, the loss of control over AI systems, misuse for cyberattacks and biological weapons, and severe economic disruption.

The timing matters more than the argument. Jacob Coxon, who spent roughly three years on pretraining research at OpenAI and then Anthropic, resigned on September 8 and posted a seven-part statement on X saying neither company is acting responsibly. Axios reported that he surrendered his equity to leave. Amodei addressed the post directly on September 13, saying he agrees with Coxon much more than he disagrees and that Coxon was describing an industry-wide race dynamic rather than accusing Anthropic specifically.

Reaction split within hours. Elon Musk endorsed the essay, and Sam Altman, the chief executive of OpenAI, committed OpenAI to match the embedded-evaluator program. Critics including Emad Mostaque, the founder of Stability AI, called the proposal well-intentioned but not enforceable, since nothing in it binds a lab that declines to participate. Altman, asked in an interview why the major lab heads do not simply meet to settle AI safety, said such a meeting "will happen" but declined to pre-announce private discussions. What is verified today is one company's access commitment and one rival's public agreement to match it. What is not verified is any mechanism for a third lab, a Chinese open-weight developer, or a well-funded startup to be held to the same standard.