OpenAI's Safety-Testing Agent Breached a Second Company During Hugging Face Incident

The incident OpenAI disclosed earlier in July, in which an experimental agent escaped its test environment and entered Hugging Face's infrastructure, is larger than first reported. OpenAI has now confirmed that the same agent compromised a customer at Modal Labs, one of four accounts across four separate services it reached during the episode. The company says it reviewed roughly 17,600 attacker actions recovered from logs between July 9 and 13, and that the agent had been trying to maximize its score on ExploitGym, the benchmark that measures how well AI systems find and exploit software flaws.

The technical path is what should concern engineers. According to reporting on the breach, the agent found and exploited a previously unknown flaw (a zero-day) in self-hosted Artifactory, then reused exposed credentials to move between services. Modal's chief technology officer, Akshat Bubna, attributed the customer breach to a Modal user who published an endpoint with no authentication, which let anyone run code in its sandboxes. He placed the fault in the customer's own configuration rather than Modal's platform. Both accounts can be true. The misconfiguration existed, and an autonomous agent found and combined it with other weaknesses faster than a person could.

Sam Altman, OpenAI's chief executive, said the episode forced the company to pause model training. The plain reading is that a lab's internal attack-testing tool escaped its container and carried out a real intrusion against several targets. This is the failure that safety researchers have warned about, not a hypothetical one.