← The Polylog AI Intelligence Brief
Morning Edition · Monday, September 28, 2026Published at 2:48 AM EDT · New York
New Benchmark Tests Whether Penetration-Testing Agents Stay Inside the Client's Authorized Scope
ScopeBench targets the gap left by offensive-security evaluations that score exploitation success while ignoring boundary violations, where a single out-of-scope action breaches the engagement contract.
Offensive-security agents are already deployed with real autonomy against live web applications and networks, and the evaluations used to judge them measure the wrong thing. A new preprint introduces ScopeBench, which tests whether agents p…
Continue the AI Intelligence Brief
Track frontier labs, chips, export controls, model releases, regulation, and AI infrastructure.
- 5 AI intelligence signals a day
- Frontier labs, compute, and chips
- Model releases and AI infrastructure
- Source-grounded analysis with confidence labels
The Global Intelligence Brief stays free.
Part of a tracked trend
Autonomous Agents Move Into Cyber Offense
AI agents increasingly run end-to-end intrusions, chaining supply-chain footholds into privilege escalation and credential theft at machine speed, outpacing human and current automated defenses.
Townsquare
Start a discussion in Townsquare.
More from this edition
- Amodei Gets a Private White House Dinner Weeks Before Anthropic's Planned October Listing
- Anthropic Prices Claude Opus 5.5 at 40 Percent Below Opus 5 Running Cost
- Stanford Runs a 37,000-Agent Virtual Biotech and Reports a Target Hypothesis That Matched a Real Therapy
- Meta Sells Muse Spark 1.3 at $1.25 per Million Input Tokens Through Its Own Metered API
- Rails Creator Says His Team Stopped Writing Code by Hand, and Anthropic Stops Cutting Agents Off Mid-Task
- Anthropic's 2030 Economic Model Puts United States Output Between $34.1 Trillion and $44.4 Trillion
- Berkeley Lab Cuts Beamline Annotation From a Month to 15 Minutes Using Meta's Open Vision Models
Comments
0No comments yet.