Morning Edition · Sunday, July 12, 2026Published at 1:29 AM EDT · New York
New domains will block training and agent crawlers by default on ad-supported pages starting September 15, while search indexing stays allowed, and the change reaches free-tier customers.

Cloudflare replaced its blanket AI bot block with three separately managed categories, giving site owners distinct switches for Search, Agent, and Training crawlers. Search covers indexing that returns referral traffic, Agent covers real-ti…
Track frontier labs, chips, export controls, model releases, regulation, and AI infrastructure.
The Global Intelligence Brief stays free.
Start a discussion in Townsquare.
More from this edition
Comments
0No comments yet.