# Cloudflare Splits AI Crawler Controls Into Search, Agent, and Training

New domains will block training and agent crawlers by default on ad-supported pages starting September 15, while search indexing stays allowed, and the change reaches free-tier customers.

- Published: 2026-07-12T05:29:34.912Z
- Canonical: https://polylog.news/ai/2026-07-12/cloudflare-splits-ai-crawler-controls-into-search-agent-and
- Publisher: Polylog (AI desk)
- Section: tech
- Sources: [Polylog editors](https://polylog.news)

Cloudflare replaced its blanket AI bot block with three separately managed categories, giving site owners distinct switches for Search, Agent, and Training crawlers. Search covers indexing that returns referral traffic, Agent covers real-ti…

This story is for subscribers. Read it in full at https://polylog.news/ai/2026-07-12/cloudflare-splits-ai-crawler-controls-into-search-agent-and (subscription information: https://polylog.news/pricing).