Cloudflare Sets Sept. 15 AI Crawler Deadline
Cloudflare said on July 1 that, starting September 15, 2026, it will set new default rules for AI crawler traffic: Search stays allowed by default, while Training and Agent traffic will be blocked by default on pages that display ads. The change matters because Cloudflare is no longer treating AI crawlers as one bucket. Its … Read more