Cloudflare replaced its one-click AI bot blocker with three separate controls: Search, Agent, and Training.
From September 15, 2026, new domains block Training and Agent bots on ad pages by default.
Google’s single mixed-use bot means any bot rule you set is quietly also a rule about Google traffic.
If you run sites for a living, this one lands right on your doorstep. On July 1, Cloudflare rebuilt how the whole web manages AI crawlers, and there is a date on the calendar you cannot ignore.
What actually changed
The old system was a blunt on-off switch. The new one sorts bots by what they do with your content. A Search bot indexes your site to answer queries later and traditionally sends referral traffic back. An Agent bot acts in real time for a human, like ChatGPT browsing a page for someone.
A Training bot absorbs your content into a model with nothing flowing back to you. Each one can now be allowed or blocked separately, per site or per page.
The reason for the split is simple. Automated bots now generate 57.5 percent of all web requests worldwide, and more than half of those crawler requests, 52 percent, up from 22 percent in Spring 2025, now serve AI training rather than search.
Cloudflare’s own report post is here:
https://x.com/Cloudflare/status/2072334567319507449
The deadline and the Google trap
Mark this down. On September 15, 2026, for all new domains onboarding to Cloudflare, Training and Agent bots will be blocked by default on pages that display ads, while Search stays allowed. Existing sites get advance notice and can opt out in Security settings before that date.
Here is the catch that affects revenue. Most AI companies use one bot for search and a separate bot for training, so you can wave in the helpful one and turn away the other. Google uses a single bot that does both at once. That means a rule blocking bots on your ad pages can quietly reach Googlebot too, and Google still sends nearly all your human visitors.
Cloudflare frames this as fixing an unfair advantage. Because Googlebot crawls for both Search and AI at the same time, sites cannot opt out of AI training without also disappearing from search results.
Before September 15, get one honest number for your own sites: how much traffic is really human, and how much of that comes from Google. Then decide the ad-page setting on purpose.
Quick Links:
