Cloudflare’s AI bot defaults kick in: Training and Agent blocked on ad pages
As of Sept 15, Cloudflare’s new defaults block Training and Agent crawlers on ad-supported pages for new domains and unchanged free accounts, while Search stays allowed. Mixed Search+Training bots follow the strictest rule unless site owners opt out in Security settings.