Cloudflare sets deadline to block AI crawlers that bundle search with AI training

2026-07-03

AI crawlers have until September to separate bots that gather content for search from those that harvest it for training or be blocked on pages that carry ads.