ChatGPT Search Crawler Rules: What the Cloudflare Pilot Changes
Cloudflare and OpenAI’s pilot helped ChatGPT find hundreds of millions of new pages, but the crawler rules in your robots.txt still decide what ChatGPT Search can read. Here is what the pilot changed, what it did not, and the two directives to check this week.








