Machine read
Primary entity
OpenAI crawler policy
Extractable answer
High
Citation potential
Medium
Main issue
Sites do not distinguish OpenAI referral traffic from generic direct or crawler traffic
Human read
This is an operations problem as much as a bot policy problem. Allow the right traffic, measure it, and keep non-public routes closed.
What to change
- Allow OpenAI search fetch traffic on public pages that are meant to be surfaced.
- Track ChatGPT-originated referrals separately in analytics and dashboards.
- Review CDN and firewall settings so published OpenAI crawler traffic is not accidentally blocked.
The playbook
- Owner: Platform analytics
- Effort: One sprint
- Expected outcome: Clear OpenAI bot policy and measurable ChatGPT referral behavior.
FAQ
Which OpenAI signals matter most?
Allowing OAI-SearchBot and capturing ChatGPT referral traffic are the most practical first steps.
What should remain blocked?
Admin routes, draft paths, preview URLs, and staging environments should stay out of public fetch surfaces.
If you cannot separate OpenAI-originated behavior from the rest of your traffic, you are effectively flying blind on one of the newest visibility surfaces.