Platform data
OpenAI
Publishes its crawler documentation directly: four declared bots with separate robots.txt controls, full user-agent strings and per-bot IP ranges. On its own crawling behaviour it is the primary source.
- Coverage
- ChatGPT crawlers and retrieval
- Website
- openai.com
- Published method
- Open the original document
OpenAI