Skip to content
Platform data

OpenAI

Publishes its crawler documentation directly: four declared bots with separate robots.txt controls, full user-agent strings and per-bot IP ranges. On its own crawling behaviour it is the primary source.

Coverage
ChatGPT crawlers and retrieval
Website
openai.com

Indicators from this source