None
Extra technical requirements to appear in Google's AI Overviews
Nothing. Google states there are no additional technical requirements beyond ordinary Search eligibility, and no new file or markup to create.
How ChatGPT, Gemini, Claude and Perplexity crawl, cite and send traffic, measured rather than asserted.
This is the part of the dataset closest to what RankWit does, which is why it is held to the strictest reading. The field is loud and the evidence is thin: most of what circulates as GEO research is a vendor describing its own product with no sample, no period and no method. Those figures are not here.
What is here falls in three groups. The publishers' own documentation, which is primary by definition because the subject is the publisher. Server-side measurement from Cloudflare, which is the only party with the visibility and also sells bot blocking. And academic work, peer-reviewed where possible and labelled as a preprint where not.
The most useful single fact is the one Google publishes about itself: appearing in AI Overviews needs no new file, no new markup and no special schema. Much of the advice sold in this field proposes exactly those things.
None
Nothing. Google states there are no additional technical requirements beyond ordinary Search eligibility, and no new file or markup to create.
3 of 4
1 of 4state no such exceptionFor automatic crawling, yes. For a fetch a user triggered, three of the four major assistant makers publish that robots.txt may not apply.
4.2%
4.5%Googlebot aloneAI bots averaged 4.2% of HTML requests across 2025, ranging from 2.4% to 6.4%. Googlebot alone accounted for 4.5%.
~14%
312domains disallowing GPTBotAbout 14%, or 546 of the 3,816 top domains where a robots.txt file was found. GPTBot was both the most blocked and the most explicitly allowed.
25.9%
13.3%Anthropic and Common Crawl25.9% of tokens in the head of the C4 corpus were restricted to OpenAI's crawlers by April 2024, against 13.3% for Anthropic and Common Crawl.
~80%
72%a year earlierTraining accounted for close to 80% of AI bot activity by July 2025, up from 72% a year earlier.
55.3%
55.3% of citations went to online travel agencies in an audit of 1,357 grounding citations across 156 Tokyo hotel queries.
55.9%
30.8%transactional queriesSharply. Non-OTA sources took 55.9% of citations on experiential queries against 30.8% on transactional ones, a gap of 25.1 points.
8.26%
3.88%organic searchIt converted at 8.26% against 3.88% for organic search, on 1.6 million sessions over nearly four years.
50.0%
57.9%DeepSeek-V3Less than you would expect. Half of ChatGPT's city recommendations fell outside Euromonitor's Top 100, and 57.9% of DeepSeek's did.