AI-crawler traffic report
As of 2026-10-24, ChangeGamer (changegamer.ai) received 1,334 AI-crawler requests in the trailing 30 days, 509 of them user-initiated retrievals (ChatGPT-User + Claude-User) — 38% of AI-crawler traffic and 1% of all 99,983 worker-served requests recorded in that window.
Key facts
- On 2026-10-24, AI crawlers made 1,334 requests to ChangeGamer in the trailing 30 days, +127 vs the 2026-10-17 snapshot, out of 99,983 total worker-served requests (1%).
- GPTBot (OpenAI's crawl-and-index bot) made 14 requests as of 2026-10-24, no change vs 2026-10-17.
- ChatGPT-User (live, user-triggered ChatGPT browsing) made 500 requests as of 2026-10-24, −26 vs 2026-10-17.
- Anthropic's crawlers combined (ClaudeBot + Claude-User) made 104 requests as of 2026-10-24, −14 vs 2026-10-17.
- PerplexityBot made 703 requests as of 2026-10-24, +170 vs 2026-10-17.
- The most-fetched page in the 2026-10-24 snapshot was `/resources/durable-execution-for-agents` with 51 AI-crawler hits in 30 days — see the full top-20 table below.
AI crawlers by bot (latest vs previous snapshot)
| Bot | 2026-10-24 | Previous | Delta |
|---|---|---|---|
| AI total | 1,334 | 1,207 | +127 |
| GPTBot | 14 | 14 | no change |
| OAI-SearchBot | 13 | 15 | −2 |
| ChatGPT-User | 500 | 526 | −26 |
| ClaudeBot | 95 | 99 | −4 |
| Claude-User | 9 | 19 | −10 |
| PerplexityBot | 703 | 533 | +170 |
| Google-Extended | 0 | 0 | no change |
| Bytespider | 0 | 1 | −1 |
| All worker hits | 99,983 | 98,725 | +1,258 |
Top 20 pages AI crawlers fetch (rolling 30 days, snapshot 2026-10-24)
| Rank | Page | AI-crawler hits (30d) |
|---|---|---|
| 1 | durable-execution-for-agents | 51 |
| 2 | evaluating-ai-agents | 49 |
| 3 | streaming-for-agents | 47 |
| 4 | computer-use-browser-automation | 41 |
| 5 | agentic-payment-protocols | 40 |
| 6 | getting-started | 36 |
| 7 | open-weight-models-for-agents | 36 |
| 8 | synthetic-data-generation | 31 |
| 9 | voice-realtime-agents | 29 |
| 10 | a2a-protocol | 27 |
| 11 | data-privacy-for-agents | 27 |
| 12 | reliable-tool-calling | 25 |
| 13 | agent-spend-controls | 25 |
| 14 | web-data-for-agents | 24 |
| 15 | structured-outputs-and-json-mode | 24 |
| 16 | essential-agent-publications | 23 |
| 17 | generative-ui-for-agents | 22 |
| 18 | deploying-serving-llms | 22 |
| 19 | agent-observability | 21 |
| 20 | agent-cost-latency-optimization | 21 |
Method
The worker that serves every ChangeGamer page logs each request to Cloudflare Analytics Engine, tagged by user-agent. A scheduled GitHub Actions job (.github/workflows/seo-crawler-stats.yml) queries that log weekly and commits the snapshot this report renders. Two limits matter: asset-served paths — /llms.txt, robots.txt, the sitemap — bypass the worker entirely and are deliberately NOT counted, so every number here is a floor on crawler interest, never a total; and user-agent strings are self-declared by the crawler, not independently verified, so a bot that spoofs or omits its user-agent will not appear correctly (or at all). Read this as retrieval demand, not citation — a crawl means a page was fetched, not that it was used or cited in an answer.
Reuse
This dataset is free to quote, republish, or build on — with attribution to ChangeGamer (https://changegamer.ai/reports/ai-crawler-traffic) — no key or license required. Machine-readable twin: https://changegamer.ai/api/reports/ai-crawler-traffic.json.
Frequently asked questions
- What counts as an "AI-crawler request" in this report?
- A request whose user-agent matches one of eight declared AI bots — GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-User, PerplexityBot, Google-Extended, Bytespider — as logged by the ChangeGamer worker to Cloudflare Analytics Engine. It is a fetch, not a citation: see the Method section above.
- Why do the totals exclude /llms.txt and robots.txt?
- Those paths are served directly by Cloudflare as static assets and never pass through the logging worker, so no per-request user-agent is recorded for them. Their traffic is real but invisible to this dataset, which is why every number here is a floor, not a total.
- How often is this report updated?
- The underlying snapshot in agents/SEO-AEO-CRAWLERS.md is committed weekly by a scheduled GitHub Actions job; this page and its .md/.json twins are regenerated from that same file on every site build, so they always show the latest committed snapshot.