Live metrics
The corpus
| Reference resources | 99 |
|---|---|
| Editorial guides | 119 (207,813 words) |
| Topic clusters complete | 9 of 10 |
AI-crawler volume (30-day rolling)
| Date (UTC) | AI total | GPTBot | OAI-SearchBot | ChatGPT-User | ClaudeBot | Claude-User | PerplexityBot | Google-Extended | Bytespider | All worker hits |
|---|---|---|---|---|---|---|---|---|---|---|
| 2026-10-24 | 1334 | 14 | 13 | 500 | 95 | 9 | 703 | 0 | 0 | 99983 |
| 2026-10-17 | 1207 | 14 | 15 | 526 | 99 | 19 | 533 | 0 | 1 | 98725 |
| 2026-10-10 | 1084 | 11 | 16 | 549 | 145 | 28 | 334 | 0 | 1 | 92900 |
| 2026-10-03 | 1205 | 4 | 13 | 722 | 56 | 28 | 381 | 0 | 1 | 85214 |
| 2026-09-26 | 1399 | 16 | 26 | 871 | 55 | 31 | 399 | 0 | 1 | 78853 |
| 2026-09-19 | 1608 | 19 | 29 | 911 | 161 | 35 | 453 | 0 | 0 | 70419 |
| 2026-09-12 | 1713 | 23 | 30 | 1033 | 158 | 32 | 437 | 0 | 0 | 62884 |
| 2026-09-05 | 1743 | 148 | 37 | 1065 | 112 | 25 | 356 | 0 | 0 | 59321 |
| 2026-08-29 | 1699 | 153 | 40 | 1097 | 115 | 25 | 269 | 0 | 0 | 56146 |
| 2026-08-22 | 1826 | 291 | 22 | 1142 | 114 | 27 | 230 | 0 | 0 | 52830 |
| 2026-08-15 | 1818 | 358 | 22 | 1056 | 116 | 27 | 239 | 0 | 0 | 55152 |
| 2026-08-13 | 1837 | 359 | 25 | 1057 | 118 | 29 | 249 | 0 | 0 | 55660 |
Reports
The full per-bot and per-page breakdown behind the table above is published monthly at the AI-crawler traffic report (Markdown: .md, JSON: .json).
How this is measured
The worker logs every request to Cloudflare's Analytics Engine; a scheduled GitHub Actions job queries it weekly and commits the snapshot this page renders. Asset-served paths (/llms.txt, robots.txt, sitemaps) bypass the worker and are deliberately uncounted, so treat these numbers as a floor. Want this for your own site? Start with measuring AI agent traffic.