🎨 Clankers Be Crawling
A Code Clucks At Midnight Production
https://blog.cloudflare.com/crawlers-click-ai-bots-training/
Crawl-to-refer imbalance (how many pages a bot crawls per page that a user clicks back to): Anthropic increased referrals but still leads with 38,000 crawls per visitor in July (down from 286,000:1 in January). Perplexity decreased referrals in 2025 — with more crawling but fewer referrals at 194 crawls per visitor in July.