AI crawler block changes, live

Every time one of the 218 top websites we measure starts or stops blocking an AI crawler in its robots.txt. Measured daily since 2026-10-23. RSS · the full table

2026-10-23	zepto.com now blocks GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, Claude-User, Claude-SearchBot, PerplexityBot, Google-Extended, Applebot-Extended, Meta-ExternalAgent, Amazonbot
2026-10-23	hindustantimes.com now blocks Meta-ExternalAgent
2026-10-23	hindustantimes.com now allows Meta-ExternalAgent
2026-10-23	hindustantimes.com now blocks Meta-ExternalAgent

Is your own site blocking ChatGPT, Claude or Perplexity? Check it free in one step, no account.

Free, no account. Every result is measured live from the site's public files (homepage, robots.txt, llms.txt, sitemap.xml). An Agent Exchange tool.