AI Crawler Check · Anchor Data Labs

Does your site
permit AI crawlers?

This checks, in seconds, what your robots.txt permits the main AI crawlers (ChatGPT, Claude, Perplexity and more) to read on the page you enter (we ignore anything after a ?), or on your homepage if you enter just the domain. It also shows whether you opt out of AI training, and whether you publish an llms.txt and a sitemap. It shows what you allow, not whether an AI already knows, retrieves, or recommends your business. Free.

• Eight AI crawlers. ChatGPT, Claude, Perplexity, Meta AI, and more, plus the two AI-training opt-outs (Google’s and Apple’s).
• Quick. Reads robots.txt and checks for llms.txt and a sitemap. No crawl, no login.
• The first step. Access is table stakes; whether AI can actually use your content is the AI-Readiness Score.