FREE · NO SIGNUP

AI Crawler Access Checker

Is your site blocked from ChatGPT, Claude, or Perplexity? Paste your URL and find out in a few seconds.

Why this matters

ChatGPT, Claude, and Perplexity increasingly answer questions directly instead of showing a list of links. If your robots.txt blocks the crawler behind one of them — GPTBot, ClaudeBot, or PerplexityBot — your content can never be cited in that engine's answers, no matter how good it is. This is often accidental: a broad Disallow: / rule written for a different reason ends up catching AI crawlers too.

Frequently asked

What does this tool actually check?
It fetches your robots.txt and checks whether it fully blocks GPTBot (ChatGPT), ClaudeBot (Claude), or PerplexityBot (Perplexity) with a blanket Disallow: / rule. It also checks whether you have an llms.txt file.
Why would robots.txt block these bots specifically?
Some sites block AI crawlers deliberately (to keep content out of LLM training data), and some block them by accident — a wildcard User-agent: * rule written for a different purpose ends up catching them too. Either way, a block means you're invisible in that engine's answers and citations.
Should I always allow these crawlers?
That depends on your goals. If you want your content cited in ChatGPT, Claude, or Perplexity answers, you need to allow the corresponding bot. If you specifically don't want your content used for AI training, a deliberate block is a legitimate choice — just make sure it's intentional, not accidental.
What is llms.txt?
An emerging, plain-text convention (like robots.txt, but for AI) that points crawlers to your most important pages in a structured way. It's not required, but it's a low-effort signal of what matters most on your site. Full explanation: our llms.txt guide.
Fix everything at once

Sign up free — Peak Visibility generates a corrected robots.txt (and sitemap, schema, meta tags, and alt text) ready to deploy.