Is Your Site Visible to Claude AI?
Find out if Claude-SearchBot — the crawler behind Claude's search answers — and Anthropic's other bots can access your website. See what's blocking Claude from reading your content.
What We Check
robots.txt Analysis
We check if Claude-SearchBot, ClaudeBot, and Claude-User are blocked in your robots.txt.
Crawl Simulation
We simulate how Anthropic's crawlers see your pages, including JavaScript content.
Actionable Report
Get specific recommendations on how to fix any issues blocking Claude access.
Anthropic Crawlers We Analyze
Anthropic runs three crawlers with different jobs. Only one of them — Claude-SearchBot — decides whether Claude can cite you.
Builds Claude's search index. Block this and your site disappears from Claude's search answers and citations.
Collects data for model training. Blocking it is a policy choice — it does not affect Claude search visibility.
Fetches a page only when a user asks Claude to open it. Informational — not a pass/fail check.
Seen Claude-Web or anthropic-ai in robots.txt guides? Both are deprecated legacy tokens no current Anthropic crawler uses — rules for them do nothing and can be removed.
We also check ChatGPT/OAI-SearchBot, Perplexity, Google Gemini, and every other major AI crawler.
Frequently Asked Questions
What is ClaudeBot?
ClaudeBot is Anthropic's training crawler — it collects data for training Claude models and respects robots.txt. It is not what decides whether you appear in Claude's search answers: that's Claude-SearchBot, which builds the index Claude searches. A third agent, Claude-User, fetches a page only when a user asks Claude to open it.
Which Anthropic bot decides if Claude can cite my site?
Claude-SearchBot. It builds Claude's search index, so blocking it removes your site from Claude's search answers and citations. Blocking ClaudeBot only opts your content out of model training — a policy choice that does not affect Claude search visibility.
Why should I care if Claude can access my site?
Claude is one of the leading AI assistants, used by millions for research, coding, and analysis. If Claude-SearchBot can index your content, Claude can cite your site in answers, driving awareness and potential traffic to your business.
How do I allow Claude's crawlers to access my site?
Check your robots.txt for 'User-agent: Claude-SearchBot' or 'User-agent: ClaudeBot' followed by 'Disallow: /'. To stay visible in Claude search, make sure Claude-SearchBot is allowed. Our tool shows exactly what's blocked.
What about Claude-Web and anthropic-ai?
Both are deprecated legacy tokens that have been removed from Anthropic's documentation — no current Anthropic crawler matches them. If your robots.txt still references Claude-Web or anthropic-ai, those rules do nothing and are safe to delete. The current tokens are ClaudeBot (training), Claude-SearchBot (search index), and Claude-User (user-triggered fetch).
Does blocking ClaudeBot affect Claude's answers about my site?
Not in the way most people assume. Blocking ClaudeBot keeps your content out of Anthropic's model training, but Claude's live search answers come from the index built by Claude-SearchBot. Block Claude-SearchBot and you disappear from Claude's search citations; block only ClaudeBot and you're still citable.
Check Your Claude AI Visibility Now
It takes 30 seconds. See if Claude can access your site and get actionable recommendations.
Related
- ClaudeBot & robots.txt guide — Allow or block Anthropic's crawler
- Check ChatGPT visibility — GPTBot checker
- Check Perplexity visibility — PerplexityBot checker
- What is GEO? — Generative Engine Optimization guide
- Check all 17 AI crawlers at once