Free AI Crawler Check

Is Your Site Visible to Google Gemini?

Gemini answers come from the Google index plus live grounding. Check whether Googlebot can render your content and whether your robots.txt opts you out of Gemini without you realizing.

https://

Free scan — no account or credit card required. Takes about 15 seconds.

What We Check

Google-Extended Token

We check your robots.txt for the Google-Extended token — the switch that controls whether Gemini can train on and ground answers in your content.

Rendered-DOM Content

Gemini works from what actually renders. We render your page like Googlebot does and measure how much of your content survives into the DOM.

Per-LLM Score

Your full report includes a Gemini-specific visibility score alongside ChatGPT, Claude, Perplexity, and Copilot.

How Gemini Actually Sees Your Site

Unlike OpenAI or Anthropic, Google doesn't run a separate AI crawler. Three pieces decide your Gemini visibility — and only one of them is under a robots.txt token.

GooglebotThe gate

Builds the index Gemini grounds its answers in. If Googlebot can't crawl or render your pages, Gemini has nothing to cite — the same failure that hurts your Search rankings.

Google-ExtendedPolicy token

A robots.txt token, not a crawler. Disallowing it opts your content out of Gemini training and grounding — many sites added it in 2023 blanket AI blocks and forgot.

RenderingThe silent killer

Gemini extracts from the rendered page. JS-only content, SPA shells, and content behind interaction render as thin or empty DOM — indexed, but with nothing worth citing.

AI Overviews ≠ Gemini

AI Overviews is part of Google Search and ignores Google-Extended. Blocking the token keeps you out of Gemini grounding but not out of AI Overviews. AI Overviews guide

Frequently Asked Questions

Does Gemini have its own crawler?

No. There is no separate 'GeminiBot'. Gemini grounds its answers in the Google Search index, which is built by Googlebot. Google-Extended is a robots.txt token — not a crawler with its own user agent — that tells Google whether content Googlebot already fetched may be used for Gemini training and grounding.

Does blocking Google-Extended remove my site from Gemini?

It removes your content from Gemini model training and from grounding (the mechanism Gemini uses to pull in fresh web results and cite sources). Add 'User-agent: Google-Extended / Disallow: /' to robots.txt and Gemini stops using your pages. It does not affect your normal Google Search rankings or AI Overviews.

Does blocking Google-Extended hurt my Google rankings?

No. Google has confirmed Google-Extended only controls Gemini training and grounding. Googlebot keeps crawling and your Search rankings are unaffected. AI Overviews are also unaffected — they're part of Search itself and can't be opted out of separately.

I'm indexed in Google — why doesn't Gemini show my content?

Being indexed isn't the same as being readable. Gemini works from the rendered page, so if your key content only appears after JavaScript runs — and rendering fails or times out — Gemini has little to work with. Thin rendered DOM, SPA shells, and content behind interaction are the usual culprits. BotView compares your initial HTML against the rendered DOM to show exactly what a crawler can extract.

Is Google AI Overviews the same as Gemini?

They share models but are controlled differently. AI Overviews is a Google Search feature: if you're indexed, you're eligible, and the only opt-out is blocking Googlebot (which removes you from Search entirely). The Gemini app/API uses grounding, which respects the Google-Extended token. You can be in AI Overviews while opted out of Gemini, and vice versa isn't possible without leaving Search.

Related

Live Check: Can AI Bots Reach Your Site?

Gemini rides on Googlebot, but the other AI engines each run their own crawler — and your firewall treats them all differently. We fetch your page as 8 AI crawler user agents (the 3 search gates plus 5 major training and user-fetch bots) and show you the actual HTTP response each one gets.

https://

Live HTTP check — we request your page with each bot's user agent and show you exactly what comes back. No signup needed.

Check Your Gemini Visibility Now

It takes 30 seconds. See what Googlebot renders, whether Google-Extended is blocked, and get your per-LLM visibility score.

https://

Free scan — no account or credit card required. Takes about 15 seconds.