robots.txt Guide + Checker

Applebot-Extended & robots.txt

Control Apple Intelligence Access to Your Content

Applebot-Extended controls whether Apple may use Applebot-crawled content to help train its foundation models. Apple says disallowing it does not affect Search.

Last verified against Apple's Applebot documentation: 2026-10-18

https://

Choose up to 3 pages. Get your score and basic results free.

What is Applebot-Extended?

Apple documents one crawler and one control token. Regular Applebot crawls the web for Apple Search. Then there's Applebot-Extended, which crawls nothing itself: it tells Apple whether data Applebot crawled may be used to help train its foundation models.

Source: Apple's Applebot documentation (published September 4, 2026). Last verified 2026-10-18.

Applebot vs Applebot-Extended

BotPurposeBlocking Impact
ApplebotApple Search crawlingBlocks crawling for Apple Search
Applebot-ExtendedOpt-out of training use of Applebot dataNo effect on search rankings

robots.txt Syntax for Applebot-Extended

Copy-paste these examples into your robots.txt file.

Allow Applebot-Extended

# Allow Apple Intelligence training

User-agent: Applebot-Extended

Allow: /

Apple Intelligence can use your content for AI features.

Block Applebot-Extended

# Block AI training, keep Siri

User-agent: Applebot-Extended

Disallow: /

Your Siri & Spotlight rankings remain unaffected.

Keep Siri, Block AI Training

# Allow Siri/Spotlight but block AI training

User-agent: Applebot

Allow: /

User-agent: Applebot-Extended

Disallow: /

This keeps your pages in Siri results while preventing Apple from using them for AI model training.

Why Applebot-Extended Matters

Training opt-out

Applebot-Extended governs whether Applebot-crawled content may help train Apple foundation models.

No crawler of its own

It does not crawl pages; it only sets how Applebot-crawled data is used. Allow Applebot for Apple Search either way.

Safe to Block

Unlike some AI crawlers, blocking Applebot-Extended has a clear separation from search. Your Apple Search visibility stays intact.

Frequently Asked Questions

What is Applebot-Extended?

Applebot-Extended is a robots.txt token, not a separate crawler — it does not crawl. Apple says Applebot-Extended is only used to determine how to use data crawled by Applebot, and that data crawled by Applebot may be used to help train Apple foundation models (source: https://support.apple.com/en-us/119829, checked 2026-10-18). Disallowing it opts your content out of that training use.

What's the difference between Applebot and Applebot-Extended?

Applebot is the crawler. Applebot-Extended is a secondary user agent that does not crawl; it only tells Apple how Applebot-crawled data may be used. Apple says pages that disallow Applebot-Extended can still be included in search results. They are controlled independently in robots.txt.

Does blocking Applebot-Extended affect my Apple Search visibility?

Apple says no: pages that disallow Applebot-Extended can still be included in search results, and its rules are not considered in ranking for Search.

Does Applebot-Extended respect robots.txt?

Apple documents Applebot-Extended as a robots.txt control: publishers opt out by disallowing it. You can allow or block it independently from regular Applebot.

What does Apple Intelligence use my content for?

Apple's page says Applebot-crawled data may be used to help train Apple foundation models, and does not list which products those models power. Applebot-Extended controls that use.

Related robots.txt Guides

Check Your Applebot-Extended Configuration

See if Apple Intelligence can access your site. Instant report on all 18 AI crawler rules.

https://

Choose up to 3 pages. Get your score and basic results free.

Free scan, no signup needed