Applebot-Extended & robots.txt
Control Apple Intelligence Access to Your Content
Applebot-Extended controls whether Apple may use Applebot-crawled content to help train its foundation models. Apple says disallowing it does not affect Search.
Last verified against Apple's Applebot documentation: 2026-10-18
What is Applebot-Extended?
Apple documents one crawler and one control token. Regular Applebot crawls the web for Apple Search. Then there's Applebot-Extended, which crawls nothing itself: it tells Apple whether data Applebot crawled may be used to help train its foundation models.
Source: Apple's Applebot documentation (published September 4, 2026). Last verified 2026-10-18.
Applebot vs Applebot-Extended
| Bot | Purpose | Blocking Impact |
|---|---|---|
Applebot | Apple Search crawling | Blocks crawling for Apple Search |
Applebot-Extended | Opt-out of training use of Applebot data | No effect on search rankings |
robots.txt Syntax for Applebot-Extended
Copy-paste these examples into your robots.txt file.
Allow Applebot-Extended
# Allow Apple Intelligence training
User-agent: Applebot-Extended
Allow: /
Apple Intelligence can use your content for AI features.
Block Applebot-Extended
# Block AI training, keep Siri
User-agent: Applebot-Extended
Disallow: /
Your Siri & Spotlight rankings remain unaffected.
Keep Siri, Block AI Training
# Allow Siri/Spotlight but block AI training
User-agent: Applebot
Allow: /
User-agent: Applebot-Extended
Disallow: /
This keeps your pages in Siri results while preventing Apple from using them for AI model training.
Why Applebot-Extended Matters
Training opt-out
Applebot-Extended governs whether Applebot-crawled content may help train Apple foundation models.
No crawler of its own
It does not crawl pages; it only sets how Applebot-crawled data is used. Allow Applebot for Apple Search either way.
Safe to Block
Unlike some AI crawlers, blocking Applebot-Extended has a clear separation from search. Your Apple Search visibility stays intact.
Frequently Asked Questions
What is Applebot-Extended?
Applebot-Extended is a robots.txt token, not a separate crawler — it does not crawl. Apple says Applebot-Extended is only used to determine how to use data crawled by Applebot, and that data crawled by Applebot may be used to help train Apple foundation models (source: https://support.apple.com/en-us/119829, checked 2026-10-18). Disallowing it opts your content out of that training use.
What's the difference between Applebot and Applebot-Extended?
Applebot is the crawler. Applebot-Extended is a secondary user agent that does not crawl; it only tells Apple how Applebot-crawled data may be used. Apple says pages that disallow Applebot-Extended can still be included in search results. They are controlled independently in robots.txt.
Does blocking Applebot-Extended affect my Apple Search visibility?
Apple says no: pages that disallow Applebot-Extended can still be included in search results, and its rules are not considered in ranking for Search.
Does Applebot-Extended respect robots.txt?
Apple documents Applebot-Extended as a robots.txt control: publishers opt out by disallowing it. You can allow or block it independently from regular Applebot.
What does Apple Intelligence use my content for?
Apple's page says Applebot-crawled data may be used to help train Apple foundation models, and does not list which products those models power. Applebot-Extended controls that use.
Related robots.txt Guides
- AI robots.txt checker — See which of 18 AI crawlers your live robots.txt blocks
- Google-Extended & robots.txt — Gemini / AI Overviews
- GPTBot & robots.txt — OpenAI / ChatGPT
- OAI-SearchBot & robots.txt — ChatGPT Search
- ClaudeBot & robots.txt — Anthropic / Claude
- Complete AI Crawlers Guide — All 18 bots explained
Check Your Applebot-Extended Configuration
See if Apple Intelligence can access your site. Instant report on all 18 AI crawler rules.
Free scan, no signup needed