Glossary
AI crawling policy
An intentional stance on which AI agents may train on or search your site.
Definition
Good policy separates training vs search vs browsing agents, documents the decision, and implements it in robots.txt and bot management consistently.
In practice
- Use precise language on public pages so assistants and crawlers share the same meaning
- Pair definitions with crawlable HTML, metadata, and intentional robots policy
- Measure outcomes (mentions, citations, pillar scores) after you change signals
See also
Next step
Browse the glossary index, read what is AI visibility?, or measure your site.
Related
FAQ
What is AI crawling policy?
An intentional stance on which AI agents may train on or search your site.
Why does AI crawling policy matter for AI visibility?
Good policy separates training vs search vs browsing agents, documents the decision, and implements it in robots.txt and bot management consistently.
How can BatSignal help?
BatSignal measures crawl access, content readiness, ChatGPT presence, and related signals so teams can improve AI visibility with evidence—not guesswork.