Glossary
Allowlist (robots)
Explicit Allow rules that carve exceptions inside broader Disallow policies.
Definition
Allowlists let you block most of a site while opening docs or marketing paths to AI bots. Test the final effective policy with live fetches.
In practice
- Use precise language on public pages so assistants and crawlers share the same meaning
- Pair definitions with crawlable HTML, metadata, and intentional robots policy
- Measure outcomes (mentions, citations, pillar scores) after you change signals
See also
Next step
Browse the glossary index, read what is AI visibility?, or measure your site.
Related
FAQ
What is Allowlist (robots)?
Explicit Allow rules that carve exceptions inside broader Disallow policies.
Why does Allowlist (robots) matter for AI visibility?
Allowlists let you block most of a site while opening docs or marketing paths to AI bots. Test the final effective policy with live fetches.
How can BatSignal help?
BatSignal measures crawl access, content readiness, ChatGPT presence, and related signals so teams can improve AI visibility with evidence—not guesswork.