Glossary
Crawl budget
How much time and attention a crawler spends fetching your URLs.
Definition
For AI crawlers, wasteful soft-404s, infinite parameters, and blocked sitemaps reduce effective discovery. Keep public URL inventories clean.
In practice
- Use precise language on public pages so assistants and crawlers share the same meaning
- Pair definitions with crawlable HTML, metadata, and intentional robots policy
- Measure outcomes (mentions, citations, pillar scores) after you change signals
See also
Next step
Browse the glossary index, read what is AI visibility?, or measure your site.
Related
FAQ
What is Crawl budget?
How much time and attention a crawler spends fetching your URLs.
Why does Crawl budget matter for AI visibility?
For AI crawlers, wasteful soft-404s, infinite parameters, and blocked sitemaps reduce effective discovery. Keep public URL inventories clean.
How can BatSignal help?
BatSignal measures crawl access, content readiness, ChatGPT presence, and related signals so teams can improve AI visibility with evidence—not guesswork.