Glossary
Claude-Web
Anthropic user-agent associated with Claude web retrieval.
Definition
Claude-Web is closer to search/retrieval than bulk training crawl. Treat it separately in robots.txt if your training and search policies differ.
In practice
- Use precise language on public pages so assistants and crawlers share the same meaning
- Pair definitions with crawlable HTML, metadata, and intentional robots policy
- Measure outcomes (mentions, citations, pillar scores) after you change signals
See also
Next step
Browse the glossary index, read what is AI visibility?, or measure your site.
Related
FAQ
What is Claude-Web?
Anthropic user-agent associated with Claude web retrieval.
Why does Claude-Web matter for AI visibility?
Claude-Web is closer to search/retrieval than bulk training crawl. Treat it separately in robots.txt if your training and search policies differ.
How can BatSignal help?
BatSignal measures crawl access, content readiness, ChatGPT presence, and related signals so teams can improve AI visibility with evidence—not guesswork.