Glossary

Claude-Web

Anthropic user-agent associated with Claude web retrieval.

Definition

Claude-Web is closer to search/retrieval than bulk training crawl. Treat it separately in robots.txt if your training and search policies differ.

In practice

  • Use precise language on public pages so assistants and crawlers share the same meaning
  • Pair definitions with crawlable HTML, metadata, and intentional robots policy
  • Measure outcomes (mentions, citations, pillar scores) after you change signals

See also

Next step

Browse the glossary index, read what is AI visibility?, or measure your site.

Related

FAQ

What is Claude-Web?

Anthropic user-agent associated with Claude web retrieval.

Why does Claude-Web matter for AI visibility?

Claude-Web is closer to search/retrieval than bulk training crawl. Treat it separately in robots.txt if your training and search policies differ.

How can BatSignal help?

BatSignal measures crawl access, content readiness, ChatGPT presence, and related signals so teams can improve AI visibility with evidence—not guesswork.