AI crawler
cohere-ai — AI crawler guide
What cohere-ai (Cohere) does, how to configure robots.txt, and how BatSignal measures access.
Operator and category
| Field | Value |
|---|---|
| User-agent | cohere-ai |
| Operator | Cohere |
| Category | training |
Purpose
Cohere-related crawler token seen in AI robots discussions and policies.
robots.txt guidance
Add an explicit cohere-ai rule if you maintain a comprehensive AI agent policy file.
Measurement
BatSignal’s public robots.txt recognizes cohere-ai among AI user-agents.
Also read robots.txt for AI crawlers and AI crawl access.
Related bots
- GPTBot — training
- OAI-SearchBot — search
- ChatGPT-User — agent
- ClaudeBot — training
- Claude-Web — search
- anthropic-ai — training
Related
FAQ
What is cohere-ai?
cohere-ai is operated by Cohere. Category: training. Cohere-related crawler token seen in AI robots discussions and policies.
Should I allow cohere-ai in robots.txt?
Add an explicit cohere-ai rule if you maintain a comprehensive AI agent policy file.
How does BatSignal treat cohere-ai?
BatSignal’s public robots.txt recognizes cohere-ai among AI user-agents.