AI crawler
OAI-SearchBot — AI crawler guide
What OAI-SearchBot (OpenAI) does, how to configure robots.txt, and how BatSignal measures access.
Operator and category
| Field | Value |
|---|---|
| User-agent | OAI-SearchBot |
| Operator | OpenAI |
| Category | search |
Purpose
Supports ChatGPT search retrieval by fetching pages that may ground answers with web sources.
robots.txt guidance
Allow OAI-SearchBot when you want to be eligible for ChatGPT search citations, even if GPTBot (training) remains disallowed.
Measurement
Crawl-access audits include OAI-SearchBot alongside other search-oriented agents.
Also read robots.txt for AI crawlers and AI crawl access.
Related bots
- GPTBot — training
- ChatGPT-User — agent
- ClaudeBot — training
- Claude-Web — search
- anthropic-ai — training
- PerplexityBot — search
Related
FAQ
What is OAI-SearchBot?
OAI-SearchBot is operated by OpenAI. Category: search. Supports ChatGPT search retrieval by fetching pages that may ground answers with web sources.
Should I allow OAI-SearchBot in robots.txt?
Allow OAI-SearchBot when you want to be eligible for ChatGPT search citations, even if GPTBot (training) remains disallowed.
How does BatSignal treat OAI-SearchBot?
Crawl-access audits include OAI-SearchBot alongside other search-oriented agents.