Entry AYKA-E-0005 · Fact
OAI-SearchBot and GPTBot: two different OpenAI crawlers
OpenAI uses OAI-SearchBot to find pages for search in ChatGPT and GPTBot to collect content for training its models. Blocking OAI-SearchBot in robots.txt can keep your pages out of ChatGPT search answers; blocking GPTBot only opts out of training.
Key facts
| OAI-SearchBot | ChatGPT search results |
|---|---|
| GPTBot | model training |
| Controlled in | robots.txt, separately |
What to do
Open your robots.txt: if you want to be cited in ChatGPT search, do not disallow OAI-SearchBot.
Source
OpenAI: Overview of OpenAI crawlers · checked 2026-11-04
How to cite this entry
AYKA Technologies, “OAI-SearchBot and GPTBot: two different OpenAI crawlers”, entry AYKA-E-0005, getayka.com, updated 2026-11-04. https://getayka.com/entries/oai-searchbot-gptbot/
Related entries
- How to see visitors who came from ChatGPT search (AYKA-E-0006)
- Does an llms.txt file get a site cited by AI? (AYKA-E-0007)
Markdown version · Updated 2026-11-04