GPTBot

Questions about GPTBot

What is GPTBot?

GPTBot is OpenAI's crawler for content that may be used to train its generative AI foundation models. OpenAI documents it separately from OAI-SearchBot (ChatGPT search) and ChatGPT-User (pages a user's action requests).

Does blocking GPTBot remove my site from ChatGPT search?

No. OpenAI says each robots.txt setting is independent, so disallowing GPTBot does not change how OAI-SearchBot — the crawler behind ChatGPT search — treats your site.

What does disallowing GPTBot signal?

OpenAI says disallowing GPTBot signals that your content should not be used for training its generative AI foundation models. CrawlPact shows what your robots.txt declares; it cannot see whether a particular request complied.

How do I check whether GPTBot is allowed on my site?

Run CrawlPact's AI crawler checker. It evaluates GPTBot against your live robots.txt and shows the rule and line that decide the result.

GPTBot identifies itself with the user-agent token GPTBot and is documented by OpenAI as a crawler used to collect content that may inform the training of future OpenAI models.

What blocking GPTBot does

Disallowing GPTBot in robots.txt signals that a website does not want its content used for this specific training purpose. It does not affect OpenAI’s other documented crawlers, such as OAI-SearchBot (search) or ChatGPT-User (user-triggered retrieval), which are evaluated and reported separately by CrawlPact.

Verifying this record

Always cross-check the current token and behaviour against OpenAI’s own crawler documentation before relying on this page for a production decision — crawler documentation can change between CrawlPact’s registry releases. OpenAI’s crawler documentation moved from platform.openai.com/docs/bots to developers.openai.com/api/docs/bots since this record was first added; the citation above reflects the current location as of the last-verified date.

How to verify GPTBot requests

OpenAI documents this user agent:

                  Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.4; +https://openai.com/gptbot
                

OpenAI publishes GPTBot's IP ranges at https://openai.com/gptbot.json and notes that the version number in the user agent may change. Operator documentation.

A user-agent string alone can be copied by anyone; confirming a request really came from OpenAI needs your server or CDN logs. CrawlPact audits declared policy and does not see your traffic.

Example robots.txt configuration

To disallow GPTBot specifically, without affecting any other crawler:

User-agent: GPTBot
Disallow: /

If no dedicated User-agent: GPTBot group exists in a domain'srobots.txt, this crawler falls back to whatever the wildcard User-agent: * group says (RFC 9309) — see robots.txt syntax basics for how group selection works. A robots.txt rule is a published instruction; it does not technically prevent access.

Official source

https://developers.openai.com/api/docs/bots

Verified against the source above as of 24 July 2026 — see how CrawlPact verifies crawler information.