GPTBot: the user agent, the robots.txt rule, and what blocking it costs
Last reviewed
Short answer
GPTBot is OpenAI's training crawler. Its robots.txt token is GPTBot and its user agent is "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.4; +https://openai.com/gptbot". OpenAI states it crawls content that may be used to train generative AI foundation models. Blocking it does not remove you from ChatGPT search.
The strings
OpenAI publishes both the robots.txt product token and the full header string. These are quoted from OpenAI's crawler documentation as read on 23 August 2026.
| Field | Value |
|---|---|
| robots.txt token | GPTBot |
| User agent | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.4; +https://openai.com/gptbot |
| Published IP ranges | https://openai.com/gptbot.json |
| Stated purpose | Crawl content that may be used in training generative AI foundation models |
Blocking it
Two lines, in your robots.txt, at the root of the domain. On Shopify that means a `robots.txt.liquid` template rather than a plain file, covered below.
User-agent: GPTBot followed by Disallow: / blocks the whole site. To close one section instead, disallow the path: Disallow: /collections/clearance. GPTBot honours the standard, so the usual Allow and Disallow precedence applies.
What blocking GPTBot does not do
This is where most advice goes wrong. GPTBot is the training crawler and only the training crawler. OpenAI runs three others, and the one that decides whether your site can appear in ChatGPT's search results is OAI-SearchBot, a separate token.
So blocking GPTBot keeps your content out of future model training and leaves your presence in ChatGPT search untouched. If you meant to be invisible to ChatGPT entirely you have blocked the wrong bot, and if you meant to protect training data while staying findable, GPTBot alone is exactly right. The three OpenAI agents are compared here.
Should a store block it
For most Shopify stores, no. The argument for blocking a training crawler is that your text has value you do not want absorbed for free, which is a real argument for a publisher with an archive and a weak one for a shop with 200 product pages.
The argument against is thinner than people assume too. Training data is not what puts your product in front of a shopper this quarter; retrieval is. Blocking GPTBot is close to a no-op on sales in either direction, which makes it a values decision rather than a growth one. Treat anyone who tells you it will hurt or help revenue as guessing.
How you actually change this on Shopify
Shopify generates robots.txt for you and there is no field in the admin for it. To change a rule you add a `robots.txt.liquid` template to your theme, which Shopify then renders instead of the default while still keeping its own future updates.
Shopify's help page is blunt about the risk: editing this file is an unsupported customization, Shopify Support will not help with it, and it says in as many words that incorrect use of the feature can result in loss of all traffic. Copy the default rules first, add your block, and read the rendered file at /robots.txt afterwards.
- Online Store, then Themes, then Edit code
- Add a new template called robots.txt.liquid
- Keep the default rules, then add your own user-agent group
- Load yourstore.com/robots.txt and read what actually rendered
Frequently asked questions
Does blocking GPTBot remove my store from ChatGPT?
No. GPTBot is the training crawler. ChatGPT's search features use OAI-SearchBot, and live page fetches use ChatGPT-User. Blocking GPTBot leaves both of those working, so your site can still be surfaced and cited in ChatGPT.
What is GPTBot's current user agent string?
OpenAI documents it as "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.4; +https://openai.com/gptbot". The version number moves, so match on the GPTBot token rather than the whole string if you are writing a log filter.
Can I block GPTBot on Shopify?
Yes, through a robots.txt.liquid template in your theme. Shopify calls this an unsupported customization and warns that incorrect use can result in loss of all traffic, so keep the default rules and add only your own group.
Will OpenAI remove content it already trained on if I block GPTBot now?
Blocking a crawler is forward-looking. It stops future fetches and does not retract anything already collected. OpenAI's documentation describes robots.txt as controlling crawling, not as a deletion mechanism.
Sources
Keep reading
Score your own catalog
Entitled grades every product against the rules on this page, explains each failure, and fixes them with AI you approve. The score is free forever.