Should a Shopify store block AI crawlers?

Why the usual advice does not fit a store

Almost every AI blocklist in circulation was written by or for publishers, and a publisher and a shop have opposite incentives. A newspaper's archive is the product, so a model absorbing it for free is a direct loss. A store's product pages are advertising, so a model refusing to read them is the loss.

Copying a publisher's robots.txt into a Shopify theme therefore inverts your own interest. It is the single most common self-inflicted AI visibility problem we see, and it is invisible because nothing breaks. You simply stop appearing.

The decision, by job

Sort the bots by what they do rather than who runs them, and the answer falls out in three lines.

The setting to avoid

A blanket Disallow against every agent with an AI-sounding name. It is what a merchant reaches for after reading one alarming thread, and it takes out the search and fetch bots along with the training ones.

The result is a store that has opted out of ChatGPT search, Perplexity results and Claude's browsing, in exchange for keeping 200 product descriptions out of a training corpus they were worth nothing to. If you do one thing after reading this page, load your own /robots.txt and check that this is not already your configuration.

What blocking does not protect you from

Two things worth being clear about, because robots.txt gets asked to do more than it can.

It is a request, not a wall. Compliant crawlers honour it and non-compliant ones ignore it entirely, so it is not a security control and never was. And it is forward-looking: it stops future fetches and does not retract anything already collected.

Shopify's own product data is a separate path

Worth separating, because robots.txt does not govern it. Shopify syndicates product titles, descriptions, prices and availability to agentic surfaces through Catalog, and that runs whether or not you have blocked a crawler.

So a store can be blocked to every AI crawler and still have its products appear in ChatGPT shopping, and a store can allow everything and still be invisible because its product data is too thin to use. The feed rules are the other half of this.

How you actually change this on Shopify

Shopify generates robots.txt for you and there is no field in the admin for it. To change a rule you add a `robots.txt.liquid` template to your theme, which Shopify then renders instead of the default while still keeping its own future updates.

Shopify's help page is blunt about the risk: editing this file is an unsupported customization, Shopify Support will not help with it, and it says in as many words that incorrect use of the feature can result in loss of all traffic. Copy the default rules first, add your block, and read the rendered file at /robots.txt afterwards.

• Online Store, then Themes, then Edit code
• Add a new template called robots.txt.liquid
• Keep the default rules, then add your own user-agent group
• Load yourstore.com/robots.txt and read what actually rendered

Frequently asked questions

Sources

• OpenAI: overview of OpenAI crawlers
• Perplexity: PerplexityBot documentation
• Anthropic: does Anthropic crawl data from the web
• Google Search Central: Google crawlers and user agents
• Shopify Help: edit robots.txt.liquid

Keep reading

• Every AI crawler user agent, in one table
• Which AI crawlers to allow in robots.txt, and what each one does
• The product data rules AI shopping surfaces actually publish