DeadpanLabs

Why isn't my ecommerce site showing up in AI chatbot answers?

By Pablo Aguiar, Deadpan Labs · October 4, 2026 · 5 min read

GEO · Ecommerce · Research

If your store doesn't come up when shoppers ask ChatGPT, Perplexity or Google's AI for products, the cause is rarely that the AI can't get into your site. On October 1, 2026 we tested 115 real online stores. None of the 114 robots.txt files we could read blocked the crawlers ChatGPT and Perplexity use for search, and every product page we could read had the product's name right there in the HTML. Getting read is not the hard part.

Once an engine is in, what it finds matters, including something your own HTML can't show: whether anyone else has written about you. Assistants build product answers from the sources they trust (roundups, review sites, forums, retailer listings), and your own site is only one of them.

What we found in 115 stores

Each row is a count, not an estimate. The left column says what we checked. The middle column is how many stores or product pages we could check it on.

115 online stores, tested October 1, 2026
What we checkedCheckedResult
robots.txt blocks ChatGPT's search crawlers (OAI-SearchBot or ChatGPT-User)114 stores0
robots.txt blocks Perplexity's crawlers (PerplexityBot or Perplexity-User)114 stores0
robots.txt blocks any of the 16 AI crawlers we checked114 stores5 (4%)
Firewall or CDN refused our plainly identified request114 stores8 (7%)
Product name in the HTML (page text or main heading) before any JavaScript runs97 product pages97 (100%)
Product name and a price in the HTML97 product pages90 (93%)
Product structured data (JSON-LD)97 product pages85 (88%)
Product page set to noindex97 product pages1

Is my robots.txt blocking ChatGPT?

Probably not. Of the 114 robots.txt files we read, five blocked any AI crawler at all, and three of those only blocked crawlers that collect training data. Blocking a training crawler keeps your pages out of a future model's training set. It does not stop ChatGPT or Perplexity from finding and citing you when a shopper asks today, because those use different crawlers. The other two stores blocked crawlers that do feed answers: Microsoft's Bing crawler, which Copilot answers from, and Amazon's. Not one store blocked ChatGPT's or Perplexity's own search crawlers.

The more common wall is the firewall, not the file. At 8 of the 114 stores, the firewall or CDN refused our request outright, even though the request said plainly who we were. We can't tell from outside whether the same rules let the real AI crawlers through. Many bot-protection services verify the big crawlers by their network and admit them. So we report it as what it is: a site that turns away readers it doesn't recognize. If you want to see your own file the way a crawler reads it, our free AI-crawler check shows the exact line that decides each crawler.

Can AI read my product pages?

On the stores we tested, mostly yes. Every one of the 97 product pages we read had the product's name in the HTML before any JavaScript ran, and 93% had a price there too. 88% carried Product structured data. Shopify's standard themes render product pages on the server and ship that data by default, and 88 of the 97 product pages we read were on Shopify.

The exception is the custom-built storefront that paints the product in with JavaScript after the page loads. We've seen it on stores outside this sample. To a crawler that doesn't run scripts, their product pages read as a list of menu links with no product on them. If your store runs on a custom front end, that is worth checking.

What else decides whether a store gets named?

With access and basic product data mostly in place, here is what is left, including the part data like this can't reach:

  • Reviews an engine can read. A store can have plenty of happy customers and still give an engine no rating signal it can use. Engines tend to weigh ratings from sources they trust, and testimonials on your own site tend to count for less than you'd hope.
  • Mentions somewhere else. This is the one a store's own HTML can't show, and our test couldn't measure it. Assistants assemble shopping answers from roundups, review sites, forums and retailer listings. A store that is perfectly readable but that nobody else has written about gives the engine nothing to cite except itself.
  • The words shoppers actually use. People ask assistants in problem language ("cream for a damaged skin barrier"), not catalog language. A store whose pages and mentions never use that phrasing is less likely to get pulled in for the question, however clean its HTML is.

How we measured

On October 1, 2026 we tested 115 independent online stores that sell on their own sites, across several consumer categories. 89 of them were on Shopify.

We checked each store's robots.txt and, where we could, one product page's HTML without running JavaScript. We checked each robots.txt against 16 AI crawlers with the same parser behind our free AI-crawler check, which follows the IETF robots standard (RFC 9309). We read 97 product pages. For the other 18 stores we got no product page: a firewall or CDN refused us at 8, and at the other 10 we couldn't find or load one.

Two limits worth knowing. The sample leans toward stores already doing reasonably well in search, so across all stores these problems are probably more common. And this is a snapshot: a store can change its theme or its robots.txt tomorrow. We aren't naming any store. The finding is the pattern.

If your store looks fine on all of this and still isn't named, the gap is most likely off your site, and the only way to see it is to ask the questions your shoppers ask and look at who gets named instead. Our free AI-visibility check does exactly that across ChatGPT, Perplexity and Google AI, and comes back with the names and the sources behind them.

The free check

Are the assistants recommending you?

We’ll run your brand against ChatGPT, Perplexity & Google AI and show you who’s named instead.

Run the free checkFree check · run by us, delivered to your inboxTalk to us →The full guide: AI search visibility →