Fix guide · Shopify

How to Fix robots.txt Issues in Shopify (2026)

Shopify automatically generates a robots.txt file for every store — you cannot delete it or make it disappear. If our checker flagged "missing robots.txt", the issue is likely that your custom domain isn't resolving correctly, or a proxy is intercepting the request. If you need to customize what robots.txt contains (allow/disallow specific paths, add AI crawler rules), Shopify provides a theme template for that.

Run a free check to confirm this is affecting your site

Why it matters

What this issue costs you

robots.txt tells search engines and AI crawlers which parts of your site they can access. Shopify's default is sensible (blocks /admin, /cart, /checkout, allows everything else), but you may need to customize it to allow AI crawlers like GPTBot or block specific paths from indexing.

Step-by-step

How to fix: Missing robots.txt

Shopify

1
Verify your robots.txt is accessible
Visit yourdomain.com/robots.txt directly in your browser. Shopify always serves one. If you get a 404, the issue is your domain configuration — check Admin > Settings > Domains and ensure your primary domain resolves to Shopify's servers.

Customize via robots.txt.liquid template

Go to Admin > Online Store > Themes > Actions > Edit code. In the Templates folder, look for robots.txt.liquid. If it doesn't exist, create it. This template overrides Shopify's default robots.txt output.

templates/robots.txt.liquid

{% comment %}
  Custom robots.txt for Shopify
  Docs: https://shopify.dev/docs/themes/architecture/templates/robots-txt-liquid
{% endcomment %}

{%- for group in robots.default_groups -%}
  {{- group.user_agent -}}
  {%- for rule in group.rules -%}
    {{- rule -}}
  {%- endfor -%}
{%- endfor -%}

# Allow AI crawlers
User-agent: GPTBot
Allow: /

User-agent: OAI-SearchBot
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: PerplexityBot
Allow: /

Sitemap: {{ shop.url }}/sitemap.xml

3
Add a sitemap reference
Your robots.txt should reference your sitemap so crawlers can discover all your pages. Add the Sitemap line at the bottom of your robots.txt.liquid template (shown in the code above). Shopify auto-generates sitemaps at /sitemap.xml.
4
Test the result
After saving, visit yourdomain.com/robots.txt and verify your changes appear. Run your URL through our checker to confirm the robots.txt finding is resolved. Changes take effect immediately — no deploy or cache purge needed.

Verify the fix

Run the checker to confirm the issue is resolved

After applying the steps above, paste your URL below. Our checker will re-run every applicable check and show whether missing robots.txt still shows as a failing check.

FAQ

Common questions about missing robots.txt

Can I delete robots.txt on Shopify?

No. Shopify always serves a robots.txt file. You can customize its contents via the robots.txt.liquid template, but you cannot remove it entirely. This is actually good — every site should have one.

Does Shopify's default robots.txt block AI crawlers?

Shopify's default robots.txt does not explicitly mention AI crawlers (GPTBot, ClaudeBot, PerplexityBot). Since there's no Disallow rule for them, they are allowed by default. However, explicitly adding Allow rules makes your intent clear and future-proofs against Shopify changing defaults.

I changed robots.txt.liquid but the old version still shows. What do I do?

Shopify caches robots.txt briefly. Wait 5–10 minutes and check again. Also verify you saved the file in the correct theme (your live/published theme, not a draft). If using a CDN in front of Shopify, purge that cache too.

While you're here

Related fix guides for Shopify

Missing robots.txtWordPress→Missing XML sitemapShopify→Missing or incorrect canonical tagShopify→

Need a full audit?

This checker spots individual issues instantly. deepseoanalysis.com crawls your whole site and tracks changes weekly, from $24/mo.

Deep audit →

See all WordPress fix guides, or run a free check now.