RankEngineRankEngine Help

llms.txt and agent.json — making your store AI-readable

AI assistants and shopping agents look for a few files on your store that tell them what you sell, what they may read, and how to work with your catalog. RankEngine builds and serves them for you from Agent Ready.

llms.txt

A plain-text guide to your store for AI assistants, in the llmstxt.org format. RankEngine builds it from your Shopify store: your shop name and description, your collections, up to 50 published products, your blog posts (Guides) and your policies. Demo products and gift cards are left out.

It is served at yourstore.com/llms.txt: RankEngine stores the file and serves it through its app proxy, and adds a URL redirect from /llms.txt to it. A redirect that you or another app already own is never replaced unless you choose to. Autopilot's Update the AI summary file (llms.txt) rule rebuilds it when your content changes, and the previous version is kept in Settings › Change history.

ai.txt

Your AI crawler permissions file, built from your AI crawler policy and served at yourstore.com/ai.txt the same way as llms.txt.

AI bot rules in robots.txt

Which AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended and others) may read your pages. RankEngine writes these rules into your theme's robots.txt only when you ask: Publish AI bot rules on the Agent Ready Overview tab, saving your AI crawler policy, or applying a one-click fix with the AI assistant access group ticked (it is ticked by default when there is work to do; untick it to leave robots.txt alone). Autopilot never changes robots.txt. Your own robots.txt rules are kept, the previous file is kept in Change history, and Remove from my theme takes RankEngine's rules out again.

agent.json and the other discovery files

agent.json, the agent-to-agent card, the API directory, the agent skills list and the commerce file (UCP, Pro) describe your store to AI agents. RankEngine serves them through its app proxy at yourstore.com/apps/a/rankengine/.well-known/…. Serving them at your domain's own /.well-known/ path needs a custom domain and the optional Cloudflare Worker (Set up the Cloudflare Worker on the Overview tab).

Structured data

Product, organization and other structured data (JSON-LD) is added to your pages by RankEngine's theme app embed, once it is turned on in Settings › Theme setup.

How to set it up

  1. Open Agent Ready. The tabs are Overview, Checks, Shopify Agentic, Fix issues and Needs you.
  2. Checks lists each file and signal with its status.
  3. Fix issues fixes what RankEngine can fix for you; Needs you lists what needs a person.
  4. One-click publishing of the crawler rules and discovery files is on the Basic and Pro plans; Web Bot Auth signing and the UCP commerce file are Pro.

Related