Skip to content

What Is llms.txt?

Definition

llms.txt is a proposed Markdown file, served at /llms.txt, that gives AI agents a short summary of a website and links to its most useful pages. Jeremy Howard proposed it in September 2024. It is not an internet standard, Google Search ignores it, and Shopify stores serve one by default that mirrors their agents.md file.

How llms.txt works

A web page is built for people. Navigation, scripts, banners and cookie notices wrap the content an AI agent actually needs. llms.txt is a proposal to give agents a shortcut. Jeremy Howard published it on 3 September 2024 as "a proposal to standardise on using an /llms.txt file to provide information to help agents use a website"[1]. The file sits at the site root, or at a subpath such as /docs/llms.txt to cover only that section[1].

It is meant to be read on demand, not collected for training. The proposal says the expectation was that llms.txt would mainly be useful for inference rather than training[1]. It also asks sites to offer clean Markdown copies of their pages at the same URL with .md added, such as page.html.md[1].

llms.txt is a proposal, not an internet standard like robots.txt, which is RFC 9309. Nothing obliges a search engine or AI company to read it. The proposal itself says the two files have different purposes: robots.txt tells automated tools what access is acceptable, while llms.txt is information an agent uses when it needs it[1].

The format

The file is Markdown, with its parts in a fixed order[1]:

PartRequired?What it holds
H1Yes, the only required sectionThe name of the site or project[1]
BlockquoteNoA short summary with the key information needed to understand the rest[1]
DetailsNoParagraphs or lists of any kind, without headings[1]
H2 file listsNoMarkdown links, each optionally followed by a colon and notes[1]
## OptionalNoSecondary links an agent can skip when it needs a shorter context[1]

For a small store, a hand-written file could look like this (a hypothetical example):

# Example Clogs
> Handmade wooden clogs, shipped from Serbia to the EU.

## Help
- [Size guide](https://example.com/pages/size-guide): how to measure
- [Shipping](https://example.com/policies/shipping-policy): times and costs

## Optional
- [Our story](https://example.com/pages/about)

Who reads llms.txt, and who doesn't

Google Search does not. Google's guide to optimizing for generative AI features says you don't need to create new machine readable files, AI text files, markup or Markdown to appear in Google Search, "as Google Search itself doesn't use them"[2]. The same guide says that keeping an llms.txt file will neither harm nor help your visibility or rankings in Google Search, because Google Search ignores such files, and lists creating unnecessary AI text files such as llms.txt among tactics you can ignore[2]. Google's page on AI features makes the same point for AI Overviews and AI Mode: you don't need new machine readable files or AI text files to appear in them[3].

Another Google product does look for it. Chrome's Lighthouse has an llms.txt audit that flags a server error when it fetches the file, while a missing file (a 404) is marked Not Applicable because providing the file is optional at the moment[4]. That audit is about AI agents browsing a site, not about Search rankings.

For other AI assistants we found no primary statement we could cite, so this page makes no claim about whether they read the file.

llms.txt on Shopify

Every Shopify store already has one. Shopify's developer changelog of 28 May 2026 says each store includes a default agents.md file and that /llms.txt and /llms-full.txt point to the same content by default[5]. Shopify calls agents.md the canonical, agent-facing description of a store: it tells AI agents and shopping assistants how to discover the store's commerce capabilities and transact with it, including its UCP discovery and MCP endpoints, read-only browsing URLs and published policies[6].

So Shopify's llms.txt is not the curated content guide the llmstxt.org proposal describes. It is a set of instructions for shopping agents. The default file we fetched from Shopify stores in November 2026 matched that description: agent instructions, endpoints and policy links, no summary of products or content.

You can override it with theme templates. For /llms.txt, Shopify uses llms.txt.liquid if it exists, then agents.md.liquid, then its own default[7]. These templates run in a restricted context where only the request and agents objects are available, so shop, collections and other usual objects are not[7]. The file is served at the bare primary domain, with no localized version per market[7]. Shopify's advice is plain: in most cases, don't add a separate llms.txt.liquid, and if you do, you take responsibility for keeping its content current[7].

Example: should a Shopify store write its own?

Take a hypothetical store selling €40,000 a month with 300 products, a size guide, a shipping page and a returns page. It has two options:

Keep Shopify's defaultAdd llms.txt.liquid
EffortNoneA few hours to write, then updates whenever key pages change
Google SearchNo effect[2]No effect[2]
Agent endpointsKept current by Shopify[6]Only what you write into the template; /agents.md keeps the default[7]
Content guideNoneCurated links to the size guide, shipping and returns

For this store the valuable work is elsewhere: a size guide that answers the question in text, clear shipping and return pages, and accurate product data. If those pages exist, a short custom file that links to them costs little. If they don't, the file has nothing useful to point to. That is the order we follow in our AI search optimization service, and the product-data side is covered in our guide to preparing a Shopify store for AI shopping.

llms.txt vs robots.txt vs sitemap.xml

llms.txtrobots.txtsitemap.xml
PurposeA summary and links for AI agentsWhich URLs crawlers may requestA list of URLs for search engines
StatusCommunity proposalInternet standard (RFC 9309)Long-established search engine protocol
Used by Google SearchNo[2]YesYes
On ShopifyDefault mirrors /agents.md[5]Generated, edited with robots.txt.liquid[8]Generated automatically

FAQ

Does Google use llms.txt?

No. Google says Google Search ignores llms.txt and similar files, so keeping one will neither harm nor help your visibility or rankings[2]. You don't need it for AI Overviews or AI Mode either[3]. Chrome's Lighthouse checks for it, but only for agent browsing[4].

Does my Shopify store already have an llms.txt?

Yes. By default /llms.txt mirrors the store's /agents.md, a file Shopify manages for every store[5][6]. Open yourdomain.com/llms.txt to see it. It describes how agents can shop the store, not your content.

Can llms.txt block AI crawlers?

No. It contains no access rules. To allow or block a crawler such as GPTBot on Shopify, edit robots.txt.liquid[8]. Even then, Shopify Catalog still sends product data to agentic storefronts you've activated[8].

What is llms-full.txt?

On Shopify it is a second URL that also mirrors /agents.md by default and can be changed with its own llms-full.txt.liquid template[5]. The llmstxt.org proposal itself defines only llms.txt and the .md page copies[1].

Should I add a custom llms.txt?

Only with a reason and someone to maintain it. Shopify advises against a separate template in most cases[7], and there is no proven ranking effect. A short file linking to your best help pages is cheap, but it won't fix weak content.

The bottom line

llms.txt is a proposed Markdown file that gives AI agents a short guide to a site. Google Search ignores it, and no other vendor has confirmed using it on a page we could cite. Shopify already serves one that mirrors the store's agents.md, aimed at shopping agents. For most stores the default is enough, and the time is better spent on content agents can quote.

Article sources

We use primary sources only: official documentation, product pages and laws. Each link was checked on the date shown.

  1. llmstxt.org (Jeremy Howard). The /llms.txt file (proposal). Accessed 18th Nov 2026.
  2. Google Search Central. Optimizing your website for generative AI features on Google Search. Accessed 18th Nov 2026.
  3. Google Search Central. AI features and your website. Accessed 18th Nov 2026.
  4. Chrome for Developers. Lighthouse: llms.txt audit. Accessed 18th Nov 2026.
  5. Shopify. Customize /llms.txt, /llms-full.txt and /agents.md (changelog, 28 May 2026). Accessed 18th Nov 2026.
  6. Shopify. agents.md.liquid. Accessed 18th Nov 2026.
  7. Shopify. llms.txt.liquid. Accessed 18th Nov 2026.
  8. Shopify Help Center. Editing robots.txt.liquid. Accessed 18th Nov 2026.

Need this on your store?

See the service

The checklist we run before touching a client's code

Get it by email, plus a few short notes over the next two weeks: what we see most often on Shopify stores and what actually fixes it.

No spam. Unsubscribe anytime. Privacy Policy