Does llms.txt Work? The Evidence, Stated Honestly (2026)

The short answer

llms.txt is a proposed standard: a Markdown file at your root that lists your most important pages so language models can find the good content fast. The idea is reasonable. The problem is adoption on the consumer side. A spec only "works" if the systems it targets actually read it, and right now they mostly do not.

Let's look at what the evidence says, without the marketing gloss.

What Google says

Google has been unusually direct. Gary Illyes said at Search Central Live in mid-2025 that Google does not support llms.txt and has no plans to. John Mueller compared it to the old meta keywords tag: a file that tells crawlers what a site is about, when the crawler would rather just read the site itself. When people pointed out that Google publishes its own llms.txt and asked whether that was an endorsement, Mueller said, bluntly, no.

Google's own AI-features guidance now states you don't need to create new machine-readable files, AI text files, or Markdown to appear in Google Search. That is about as clear as platform guidance gets. [1] [2]

What the other providers say

Nothing. That is the key point. As of mid-2026, no major AI provider (OpenAI, Anthropic, Perplexity, Meta) has publicly confirmed that its crawlers read or prioritize llms.txt. Absence of confirmation is not proof of nothing, but it means anyone claiming llms.txt boosts your ChatGPT or Claude visibility is guessing.

What the server logs show

This is the most damning evidence, because it is behavior, not opinion.

• Ahrefs analyzed roughly 137,000 domains and found that about 97% of llms.txt files received no recorded requests at all. Of the files that did get hits, most traffic came from SEO audit tools, not AI bots. [3] [4]

• One monitoring effort tracked over 500 million AI bot visits across 90 days. Only about 408 requests targeted llms.txt directly. That is a rounding error.

• OtterlyAI reported that across 60,000+ AI bot visits over 90 days, roughly 0.1% touched the llms.txt file.

Three independent datasets, same conclusion: AI crawlers overwhelmingly skip the file today.

What the adoption numbers show

Publishing behavior tells a similar story. A SE Ranking study of 300,000 domains found a 10.13% adoption rate, roughly one site in ten, after eighteen months of industry discussion. [5] Adoption is neither zero nor mainstream. It sits in the awkward middle where a standard can still fail for lack of consumer support.

Comparison at a glance

So should you bother?

A defensible position: publishing llms.txt is fine as a low-cost bet, provided you keep it accurate and don't let it drift out of sync with your site. What you should not do is treat it as an AEO strategy or expect it to move citations. The things that demonstrably matter for being cited by AI systems are the same fundamentals as ever: crawlable HTML, clear answer-first content, and not accidentally blocking the crawlers that feed AI search.

That last point is where most sites actually lose. A misconfigured robots.txt or an aggressive WAF rule quietly blocks OAI-SearchBot or Claude-SearchBot, and no llms.txt file will fix that.

FAQ