Skip to content
LLMs Full Text
Select theme

Who publishes llms.txt

A registry of sites checked for llms.txt, llms-full.txt and Markdown versions of pages - with the measurement date, adoption estimates and a list of well-known sites that do not have the file

How many sites have the file

Section titled “How many sites have the file”
of sites in the HTTP Archive crawl
2.1%
Web Almanac 2025, Jan 15, 2026
of the top thousand sites
8.7%
Rankability, June 2026
of domains in a sample skewed towards an SEO audience
28%
Ahrefs, Jun 15, 2026
files found in a single crawl of the web
584K
Common Crawl, Aug 31, 2026

The numbers do not contradict one another: they have different denominators. A crawl of the whole web gives about two percent. A sample of sites whose owners do SEO gives ten times more, and its authors call it an upper bound themselves.

Notes on the sources: Web Almanac, Common Crawl.

Who creates the files

Section titled “Who creates the files”
Source of the file Share Where the number comes from
Made by a generator, not by hand 68% Common Crawl
Sites on Wix 41% Common Crawl
All in One SEO for WordPress 39.6% Web Almanac 2025
Yoast SEO for WordPress 3.6% Web Almanac 2025

The shares come from different crawls and do not add up. The common conclusion: most files exist because a platform switched the feature on by default.

Sites that were checked

Section titled “Sites that were checked”

The measurement was made by requests to the sites themselves. The table notes what each example shows and what it does not prove.

  • OpenAI

    developers.openai.com/llms.txt
    llms-full.txt
    yes
    Markdown pages
    via the Accept header

    What it shows. A root index plus nested files for /api, /codex, /commerce

    What it does not prove. That ChatGPT reads other sites’ llms.txt

  • Anthropic

    platform.claude.com/llms.txt
    llms-full.txt
    yes
    Markdown pages
    yes, with rel=alternate

    What it shows. A docs index and the full text in one file

    What it does not prove. That Claude reads other sites’ llms.txt

  • Cloudflare

    developers.cloudflare.com/llms.txt
    llms-full.txt
    yes
    Markdown pages
    yes

    What it shows. A very large index: the full text takes 67 MB

    What it does not prove. That a file this big is usable by an agent as a whole

  • Stripe

    docs.stripe.com/llms.txt
    llms-full.txt
    no
    Markdown pages
    via the Accept header

    What it shows. llms-full.txt is not required: an index and Markdown pages are enough

    What it does not prove. That skipping the full file is a general rule

  • Cursor

    cursor.com/llms.txt
    llms-full.txt
    not checked
    Markdown pages
    via the Accept header

    What it shows. The only measured site with rel=describedby from the second edition

    What it does not prove. That the second edition is widely adopted

  • GitHub Docs

    docs.github.com/llms.txt
    llms-full.txt
    no
    Markdown pages
    yes

    What it shows. An index without a full file on large docs

    What it does not prove. That Copilot relies on this file

  • Mintlify

    www.mintlify.com/docs/llms.txt
    llms-full.txt
    yes
    Markdown pages
    yes

    What it shows. The platform generates the files automatically for every site it hosts

    What it does not prove. The quality of each generated file

  • Yandex Cloud

    yandex.cloud/llms.txt
    llms-full.txt
    not checked
    Markdown pages
    not checked

    What it shows. An example on a Russian site

    What it does not prove. That Yandex Search uses such files

Who does not have the file

Section titled “Who does not have the file”

On the measurement date /llms.txt answered 404 at:

Site Why it is notable
developers.google.com, developer.chrome.com, web.dev Lighthouse checks for the file, but the team’s own sites do not publish it
docs.astro.build, starlight.astro.build often cited as examples in older lists
developer.mozilla.org, the root of huggingface.co the same
tailwindcss.com developer documentation without the file
ahrefs.com, moz.com they study the format but do not publish it

The list is a useful correction to “who supports llms.txt” directories: they age fast and are rarely rechecked.

The second edition

Section titled “The second edition”

The second edition of the proposal came out on August 10, 2026 and added discovery relations: rel="describedby" and rel="alternate". Among the measured sites rel="describedby" appeared on one. Documentation platforms still send headers of their own that are not in the proposal.

What changed: changes in the second edition, discovery.

What follows from this

Section titled “What follows from this”

What is known and what is not

Confirmed

  • Large documentation sites publish llms.txt and Markdown versions of pages.
  • Most files on the web were created automatically.
  • Not everyone publishes llms-full.txt: Stripe and GitHub Docs do without it.

Not proven

  • That owners of AI systems read other sites’ files: nobody has published such a commitment.
  • That the second edition is widespread: the measurement shows isolated cases.

What it does not mean

  • A well-known company having the file does not prove a benefit for another site.
  • The number of published files is not the number of files read.

The format took root in developer documentation. Outside it, a platform creates the file more often than an owner does.

How the measurement was made

Section titled “How the measurement was made”
  • Date: October 3, 2026.
  • Method: requests to /llms.txt and /llms-full.txt, a page request with Accept: text/markdown, inspection of the Link header and rel links in the HTML.
  • The status code, content type and size were recorded.
  • The answer depends on the client: some sites answer a command line and redirect a browser. The table records the answer given to a command line.

Repeat the measurement for your own site: Validating files and markup.

Section titled “What to read next”