llms.txt Ecosystem

llms.txt ecosystem — CLI generators, CMS plugins, documentation frameworks, llms-full.txt standard, comparison with robots.txt, sitemap.xml and MCP

Official Resources

Resource	Description
llms.txt specification	Official standard website
AnswerDotAI/llms-txt	Original repository (2,191 stars)
llms-txt-hub	Largest directory (732 stars, 381 forks)

Generation Tools

CLI Tools

Tool	Language	Description
llmstxt	Node.js	Generate from sitemap.xml
llmstxt-architect	Python	AI-powered generation with LLM
llms_txt2ctx	Python	Convert to context
Crawl4AI	Python	LLM-friendly crawler

Web Services

Service	Description
llm.codes	Convert JS documentation
llmstxt.com	Generator and hub
Firecrawl llmstxt-generator	Generate from any URL

Framework Plugins

Astro / Starlight

pnpm add starlight-llms-txt

import starlightLlmsTxt from 'starlight-llms-txt'

export default defineConfig({
  integrations: [
    starlight({
      plugins: [starlightLlmsTxt()],
    }),
  ],
})

VitePress

npm install vitepress-plugin-llms

import llmsPlugin from 'vitepress-plugin-llms'

export default {
  vite: {
    plugins: [llmsPlugin()],
  },
}

Docusaurus

npm install docusaurus-plugin-llms-txt

module.exports = {
  plugins: ['docusaurus-plugin-llms-txt'],
}

MkDocs

pip install mkdocs-llmstxt

plugins:
  - llmstxt

mkdocs-llmstxt (79+ stars) — auto-generate from MkDocs documentation.

Nuxt

npx nuxi module add nuxt-llms

nuxt-llms — official Nuxt Content module.

WordPress

5+ plugins: LLMS.txt Generator, bloglogistics-llm-generator, srworksllc/llmstxt-generator.

Discourse

discourse-llms-txt-generator — automatic llms.txt generation for forums.

Drupal

Recipe for Drupal 10.3+:

Drupal llms.txt recipe

Full catalog: Generators and Tools

Extensions and Utilities

Browser Extensions

Extension	Description
LLMs.txt Checker	Chrome: check for llms.txt presence

IDE Extensions

Extension	Description
PagePilot	VS Code: load context from llms.txt

Raycast

# Raycast extension for llms.txt
raycast://extensions/llmstxt

MCP Integrations

mcpdoc

Using llms.txt as a source for MCP:

{
  "mcpServers": {
    "docs": {
      "command": "uvx",
      "args": [
        "--from", "mcpdoc",
        "mcpdoc",
        "--urls", "LangGraph:https://langchain-ai.github.io/langgraph/llms.txt",
        "--transport", "stdio"
      ]
    }
  }
}

Multiple Sources

{
  "mcpServers": {
    "multi-docs": {
      "command": "uvx",
      "args": [
        "--from", "mcpdoc",
        "mcpdoc",
        "--urls",
        "React:https://react.dev/llms.txt",
        "Next.js:https://nextjs.org/llms.txt",
        "Tailwind:https://tailwindcss.com/llms.txt",
        "--transport", "stdio"
      ]
    }
  }
}

Libraries

Python

pip install llms-txt

from llms_txt import parse_llms_txt, to_context

# Parsing
with open('llms.txt') as f:
    data = parse_llms_txt(f.read())

# Convert to context
context = to_context(data, include_optional=False)

JavaScript

import { parseLlmsTxt } from 'llmstxt-parser'

const response = await fetch('https://example.com/llms.txt')
const content = await response.text()
const parsed = parseLlmsTxt(content)

console.log(parsed.title)       // "Project Name"
console.log(parsed.description) // "Brief description"
console.log(parsed.sections)    // { "Docs": [...], "API": [...] }

PHP

composer require nicholasgasior/llms-txt-php

llms-txt-php — parsing and generating llms.txt.

Sites with llms.txt

By Category

Category	Examples
AI/ML	Anthropic, Cohere, Hugging Face, CrewAI
Developer Tools	Astro, Vercel, Stripe, Resend
Databases	DuckDB, Upstash, Turso
Integration	Zapier, Make, Activepieces

Full Directory

See llms-txt-hub for the complete list of 329+ sites.

Standards and Compatibility

Relationship with Other Standards

Standard	Purpose	Relationship to llms.txt
robots.txt	Rules for crawlers	Complements, doesn’t replace
sitemap.xml	List of all pages	llms.txt is a curated subset
humans.txt	Team information	Different purposes
MCP	Dynamic protocol for LLMs	llms.txt = discovery, MCP = interaction

Versioning

Current specification version: 1.0

The specification is stable and backward compatible.