Glossary

llms.txt

Also called llms.txt file, LLMs.txt, llms-full.txt.

Definitionllms.txt is a proposed Markdown file placed at a website's root that summarizes the site and lists its key pages for large language models to read.

llms.txt is a proposed file, placed at the root of a website (for example example.com/llms.txt), that gives large language models a short Markdown summary of the site and links to its most useful pages. The idea, published in 2024, is that a clean, text-only guide is easier for an AI system to read than a full website with navigation, scripts and ads.

What goes in an llms.txt file?

The proposal suggests a simple structure:

  • an H1 with the site or company name,
  • a short summary in a blockquote,
  • optional notes about the site,
  • H2 sections with lists of links to key pages, each with a one-line description.

Some sites also publish an llms-full.txt with the full text of their documentation in one file.

Do AI engines actually use llms.txt?

This is the honest part: it is a proposal, not a standard, and the major AI companies have not confirmed that their crawlers or answer engines use it to decide what to show. Google has said it does not use llms.txt for Search. Some developer tools and coding assistants do read llms.txt files for documentation.

So treat it as a low-cost, low-risk addition, not a ranking lever. It takes little time to write, it forces a useful exercise (deciding which pages matter most), and it may become more widely used. It does not replace crawlable pages, clear content or an AI crawler policy in robots.txt.

Example

A hypothetical accounting software company, Tallybook, writes an llms.txt with a two-sentence summary and three sections: Product (pricing, features, integrations pages), Guides (its five most-read help articles) and Company (about and contact). It takes about an hour. The agency notes it in the client report as a completed housekeeping item, without promising any traffic change.

How AI Visibility Desk checks it

The built-in white-label site audit in AI Visibility Desk checks whether a site has an llms.txt file, alongside AI crawler blocking and other SEO, GEO and AEO issues. You can also run the free SEO checker or a full SEO audit.

Measure it on a real brand

Run a free AI visibility audit across ChatGPT, Gemini, Google AI Overviews, AI Mode, Perplexity and Claude, and get a white-label report.

Start free