What is llms.txt and why your website should have one

Direct answer: llms.txt is a plain text file, placed at the root of a website, that gives AI models (such as ChatGPT, Perplexity or Claude) a clear, organised summary of the site — what it is, what it offers and where to find the most important pages. It works as a map designed for AI machines, helping them understand and cite your business more accurately.

What is llms.txt, in plain language?

If you've heard of robots.txt (which tells search engines what they can and can't crawl) and the sitemap (which lists the site's pages), llms.txt is the newest cousin in this family — but for the AI era. Instead of letting a model guess the essentials among menus, footers and code, the file hands it a curated summary: a description of the company and links to the pages that really matter, in clean text.

It's an emerging technical proposal, not yet an official standard imposed by the platforms. But the cost of having it is practically zero and it aligns with the market's clear direction: making websites readable for people who now ask AI instead of searching Google.

Does llms.txt replace SEO or the sitemap?

No. It complements them. The sitemap still serves traditional search engines; robots.txt still manages crawler access; and good SEO remains the foundation of everything. llms.txt adds a layer: a condensed, AI-friendly version of what the site communicates. Think of it as your website's executive summary for a reader that happens to be a machine.

What should a good llms.txt contain?

The value is in the curation, not the quantity. A useful file usually includes:

• A clear title and summary of what the company is and does — that factual sentence AI can cite.
• Links to the essential pages — services, about, contact, case studies — each with a brief description.
• Relevant context information: who it's for, where you operate, how to get started.
• Clean, concise text, with no HTML, no menus, no repetition.

The most common mistake in auto-generated versions is dumping truncated text from every page. A curated, short, well-written file is worth more than a long, confusing one.

How to create it and where to put it?

The file is called llms.txt and lives at the root of the domain (for example, yoursite.com/llms.txt), just like robots.txt. There are three routes:

• Plugin. Several SEO and optimisation plugins already generate an llms.txt automatically. It's the fastest route, but do review the quality of the result.
• Manual. Write the file by hand (it's just text) and place it at the site root. It gives you more control over what the AI sees.
• Curated with technical support. The best version combines both: a well-structured file, reviewed and kept up to date as the business evolves.

Is it really worth it? An honest note

Adoption of llms.txt by the major AI platforms is still consolidating, and nobody should promise that it alone will boost your visibility. But it's cheap, it does no harm, and it puts you on the right side of the shift. At a time when more and more decisions start with a conversation with AI, giving it a clear summary of your business is a low-risk bet with real potential — especially when combined with direct answers, FAQs and authority signals across the rest of the site.

Frequently asked questions

What is llms.txt?

It's a text file at the root of a website that provides AI models with a curated summary of the site — a description of the business and links to the main pages — so they interpret and cite it more accurately.

Is llms.txt mandatory?

No. It's an emerging proposal, not a requirement. But it has a very low cost and aligns the site with how AI looks for information, so it's good preventive practice.

What's the difference between llms.txt and robots.txt?

robots.txt controls what crawlers can access; llms.txt summarises the site's content for AI models. One manages access, the other aids understanding.

Where does the file go?

At the root of the domain, reachable at yoursite.com/llms.txt, just like robots.txt.

Want your site ready for the AI era?

At Shiftworks we handle the technical base that makes a website readable and citable by AI engines — from llms.txt to structured data. Start with a free diagnosis.

Talk to us → · Reply within 24 hours.