llms.txt is a proposed plain-text (Markdown) file placed at the root of a website, such as example.com/llms.txt, that lists your most important pages with short descriptions so large language models can find them easily. It is a community proposal, not an official standard, and major AI search companies have not confirmed that they use it for ranking or citations. It is cheap to add and harmless, but it is not a substitute for good content and crawlable pages.
I’m Nazirul Islam Nakib, an SEO, AEO and GEO specialist. I get asked about llms.txt constantly, so here is an honest, evidence-based answer: what it is, what is known, and whether to bother.
What is llms.txt?
The llms.txt idea was proposed in 2024 by Jeremy Howard. The goal is to give AI systems a clean, human-readable map of a site. Instead of crawling messy HTML with menus, scripts and ads, a model could read one Markdown file that says what the site is and links to the key pages.
It is usually structured like this:
- A title with the site or brand name.
- A short summary (one or two sentences).
- Sections with lists of links, each with a brief description.
- Optionally, an extended file (llms-full.txt) containing full page text.
llms.txt vs robots.txt vs sitemap.xml
| File | Purpose | Status |
|---|---|---|
| robots.txt | Tells crawlers what they may or may not crawl | Long-established standard |
| sitemap.xml | Lists URLs for search engines to discover | Widely supported |
| llms.txt | Gives LLMs a curated summary and link list | Proposal, not confirmed by major AI search engines |
Note that llms.txt does not control access. To allow or block AI crawlers, you still use robots.txt and server rules.
Does llms.txt help AI search?
The honest answer is: there is no confirmed evidence that it does. As far as I know, Google has publicly said it does not use llms.txt for Search, and OpenAI, Perplexity and Microsoft have not announced that their search products rely on it. Some developer tools and AI coding assistants do read these files, especially for documentation sites, which is where the idea has been most useful.
This could change, so check each company’s current documentation. I would treat any agency promising ranking or citation gains from llms.txt alone as overselling.
Should you add one?
My view:
- Documentation, SaaS, developer and knowledge-heavy sites: worth adding, because tools that do read it can benefit.
- Local and service businesses: optional. Do it after the basics, in under an hour.
- If your site is thin, slow or unindexed: fix that first. A file listing weak pages helps no one.
How to create an llms.txt file
- Pick your best pages. Usually 10 to 30: key services, guides, pricing or process, About, contact.
- Write a clear summary of who you are and what you do.
- Add short descriptions to each link. One line, factual, no hype.
- Save as plain text named
llms.txtand upload it to your site root. - Check that yourdomain.com/llms.txt loads and returns plain text.
- Update it when you add or remove important pages.
Example outline
Title: Nakib IT. Summary: an SEO, AEO and GEO consultancy in Dhaka. Sections: Services (links to AI SEO, technical SEO, local SEO), Guides (links to key articles), Company (About, contact). Each link has one factual sentence.
What matters more than llms.txt
- Allowing the right crawlers in robots.txt. See how to optimize your website for ChatGPT search.
- Clear, answer-first pages. See how to get featured in Google AI Overviews.
- A strong technical base. See technical SEO checklist for AI search.
- Accurate structured data. See schema markup for AI search.
- Brand mentions on trusted sites.
Risks and cautions
- Do not list pages you do not want summarised.
- Do not stuff it with keywords or claims. Keep it factual.
- Do not rely on it as protection against AI scraping; it is not an access control.
- Do not spend budget on it before fixing indexing and content problems.
Frequently asked questions
What is llms.txt?
A proposed Markdown file at your site root that gives AI models a curated summary and list of key pages.
Is llms.txt an official standard?
No. It is a community proposal. Adoption varies.
Does Google use llms.txt?
Google has said it does not use it for Search. Check current statements, as policies can change.
Will llms.txt get me cited in ChatGPT?
There is no confirmed evidence. Focus on content, access and trust first.
Is it safe to add?
Yes. It is a public file with no known downside if you only list pages you are happy to share.
Where do I put it?
At the root: yourdomain.com/llms.txt.
For a plan that fits your site, see my AI SEO service, order an AI visibility audit, or request a free website audit.
