What Is llms.txt and Do You Need It?

🎧 Podcast · Pavel

Artificial intelligence For business owners SEO

In short: llms.txt is a Markdown file in your site’s root (example.ee/llms.txt) that gives AI a short summary of your business and links to your most important pages. Jeremy Howard proposed it in September 2024, but it is not an official standard. Google has said it is not needed for Search, and 2026 log analyses show the major AI crawlers rarely fetch llms.txt. Adding the file is cheap and harmless, but robots.txt, content visible in HTML and structured data matter far more for AI visibility.

If you have read anything about AI visibility in the past year, you have probably seen the advice “add an llms.txt file to your site”. Some present it as the new robots.txt, others as a magic key to ChatGPT. Here is what llms.txt really is, what it does and does not do, and whether your company website needs one.

What is llms.txt?

llms.txt is a plain text file in Markdown format located at yoursite.com/llms.txt. The idea is to give language models a short, clean overview of a site without menus, ads or scripts. The format was proposed on 3 September 2024 by Jeremy Howard, co-founder of Answer.AI, at llmstxt.org.

The file structure:

an H1 heading with the site or company name – the only required part;
a blockquote (a line starting with >) with a short summary;
H2 sections with lists of links, each followed by a short note;
an “Optional” section for secondary links that an AI can skip.

Some documentation sites also publish an llms-full.txt with the full text of every page. That is a convention, not part of the original proposal.

What does an llms.txt file look like?

An example for a fictional Estonian bookkeeping firm with three language versions:

# Näidis OÜ

> Näidis OÜ is a bookkeeping company in Tartu, Estonia (registry code 12345678).
> We serve small businesses in Estonian, Russian and English.

## Services
- [Bookkeeping](https://example.ee/en/bookkeeping/): monthly accounting, prices from €90/month
- [Raamatupidamine](https://example.ee/raamatupidamine/): Estonian version
- [Бухгалтерия](https://example.ee/ru/buhgalterija/): Russian version
- [Payroll](https://example.ee/en/payroll/): salaries, taxes, TSD declarations

## Company
- [About us](https://example.ee/en/about/): team, experience, certificates
- [Contact](https://example.ee/en/contact/): Riia 1, Tartu, +372 5000 0000

## Optional
- [Blog](https://example.ee/en/blog/): guides for entrepreneurs

How is llms.txt different from robots.txt and sitemap.xml?

	robots.txt	sitemap.xml	llms.txt
Purpose	Allows or blocks crawlers from pages	Lists every page to index	Short summary and key links for AI
Format	Plain text directives	XML	Markdown
Status	Official standard (RFC 9309)	Supported by all search engines	A proposal, not a standard
Controls access?	Yes	No	No
Who reads it	All well-behaved crawlers	Google, Bing and others	Mainly developer tools and AI agents

Important: llms.txt does not control access. If you want ChatGPT, Claude or Perplexity to see your site – or not – that is set in robots.txt. See how to open your site to AI crawlers.

Do AI systems actually read llms.txt?

In short: the big AI search products hardly do at the moment.

Google has said llms.txt is not needed for Search or its AI features. AI Overviews use the regular Google index.
OpenAI’s documentation covers only robots.txt and does not mention llms.txt.
2026 log analyses show GPTBot, ClaudeBot and PerplexityBot rarely request llms.txt and read pages straight from the HTML.
The file is used more often by developer tools and AI agents – for example coding assistants and some MCP integrations that need a quick summary of a site.

Does your website need llms.txt?

Honestly: it is not a priority, but it is a cheap extra. We recommend this order:

Fix the technical basics: the AI visibility checklist – robots.txt, Cloudflare, content in HTML, speed.
Add Schema.org structured data.
Write content that AI cites.
Then add llms.txt – it takes about an hour.

llms.txt makes the most sense if you have a software product, an API or documentation that developers use through AI tools.

How do you add llms.txt to WordPress?

Manually: create a file called llms.txt with the structure shown above and upload it via FTP or your hosting file manager to the site root (the same folder as wp-config.php).
Yoast SEO: the free version has an llms.txt feature that you switch on in the settings (Yoast SEO → Settings → Site Features) and that builds the file automatically. It is not available on multisite installs.
Check it: open yoursite.com/llms.txt in a browser – it should show as text, not a 404 page.

What should you put in llms.txt?

In the summary – 1–3 sentences: who you are, what you do, where and for whom. Add your registry code and city – facts an AI agent can verify.
Services or products – one line after each link saying what the page covers, with a price range if possible.
Language versions – if your site is in Estonian, Russian and English, link all of them so an agent finds the right language.
Contact and company facts – address, phone, opening hours.
Guides – your 5–10 best blog posts, not the whole archive.

Keep the file short: it is an introduction, not a sitemap. When you add a service or change a price, update llms.txt too.

Which llms.txt mistakes do harm?

Outdated information – a wrong price or address that an AI agent may pass on. Update the file together with the site.
Links to redirects or 404 pages – check that every link opens.
A keyword list – the file is there to explain, not to act as SEO copy.
Expecting it to replace robots.txt – it will not.

Frequently asked questions

Will llms.txt get me into ChatGPT answers?

Not directly. ChatGPT search is controlled by OAI-SearchBot and robots.txt. llms.txt is an extra that may help AI agents, but it does not replace the technical checks or good content.

Can llms.txt do any harm?

Only if the information in it is wrong or outdated. Keep the file accurate and update it together with your site.

Does llms.txt stop AI from using my content?

No. Access and training are controlled in robots.txt (for example GPTBot, ClaudeBot, Google-Extended).

Does the IT Solutions website have an llms.txt?

Yes. Our file lists company facts, services in three languages and guides from our blog, and we update it after new posts.

Want us to write an llms.txt for your site and check the whole technical side of AI visibility? See our AI search visibility and WordPress maintenance services, run the free website audit or contact us.

Sources

Tagged Artificial intelligence, For business owners, SEO