llms.txt that guides AI tools around your site
We write and maintain an llms.txt file, a plain Markdown map of your most useful pages for language models.
In plain English.
llms.txt is a proposed standard, published in 2024, for a Markdown file at the root of your website. It gives a short summary of who you are and a curated list of links to your most useful pages, with a line on each. The idea is to give AI tools a clean starting point instead of making them pick through menus, scripts and cookie banners.
It is worth being clear about where it stands. It is not an official web standard, and the major AI providers have not confirmed that their search or chat products read it. Some developer tools and documentation platforms do use it, and it costs little to add, so for many sites it is a sensible small step that should come after the basics.
If you want one, we write it properly: a summary that matches your site, links grouped by topic, optional Markdown versions of key pages, and a process to keep it in step when pages change. It sits alongside the work that matters more, such as crawler access and clear content.
It suits you if.
- You publish documentation, guides or a large knowledge base
- You run a software product that developers use with AI coding tools
- You want a low-cost addition to wider AI search work
- Your site is heavy with scripts and you want a clean text summary
What we do.
Plain-text summary
A short description of your organisation and what the site covers, written to match your pages.
Curated link sections
Your best pages grouped under headings, each with a one-line description, plus an optional section for less essential links.
Markdown page copies
Optional .md versions of key pages, or an llms-full.txt file, for tools that prefer clean text.
Update routine
A process, manual or automated from your CMS, so the file stays current when pages change.
Honest priority setting
Advice on where llms.txt fits against crawler access, content and schema, so effort goes where it counts.
How it runs.
- 01
Choose the pages
We agree which pages best explain your business, products or documentation.
- 02
Write the file
A summary and grouped links are written in the format the proposal sets out.
- 03
Publish and test
The file goes live at /llms.txt and we check it loads correctly and reads cleanly as Markdown.
- 04
Keep it current
An update routine is set up, and we review the file when your site changes.
Questions people ask.
Will llms.txt make ChatGPT or Google use my site?
There is no evidence that it does today. Google has said it does not use the file for search, and other major providers have not confirmed support. We recommend it as a low-cost extra and will never sell it to you as a ranking factor.
Who actually uses llms.txt?
Mainly developer tools, documentation platforms and some AI coding assistants that fetch it to understand a library or product. That makes it most useful for software companies and sites with technical documentation that developers read often.
Is it the same as robots.txt?
No. Robots.txt tells crawlers what they may or may not access. llms.txt makes no rules about access and works as a guide to your content. If you want to control AI crawlers, that is done in robots.txt and your CDN or firewall settings.
What does an llms.txt file cost?
A small fixed fee for most sites, more if you want Markdown versions of many pages or an automated update script. It is often added as part of a wider AI search project. The fee is agreed in writing before we start.
Your next chapter starts with a conversation.
Nottingham & Derby / UK-wideLet’s build
what’s next.
15 minutes with Garreth.
A real conversation about your business.