How to make your llms.txt
- Type your site or business name and one or two sentences on what you do, for whom, and where if you are local.
- Add anything else a model should know, such as opening hours or what you don't offer, under Other details.
- Pick an example layout or name your own sections, then list your most useful pages, one per line, with a short note after each. Ten to fifty links is plenty for most sites.
- Put nice-to-have pages in the section named Optional. The generator writes it last.
- Copy or download the file and upload it to the root of your site, so it opens at https://yourdomain.com/llms.txt. Then open that address to make sure it loads as plain text.
Keep it current: a file that links to deleted pages is worse than none. For what the file does and doesn't do, and which big sites have one, see our llms.txt guide, with a check of 33 sites. Ours is at thesearchpost.com/llms.txt.
Questions about llms.txt
What is an llms.txt file?
llms.txt is a short Markdown file at the root of a site, like example.com/llms.txt, that tells AI tools what the site is and links to its most useful pages. Jeremy Howard proposed it on Sept. 3, 2024, at llmstxt.org. It is a proposal, not a standard any search engine has adopted.
What goes in an llms.txt file?
In order: an H1 with the site name (the only required part), a blockquote with a one or two sentence summary, optional paragraphs without headings, then H2 sections of Markdown links, each with an optional note after a colon. A section called Optional holds links a tool can skip when it is short on room.
Does llms.txt help me appear in AI Overviews or ChatGPT?
Nobody has shown that it does. Google says you don’t need new machine readable files or AI text files to appear in AI Overviews or AI Mode, and the crawler documentation of OpenAI, Anthropic and Perplexity does not say their crawlers read other sites’ llms.txt files. It is cheap to make, so treat it as a tidy map for AI tools, not a ranking tactic.
Does Google check llms.txt anywhere?
Lighthouse does. Its agentic browsing audits include an llms.txt check: a missing file is marked not applicable, because Google calls the file optional at the moment, and only a server error when fetching it fails the audit.
Is llms.txt the same as robots.txt?
No. robots.txt tells crawlers what they may fetch. llms.txt tells a model what is worth reading, and it allows or blocks nothing. To control which AI crawlers may visit, use robots.txt.
Where do I put the file?
Save it as plain text named llms.txt and upload it to the root of your site, so it opens at https://yourdomain.com/llms.txt. It is public, so don’t put anything in it you wouldn’t publish.
Is my data sent anywhere?
No. The generator runs entirely in your browser. Nothing you type is sent to The Search Post or anyone else.