Blog Guides

Markdown versions of your pages for AI: llms-full.txt and .md mirrors explained

"Creating markdown files for AI visibility" is one of the few AI-SEO phrases people actually type into Google, and the honest answer is more modest than most guides let on. A markdown file will not get you cited on its own. It removes friction for the systems that already want to read you.

Where the idea comes from

In September 2024, Jeremy Howard of Answer.AI proposed a simple convention, now published at llmstxt.org: "We propose adding a /llms.txt markdown file to websites to provide LLM-friendly content." The idea has two layers. llms.txt is a short index at your domain root linking to your most important pages. llms-full.txt goes further: it concatenates the full text of those pages, stripped of navigation and markup, into one plain markdown file a model can read in a single pass.

Why the full version matters more than the index

A one-page index tells a model what exists; a markdown mirror lets it actually read your content without fighting your theme's HTML. For a five-to-twenty-page small business site, generating an llms-full.txt and a plain .md copy of each key page is a cheap way to hand over clean, unambiguous text.

Set expectations correctly

Adoption is growing but still early. Rankability's tracking found 5.61% of the top 10,000 websites had a valid llms.txt as of June 2026, up from 1.04% a year earlier, roughly 5.4x growth. And a separate Ahrefs study of 137,000 sites found that 97% of llms.txt files logged zero crawler traffic in May 2026. The file itself is rarely fetched directly; what matters is that the pages it points to are easy for a model to read once it does arrive, by any route.

How to ship one this week

  • List your 5 to 15 most important pages as plain markdown links with a one-line description each, saved as /llms.txt.
  • Export the main body text of those same pages to individual .md files, or concatenate them into /llms-full.txt.
  • Keep both in sync with the live pages; a stale mirror is worse than none.
  • Do this after, not instead of, making sure GPTBot, OAI-SearchBot, and PerplexityBot can actually reach your site. See our 10-minute llms.txt walkthrough for the base file.

Quick answers

Is llms-full.txt different from llms.txt?

Yes. llms.txt is a short index of links with descriptions. llms-full.txt is a single file containing the actual markdown content of those pages, so a model does not need to crawl each one separately.

Will adding these files guarantee my site gets cited by AI assistants?

No. Adoption data shows most llms.txt files get little direct crawler traffic. They reduce friction once a model reaches your site; they do not replace crawlable pages or answer-shaped content.

Run a free scan at RankMerlin to see how AI-readable your current pages already are, no account needed, before you spend an afternoon building markdown mirrors.

Newsletter

Enjoyed this article?

Subscribe and new SEO and AI-visibility guides land straight in your inbox. No spam, unsubscribe anytime.

Double opt-in: confirm by email. Unsubscribe anytime. Privacy policy.