Does an llms.txt Actually Impact Your Site's Visibility in LLMs?

When an AI model pulls information from your site, it does not read every page. It fetches what it can find quickly and fits that content into a limited context window. Most sites give AI models no guidance at all, which means the model grabs whatever it lands on first.

llms.txt changes that. It is a plain-text Markdown file you place at the root of your domain (yoursite.com/llms.txt) that tells AI models what your site covers and links them directly to your most important content. Think of it less like a sitemap and more like a briefing document written specifically for AI.

What llms.txt is and what it is not

The format was proposed in 2024 by Jeremy Howard of Answer.AI. A standard llms.txt file starts with an H1 title, includes a short blockquote summary of what your site is, and then organizes links under H2 headings by content type: documentation, blog posts, case studies, key pages.

It is not a robots.txt replacement. Robots.txt controls what crawlers are allowed to access. llms.txt is an invitation, not a gate. You are telling AI tools: here is what we do, here is where the good content lives, please use this instead of guessing.

The files can coexist. Many teams use robots.txt to manage crawl permissions and llms.txt to guide how AI models navigate the pages they are allowed to reach.

Why context windows make this matter

Large language models have limited context windows. When a model fetches content from your site to answer a query, it cannot process your entire domain in one pass. It takes what it can fit.

A well-written llms.txt file pre-filters that problem. Instead of forcing the model to crawl three layers deep to find your most authoritative content, you surface it immediately. Search Engine Land described it as a treasure map for AI, which is accurate. You are not just making content accessible, you are sequencing what the model sees first.

This matters most for brands in competitive categories where AI models are generating answers from multiple sources. The site that makes its content easiest to read and retrieve is the one that gets cited.

Who is using it

Adoption is still early but the pattern is telling. Companies like Anthropic, Stripe, Cursor, Cloudflare, Vercel, Supabase, and Mintlify already have llms.txt files in place. Rankability’s ongoing dataset tracked a jump from 15 sites in February 2025 to over 105 by May, a 600% increase from a near-zero base.

The current adopters are almost entirely developer tools, AI companies, and technical SaaS platforms. Mainstream consumer sites have not moved yet, which means there is a window right now for brands in those categories to establish positioning before the space gets crowded.

What it does not do

There is an important limitation worth being direct about. In July 2025, Google’s Gary Illyes confirmed that Google does not support llms.txt and has no plans to. SEO Ranking’s analysis notes that the major crawler bots from OpenAI, Google, and Anthropic do not request the file in any meaningful volume during their standard crawls.

This is not a reason to skip it. But it does mean llms.txt is not a shortcut to better Google AI Overview placement. Its primary value right now is with retrieval-augmented generation tools, AI agents, and models that actively fetch content to answer user queries, not models trained on static web snapshots.

How to create yours

The file format is straightforward. An H1 with your brand name, a blockquote with a one-paragraph description, and then H2 sections with labeled links. Many teams also publish a companion llms-full.txt file that contains the full text of key pages rather than just links, useful for models that need to pull content rather than navigate to it.

You can build yours in ten minutes with our free llms.txt generator. It outputs a properly formatted file based on your site’s structure and content priorities, ready to publish at your domain root.

The brands that get referenced in AI answers are the ones that make themselves easy to find, read, and cite. llms.txt is one of the few things you can do today that directly improves that.

---

Frequently asked questions

What is llms.txt and where does it go?

llms.txt is a Markdown file you host at the root of your domain, for example yoursite.com/llms.txt. It contains a short description of your site and links to your most important content, written in a format that AI models can read and navigate easily. It is different from robots.txt, which manages crawler permissions. llms.txt is a content guide, not an access control file.

Does llms.txt help with Google rankings or Google AI Overviews?

No. Google has confirmed it does not support llms.txt and does not use it when generating AI Overviews. The file is most relevant for retrieval-augmented generation tools, AI agents, and models that actively fetch content during query answering. If your goal is Google AI Overview placement, focus on content structure, schema markup, and authority signals instead.

What companies are using llms.txt right now?

Adoption is concentrated in tech: Anthropic, Stripe, Vercel, Cloudflare, Cursor, Supabase, and Mintlify all have llms.txt files in place. Mainstream consumer brands have largely not adopted it yet. Over 784 live examples are indexed at llms-text.com if you want to see how other companies are structuring their files.

What is the difference between llms.txt and llms-full.txt?

llms.txt contains links and a summary, designed to help AI models navigate to your content. llms-full.txt contains the actual text of your key pages in a single flat file, useful for models or tools that need to pull the content directly rather than follow links. Publishing both covers more use cases. Start with llms.txt if you are doing this for the first time.

How long does it take to create a llms.txt file?

For most sites, about ten to fifteen minutes. The format is simple: a title, a short description, and organized links to your most important pages. Our free llms.txt generator at Viewership handles the formatting automatically, so you fill in your site’s details and it outputs a ready-to-publish file.