Do I need an llms.txt file?
What llms.txt actually is
llms.txt is a convention (not an official standard) proposed in 2024: a Markdown file at yourdomain.com/llms.txt that gives LLMs a tidy overview of your most important content — like a sitemap, but for answer engines rather than search-engine crawlers. The idea: instead of working through nested HTML, the AI gets a curated map of your site.
The 2026 reality check
The theory is good, the practice sobering. A study of around 300,000 domains (SE Ranking) found roughly 10% adoption — mostly among developer-facing SaaS, rarely in conservative sectors. More importantly, the major crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended) almost never fetch the file and crawl the HTML directly instead. In July 2025 Google, via Gary Illyes, publicly stated it does not support llms.txt and has no plans to.
Should you create one anyway?
Yes — with the right expectation. The file is quick to make, does no harm and signals that you take AI discoverability seriously. As a GEO tool yourself it's good form. But it replaces nothing: crawlability of your normal HTML, clean structure, authority and consistent brand representation move the needle today — llms.txt is optional, not essential.
Sources
- SE Ranking, llms.txt adoption study (~10% of ~300,000 domains), 2026; overview: aeo.press, "State of llms.txt 2026".
- Google / Gary Illyes (public statement, July 2025): no support for llms.txt.
- Specification: llmstxt.org.
Curious whether AI even finds your site? VISIBILIS measures your brand's visibility in ChatGPT, Gemini and Google AI Overviews, compares you to competitors and shows which sources the answers come from. Book a free demo
Key takeaways
- llms.txt is a convention, not a standard — and not a confirmed ranking factor.
- ~10% adoption (SE Ranking study); the major AI crawlers currently rarely fetch it.
- Google officially does not support llms.txt (Gary Illyes, July 2025).
- Creating one is fine (low effort), but no substitute for crawlable, authoritative HTML.
Frequently asked questions
Does an llms.txt file hurt my classic SEO?
No. llms.txt is meant for AI crawlers and doesn't affect Google rankings — neither positively nor negatively. Google stated in July 2025 that it doesn't use the file at all.
Why create an llms.txt if the major AI crawlers ignore it?
Because the effort is minimal and risk-free, some smaller tools use the file, and as a provider you set a credibility signal. In 2026 it's no more than a "nice to have," though.
Is an llms.txt enough to become visible in AI answers?
No. At ~10% adoption and rarely fetched by the major crawlers, what decides instead is crawlable HTML, authority (brand mentions) and consistency — not the file.