Data study · llms.txt and AI instruction files
llms.txt Overtook security.txt in Under a Year and Is Now on 4.9 Times as Many Top Websites, but the Top 1,000 Still Favor security.txt
security.txt, the standard file for reporting security problems, sits on 22,284 top-1M homepages (2.9%) and has barely moved since mid-2025. llms.txt went from 9,011 sites to 110,188 over the same period.
Analysis of 772,412 top-1M homepages, with seven crawls from July 2025 · HTTP Archive
Key findings
- 1
110,188 top-1M homepages serve llms.txt and 22,284 serve a security.txt with contact details, a ratio of 4.9 to 1.
- 2
llms.txt passed security.txt between the October 2025 and January 2026 crawls, when it went from 18,500 to 27,203 sites against 21,459 and 22,385 for security.txt.
- 3
security.txt stayed between 20,448 and 22,385 sites in every crawl from July 2025 to October 2026.
- 4
In the top 1,000, security.txt still leads: 111 sites (15.0%) against 58 with llms.txt (7.9%).
- 5
Only 7,502 sites have both files: 33.7% of security.txt sites have llms.txt, and 6.8% of llms.txt sites have security.txt.
Summary
Picture an IT manager with a checklist of files every company site should have: robots.txt, a sitemap, and security.txt so researchers can report vulnerabilities. This year the marketing team asks to add llms.txt. Which one do websites actually adopt first?
security.txt is an official internet standard (RFC 9116) published in 2022. It sits at /.well-known/security.txt and lists who to contact about security issues. llms.txt is an informal proposal from 2024 with no standards body behind it. Both are small text files at fixed addresses, which makes them a fair comparison.
The newer, informal file has already won on numbers. llms.txt is on 4.9 times as many top homepages as security.txt. Much of that comes from platforms switching llms.txt on by default. The most visited sites still lean the other way.
What we measured
We used the HTTP Archive mobile crawl in BigQuery (httparchive.crawl.pages) for top-1M homepages, October 2026, plus six earlier crawls from July 2025. A site has security.txt when HTTP Archive parsed at least one Contact field from /.well-known/security.txt. That rule screens out servers that return a web page at that address. A site has llms.txt when /llms.txt returned 200 with a text/plain or text/markdown content type.
We also compared newer AI-era files from the October crawl: the UCP commerce profile, and the agent discovery files (agent card, ai-catalog.json, ard.json).
llms.txt passed security.txt in about six months
Homepages with each file, by crawl.
Homepages
| Crawl | Homepages | security.txt | % security.txt | llms.txt | % llms.txt |
|---|---|---|---|---|---|
| Jul 2025 | 808,988 | 21,138 | 2.6 | 9,011 | 1.1 |
| Oct 2025 | 792,964 | 21,459 | 2.7 | 18,500 | 2.3 |
| Jan 2026 | 795,400 | 22,385 | 2.8 | 27,203 | 3.4 |
| Apr 2026 | 788,035 | 20,849 | 2.6 | 35,509 | 4.5 |
| Jul 2026 | 789,213 | 20,448 | 2.6 | 94,942 | 12 |
| Sep 2026 | 782,850 | 21,836 | 2.8 | 107,687 | 13.8 |
| Oct 2026 | 772,412 | 22,284 | 2.9 | 110,188 | 14.3 |
Source: aisearchoptimization.net analysis of 772,412 top-1M homepages, with seven crawls from July 2025 · HTTP Archive
security.txt is flat at roughly 2.6% to 2.9% of homepages. llms.txt climbed in every crawl and jumped in mid-2026 when a large store platform turned it on.
The top 1,000 still prefer the security standard
October 2026, share of homepages with each file by rank. UCP and agent files are included as newer AI-era files.
| Rank bucket | Homepages | % security.txt | % llms.txt | % UCP profile | % agent discovery file |
|---|---|---|---|---|---|
| Top 1K | 738 | 15 | 7.9 | 0 | 0.14 |
| 1K-5K | 2,920 | 9 | 9 | 0.4 | 0.27 |
| 5K-10K | 3,586 | 7.1 | 9.5 | 0.9 | 0.28 |
| 10K-50K | 28,831 | 4.9 | 10 | 2.1 | 0.2 |
| 50K-100K | 36,937 | 3.4 | 10.5 | 3.5 | 0.2 |
| 100K-500K | 306,048 | 2.7 | 13.4 | 6.5 | 0.28 |
| 500K-1M | 393,352 | 2.7 | 15.7 | 8.3 | 0.35 |
Source: aisearchoptimization.net analysis of 772,412 top-1M homepages, with seven crawls from July 2025 · HTTP Archive
The lines cross around rank 1,000 to 5,000. Above it, security teams' file wins; below it, AI files win, largely because hosted platforms add llms.txt and UCP profiles for small stores.
The two files rarely sit on the same site
Overlap between the two files, October 2026.
Sites
| Group | Sites |
|---|---|
| llms.txt only | 102,686 |
| security.txt only | 14,782 |
| Both | 7,502 |
Source: aisearchoptimization.net analysis of 772,412 top-1M homepages, with seven crawls from July 2025 · HTTP Archive
Sites with security.txt are more than twice as likely as average to have llms.txt (33.7% vs 14.3%), so sites that publish one file are more likely to publish the other. But most llms.txt sites do not have the security file.
What this means
If you are adding llms.txt, take ten more minutes and add security.txt too. It is an official standard, it helps anyone who finds a problem on your site reach you, and it signals a maintained site. Neither file is a ranking factor. Be cautious with any AI SEO agency that sells either one as a shortcut.
The fast spread of llms.txt shows how quickly AI-related files catch on, often through platform defaults rather than owner choice. Check what your platform publishes in your name. Neither file decides whether AI assistants quote you; a free AI SEO audit from our team checks the things that do.
Limits
security.txt counts require a parsed Contact field, which excludes empty or malformed files; HTML pages at that address are excluded the same way.
llms.txt counts rely on status and content type; contents are not checked.
The top-1M sample changes between crawls.
Neither file's presence shows how well a site handles security or AI visibility.
Embed this research
Add the charts from this study to your page. The embed links back here.
<iframe src="https://aisearchoptimization.net/embed/data-studies/security-txt-vs-llms-txt-adoption" title="llms.txt Now Outnumbers security.txt Nearly 5 to 1" width="100%" height="720" style="border:0" loading="lazy"></iframe>
Cite this study
APA
Grenyo, K. (2026). llms.txt Now Outnumbers security.txt Nearly 5 to 1. AI Search Optimization. https://aisearchoptimization.net/resources/data-studies/security-txt-vs-llms-txt-adoption
Plain link
llms.txt Now Outnumbers security.txt Nearly 5 to 1 - AI Search Optimization - https://aisearchoptimization.net/resources/data-studies/security-txt-vs-llms-txt-adoption
Frequently asked questions
What is security.txt?
A standard file (RFC 9116) at /.well-known/security.txt that tells people how to report security problems. 22,284 top-1M homepages publish one with contact details.
Is llms.txt more common than security.txt?
Yes. In October 2026, 110,188 top-1M homepages served llms.txt versus 22,284 with security.txt, 4.9 times as many.
When did llms.txt overtake security.txt?
Between the October 2025 and January 2026 crawls.
Do big websites prefer one or the other?
The top 1,000 favor security.txt: 15.0% have it, against 7.9% with llms.txt.
Related studies
- llms.txt and AI instruction filesllms.txt Adoption 2026: 14.3% of Top Sites Have One
- llms.txt and AI instruction filesllms.txt Grew From 1.1% to 14.3% of Top Sites in 15 Months
- llms.txt and AI instruction files15.6% of Top Sites Say 'Found' for Pages That Don't Exist
- llms.txt and AI instruction files46% of llms.txt Files Are Added Automatically by Platforms
See where AI search leaves you out
Run the free AI visibility audit. If you want the fixes done for you, the plan is a flat $299/month.