A file format conceived to help artificial intelligence navigate the web has arrived, largely, to an empty room. Ahrefs examined server logs across 137,000 domains and found that 97 percent of llms.txt files drew no visitors at all — not from AI systems, not from humans. The data quietly reframes a broader assumption: that building infrastructure for AI attention will summon it. What it has summoned instead are auditors, scanners, and coding agents — a reminder that the gap between a standard's intention and its adoption is often wider than its architects imagine.
Search Engine Journal
· Jun 16, 2026
· technology
· 2 min de leitura
High
Apuração: Verificado
97% of llms.txt Files Receive Zero Traffic, Ahrefs Analysis Reveals
◉
Technology
8572 artigos relacionados
Google Pixel 11 Pro Fold launches with Tensor G6, Gemini AI, and new O…
Business Today · 100% correspondência
Honor's Robot Phone and Google Pixel 11 Lead Week's Tech Innovation Ra…
Google News · 99% correspondência
Tech Giants Embrace Nuclear Power to Meet Surging AI Energy Demands
CNBC · 99% correspondência
AI's Power Hunger Derails Big Tech's Climate Pledges
Fortune · 99% correspondência
Google to Retire Assistant on Phones, Watches by September 2026
Bangkok Post · 99% correspondência
Cobertura Relacionada
CBS News · Aug 21
Meta Smart Glasses Fuel Privacy Crisis as Covert Filming Trend Spreads
A woman was secretly filmed by someone wearing Meta's AI smart glasses in a viral prank video, raising concerns about we…
CBS News · Aug 21 Consumer groups urge FTC probe into AI firms' 'hoard-and-destroy' book practicesConsumer advocacy groups urge the FTC to investigate AI developers for allegedly buying, scanning, and destroying millio…
BBC News · Aug 21 Ofcom investigates Sky News over Farage family privacy claimsOfcom has launched an investigation into Sky News following harassment complaints by Reform UK leader Nigel Farage, who …
Pocket-lint · Aug 21 Amazon's Fire OS 16 Update Bypasses Fire Sticks EntirelyAmazon's new Fire OS 16 update will only launch on smart TVs, not Fire Sticks, as the company transitions all future sti…
Viés e Enquadramento
⚖
Data-driven analysis presenting empirical findings about llms.txt adoption with minimal editorializing, though framing emphasizes low adoption rates and questions the file format's utility.
Bias Direction
center
Confidence
MED
Empirical skepticism: The article frames llms.txt as a solution in search of a problem by emphasizing zero-traffic statistics and noting that scanning/auditing tools outnumber actual AI users. The headline and structure highlight failure metrics rather than potential or emerging adoption.
got zero requests, No bots, no humans
An ecosystem has developed around scoring and cataloging a file format before a significant audience appears
The industry studying itself
No AI Bot Looks For Files That Don't Exist
Perspective from llms.txt advocates defending the format's early-stage status
Voices from companies actively using llms.txt for legitimate AI governance
Analysis of whether 97% zero-traffic metric is expected for emerging web standards
Discussion of whether Ahrefs' technical-skewed customer base affects representativeness
Impacto Geopolítico
🌎
llms.txt adoption remains negligible with 97% receiving zero traffic; primarily used by coding agents rather than AI systems, indicating premature standardization of an unused web format.
Escalation Risk
low
Confidence
HIGH
Global web ecosystem
United States (primary tech sector)
European Union (AI regulation context)
Reveals fragmentation in AI bot governance: major AI companies (OpenAI, Anthropic, Perplexity) have minimal adoption of llms.txt despite industry advocacy. SEO tools and audit platforms dominate usage, suggesting traditional web infrastructure players retain control over web crawling standards rather than AI companies establishing new norms.
Similar to robots.txt adoption curve in 1990s—standards precede widespread implementation. However, unlike robots.txt which solved immediate problems, llms.txt addresses a non-existent use case, risking becoming technical debt.
Lente Econômica
📈
97% of llms.txt files receive zero traffic, suggesting the AI-focused file format has minimal adoption and utility despite industry hype, with most requests from non-AI bots and scanning tools rather than actual AI systems.
Market Signal
bearish
Confidence
HIGH
Software/SaaS
AI/Machine Learning
Digital Marketing/SEO
Web Development Tools
Enterprise Software
Minimal direct consumer impact currently. Consumers may see continued AI search fragmentation and inconsistent AI bot access to web content, potentially affecting search quality and AI assistant capabilities. No immediate pricing or service changes expected.
The data suggests premature standardization efforts around llms.txt may be unnecessary. Policymakers should monitor whether AI companies adopt standardized protocols organically before mandating compliance. This could inform future AI transparency and web access regulations.