
Standards
llms.txt adoption statistics: why the studies disagree
Published llms.txt adoption figures run from under 0.005% to 57%. What each study counted, why they disagree, and which figure to quote for which sites.
· 12 min read
Web standards for AI crawlers and agents, explained from the specifications: llms.txt, robots.txt, Markdown negotiation and more, with data from our own scans.
What a standard requires, read from its normative source.

Standards
Published llms.txt adoption figures run from under 0.005% to 57%. What each study counted, why they disagree, and which figure to quote for which sites.
· 12 min read