Signals Corps read the response headers of 217,097,223 pages, 10% of Common Crawl's September 2026 crawl, and found 7,959 sites sending a header written for an AI system. Of those, 7,271 sent pointers to resources such as llms.txt files…
In the News: October 15, 2026 (Midday)
A scan of 217 million web responses found sites already writing to AI agents through HTTP headers, and whether it reaches your model depends on your fetch tool.
Midday edition
Machine-readable
Download Markdown