What agents read

Every machine-readable file this site serves, in one place. Click any of them. This is exactly what an agent sees when it visits.

curl timhey.co/.well-known/

GET /llms.txt: site map for models
GET /.well-known/ai-catalog.json: ARD capability catalog
GET /feed.xml: writing feed (RSS)
GET /robots.txt: crawl + AI-bot rules
GET /sitemap.xml: every URL, dated
GET /posts/the-third-system-doesnt-run-your-tag.md: markdown mirror, one per post

Every post ships two more an agent can use: the Markdown mirror above, and JSON-LD in the page head. View source on any post to read the typed facts an agent lifts instead of guessing.

New to this? Start with the files an agent checks before it reads your page.

Who’s crawling this, live

This site logs its own agent readers. Crawlers and agents don’t run JavaScript, so analytics never sees them — these counts come from the middleware, before the cache. It’s the argument these posts make, measuring itself.

11,558 agent visits from 22 distinct agents.

Not counted: 3,122 vulnerability scans — requests for .env files, PHP shells, and SSH keys this site has never served. Every public host gets them. They’re filtered out on purpose, because a number that counts scanners as readers isn’t measuring anything.

Also not counted: 3 requests from plain HTTP clients — curl, python-requests. Some of that is me testing this site with curl. It was landing in the agent column until I looked.

By agent

ByteDance3,537
Anthropic ClaudeBot2,165
unknown2,008
Meta910
OpenAI SearchBot637
Bingbot539
Googlebot500
Amazon449
OpenAI GPTBot270
OpenAI ChatGPT-User152
Applebot108
Common Crawl87
You.com76
Perplexity57
Anthropic Claude-User24
Diffbot9
Applebot-Extended7
Cohere7
DuckDuckGo6
Perplexity-User5
Anthropic4
Anthropic Claude-Web1

Most requested paths

/robots.txt2,566
/sitemap.xml1,180
/1,144
/agents790
/resume787
/posts/github-agent-traffic256
/feed.xml254
/llms.txt246

Volume

Sep 18last 14 daysOct 1

Recent hits

Anthropic ClaudeBot/agents10-01 00:59
unknown/posts/an-api-an-agent-can-call.md10-01 00:34
unknown/posts/an-api-an-agent-can-call.md10-01 00:24
Anthropic ClaudeBot/sitemap.xml10-01 00:20
Anthropic ClaudeBot/robots.txt10-01 00:20
unknown/posts/the-files-agents-look-for.md10-01 00:14
unknown/posts/get-your-mcp-server-found.md09-30 23:54
unknown/posts/who-reads-you-isnt-who-sends-you.md09-30 23:46
Amazon/posts/the-ask-the-model-eval09-30 23:36
unknown/posts/the-files-agents-look-for.md09-30 23:35
unknown/posts/analytics-cant-see-agents.md09-30 23:23
Anthropic ClaudeBot/posts/a-standard-is-not-adoption09-30 22:47

Still unidentified

User-agents that asked for a machine-readable file but don’t match anything I recognize. This is the honest version of “unknown” — the list I work from when I add a new agent to the classifier.

Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/320
Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (HTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+http211
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36155
Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler)122
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)39
Chrome Privacy Preserving Prefetch Proxy32
AteveSearchSourceUrlDiscovery/0.1 (+mailto:crawler@example.com)31
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.3630

Raw JSON: /api/agent-traffic