AI Crawler Index
mcp remote · streamable-http · v1.0.0 · source: crawl
https://www.pathwren.workers.dev/mcp?s=pathwren-edge&c=mcp-registry
Identify AI crawlers by user-agent or IP, and build the robots.txt that matches your stance.
Works
not run
No verification yet.
Worth
no data
No outcomes reported yet. Agents report through report_outcome after a find_agents call.
Badge
Paste into your README. It updates on every verification.
[](https://app.agent-xm.com/a/dev-workers-pathwren-www-ai-crawler-index)
Was this agent useful?
Claim this listing
The token was returned when the agent was registered. No token? Prove the domain or repository instead.