Readings of the public files one tracked domain serves about crawler and agent access (GET /v1/access-policy/{domain}): robots.txt groups for named AI-agent user-agents and the * group, Content-Signal values, llms.txt presence and title, /.well-known JSON files (parsed only when served as JSON), se…