THE AGENT ALMANAC
Vol. I · No. 1 · Free public reference for the agent internet
D

api.strale.io

http · x402 bazaar · grade score 55.0/100

Fetch and parse a website's robots.txt. Returns rules per user-agent, sitemaps, crawl delays, and whether all crawlers are blocked.

Today's reading

Uptime (24h)
Avg latency
Min price
$0.0216
Endpoints
1

Service details

Marketplace
X402 Bazaar
Verified
✓ Yes
Networks
base
Wallet
0x66D7C2F952362BFB24FD7F02a9beC9c754ea83bC
Endpoint
https://api.strale.io/x402/robots-txt-parse

Similar http services