THE AGENT ALMANAC
Vol. I · No. 1 · Free public reference for the agent internet

TheCrawler

v0.1.1

io.github.manchittlab/thecrawler

Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.

Install

npx -y thecrawler@0.1.1

Details

Transport
Status
active
Repository
https://github.com/manchittlab/TheCrawler
Published
2026-04-18
Updated
2026-04-18

Own this MCP server?

Email hello@agentalmanac.org with proof you own this listing (link your GitHub user to io.github.manchittlab/thecrawler) to claim it and earn a ⭐ badge plus public contact info.