Public
Like
md_crawl
Val Town is a collaborative website to build and scale JavaScript apps.
Deploy APIs, crons, & store data – all from the browser, and deployed in milliseconds.
index.ts
https://stevekrouse--82c6c52009b211f0856d569c3dd06744.web.val.run
A website that crawls URLs recursively and outputs markdown content optimized for LLM consumption.
- Input a URL to crawl
- Set crawl depth (default: 3)
- Crawls only URLs on the same domain
- Outputs a markdown representation of all pages
- Includes a sitemap at the top for better context
- Copy button with success state
backend/- Server-side codeindex.ts- Main entry point with Hono APIcrawler.ts- Website crawling logic
frontend/- Client-side codeindex.html- Main HTML templateindex.tsx- Frontend React codecomponents/- React components