RQVSeeker
Val Town is a collaborative website to build and scale JavaScript apps.
Deploy APIs, crons, & store data ā all from the browser, and deployed in milliseconds.
A webapp that crawls URLs from a sitemap looking for specific strings on pages.
- Input main sitemap URL (e.g., https://example.com/sitemap.xml)
- Automatically finds and crawls "posts" sitemap if available
- Falls back to main sitemap if no posts sitemap found
- Searches for "extendedrecipe" string on each page
- Crawls up to 50 URLs from the posts sitemap
- Shows real-time progress and posts sitemap detection
- Reports first match found or summary of all crawled pages
backend/
- Hono API serverfrontend/
- React frontendshared/
- Shared types and utilities
POST /api/crawl
- Start crawling a sitemapGET /
- Serve the frontend
- Enter a main sitemap URL (e.g., sitemap.xml or sitemap_index.xml)
- Click "Start Crawling"
- App will look for a posts sitemap within the main sitemap
- Watch real-time progress and posts sitemap detection
- Get results when complete
Get started with a template: