• Blog
  • Docs
  • Pricing
  • We’re hiring!
Log inSign up
dangermouse5

dangermouse5

RQVSeeker

Public
Like
RQVSeeker
Home
Code
4
backend
2
frontend
4
shared
2
README.md
Branches
1
Pull requests
Remixes
History
Environment variables
Val Town is a collaborative website to build and scale JavaScript apps.
Deploy APIs, crons, & store data – all from the browser, and deployed in milliseconds.
Sign up now
Code
/
/
x
/
dangermouse5
/
RQVSeeker
Code
/
/
x
/
dangermouse5
/
RQVSeeker
Search
index.ts
https://dangermouse5--a00a71430403483e802104ff26eef42a.web.val.run
README.md

Sitemap Crawler

A webapp that crawls URLs from a sitemap looking for specific strings on pages.

Features

  • Input main sitemap URL (e.g., https://example.com/sitemap.xml)
  • Automatically finds and crawls "posts" sitemap if available
  • Falls back to main sitemap if no posts sitemap found
  • Searches for "extendedrecipe" string on each page
  • Crawls up to 50 URLs from the posts sitemap
  • Shows real-time progress and posts sitemap detection
  • Reports first match found or summary of all crawled pages

Structure

  • backend/ - Hono API server
  • frontend/ - React frontend
  • shared/ - Shared types and utilities

API Endpoints

  • POST /api/crawl - Start crawling a sitemap
  • GET / - Serve the frontend

Usage

  1. Enter a main sitemap URL (e.g., sitemap.xml or sitemap_index.xml)
  2. Click "Start Crawling"
  3. App will look for a posts sitemap within the main sitemap
  4. Watch real-time progress and posts sitemap detection
  5. Get results when complete
Code
backendfrontendsharedREADME.md
FeaturesVersion controlCode intelligenceCLIMCP
Use cases
TeamsAI agentsSlackGTM
DocsShowcaseTemplatesNewestTrendingAPI examplesNPM packages
PricingNewsletterBlogAboutCareers
We’re hiring!
Brandhi@val.townStatus
X (Twitter)
Discord community
GitHub discussions
YouTube channel
Bluesky
Open Source Pledge
Terms of usePrivacy policyAbuse contact
© 2025 Val Town, Inc.