• Townie
    AI
  • Blog
  • Docs
  • Pricing
  • We’re hiring!
Log inSign up
diegoivo

diegoivo

todo-app-conversion

Public
Like
todo-app-conversion
Home
Code
4
backend
1
frontend
3
shared
1
README.md
Branches
1
Pull requests
Remixes
History
Environment variables
1
Val Town is a collaborative website to build and scale JavaScript apps.
Deploy APIs, crons, & store data – all from the browser, and deployed in milliseconds.
Sign up now
Code
/
Code
/
Search
index.ts
https://diegoivo--35d646663da411f09c2e76b3cceeab13.web.val.run
README.md

Web Crawler App

A web crawler application that allows users to crawl URLs and download CSV reports with the crawling results.

Project Structure

β”œβ”€β”€ backend/
β”‚   └── index.ts             # Main entry point with Hono
β”œβ”€β”€ frontend/
β”‚   β”œβ”€β”€ components/
β”‚   β”‚   β”œβ”€β”€ App.tsx          # Main React component
β”‚   β”‚   β”œβ”€β”€ CrawlerForm.tsx  # URL input form
β”‚   β”‚   β”œβ”€β”€ CrawlResults.tsx # Results display
β”‚   β”‚   └── DownloadButton.tsx # CSV download button
β”‚   β”œβ”€β”€ index.html           # Main HTML template
β”‚   └── index.tsx            # Frontend entry point
β”œβ”€β”€ shared/
β”‚   └── types.ts             # Shared types
└── README.md

Features

  • βœ… URL input form with validation
  • βœ… Web crawling with configurable depth
  • βœ… Real-time crawling progress
  • βœ… Results display with metadata
  • βœ… CSV report generation and download
  • βœ… Error handling and status reporting
  • βœ… Responsive design with TailwindCSS

Crawling Data Collected

  • URL
  • Title
  • Meta description
  • Status code
  • Response time
  • Content length
  • Links found
  • Images found
  • Crawl timestamp
  • Error messages (if any)

Technologies

  • Backend: Hono
  • Frontend: React 18.2.0
  • Styling: TailwindCSS
  • Storage: In-memory (session-based)

API Routes

  • / - Main application
  • /api/crawl - Start crawling process
  • /api/crawl/status/:id - Get crawling status
  • /api/crawl/results/:id - Get crawling results
  • /api/crawl/download/:id - Download CSV report
HTTP
  • index.ts
    diegoivo--35…13.web.val.run
Code
backendfrontendsharedREADME.md
FeaturesVersion controlCode intelligenceCLI
Use cases
TeamsAI agentsSlackGTM
DocsShowcaseTemplatesNewestTrendingAPI examplesNPM packages
PricingNewsletterBlogAboutCareers
We’re hiring!
Brandhi@val.townStatus
X (Twitter)
Discord community
GitHub discussions
YouTube channel
Bluesky
Terms of usePrivacy policyAbuse contact
Β© 2025 Val Town, Inc.