A web crawler application that allows users to crawl URLs and download CSV reports with the crawling results.

├── backend/
│   └── index.ts             # Main entry point with Hono
├── frontend/
│   ├── components/
│   │   ├── App.tsx          # Main React component
│   │   ├── CrawlerForm.tsx  # URL input form
│   │   ├── CrawlResults.tsx # Results display
│   │   └── DownloadButton.tsx # CSV download button
│   ├── index.html           # Main HTML template
│   └── index.tsx            # Frontend entry point
├── shared/
│   └── types.ts             # Shared types
└── README.md

• ✅ URL input form with validation
• ✅ Web crawling with configurable depth
• ✅ Real-time crawling progress
• ✅ Results display with metadata
• ✅ CSV report generation and download
• ✅ Error handling and status reporting
• ✅ Responsive design with TailwindCSS

• URL
• Title
• Meta description
• Status code
• Response time
• Content length
• Links found
• Images found
• Crawl timestamp
• Error messages (if any)

• Backend: Hono
• Frontend: React 18.2.0
• Styling: TailwindCSS
• Storage: In-memory (session-based)

• / - Main application
• /api/crawl - Start crawling process
• /api/crawl/status/:id - Get crawling status
• /api/crawl/results/:id - Get crawling results
• /api/crawl/download/:id - Download CSV report