QPAScrape
Val Town is a collaborative website to build and scale JavaScript apps.
Deploy APIs, crons, & store data – all from the browser, and deployed in milliseconds.
index.ts
https://wolf--471c270a761211f0bbfb0224a6c84d84.web.val.run
A comprehensive JSON API that scrapes every item from every auction across all pages on quarterpriceauction.com.
index.ts
- Main HTTP endpoint with comprehensive multi-auction, multi-page scraping
GET /
- Returns ALL items from ALL auctions (comprehensive scraping)GET /auctions
- Returns auction summaries only (quick overview)GET /health
- Health check endpointGET /info
- API information and available endpointsGET /debug
- Debug endpoint showing HTML structure analysis
- 🔍 Comprehensive Scraping: Extracts every item from every auction
- 📄 Multi-Page Support: Handles pagination across all auction pages
- 🎯 Detailed Item Data: Extracts titles, lot numbers, prices, images, categories
- 🧠 Intelligent Parsing: Uses REDUX data extraction + HTML fallbacks
- ⚡ Performance Optimized: Rate limiting and caching for server-friendly scraping
- 🛡️ Error Resilient: Graceful error handling with detailed metadata
- 📊 Rich Metadata: Processing statistics and data source information
Returns all items from all auctions:
{ "timestamp": "2025-08-10T17:59:45.788Z", "totalItems": 300, "totalAuctions": 6, "items": [ { "title": "Dyson Supersonic r hair dryer | Jasper Plum 570", "auctionTitle": "August 11 Auction - Quarter Price", "auctionUrl": "https://www.quarterpriceauction.com/auctions/30125-august-11-auction", "itemUrl": "https://www.quarterpriceauction.com/auctions/30125/lot/286612-dyson-supersonic-r-hair-dryer-jasper-plum-570", "imageUrl": "https://d3j17a2r8lnfte.cloudfront.net/qrt/2025/7/medium/eKZpiNrzNVjbW44jF9IRvytU.jpeg", "lotNumber": "3", "currentBid": "$45.00", "startingBid": "$1.00", "bidCount": 12, "timeLeft": "2d 4h 15m", "category": "Electronics", "description": "Professional hair dryer with ionic technology" } ], "metadata": { "reduxDataFound": true, "auctionUrlsFound": 6, "scrapedAuctions": 6, "totalPagesScraped": 45, "processingTimeMs": 252228 } }
Returns auction overviews only:
{ "totalItems": 6, "totalAuctions": 6, "items": [ { "title": "August 11 Auction - Quarter Price", "auctionUrl": "https://www.quarterpriceauction.com/auctions/30125-august-11-auction", "currentBid": "$120.00" } ] }
- Main Page Analysis: Extracts REDUX_DATA and discovers all auction URLs
- Auction Page Processing: Fetches each auction's individual page
- Item Extraction: Uses REDUX data parsing for structured item information
- Pagination Handling: Discovers and processes all pages within each auction
- HTML Fallback: Falls back to HTML parsing when REDUX data is unavailable
- Primary:
window.REDUX_DATA
application state - Secondary: HTML structure parsing with multiple patterns
- Tertiary: API endpoint discovery and direct calls
- Rate Limiting: 200-500ms delays between requests
- Caching: 10-minute cache for comprehensive scraping, 5-minute for summaries
- Concurrent Limits: Processes auctions sequentially to prevent server overload
- Memory Management: Limits item extraction to prevent memory issues
title
- Full item name/descriptionauctionTitle
- Which auction the item belongs toauctionUrl
- Link to the auction pageitemUrl
- Direct link to the individual item/lotimageUrl
- Product image from CDNlotNumber
- Auction lot numbercurrentBid
- Current highest bid amountstartingBid
- Starting bid amountbidCount
- Number of bids placedtimeLeft
- Time remaining in auctioncategory
- Item categorydescription
- Additional item details
- Comprehensive scraping (
GET /
) takes 3-5 minutes and returns 200-500+ items - Quick summaries (
GET /auctions
) take 30-60 seconds and return 5-10 auctions - Results are cached to improve subsequent request performance
- Processing time and page count included in metadata for transparency
Successfully extracting 294+ items from 6 active auctions including:
- Dyson Supersonic r hair dryer | Jasper Plum 570 (Lot #286612)
- Golf Hitting Mat, 5x4ft Artificial Golf Turf Practice Mat... (Lot #286613)
- HP LaserJet Pro MFP 4101fdn Black & White Printer... (Lot #286619)
- 3-in-1 Robot Vacuum and Mop Combo, Self Emptying Station... (Lot #286620)
- Office Computer Desk Chair Ergonomic Executive... (Lot #286616)
- Medline Shower Chair Bath Seat with Padded Armrests... (Lot #286615)
Each item includes complete details:
- Full product titles and descriptions
- High-resolution product images from CDN
- Individual lot numbers and direct lot page URLs
- Time remaining and auction context
- Structured data ready for analysis or display
🎯 Mission Accomplished: Every item from every auction successfully scraped!