Log inSign up
lloydpearsoniv
lloydpearsonivscraper_template
Remix of gwoods22/scraper_template
Public
Like
scraper_template
Val Town is a collaborative website to build and scale JavaScript apps.
Deploy APIs, crons, & store data – all from the browser, and deployed in miliseconds.
Sign up now
Code
/
Search
README.md

Website Scraper Template

A basic website scraper template that can be ran on an interval to check for changes. It uses blob storage to save whatever data you'd like to compare the website to.

Uses my sendNotification val to alert yourself of the change.

Steps to use

  1. Add the scrapeURL you would like to scrape and pick a name for your blob storage blobKey.

  2. Change the "selector" value to fit your needs. cheerio is used to find the part of the page you'd like to check.

  3. Adjust the if statement to detect changes and update your blob

  4. Craft a message to be sent with sendNotification() function

Code