Scrape users from any GitHub repo, and automatically ingest into Clay. This val scrapes the username of anyone who has created an issue, reacted to an issues, commented on an issue, reacted to the comments, starred, or forked any repo.
-
Click
Remixon the top-right to get a copy of it -
Set up a Clay workbook with a
Webhookcolumn -
Copy your Clay workbook's
WebhookURL -
Set that as
CLAY_WEBHOOK_URLin this val'sEnvironment variableson the left sidebar -
In main.ts, replace
GITHUB_REPOwith the full repository name (format:"owner/repo") -
And that's it! The cron will run on your repo every 30 minutes from now on. To test it out immediately, navigate to main.ts and click
Run.
- clay.ts - Send data to Clay
- github.ts - Collects engaged users and fetches usernames
- main.ts - Cron trigger that orchestrates the scraping and Clay integration
On larger repos, you may get rate-limited by GitHub. To mitigate this, Val Town uses a proxied fetch that reroutes requests using a proxy vendor so that requests obtain different IP addresses. It also automatically retries failed requests several times.
