Scrape users from any GitHub repo, and automatically ingest into Clay. This val scrapes the username of anyone who has created an issue, reacted to an issues, commented on an issue, reacted to the comments, starred, or forked any repo.
-
Click
Remix
on the top-right to get a copy of it -
Set up a Clay workbook with a
Webhook
column -
Copy your Clay workbook's
Webhook
URL -
Set that as
CLAY_WEBHOOK_URL
in this val'sEnvironment variables
on the left sidebar -
In main.ts, replace
GITHUB_REPO
with the full repository name (format:"owner/repo"
) -
(Optional) Update the limits for
ISSUE_LIMIT
,MAX_STARGAZERS
,MAX_FORKS
,MAX_COMMENTS_PER_ISSUE
, andFETCH_REACTIONS
-
Navigate to main.ts and click "Run".
- clay.ts - Send data to Clay
- github.ts - Collects engaged users and fetches usernames
- main.ts - Cron trigger that orchestrates the scraping and Clay integration
On larger repos, you may get rate-limited by GitHub. To mitigate this, Val Town uses a proxied fetch that reroutes requests using a proxy vendor so that requests obtain different IP addresses. It also automatically retries failed requests several times.