Log in Sign up

ashryanio

index-now

Public

Val Town is a collaborative website to build and scale JavaScript apps.

Deploy APIs, crons, & store data – all from the browser, and deployed in milliseconds.

Sign up now

Code

/

README.md

…

Viewing readonly version of main branch: v15

View latest version

README.md

IndexNow Automation Val

This val automates IndexNow submission by:

Crawling sitemap URLs.
Tracking submission history in SQLite.
Submitting only changed URLs in batches (up to 10,000 URLs per POST).

Trigger Model

indexnow.cron.ts: scheduled automation trigger.
indexnow.http.ts: manual trigger for dry runs and debugging.

The recommended setup is a cron trigger every hour for sitemap polling, plus the HTTP trigger when you want immediate/manual control.

Environment Variables

INDEXNOW_ENDPOINT (optional): defaults to https://api.indexnow.org/indexnow.
INDEXNOW_MAX_URLS_PER_RUN (optional): defaults to 5000.

Site Config Files

Site configs live in config/sites/*.json with one site per file. At least one file must exist or the val will throw on startup.

Example: config/sites/hanayou.studio.json

{
  "host": "www.hanayou.studio",
  "sitemapUrl": "https://www.hanayou.studio/sitemap.xml",
  "keyLocation": "https://www.hanayou.studio/2dc12b205bfe46d19a75077e3991f7ce.txt",
  "key": "optional-explicit-key",
  "includePrefixes": ["/journal/", "/guides/"],
  "excludePrefixes": ["/tag/", "/author/"]
}

HTTP Usage

Dry run: ?dryRun=1
Force resubmit currently eligible URLs: ?force=1
Target a single configured site: ?site=www.hanayou.studio

Example:

https://<your-val>.web.val.run/?dryRun=1&site=www.hanayou.studio

History Tracking

SQLite tables:

indexnow_url_state_v1: per-URL state (seen/submitted timestamps, lastmod, status).
indexnow_run_log_v1: per-run summaries for observability and debugging.