AGENTS.md

Scan of the MCP registry's remote servers for OAuth / DCR / CIMD support. 3-stage pipeline, state in project blob storage (no SQLite).

File map

FileTypePurpose
collect.tsscriptPage the MCP registry (/v0/servers), save remote URLs + names to registry-state blob. Resumable cursor; run repeatedly until done: true.
collect_http.tshttpProbe URL chunks for OAuth support (MCP initialize POST → 401/www-auth → PRM → AS metadata → dcr/cimd flags). ?offset=&n=&conc= probes into probe/*.json; ?mode=hosts builds recheck-list.json; ?mode=recheck probes that list into recheck/*.json.
dump.tshttpMerge probe/recheck chunks + join registry names into one JSON array. `?set=probe
README.mddocFull pipeline docs, blob keys, result schema.

Notes

  • Blob keys: registry-state, probe/<6-digit-offset>.json, recheck-list.json, recheck/<6-digit-offset>.json.
  • The HTTP endpoints exist so probes can be driven in resumable chunks with query params (scripts can't take params and the full probe doesn't fit in one run). They return JSON by design — don't convert to HTML pages; add a separate HTML view if a human-friendly UI is wanted.
  • probe(url) in collect_http.ts is exported and reusable for one-off checks.
  • This val feeds registry-scan-data.ts in stevekrouse/oauth-demos (consumer of the ?set=probe dump). Keep it separate from oauth-demos — offline batch scraper vs live public app.