Hi

\",\n});\n```\n\n## Val Town Utility Functions\n\nVal Town provides several utility functions to help with common project tasks.\n\n### Importing Utilities\n\nAlways import utilities with version pins to avoid breaking changes:\n\n```ts\nimport {\n parseProject,\n readFile,\n serveFile,\n} from \"https://esm.town/v/std/utils@85-main/index.ts\";\n```\n\n### Available Utilities\n\n#### **serveFile** - Serve project files with proper content types\n\nFor example, in Hono:\n\n```ts\n// serve all files in frontend/ and shared/\napp.get(\"/frontend/*\", (c) => serveFile(c.req.path, import.meta.url));\napp.get(\"/shared/*\", (c) => serveFile(c.req.path, import.meta.url));\n```\n\n#### **readFile** - Read files from within the project:\n\n```ts\n// Read a file from the project\nconst fileContent = await readFile(\"/frontend/index.html\", import.meta.url);\n```\n\n#### **listFiles** - List all files in the project\n\n```ts\nconst files = await listFiles(import.meta.url);\n```\n\n#### **parseProject** - Extract information about the current project from import.meta.url\n\nThis is useful for including info for linking back to a val, ie in \"view source\"\nurls:\n\n```ts\nconst projectVal = parseProject(import.meta.url);\nconsole.log(projectVal.username); // Owner of the project\nconsole.log(projectVal.name); // Project name\nconsole.log(projectVal.version); // Version number\nconsole.log(projectVal.branch); // Branch name\nconsole.log(projectVal.links.self.project); // URL to the project page\n```\n\nHowever, it's _extremely importing_ to note that `parseProject` and other\nStandard Library utilities ONLY RUN ON THE SERVER. If you need access to this\ndata on the client, run it in the server and pass it to the client by splicing\nit into the HTML page or by making an API request for it.\n\n## Val Town Platform Specifics\n\n- **Redirects:** Use\n `return new Response(null, { status: 302, headers: { Location: \"/place/to/redirect\" }})`\n instead of `Response.redirect` which is broken\n- **Images:** Avoid external images or base64 images. Use emojis, unicode\n symbols, or icon fonts/libraries instead\n- **AI Image:** To inline generate an AI image use:\n `

`\n- **Storage:** DO NOT use the Deno KV module for storage\n- **Browser APIs:** DO NOT use the `alert()`, `prompt()`, or `confirm()` methods\n- **Weather Data:** Use open-meteo for weather data (doesn't require API keys)\n unless otherwise specified\n- **View Source:** Add a view source link by importing & using\n `import.meta.url.replace(\"ems.sh\", \"val.town)\"` (or passing this data to the\n client) and include `target=\"_top\"` attribute\n- **Error Debugging:** Add\n `` to HTML to capture\n client-side errors\n- **Error Handling:** Only use try...catch when there's a clear local\n resolution; Avoid catches that merely log or return 500s. Let errors bubble up\n with full context\n- **Environment Variables:** Use `Deno.env.get('keyname')` when you need to, but\n generally prefer APIs that don't require keys\n- **Imports:** Use `https://esm.sh` for npm and Deno dependencies to ensure\n compatibility on server and browser\n- **Storage Strategy:** Only use backend storage if explicitly required; prefer\n simple static client-side sites\n- **React Configuration:** When using React libraries, pin versions with\n `?deps=react@18.2.0,react-dom@18.2.0` and start the file with\n `/** @jsxImportSource https://esm.sh/react@18.2.0 */`\n- Ensure all React dependencies and sub-dependencies are pinned to the same\n version\n- **Styling:** Default to using TailwindCSS via\n `` unless otherwise\n specified\n\n## Project Structure and Design Patterns\n\n### Recommended Directory Structure\n\n```\n├── backend/\n│ ├── database/\n│ │ ├── migrations.ts # Schema definitions\n│ │ ├── queries.ts # DB query functions\n│ │ └── README.md\n│ └── routes/ # Route modules\n│ ├── [route].ts\n│ └── static.ts # Static file serving\n│ ├── index.ts # Main entry point\n│ └── README.md\n├── frontend/\n│ ├── components/\n│ │ ├── App.tsx\n│ │ └── [Component].tsx\n│ ├── favicon.svg\n│ ├── index.html # Main HTML template\n│ ├── index.tsx # Frontend JS entry point\n│ ├── README.md\n│ └── style.css\n├── README.md\n└── shared/\n ├── README.md\n └── utils.ts # Shared types and functions\n```\n\n### Backend (Hono) Best Practices\n\n- Hono is the recommended API framework\n- Main entry point should be `backend/index.ts`\n- **Static asset serving:** Use the utility functions to read and serve project\n files:\n ```ts\n import {\n readFile,\n serveFile,\n } from \"https://esm.town/v/std/utils@85-main/index.ts\";\n\n // serve all files in frontend/ and shared/\n app.get(\"/frontend/*\", (c) => serveFile(c.req.path, import.meta.url));\n app.get(\"/shared/*\", (c) => serveFile(c.req.path, import.meta.url));\n\n // For index.html, often you'll want to bootstrap with initial data\n app.get(\"/\", async (c) => {\n let html = await readFile(\"/frontend/index.html\", import.meta.url);\n\n // Inject data to avoid extra round-trips\n const initialData = await fetchInitialData();\n const dataScript = ``;\n\n html = html.replace(\"\", `${dataScript}`);\n return c.html(html);\n });\n ```\n- Create RESTful API routes for CRUD operations\n- Always include this snippet at the top-level Hono app to re-throwing errors to\n see full stack traces:\n ```ts\n // Unwrap Hono errors to see original error details\n app.onError((err, c) => {\n throw err;\n });\n ```\n\n### Database Patterns\n\n- Run migrations on startup or comment out for performance\n- Change table names when modifying schemas rather than altering\n- Export clear query functions with proper TypeScript typing\n\n## Common Gotchas and Solutions\n\n1. **Environment Limitations:**\n - Val Town runs on Deno in a serverless context, not Node.js\n - Code in `shared/` must work in both frontend and backend environments\n - Cannot use `Deno` keyword in shared code\n - Use `https://esm.sh` for imports that work in both environments\n\n2. **SQLite Peculiarities:**\n - Limited support for ALTER TABLE operations\n - Create new tables with updated schemas and copy data when needed\n - Always run table creation before querying\n\n3. **React Configuration:**\n - All React dependencies must be pinned to 18.2.0\n - Always include `@jsxImportSource https://esm.sh/react@18.2.0` at the top of\n React files\n - Rendering issues often come from mismatched React versions\n\n4. **File Handling:**\n - Val Town only supports text files, not binary\n - Use the provided utilities to read files across branches and forks\n - For files in the project, use `readFile` helpers\n\n5. **API Design:**\n - `fetch` handler is the entry point for HTTP vals\n - Run the Hono app with\n `export default app.fetch // This is the entry point for HTTP vals`\n",[162],"1f117c60-0a91-11f1-ac04-42dde27851f2",".vtignore","1f117d14-0a91-11f1-ac04-42dde27851f2",21,["D",1771175383282],".git\n.vscode\n.cursorrules\n.DS_Store\nnode_modules\nvendor\n",[170],"1f078c78-0a91-11f1-ac04-42dde27851f2",".gitignore","1f078d4a-0a91-11f1-ac04-42dde27851f2",19,["D",1771175383227],".DS_Store\n.vscode/\n.cursorrules\nnode_modules/\n.deno/\ndeno.lock\n.env\n.env.local\n.vt/\nvendor/\n*.log\n*.db\n*.sqlite\ncoverage/\ndist/\nbuild/\n.local/\n",[177],"1df465fe-0a91-11f1-ac04-42dde27851f2","shared","1df466e4-0a91-11f1-ac04-42dde27851f2",["D",1771175381422],[184],"d139cb94-1cb7-11f1-8f90-42dde27851f2",["D",1773171123991],[27],"1e3f9592-0a91-11f1-a289-42dde27851f2","cron","1e3f9650-0a91-11f1-a289-42dde27851f2",4,["D",1771175381915],[192],"1dd5afa6-0a91-11f1-a289-42dde27851f2","backend","1dd5b05a-0a91-11f1-a289-42dde27851f2",["D",1771175381220],[198],"pulls","branches","forks","envVars",{"_209":58,"_211":58},"connections",{"_209":58,"_210":58},"count","unfilledCount","emptyCount",{"_40":197,"_31":198,"_29":199,"_139":-5,"_38":39,"_37":166,"_141":119,"_35":413,"_13":58,"_32":33,"_34":-5,"_23":24,"_145":-5,"_241":414,"_26":415},{"_40":408,"_31":399,"_29":392,"_139":199,"_38":39,"_37":409,"_141":119,"_35":410,"_13":58,"_32":33,"_34":-5,"_23":24,"_145":-5,"_241":411,"_26":412},{"_40":400,"_31":401,"_29":402,"_139":392,"_38":39,"_37":403,"_141":119,"_35":404,"_13":166,"_32":264,"_34":405,"_23":24,"_145":-5,"_241":406,"_26":407},{"_40":389,"_31":390,"_29":391,"_139":392,"_38":39,"_37":393,"_141":119,"_35":394,"_13":395,"_32":264,"_34":396,"_23":24,"_145":-5,"_241":397,"_26":398},{"_40":385,"_31":375,"_29":369,"_139":199,"_38":39,"_37":311,"_141":119,"_35":386,"_13":58,"_32":33,"_34":-5,"_23":24,"_145":-5,"_241":387,"_26":388},{"_40":376,"_31":377,"_29":378,"_139":369,"_38":39,"_37":379,"_141":119,"_35":380,"_13":381,"_32":264,"_34":382,"_23":24,"_145":-5,"_241":383,"_26":384},{"_40":366,"_31":367,"_29":368,"_139":369,"_38":39,"_37":370,"_141":24,"_35":371,"_13":179,"_32":264,"_34":372,"_23":24,"_145":-5,"_241":373,"_26":374},{"_40":361,"_31":336,"_29":330,"_139":199,"_38":39,"_37":362,"_141":119,"_35":363,"_13":58,"_32":33,"_34":-5,"_23":24,"_145":-5,"_241":364,"_26":365},{"_40":353,"_31":354,"_29":355,"_139":330,"_38":39,"_37":356,"_141":119,"_35":357,"_13":58,"_32":264,"_34":358,"_23":24,"_145":-5,"_241":359,"_26":360},{"_40":345,"_31":346,"_29":347,"_139":330,"_38":39,"_37":348,"_141":119,"_35":349,"_13":311,"_32":264,"_34":350,"_23":24,"_145":-5,"_241":351,"_26":352},{"_40":337,"_31":338,"_29":339,"_139":330,"_38":39,"_37":340,"_141":119,"_35":341,"_13":143,"_32":264,"_34":342,"_23":24,"_145":-5,"_241":343,"_26":344},{"_40":327,"_31":328,"_29":329,"_139":330,"_38":39,"_37":331,"_141":119,"_35":332,"_13":194,"_32":264,"_34":333,"_23":24,"_145":-5,"_241":334,"_26":335},{"_40":319,"_31":320,"_29":124,"_139":199,"_38":39,"_37":321,"_141":24,"_35":322,"_13":58,"_32":323,"_34":324,"_23":24,"_145":42,"_241":325,"_26":326},{"_40":191,"_31":192,"_29":193,"_139":-5,"_38":39,"_37":194,"_141":119,"_35":316,"_13":58,"_32":33,"_34":-5,"_23":24,"_145":-5,"_241":317,"_26":318},{"_40":306,"_31":307,"_29":308,"_139":193,"_38":39,"_37":309,"_141":119,"_35":310,"_13":311,"_32":312,"_34":313,"_23":24,"_145":-5,"_241":314,"_26":315},{"_40":188,"_31":27,"_29":30,"_139":-5,"_38":39,"_37":14,"_141":119,"_35":303,"_13":58,"_32":33,"_34":-5,"_23":24,"_145":-5,"_241":304,"_26":305},{"_40":183,"_31":184,"_29":185,"_139":-5,"_38":39,"_37":143,"_141":119,"_35":300,"_13":58,"_32":33,"_34":-5,"_23":24,"_145":-5,"_241":301,"_26":302},{"_40":292,"_31":293,"_29":294,"_139":185,"_38":39,"_37":295,"_141":24,"_35":296,"_13":194,"_32":264,"_34":297,"_23":24,"_145":-5,"_241":298,"_26":299},{"_40":284,"_31":285,"_29":286,"_139":185,"_38":39,"_37":287,"_141":119,"_35":288,"_13":166,"_32":264,"_34":289,"_23":24,"_145":-5,"_241":290,"_26":291},{"_40":276,"_31":277,"_29":278,"_139":185,"_38":39,"_37":279,"_141":119,"_35":280,"_13":194,"_32":264,"_34":281,"_23":24,"_145":-5,"_241":282,"_26":283},{"_40":268,"_31":269,"_29":270,"_139":185,"_38":39,"_37":271,"_141":119,"_35":272,"_13":58,"_32":264,"_34":273,"_23":24,"_145":-5,"_241":274,"_26":275},{"_40":259,"_31":260,"_29":261,"_139":185,"_38":39,"_37":262,"_141":119,"_35":263,"_13":58,"_32":264,"_34":265,"_23":24,"_145":-5,"_241":266,"_26":267},{"_40":176,"_31":177,"_29":178,"_139":-5,"_38":39,"_37":179,"_141":119,"_35":256,"_13":58,"_32":20,"_34":181,"_23":24,"_145":-5,"_241":257,"_26":258},{"_40":169,"_31":170,"_29":171,"_139":-5,"_38":39,"_37":172,"_141":24,"_35":253,"_13":58,"_32":20,"_34":174,"_23":24,"_145":-5,"_241":254,"_26":255},{"_40":161,"_31":162,"_29":163,"_139":-5,"_38":39,"_37":164,"_141":119,"_35":250,"_13":166,"_32":20,"_34":167,"_23":24,"_145":-5,"_241":251,"_26":252},{"_40":154,"_31":155,"_29":156,"_139":-5,"_38":39,"_37":157,"_141":119,"_35":247,"_13":58,"_32":20,"_34":159,"_23":24,"_145":-5,"_241":248,"_26":249},{"_40":147,"_31":148,"_29":149,"_139":-5,"_38":39,"_37":150,"_141":119,"_35":244,"_13":58,"_32":20,"_34":152,"_23":24,"_145":-5,"_241":245,"_26":246},{"_40":136,"_31":137,"_29":138,"_139":-5,"_38":39,"_37":140,"_141":119,"_35":240,"_13":143,"_32":20,"_34":144,"_23":24,"_145":-5,"_241":242,"_26":243},["D",1771175759803],"children",[],[137],["D",1771175383120],[],[148],["D",1771359449686],[],[155],["D",1771175655763],[],[162],["D",1771175383282],[],[170],["D",1771175383227],[],[177],"8027c190-0c43-11f1-942a-42dde27851f2","url-validation_test.ts","8027c280-0c43-11f1-942a-42dde27851f2",71,["D",1771361947086],"script","import { assertEquals } from \"https://deno.land/std@0.224.0/assert/mod.ts\";\nimport { isPrivateIp, isSafeHref, isValidPdsUrl } from \"./url-validation.ts\";\n\n// --- isPrivateIp ---\n\nDeno.test(\"isPrivateIp rejects loopback\", () => {\n assertEquals(isPrivateIp(\"127.0.0.1\"), true);\n assertEquals(isPrivateIp(\"127.0.1.1\"), true);\n});\n\nDeno.test(\"isPrivateIp rejects RFC 1918 ranges\", () => {\n assertEquals(isPrivateIp(\"10.0.0.1\"), true);\n assertEquals(isPrivateIp(\"10.255.255.255\"), true);\n assertEquals(isPrivateIp(\"172.16.0.1\"), true);\n assertEquals(isPrivateIp(\"172.31.255.255\"), true);\n assertEquals(isPrivateIp(\"192.168.0.1\"), true);\n assertEquals(isPrivateIp(\"192.168.1.100\"), true);\n});\n\nDeno.test(\"isPrivateIp allows 172.x outside /12 range\", () => {\n assertEquals(isPrivateIp(\"172.15.0.1\"), false);\n assertEquals(isPrivateIp(\"172.32.0.1\"), false);\n});\n\nDeno.test(\"isPrivateIp rejects link-local\", () => {\n assertEquals(isPrivateIp(\"169.254.1.1\"), true);\n});\n\nDeno.test(\"isPrivateIp rejects cloud metadata IPs\", () => {\n assertEquals(isPrivateIp(\"169.254.169.254\"), true);\n assertEquals(isPrivateIp(\"100.100.100.200\"), true);\n});\n\nDeno.test(\"isPrivateIp rejects 0.x.x.x\", () => {\n assertEquals(isPrivateIp(\"0.0.0.0\"), true);\n});\n\nDeno.test(\"isPrivateIp rejects IPv6 private ranges\", () => {\n assertEquals(isPrivateIp(\"::1\"), true);\n assertEquals(isPrivateIp(\"fc00::1\"), true);\n assertEquals(isPrivateIp(\"fd12::1\"), true);\n assertEquals(isPrivateIp(\"fe80::1\"), true);\n});\n\nDeno.test(\"isPrivateIp allows public IPs\", () => {\n assertEquals(isPrivateIp(\"1.1.1.1\"), false);\n assertEquals(isPrivateIp(\"8.8.8.8\"), false);\n assertEquals(isPrivateIp(\"93.184.216.34\"), false);\n assertEquals(isPrivateIp(\"203.0.113.1\"), false);\n});\n\n// --- isValidPdsUrl ---\n\nDeno.test(\"isValidPdsUrl accepts valid https PDS URLs\", () => {\n assertEquals(isValidPdsUrl(\"https://pds.example.com\"), true);\n assertEquals(isValidPdsUrl(\"https://my.pds.server.org\"), true);\n assertEquals(isValidPdsUrl(\"https://bsky.social\"), true);\n});\n\nDeno.test(\"isValidPdsUrl rejects non-https protocols\", () => {\n assertEquals(isValidPdsUrl(\"http://pds.example.com\"), false);\n assertEquals(isValidPdsUrl(\"ftp://pds.example.com\"), false);\n assertEquals(isValidPdsUrl(\"javascript:alert(1)\"), false);\n assertEquals(isValidPdsUrl(\"data:text/html,

hi

\"), false);\n});\n\nDeno.test(\"isValidPdsUrl rejects bare IP addresses\", () => {\n assertEquals(isValidPdsUrl(\"https://1.2.3.4\"), false);\n assertEquals(isValidPdsUrl(\"https://192.168.1.1\"), false);\n});\n\nDeno.test(\"isValidPdsUrl rejects private IP hostnames\", () => {\n assertEquals(isValidPdsUrl(\"https://127.0.0.1\"), false);\n assertEquals(isValidPdsUrl(\"https://10.0.0.1\"), false);\n});\n\nDeno.test(\"isValidPdsUrl rejects localhost and single-label hosts\", () => {\n assertEquals(isValidPdsUrl(\"https://localhost\"), false);\n assertEquals(isValidPdsUrl(\"https://intranet\"), false);\n});\n\nDeno.test(\"isValidPdsUrl rejects URLs with userinfo\", () => {\n assertEquals(isValidPdsUrl(\"https://user:pass@pds.example.com\"), false);\n assertEquals(isValidPdsUrl(\"https://admin@pds.example.com\"), false);\n});\n\nDeno.test(\"isValidPdsUrl rejects malformed URLs\", () => {\n assertEquals(isValidPdsUrl(\"not-a-url\"), false);\n assertEquals(isValidPdsUrl(\"\"), false);\n assertEquals(isValidPdsUrl(\"://missing-scheme\"), false);\n});\n\n// --- isSafeHref ---\n\nDeno.test(\"isSafeHref allows https and http URLs\", () => {\n assertEquals(isSafeHref(\"https://example.com\"), true);\n assertEquals(isSafeHref(\"http://example.com\"), true);\n});\n\nDeno.test(\"isSafeHref rejects dangerous URI schemes\", () => {\n assertEquals(isSafeHref(\"javascript:alert(1)\"), false);\n assertEquals(isSafeHref(\"data:text/html,

xss

\"), false);\n assertEquals(isSafeHref(\"vbscript:msgbox\"), false);\n});\n\nDeno.test(\"isSafeHref rejects invalid URLs\", () => {\n assertEquals(isSafeHref(\"not-a-url\"), false);\n assertEquals(isSafeHref(\"\"), false);\n});\n",[],[184,260],"7ff475e2-0c43-11f1-9509-42dde27851f2","url-validation.ts","7ff47696-0c43-11f1-9509-42dde27851f2",67,["D",1771361947088],"/**\n * URL and IP validation for PDS ingestion.\n * Prevents SSRF by enforcing https: and rejecting private/reserved IPs.\n */\n\n/** IPv4 ranges that must never be contacted (SSRF protection) */\nconst PRIVATE_IP_RANGES: Array<{ prefix: string; mask: number }> = [\n // Loopback\n { prefix: \"127.\", mask: 0 },\n // 10.0.0.0/8\n { prefix: \"10.\", mask: 0 },\n // 172.16.0.0/12\n { prefix: \"172.\", mask: 16 },\n // 192.168.0.0/16\n { prefix: \"192.168.\", mask: 0 },\n // Link-local\n { prefix: \"169.254.\", mask: 0 },\n // Current network\n { prefix: \"0.\", mask: 0 },\n];\n\n/** Cloud metadata IPs to block explicitly */\nconst BLOCKED_IPS = new Set([\n \"169.254.169.254\", // AWS/GCP/Azure metadata\n \"100.100.100.200\", // Alibaba Cloud metadata\n \"fd00:ec2::254\", // AWS IMDSv2 IPv6\n]);\n\n/** Check if an IP address is in a private/reserved range */\nexport function isPrivateIp(ip: string): boolean {\n if (BLOCKED_IPS.has(ip)) return true;\n\n // IPv6 private ranges\n if (\n ip.startsWith(\"::1\") || ip.startsWith(\"fc\") || ip.startsWith(\"fd\") ||\n ip.startsWith(\"fe80\")\n ) {\n return true;\n }\n\n // IPv4 checks\n for (const range of PRIVATE_IP_RANGES) {\n if (!ip.startsWith(range.prefix)) continue;\n\n // 172.16.0.0/12: second octet must be 16-31\n if (range.prefix === \"172.\" && range.mask === 16) {\n const secondOctet = parseInt(ip.split(\".\")[1], 10);\n if (secondOctet >= 16 && secondOctet <= 31) return true;\n continue;\n }\n\n return true;\n }\n\n return false;\n}\n\n/** Validate a PDS URL is safe to store and fetch */\nexport function isValidPdsUrl(url: string): boolean {\n let parsed: URL;\n try {\n parsed = new URL(url);\n } catch {\n return false;\n }\n\n // Must be https\n if (parsed.protocol !== \"https:\") return false;\n\n // No userinfo (user:pass@host)\n if (parsed.username || parsed.password) return false;\n\n // Hostname must not be an IP literal pointing to private range\n if (isPrivateIp(parsed.hostname)) return false;\n\n // Reject bare IPs — PDS servers should have real hostnames\n if (/^\\d{1,3}(\\.\\d{1,3}){3}$/.test(parsed.hostname)) return false;\n\n // Must have a valid hostname with at least one dot (no localhost etc.)\n if (!parsed.hostname.includes(\".\")) return false;\n\n return true;\n}\n\n/** Strip trailing slashes from a PDS URL to prevent double-slash in paths */\nexport function normalizePdsUrl(url: string): string {\n return url.replace(/\\/+$/, \"\");\n}\n\n/** Validate a URL is safe to render in an href attribute */\nexport function isSafeHref(url: string): boolean {\n try {\n const parsed = new URL(url);\n return parsed.protocol === \"https:\" || parsed.protocol === \"http:\";\n } catch {\n return false;\n }\n}\n",[],[184,269],"81a0bce2-14c8-11f1-a1fa-42dde27851f2","types.ts","1f0da0d6-0a91-11f1-b423-42dde27851f2",79,["D",1772298682590],"/** A PDS server as stored in the database */\nexport type PdsServer = {\n url: string;\n first_seen: string;\n last_seen: string;\n last_enriched: string | null;\n version: string | null;\n pds_software: string | null;\n did: string | null;\n invite_code_required: boolean;\n phone_verification: boolean;\n user_domains: string[];\n contact_email: string | null;\n privacy_policy: string | null;\n terms_of_service: string | null;\n user_count: number | null;\n country_code: string | null;\n country_name: string | null;\n ip_address: string | null;\n is_open: boolean;\n error_at: number | null;\n};\n\n/** Maps software ID to its latest version string */\nexport type LatestVersionMap = Record;\n\n/** Maps a version string to the software ID that uses it */\nexport type VersionSoftwareMap = Record;\n\n/** Raw PDS entry from mary-ext/atproto-scraping state.json */\nexport type StatePdsEntry = {\n inviteCodeRequired: boolean;\n version: string;\n errorAt?: number;\n};\n\n/** Shape of state.json from atproto-scraping */\nexport type StateJson = {\n pdses: Record;\n};\n\n/** Response from PDS describeServer endpoint */\nexport type DescribeServerResponse = {\n did: string;\n availableUserDomains: string[];\n inviteCodeRequired?: boolean;\n phoneVerificationRequired?: boolean;\n contact?: { email?: string };\n links?: {\n privacyPolicy?: string;\n termsOfService?: string;\n };\n};\n\n/** Response from PDS _health endpoint */\nexport type HealthResponse = {\n version?: string;\n};\n\n/** Response from dns.google resolve API */\nexport type DnsResponse = {\n Answer?: Array<{ data: string }>;\n};\n\n/** Single entry in ip-api.com batch response */\nexport type GeoIpResult = {\n status: string;\n query: string;\n country: string;\n countryCode: string;\n};\n\n/** Server data passed into enrichment (includes cached DNS/geo) */\nexport type ServerToEnrich = {\n url: string;\n ipAddress: string | null;\n countryCode: string | null;\n countryName: string | null;\n lastEnriched: string | null;\n};\n\n/** Sort options for the directory listing */\nexport type SortField = \"trust\";\nexport type SortDirection = \"desc\";\n",[],[184,277],"81b06d86-14c8-11f1-8085-42dde27851f2","constants_test.ts","ff8a8eda-0a91-11f1-9890-42dde27851f2",80,["D",1772298682596],"import { assertEquals } from \"https://deno.land/std@0.224.0/assert/mod.ts\";\nimport {\n countryFlag,\n getSoftwareConfig,\n getTrackedSoftware,\n PDS_SOFTWARE_REGISTRY,\n} from \"./constants.ts\";\n\nDeno.test(\"countryFlag returns correct emoji for country codes\", () => {\n assertEquals(countryFlag(\"US\"), \"\\u{1F1FA}\\u{1F1F8}\");\n assertEquals(countryFlag(\"NL\"), \"\\u{1F1F3}\\u{1F1F1}\");\n assertEquals(countryFlag(\"DE\"), \"\\u{1F1E9}\\u{1F1EA}\");\n});\n\nDeno.test(\"countryFlag handles lowercase input\", () => {\n assertEquals(countryFlag(\"us\"), countryFlag(\"US\"));\n});\n\n// --- PDS Software Registry tests ---\n\nDeno.test(\"getSoftwareConfig returns config for known IDs\", () => {\n const bsky = getSoftwareConfig(\"bluesky-pds\");\n assertEquals(bsky?.displayName, \"Bluesky PDS\");\n assertEquals(bsky?.githubOwner, \"bluesky-social\");\n\n const milli = getSoftwareConfig(\"millipds\");\n assertEquals(milli?.displayName, \"millipds\");\n\n const tranquil = getSoftwareConfig(\"tranquil\");\n assertEquals(tranquil?.displayName, \"Tranquil\");\n});\n\nDeno.test(\"getSoftwareConfig returns undefined for unknown ID\", () => {\n assertEquals(getSoftwareConfig(\"nonexistent\"), undefined);\n});\n\nDeno.test(\"getTrackedSoftware returns only entries with GitHub info\", () => {\n const tracked = getTrackedSoftware();\n for (const sw of tracked) {\n assertEquals(typeof sw.githubOwner, \"string\");\n assertEquals(typeof sw.githubRepo, \"string\");\n assertEquals(typeof sw.parseVersion, \"function\");\n }\n // Link-only entries should not be included\n const ids = tracked.map((s) => s.id);\n assertEquals(ids.includes(\"tranquil\"), false);\n assertEquals(ids.includes(\"hexpds\"), false);\n assertEquals(ids.includes(\"picopds\"), false);\n // Tracked entries should be included\n assertEquals(ids.includes(\"bluesky-pds\"), true);\n assertEquals(ids.includes(\"millipds\"), true);\n assertEquals(ids.includes(\"cirrus\"), true);\n assertEquals(ids.includes(\"cocoon\"), true);\n});\n\n// --- parseVersion tests ---\n\nDeno.test(\"bluesky-pds parseVersion handles valid tags\", () => {\n const sw = getSoftwareConfig(\"bluesky-pds\")!;\n assertEquals(sw.parseVersion!(\"v0.4.74\"), \"0.4.74\");\n assertEquals(sw.parseVersion!(\"v1.0.0\"), \"1.0.0\");\n});\n\nDeno.test(\"bluesky-pds parseVersion rejects invalid tags\", () => {\n const sw = getSoftwareConfig(\"bluesky-pds\")!;\n assertEquals(sw.parseVersion!(\"0.4.74\"), null);\n assertEquals(sw.parseVersion!(\"v0.4\"), null);\n assertEquals(sw.parseVersion!(\"release-1.0\"), null);\n assertEquals(sw.parseVersion!(\"@getcirrus/pds@0.10.4\"), null);\n});\n\nDeno.test(\"millipds parseVersion handles valid tags\", () => {\n const sw = getSoftwareConfig(\"millipds\")!;\n assertEquals(sw.parseVersion!(\"v0.0.5\"), \"0.0.5\");\n assertEquals(sw.parseVersion!(\"v1.2.3\"), \"1.2.3\");\n});\n\nDeno.test(\"millipds parseVersion rejects invalid tags\", () => {\n const sw = getSoftwareConfig(\"millipds\")!;\n assertEquals(sw.parseVersion!(\"0.0.5\"), null);\n assertEquals(sw.parseVersion!(\"release-0.0.5\"), null);\n});\n\nDeno.test(\"cirrus parseVersion handles scoped tags\", () => {\n const sw = getSoftwareConfig(\"cirrus\")!;\n assertEquals(sw.parseVersion!(\"@getcirrus/pds@0.10.4\"), \"0.10.4\");\n assertEquals(sw.parseVersion!(\"@getcirrus/pds@1.0.0\"), \"1.0.0\");\n});\n\nDeno.test(\"cirrus parseVersion rejects non-matching tags\", () => {\n const sw = getSoftwareConfig(\"cirrus\")!;\n assertEquals(sw.parseVersion!(\"v0.10.4\"), null);\n assertEquals(sw.parseVersion!(\"0.10.4\"), null);\n assertEquals(sw.parseVersion!(\"@getcirrus/other@0.10.4\"), null);\n});\n\nDeno.test(\"cocoon parseVersion handles valid tags\", () => {\n const sw = getSoftwareConfig(\"cocoon\")!;\n assertEquals(sw.parseVersion!(\"v0.8.5\"), \"0.8.5\");\n assertEquals(sw.parseVersion!(\"v2.0.0\"), \"2.0.0\");\n});\n\nDeno.test(\"cocoon parseVersion rejects invalid tags\", () => {\n const sw = getSoftwareConfig(\"cocoon\")!;\n assertEquals(sw.parseVersion!(\"0.8.5\"), null);\n assertEquals(sw.parseVersion!(\"cocoon-v0.8.5\"), null);\n});\n\nDeno.test(\"all registry entries have required fields\", () => {\n for (const sw of PDS_SOFTWARE_REGISTRY) {\n assertEquals(typeof sw.id, \"string\");\n assertEquals(sw.id.length > 0, true);\n assertEquals(typeof sw.displayName, \"string\");\n assertEquals(typeof sw.projectUrl, \"string\");\n assertEquals(sw.projectUrl.startsWith(\"http\"), true);\n }\n});\n",[],[184,285],"81b606c4-14c8-11f1-a1fa-42dde27851f2","constants.ts","1f187a92-0a91-11f1-be9c-42dde27851f2",81,["D",1772298682730],"export const SERVERS_TABLE = \"openpds_servers\";\nexport const METADATA_TABLE = \"openpds_metadata\";\n\nexport const STATE_JSON_URL =\n \"https://raw.githubusercontent.com/mary-ext/atproto-scraping/trunk/state.json\";\n\nexport const ENRICHMENT_BATCH_SIZE = 75;\nexport const PDS_REQUEST_TIMEOUT_MS = 5000;\nexport const DNS_CACHE_TTL_DAYS = 7;\nexport const GEO_CACHE_TTL_DAYS = 30;\n\n/** Configuration for a known PDS software implementation */\nexport type PdsSoftwareConfig = {\n id: string;\n displayName: string;\n projectUrl: string;\n /** If set, enables version tracking via GitHub tags */\n githubOwner?: string;\n githubRepo?: string;\n /** Extract a version string from a GitHub tag name, or null if not a valid tag */\n parseVersion?: (tag: string) => string | null;\n};\n\n/** Registry of known PDS software implementations */\nexport const PDS_SOFTWARE_REGISTRY: PdsSoftwareConfig[] = [\n {\n id: \"bluesky-pds\",\n displayName: \"Bluesky PDS\",\n projectUrl: \"https://github.com/bluesky-social/pds\",\n githubOwner: \"bluesky-social\",\n githubRepo: \"pds\",\n parseVersion: (tag) => {\n const m = tag.match(/^v(\\d+\\.\\d+\\.\\d+)$/);\n return m ? m[1] : null;\n },\n },\n {\n id: \"millipds\",\n displayName: \"millipds\",\n projectUrl: \"https://github.com/DavidBuchanan314/millipds\",\n githubOwner: \"DavidBuchanan314\",\n githubRepo: \"millipds\",\n parseVersion: (tag) => {\n const m = tag.match(/^v(\\d+\\.\\d+\\.\\d+)$/);\n return m ? m[1] : null;\n },\n },\n {\n id: \"cirrus\",\n displayName: \"Cirrus\",\n projectUrl: \"https://github.com/ascorbic/cirrus\",\n githubOwner: \"ascorbic\",\n githubRepo: \"cirrus\",\n parseVersion: (tag) => {\n const m = tag.match(/^@getcirrus\\/pds@(\\d+\\.\\d+\\.\\d+)$/);\n return m ? m[1] : null;\n },\n },\n {\n id: \"cocoon\",\n displayName: \"Cocoon\",\n projectUrl: \"https://github.com/haileyok/cocoon\",\n githubOwner: \"haileyok\",\n githubRepo: \"cocoon\",\n parseVersion: (tag) => {\n const m = tag.match(/^v(\\d+\\.\\d+\\.\\d+)$/);\n return m ? m[1] : null;\n },\n },\n // Link-only software (no version tracking)\n {\n id: \"tranquil\",\n displayName: \"Tranquil\",\n projectUrl: \"https://tangled.org/tranquil.farm/tranquil-pds\",\n },\n {\n id: \"hexpds\",\n displayName: \"hexpds\",\n projectUrl: \"https://github.com/ovnanova/hexpds\",\n },\n {\n id: \"bluepds\",\n displayName: \"bluepds\",\n projectUrl: \"https://github.com/DrChat/bluepds\",\n },\n {\n id: \"rsky\",\n displayName: \"rsky\",\n projectUrl: \"https://github.com/blacksky-algorithms/rsky\",\n },\n {\n id: \"picopds\",\n displayName: \"picopds\",\n projectUrl: \"https://github.com/DavidBuchanan314/picopds\",\n },\n];\n\n/** Look up a software config by its ID */\nexport function getSoftwareConfig(\n id: string,\n): PdsSoftwareConfig | undefined {\n return PDS_SOFTWARE_REGISTRY.find((s) => s.id === id);\n}\n\n/** Return only software entries that have GitHub version tracking */\nexport function getTrackedSoftware(): PdsSoftwareConfig[] {\n return PDS_SOFTWARE_REGISTRY.filter(\n (s) => s.githubOwner && s.githubRepo && s.parseVersion,\n );\n}\n\n/** Country code to flag emoji */\nexport function countryFlag(code: string): string {\n return [...code.toUpperCase()]\n .map((c) => String.fromCodePoint(0x1f1e6 - 65 + c.charCodeAt(0)))\n .join(\"\");\n}\n",[],[184,293],["D",1771175381422],[229,230,231,232,233],[184],["D",1773171123991],[],[27],"aca2e96e-14c9-11f1-ad92-42dde27851f2","refresh.cron.ts","1f1c2ab6-0a91-11f1-987b-42dde27851f2",86,["D",1772299184242],6,"interval","import {\n ENRICHMENT_BATCH_SIZE,\n getTrackedSoftware,\n} from \"../shared/constants.ts\";\nimport type { LatestVersionMap, VersionSoftwareMap } from \"../shared/types.ts\";\nimport { runMigrations } from \"../backend/database/migrations.ts\";\nimport {\n getMetadata,\n getServersToEnrich,\n setMetadata,\n updateEnrichment,\n upsertServer,\n} from \"../backend/database/queries.ts\";\nimport { fetchPdsList } from \"../backend/services/pds-fetcher.ts\";\nimport { fetchRecentVersions } from \"../backend/services/version-checker.ts\";\nimport { enrichBatch } from \"../backend/services/pds-enricher.ts\";\n\nexport default async function () {\n console.log(\"OpenPDS refresh started:\", new Date().toISOString());\n\n try {\n await runMigrations();\n\n // 1. Fetch and sync state.json (with ETag caching)\n const previousStateEtag = await getMetadata(\"state_json_etag\");\n const { pdsList, etag: stateEtag } = await fetchPdsList(previousStateEtag);\n\n if (stateEtag) {\n await setMetadata(\"state_json_etag\", stateEtag);\n }\n\n if (pdsList) {\n console.log(\n `state.json: new data (${pdsList.length} PDSes), etag=${stateEtag}`,\n );\n let openCount = 0;\n for (const pds of pdsList) {\n await upsertServer(pds.url, {\n inviteCodeRequired: pds.inviteCodeRequired,\n version: pds.version,\n errorAt: pds.errorAt,\n isOpen: pds.isOpen,\n });\n if (pds.isOpen) openCount++;\n }\n console.log(`Synced to DB: ${openCount} open, ${pdsList.length} total`);\n } else {\n console.log(\n `state.json: 304 not modified, skipping upsert (etag=${stateEtag})`,\n );\n }\n\n // 2. Fetch latest versions for all tracked PDS software\n const latestVersions: LatestVersionMap = {};\n const versionToSoftware: VersionSoftwareMap = {};\n const trackedSoftware = getTrackedSoftware();\n\n for (const software of trackedSoftware) {\n const etagKey = `github_tags_etag:${software.id}`;\n const previousEtag = await getMetadata(etagKey);\n const result = await fetchRecentVersions(software, previousEtag);\n\n if (result.etag) {\n await setMetadata(etagKey, result.etag);\n }\n\n if (result.notModified) {\n console.log(\n `GitHub tags [${software.id}]: 304 not modified`,\n );\n // Load cached versions from metadata\n const cachedLatest = await getMetadata(\n `latest_version:${software.id}`,\n );\n if (cachedLatest) {\n latestVersions[software.id] = cachedLatest;\n }\n const cachedVersions = await getMetadata(\n `version_map:${software.id}`,\n );\n if (cachedVersions) {\n for (const v of JSON.parse(cachedVersions)) {\n versionToSoftware[v] = software.id;\n }\n }\n } else if (result.latest) {\n latestVersions[software.id] = result.latest;\n await setMetadata(`latest_version:${software.id}`, result.latest);\n await setMetadata(\n `version_map:${software.id}`,\n JSON.stringify(result.versions),\n );\n for (const v of result.versions) {\n versionToSoftware[v] = software.id;\n }\n console.log(\n `GitHub tags [${software.id}]: latest ${result.latest} (${result.versions.length} versions)`,\n );\n } else if (result.error) {\n console.log(\n `GitHub tags [${software.id}]: API error (using cached)`,\n );\n const cachedLatest = await getMetadata(\n `latest_version:${software.id}`,\n );\n if (cachedLatest) {\n latestVersions[software.id] = cachedLatest;\n }\n const cachedVersions = await getMetadata(\n `version_map:${software.id}`,\n );\n if (cachedVersions) {\n for (const v of JSON.parse(cachedVersions)) {\n versionToSoftware[v] = software.id;\n }\n }\n } else {\n console.log(`GitHub tags [${software.id}]: no versions found`);\n }\n }\n\n // Backward compat: keep latest_pds_version for bluesky-pds\n if (latestVersions[\"bluesky-pds\"]) {\n await setMetadata(\"latest_pds_version\", latestVersions[\"bluesky-pds\"]);\n }\n // Also maintain legacy github_tags_etag for backward compat\n const bskyEtag = await getMetadata(\"github_tags_etag:bluesky-pds\");\n if (bskyEtag) {\n await setMetadata(\"github_tags_etag\", bskyEtag);\n }\n\n console.log(\n `Version map: ${\n Object.keys(versionToSoftware).length\n } known versions across ${trackedSoftware.length} software`,\n );\n\n // 3. Enrich a batch of servers\n const toEnrich = await getServersToEnrich(ENRICHMENT_BATCH_SIZE);\n if (toEnrich.length > 0) {\n const cachedIpCount = toEnrich.filter((s) => s.ipAddress).length;\n const cachedGeoCount = toEnrich.filter((s) => s.countryCode).length;\n console.log(\n `Enriching ${toEnrich.length} servers (${cachedIpCount} have cached IP, ${cachedGeoCount} have cached geo)`,\n );\n\n const { results: enriched, stats } = await enrichBatch(toEnrich);\n\n for (const data of enriched) {\n // Detect software by matching version against known version map\n if (data.version) {\n if (versionToSoftware[data.version]) {\n // Exact match (e.g. \"0.4.74\" → bluesky-pds)\n data.pdsSoftware = versionToSoftware[data.version];\n } else {\n // Extract semver from strings like \"millipds v0.0.5.dev17+...\"\n const m = data.version.match(/(\\d+\\.\\d+\\.\\d+)/);\n if (m && m[1] !== data.version && versionToSoftware[m[1]]) {\n data.pdsSoftware = versionToSoftware[m[1]];\n }\n }\n }\n\n await updateEnrichment(data.url, {\n version: data.version,\n did: data.did,\n phoneVerification: data.phoneVerification,\n userDomains: data.userDomains,\n contactEmail: data.contactEmail,\n privacyPolicy: data.privacyPolicy,\n termsOfService: data.termsOfService,\n userCount: data.userCount,\n countryCode: data.countryCode,\n countryName: data.countryName,\n ipAddress: data.ipAddress,\n pdsSoftware: data.pdsSoftware,\n });\n }\n\n const noUserCount = enriched.filter((s) => s.userCount === null).length;\n const softwareCounts: Record = {};\n for (const s of enriched) {\n const sw = s.pdsSoftware ?? \"unknown\";\n softwareCounts[sw] = (softwareCounts[sw] ?? 0) + 1;\n }\n console.log(\n `Enriched ${enriched.length} servers: ` +\n `DNS ${stats.cachedDns} cached/${stats.freshDns} fresh, ` +\n `geo ${stats.cachedGeo} cached/${stats.freshGeo} fresh` +\n (noUserCount > 0 ? `, ${noUserCount} without user count` : \"\") +\n `, software: ${JSON.stringify(softwareCounts)}`,\n );\n }\n\n await setMetadata(\"last_full_refresh\", new Date().toISOString());\n console.log(\"OpenPDS refresh completed\");\n } catch (err) {\n console.error(\"OpenPDS refresh failed:\", err);\n }\n}\n",[],[192,307],["D",1771175381915],[226],[192],"1ed99eb2-0a91-11f1-9740-42dde27851f2","index.http.ts",14,["D",1771175382903],"http","import { Hono } from \"https://esm.sh/hono@4.4.0\";\nimport { runMigrations } from \"./database/migrations.ts\";\nimport { pages } from \"./routes/pages.ts\";\nimport { api } from \"./routes/api.ts\";\n\nconst app = new Hono();\n\napp.onError((err, _c) => {\n throw err;\n});\n\nlet migrationsRan = false;\napp.use(\"*\", async (_c, next) => {\n if (!migrationsRan) {\n await runMigrations();\n migrationsRan = true;\n }\n await next();\n});\n\napp.route(\"/api\", api);\napp.route(\"/\", pages);\n\nexport default app.fetch;\n",[],[198,320],"819442c8-14c8-11f1-a1fa-42dde27851f2","version-checker.ts","1ede6d98-0a91-11f1-b423-42dde27851f2","1e950220-0a91-11f1-987b-42dde27851f2",78,["D",1772298682473],"import type { PdsSoftwareConfig } from \"../../shared/constants.ts\";\n\nexport type FetchVersionResult = {\n version: string | null;\n etag: string | null;\n notModified: boolean;\n error: boolean;\n};\n\nexport type FetchRecentVersionsResult = {\n latest: string | null;\n versions: string[];\n etag: string | null;\n notModified: boolean;\n error: boolean;\n};\n\n/** Fetch latest version for a PDS software from its GitHub tags with ETag caching. */\nexport async function fetchLatestPdsVersion(\n software: PdsSoftwareConfig,\n previousEtag?: string | null,\n): Promise {\n const result = await fetchRecentVersions(software, previousEtag);\n return {\n version: result.latest,\n etag: result.etag,\n notModified: result.notModified,\n error: result.error,\n };\n}\n\n/** Fetch up to 30 recent parsed versions for a PDS software from GitHub tags. */\nexport async function fetchRecentVersions(\n software: PdsSoftwareConfig,\n previousEtag?: string | null,\n): Promise {\n if (!software.githubOwner || !software.githubRepo || !software.parseVersion) {\n return {\n latest: null,\n versions: [],\n etag: null,\n notModified: false,\n error: true,\n };\n }\n\n const url =\n `https://api.github.com/repos/${software.githubOwner}/${software.githubRepo}/tags?per_page=30`;\n\n const headers: Record = {\n \"Accept\": \"application/vnd.github.v3+json\",\n \"User-Agent\": \"OpenPDS/1.0 (github.com/tijs/openpds)\",\n };\n if (previousEtag) {\n headers[\"If-None-Match\"] = previousEtag;\n }\n\n const resp = await fetch(url, { headers });\n const etag = resp.headers.get(\"etag\");\n\n if (resp.status === 304) {\n return {\n latest: null,\n versions: [],\n etag: etag ?? previousEtag ?? null,\n notModified: true,\n error: false,\n };\n }\n\n if (!resp.ok) {\n console.error(\n `GitHub API error for ${software.id}: ${resp.status}`,\n );\n return {\n latest: null,\n versions: [],\n etag: previousEtag ?? null,\n notModified: false,\n error: true,\n };\n }\n\n const tags: Array<{ name: string }> = await resp.json();\n const versions: string[] = [];\n for (const tag of tags) {\n const v = software.parseVersion(tag.name);\n if (v) versions.push(v);\n }\n\n return {\n latest: versions.length > 0 ? versions[0] : null,\n versions,\n etag: etag ?? null,\n notModified: false,\n error: false,\n };\n}\n",[],[198,336,328],"services","801934d6-0c43-11f1-b058-42dde27851f2","pds-fetcher.ts","1ef5c6d2-0a91-11f1-a315-42dde27851f2",69,["D",1771361947646],"import { STATE_JSON_URL } from \"../../shared/constants.ts\";\nimport type { StateJson } from \"../../shared/types.ts\";\nimport { isValidPdsUrl, normalizePdsUrl } from \"../../shared/url-validation.ts\";\n\nexport type FilteredPds = {\n url: string;\n inviteCodeRequired: boolean;\n version: string;\n errorAt: number | null;\n isOpen: boolean;\n};\n\nexport type FetchPdsResult = {\n pdsList: FilteredPds[] | null;\n etag: string | null;\n};\n\n/** Fetch state.json with ETag caching. Returns null pdsList on 304. */\nexport async function fetchPdsList(\n previousEtag?: string | null,\n): Promise {\n const headers: Record = {};\n if (previousEtag) {\n headers[\"If-None-Match\"] = previousEtag;\n }\n\n const resp = await fetch(STATE_JSON_URL, { headers });\n const etag = resp.headers.get(\"etag\");\n\n if (resp.status === 304) {\n return { pdsList: null, etag: etag ?? previousEtag ?? null };\n }\n\n if (!resp.ok) {\n throw new Error(`Failed to fetch state.json: ${resp.status}`);\n }\n\n const data: StateJson = await resp.json();\n const results: FilteredPds[] = [];\n\n let skipped = 0;\n for (const [rawUrl, entry] of Object.entries(data.pdses)) {\n if (!isValidPdsUrl(rawUrl)) {\n skipped++;\n continue;\n }\n const url = normalizePdsUrl(rawUrl);\n const isOpen = !entry.inviteCodeRequired && !entry.errorAt;\n results.push({\n url,\n inviteCodeRequired: entry.inviteCodeRequired,\n version: entry.version,\n errorAt: entry.errorAt ?? null,\n isOpen,\n });\n }\n if (skipped > 0) {\n console.warn(`Skipped ${skipped} PDS URLs that failed validation`);\n }\n\n return { pdsList: results, etag: etag ?? null };\n}\n",[],[198,336,338],"817e9c20-14c8-11f1-958b-42dde27851f2","pds-enricher.ts","1eedcf72-0a91-11f1-82a1-42dde27851f2",75,["D",1772298682262],"import {\n DNS_CACHE_TTL_DAYS,\n GEO_CACHE_TTL_DAYS,\n PDS_REQUEST_TIMEOUT_MS,\n} from \"../../shared/constants.ts\";\nimport type {\n DescribeServerResponse,\n HealthResponse,\n ServerToEnrich,\n} from \"../../shared/types.ts\";\nimport {\n isPrivateIp,\n isValidPdsUrl,\n normalizePdsUrl,\n} from \"../../shared/url-validation.ts\";\nimport { batchGeoLookup, resolveIp } from \"./geo-resolver.ts\";\n\nexport type EnrichmentResult = {\n url: string;\n version: string | null;\n pdsSoftware: string | null;\n did: string | null;\n phoneVerification: boolean;\n userDomains: string[];\n contactEmail: string | null;\n privacyPolicy: string | null;\n termsOfService: string | null;\n userCount: number | null;\n ipAddress: string | null;\n countryCode: string | null;\n countryName: string | null;\n};\n\nexport type EnrichmentStats = {\n cachedDns: number;\n freshDns: number;\n cachedGeo: number;\n freshGeo: number;\n};\n\n/** Check if a cached value is older than the given TTL in days */\nfunction isCacheStale(lastEnriched: string | null, ttlDays: number): boolean {\n if (!lastEnriched) return true;\n const ageMs = Date.now() - new Date(lastEnriched).getTime();\n return ageMs > ttlDays * 24 * 60 * 60 * 1000;\n}\n\n/** Enrich a batch of PDS servers with metadata, reusing cached DNS/geo data */\nexport async function enrichBatch(\n servers: ServerToEnrich[],\n): Promise<{ results: EnrichmentResult[]; stats: EnrichmentStats }> {\n const stats: EnrichmentStats = {\n cachedDns: 0,\n freshDns: 0,\n cachedGeo: 0,\n freshGeo: 0,\n };\n\n // Step 1: Fetch PDS endpoints concurrently, passing existing IP to skip DNS\n // Invalidate stale DNS caches by passing null instead of the cached IP\n const pdsResults = await Promise.allSettled(\n servers.map((s) => {\n const dnsStale = isCacheStale(s.lastEnriched, DNS_CACHE_TTL_DAYS);\n return enrichSinglePds(s.url, dnsStale ? null : s.ipAddress);\n }),\n );\n\n const results: EnrichmentResult[] = [];\n const needsGeoLookup = new Map();\n\n for (let i = 0; i < servers.length; i++) {\n const server = servers[i];\n const r = pdsResults[i];\n let result: EnrichmentResult;\n\n if (r.status === \"fulfilled\") {\n result = r.value;\n } else {\n console.error(`Enrichment failed for ${server.url}:`, r.reason);\n result = emptyResult(server.url);\n }\n\n // Track DNS cache stats\n if (server.ipAddress && result.ipAddress === server.ipAddress) {\n stats.cachedDns++;\n } else if (result.ipAddress) {\n stats.freshDns++;\n }\n\n const geoStale = isCacheStale(server.lastEnriched, GEO_CACHE_TTL_DAYS);\n const ipChanged = result.ipAddress !== null &&\n result.ipAddress !== server.ipAddress;\n\n // Determine if we need geo lookup or can carry forward cached data\n if (result.ipAddress && (!server.countryCode || geoStale || ipChanged)) {\n // Need fresh geo: no cached data, cache expired, or IP changed\n needsGeoLookup.set(result.url, result.ipAddress);\n } else if (server.countryCode) {\n // Carry forward cached geo data\n result.countryCode = result.countryCode ?? server.countryCode;\n result.countryName = result.countryName ?? server.countryName;\n stats.cachedGeo++;\n }\n\n results.push(result);\n }\n\n // Step 2: Batch geo-IP lookup only for servers that need it\n if (needsGeoLookup.size > 0) {\n const geoData = await batchGeoLookup(needsGeoLookup);\n for (const result of results) {\n const geo = geoData.get(result.url);\n if (geo) {\n result.countryCode = geo.countryCode;\n result.countryName = geo.countryName;\n stats.freshGeo++;\n }\n }\n }\n\n return { results, stats };\n}\n\nasync function enrichSinglePds(\n rawUrl: string,\n existingIp?: string | null,\n): Promise {\n const url = normalizePdsUrl(rawUrl);\n if (!isValidPdsUrl(url)) {\n throw new Error(`Refusing to enrich invalid URL: ${url}`);\n }\n\n const result = emptyResult(url);\n\n // Reuse existing IP or resolve fresh, then verify it's not private\n if (existingIp) {\n result.ipAddress = existingIp;\n } else {\n const hostname = new URL(url).hostname;\n result.ipAddress = await resolveIp(hostname);\n }\n\n if (result.ipAddress && isPrivateIp(result.ipAddress)) {\n throw new Error(`Refusing to contact private IP for ${url}`);\n }\n\n // Fetch health, describeServer, and listRepos concurrently\n const [health, describe, userCount] = await Promise.allSettled([\n fetchHealth(url, AbortSignal.timeout(PDS_REQUEST_TIMEOUT_MS)),\n fetchDescribeServer(url, AbortSignal.timeout(PDS_REQUEST_TIMEOUT_MS)),\n fetchUserCount(url, AbortSignal.timeout(PDS_REQUEST_TIMEOUT_MS)),\n ]);\n\n if (health.status === \"fulfilled\" && health.value) {\n result.version = health.value.version ?? null;\n }\n\n if (describe.status === \"fulfilled\" && describe.value) {\n const d = describe.value;\n result.did = d.did;\n result.userDomains = d.availableUserDomains ?? [];\n result.phoneVerification = d.phoneVerificationRequired ?? false;\n result.contactEmail = d.contact?.email ?? null;\n result.privacyPolicy = d.links?.privacyPolicy ?? null;\n result.termsOfService = d.links?.termsOfService ?? null;\n }\n\n if (userCount.status === \"fulfilled\") {\n result.userCount = userCount.value;\n }\n\n return result;\n}\n\nasync function fetchHealth(\n url: string,\n signal: AbortSignal,\n): Promise {\n try {\n const resp = await fetch(`${url}/xrpc/_health`, { signal });\n if (!resp.ok) return null;\n return await resp.json();\n } catch {\n return null;\n }\n}\n\nasync function fetchDescribeServer(\n url: string,\n signal: AbortSignal,\n): Promise {\n try {\n const resp = await fetch(\n `${url}/xrpc/com.atproto.server.describeServer`,\n { signal },\n );\n if (!resp.ok) return null;\n return await resp.json();\n } catch {\n return null;\n }\n}\n\nasync function fetchUserCount(\n url: string,\n signal: AbortSignal,\n): Promise {\n try {\n const resp = await fetch(\n `${url}/xrpc/com.atproto.sync.listRepos?limit=1000`,\n { signal },\n );\n if (!resp.ok) {\n // 404 is expected for non-standard PDSes — only log other errors\n if (resp.status !== 404) {\n console.error(`listRepos ${url}: HTTP ${resp.status}`);\n }\n return null;\n }\n const data = await resp.json();\n const repos: unknown[] = data.repos ?? [];\n // If we got exactly 1000 repos, there are likely more\n return repos.length >= 1000 ? 1000 : repos.length;\n } catch (err) {\n console.error(`listRepos ${url}: ${err}`);\n return null;\n }\n}\n\nfunction emptyResult(url: string): EnrichmentResult {\n return {\n url,\n version: null,\n pdsSoftware: null,\n did: null,\n phoneVerification: false,\n userDomains: [],\n contactEmail: null,\n privacyPolicy: null,\n termsOfService: null,\n userCount: null,\n ipAddress: null,\n countryCode: null,\n countryName: null,\n };\n}\n",[],[198,336,346],"1ed2b034-0a91-11f1-a09a-42dde27851f2","geo-resolver.ts","1ed2b0e8-0a91-11f1-a09a-42dde27851f2",13,["D",1771175382877],"import type { DnsResponse, GeoIpResult } from \"../../shared/types.ts\";\n\n/** Resolve hostname to IP address via DNS-over-HTTPS */\nexport async function resolveIp(hostname: string): Promise {\n try {\n const resp = await fetch(\n `https://dns.google/resolve?name=${encodeURIComponent(hostname)}&type=A`,\n { signal: AbortSignal.timeout(5000) },\n );\n if (!resp.ok) return null;\n\n const data: DnsResponse = await resp.json();\n if (!data.Answer || data.Answer.length === 0) return null;\n\n // Return the last A record (usually the actual IP after CNAMEs)\n return data.Answer[data.Answer.length - 1].data;\n } catch {\n return null;\n }\n}\n\n/** Batch geo-IP lookup for up to 100 IPs */\nexport async function batchGeoLookup(\n ipMap: Map,\n): Promise> {\n const results = new Map<\n string,\n { countryCode: string; countryName: string }\n >();\n if (ipMap.size === 0) return results;\n\n // ip-api.com batch endpoint: POST array of IPs\n const ips = [...new Set(ipMap.values())].filter(Boolean);\n if (ips.length === 0) return results;\n\n try {\n const resp = await fetch(\n \"http://ip-api.com/batch?fields=status,query,country,countryCode\",\n {\n method: \"POST\",\n headers: { \"Content-Type\": \"application/json\" },\n body: JSON.stringify(ips),\n signal: AbortSignal.timeout(10000),\n },\n );\n\n if (!resp.ok) {\n console.error(`ip-api.com batch error: ${resp.status}`);\n return results;\n }\n\n const geoResults: GeoIpResult[] = await resp.json();\n\n // Build IP → geo map\n const ipToGeo = new Map<\n string,\n { countryCode: string; countryName: string }\n >();\n for (const r of geoResults) {\n if (r.status === \"success\") {\n ipToGeo.set(r.query, {\n countryCode: r.countryCode,\n countryName: r.country,\n });\n }\n }\n\n // Map hostnames back to geo data via their IPs\n for (const [hostname, ip] of ipMap) {\n const geo = ipToGeo.get(ip);\n if (geo) results.set(hostname, geo);\n }\n } catch (err) {\n console.error(\"Geo lookup failed:\", err);\n }\n\n return results;\n}\n",[],[198,336,354],"1e95013a-0a91-11f1-987b-42dde27851f2",7,["D",1771175382473],[220,221,222,223],[198,336],"79d7a994-14d7-11f1-8531-42dde27851f2","pages.ts","1eb91b88-0a91-11f1-aa7d-42dde27851f2","1e7af3e4-0a91-11f1-a09a-42dde27851f2",91,["D",1772305111976],"import { Hono } from \"https://esm.sh/hono@4.4.0\";\nimport {\n getMetadata,\n getOpenServers,\n getServerCount,\n} from \"../database/queries.ts\";\nimport {\n countryFlag,\n getSoftwareConfig,\n getTrackedSoftware,\n PDS_SOFTWARE_REGISTRY,\n} from \"../../shared/constants.ts\";\nimport type {\n LatestVersionMap,\n PdsServer,\n VersionSoftwareMap,\n} from \"../../shared/types.ts\";\nimport { isSafeHref } from \"../../shared/url-validation.ts\";\n\nconst pages = new Hono();\n\npages.get(\"/\", async (c) => {\n // Fetch per-software latest versions and version maps\n const tracked = getTrackedSoftware();\n const latestVersions: LatestVersionMap = {};\n const versionToSoftware: VersionSoftwareMap = {};\n const metadataPromises = tracked.map(async (sw) => {\n const [latest, versionsJson] = await Promise.all([\n getMetadata(`latest_version:${sw.id}`),\n getMetadata(`version_map:${sw.id}`),\n ]);\n if (latest) latestVersions[sw.id] = latest;\n if (versionsJson) {\n for (const v of JSON.parse(versionsJson) as string[]) {\n versionToSoftware[v] = sw.id;\n }\n }\n });\n const [, counts] = await Promise.all([\n Promise.all(metadataPromises),\n getServerCount(),\n ]);\n\n // Backward compat: fall back to legacy key until cron populates new keys\n if (!latestVersions[\"bluesky-pds\"]) {\n const legacy = await getMetadata(\"latest_pds_version\");\n if (legacy) latestVersions[\"bluesky-pds\"] = legacy;\n }\n\n const servers = await getOpenServers(latestVersions);\n\n c.header(\n \"Cache-Control\",\n \"public, max-age=3600, stale-while-revalidate=3600\",\n );\n return c.html(renderPage(servers, {\n latestVersions,\n versionToSoftware,\n openCount: counts.open,\n totalCount: counts.total,\n }));\n});\n\ntype PageOpts = {\n latestVersions: LatestVersionMap;\n versionToSoftware: VersionSoftwareMap;\n openCount: number;\n totalCount: number;\n};\n\ntype TrustResult = { score: number; breakdown: string };\n\nfunction trustScore(\n s: PdsServer,\n latestVersions: LatestVersionMap,\n versionToSoftware: VersionSoftwareMap,\n): TrustResult {\n const signals: string[] = [];\n let score = 0;\n\n const check = (pass: boolean, label: string) => {\n signals.push(`${pass ? \"\\u2713\" : \"\\u2717\"} ${label}`);\n if (pass) score += 20;\n };\n\n check(!!s.contact_email, \"Contact email\");\n check(!!s.terms_of_service, \"Terms of Service\");\n check(!!s.privacy_policy, \"Privacy Policy\");\n check(s.user_count != null && s.user_count > 5, \"Active users (>5)\");\n\n // Version check: compare against the server's own software latest version\n // Extract clean semver from strings like \"millipds v0.0.5.dev17+...\"\n const softwareId = detectSoftwareId(s, versionToSoftware);\n if (!softwareId) {\n // Unknown software: can't fairly compare, benefit of the doubt\n check(true, \"Latest version\");\n } else {\n const expectedVersion = latestVersions[softwareId];\n if (!expectedVersion) {\n // Link-only software with no tracked version: benefit of the doubt\n check(true, \"Latest version\");\n } else {\n const cleanVersion = extractSemver(s.version);\n check(cleanVersion === expectedVersion, \"Latest version\");\n }\n }\n\n return { score, breakdown: signals.join(\"\\n\") };\n}\n\nfunction renderPage(servers: PdsServer[], opts: PageOpts): string {\n const { latestVersions, versionToSoftware, openCount, totalCount } = opts;\n\n const rows = servers\n .map((s) =>\n renderRow(\n s,\n latestVersions,\n versionToSoftware,\n trustScore(s, latestVersions, versionToSoftware),\n )\n )\n .join(\"\\n\");\n\n // Build stats for tracked software versions\n const versionStats = getTrackedSoftware()\n .filter((sw) => latestVersions[sw.id])\n .map((sw) =>\n `${esc(sw.displayName)}: ${esc(latestVersions[sw.id])}`\n )\n .join(\"\\n \");\n\n return `\n\n\n \n \n OpenPDS - AT Protocol PDS Directory\n \n\n\n

OpenPDS

\n AT Protocol PDS servers with open registration.\n Data from atproto-scraping,\n enriched daily.\n

\n ${servers.length} servers listed\n ${openCount} open of ${totalCount} known\n ${versionStats}\n

\n ${\n servers.length > 0\n ? `\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n ${rows}\n \n

Trust^*	Hostname	Country	Software	Version	Users	First seen

`\n : `

No servers found. Data may still be loading — check back after the first cron run.

`\n }\n

^* Trust score

A simple transparency score based on five signals, each worth 20%:

Contact email — operator provides a way to reach them
Terms of Service — published terms for using the server
Privacy Policy — published data handling policy
Active users — more than 5 accounts on the server
Latest version — running the latest release of its PDS software (servers are compared against their own software's latest version)

This is not an endorsement. Always review a server's policies before creating an account.

\n \n\n`;\n}\n\nfunction renderRow(\n s: PdsServer,\n latestVersions: LatestVersionMap,\n versionToSoftware: VersionSoftwareMap,\n trust: TrustResult,\n): string {\n const { score, breakdown } = trust;\n const hostname = new URL(s.url).hostname;\n const safeUrl = isSafeHref(s.url) ? s.url : \"#\";\n const flag = s.country_code ? esc(countryFlag(s.country_code)) + \" \" : \"\";\n const country = s.country_name || \"\";\n\n // Determine version badge class based on per-software comparison\n const softwareId = detectSoftwareId(s, versionToSoftware);\n const cleanVersion = extractSemver(s.version);\n const versionText = cleanVersion || \"unknown\";\n let versionClass = \"version-outdated\";\n if (!softwareId) {\n // Unknown software: no comparison possible\n versionClass = \"version-current\";\n } else {\n const expectedVersion = latestVersions[softwareId];\n if (!expectedVersion || cleanVersion === expectedVersion) {\n versionClass = \"version-current\";\n }\n }\n\n // Software cell: linked name to project URL\n let softwareHtml = \"—\";\n if (softwareId) {\n const config = getSoftwareConfig(softwareId);\n softwareHtml = config\n ? `${esc(config.displayName)}`\n : esc(softwareId);\n }\n\n const users = s.user_count != null\n ? (s.user_count >= 1000 ? \"1000+\" : String(s.user_count))\n : \"-\";\n\n const firstSeen = s.first_seen\n ? new Date(s.first_seen).toLocaleDateString(\"en-US\", {\n month: \"short\",\n day: \"numeric\",\n year: \"numeric\",\n })\n : \"-\";\n\n const trustClass = score >= 60\n ? \"trust-high\"\n : score >= 40\n ? \"trust-mid\"\n : \"trust-low\";\n\n return `\n ${score}%\n ${esc(hostname)}\n ${flag}${esc(country)}\n ${softwareHtml}\n ${\n esc(versionText)\n }\n ${esc(users)}\n ${esc(firstSeen)}\n Moove here\n `;\n}\n\n/** Extract a clean semver from a version string (e.g. \"millipds v0.0.5.dev17+...\" → \"0.0.5\") */\nfunction extractSemver(version: string | null): string | null {\n if (!version) return null;\n const m = version.match(/(\\d+\\.\\d+\\.\\d+)/);\n return m ? m[1] : version;\n}\n\n/** Known non-overlapping version ranges for each tracked software */\nconst VERSION_RANGES: Array<{ prefix: string; softwareId: string }> = [\n { prefix: \"0.4.\", softwareId: \"bluesky-pds\" },\n { prefix: \"0.0.\", softwareId: \"millipds\" },\n { prefix: \"0.10.\", softwareId: \"cirrus\" },\n { prefix: \"0.8.\", softwareId: \"cocoon\" },\n];\n\n/** Detect software from DB field, version-to-software map, or version string. Returns null if unknown. */\nfunction detectSoftwareId(\n server: PdsServer,\n versionToSoftware: VersionSoftwareMap,\n): string | null {\n // 1. Already detected by cron\n if (server.pds_software) return server.pds_software;\n if (!server.version) return null;\n\n // 2. Exact version match against known versions from all tracked software\n if (versionToSoftware[server.version]) {\n return versionToSoftware[server.version];\n }\n\n // 3. Extract semver and try again (handles \"millipds v0.0.5.dev17+...\" → \"0.0.5\")\n const semver = extractSemver(server.version);\n if (semver && semver !== server.version && versionToSoftware[semver]) {\n return versionToSoftware[semver];\n }\n\n // 4. Check if version string starts with a known software name\n const vLower = server.version.toLowerCase();\n for (const sw of PDS_SOFTWARE_REGISTRY) {\n if (sw.id !== \"bluesky-pds\" && vLower.startsWith(sw.id)) {\n return sw.id;\n }\n }\n\n // 5. Match by known version ranges (non-overlapping major.minor prefixes)\n if (semver) {\n for (const range of VERSION_RANGES) {\n if (semver.startsWith(range.prefix)) {\n return range.softwareId;\n }\n }\n }\n\n return null;\n}\n\nfunction esc(str: string): string {\n return str\n .replace(/&/g, \"&\")\n .replace(//g, \">\")\n .replace(/\"/g, \""\")\n .replace(/'/g, \"'\");\n}\n\nexport { pages };\n",[],[198,375,367],"routes","ac8b1bc2-14c9-11f1-ad92-42dde27851f2","api.ts","1eccef46-0a91-11f1-a315-42dde27851f2",84,["D",1772299184036],3,"import { Hono } from \"https://esm.sh/hono@4.4.0\";\nimport {\n getAllServers,\n getMetadata,\n getServerCount,\n} from \"../database/queries.ts\";\nimport { getTrackedSoftware } from \"../../shared/constants.ts\";\nimport type { LatestVersionMap } from \"../../shared/types.ts\";\n\nconst api = new Hono();\n\napi.get(\"/servers\", async (c) => {\n // Fetch per-software latest versions\n const tracked = getTrackedSoftware();\n const latestVersions: LatestVersionMap = {};\n const versionPromises = tracked.map(async (sw) => {\n const v = await getMetadata(`latest_version:${sw.id}`);\n if (v) latestVersions[sw.id] = v;\n });\n\n const [servers, , counts] = await Promise.all([\n getAllServers(),\n Promise.all(versionPromises),\n getServerCount(),\n ]);\n\n // Backward compat: fall back to legacy key until cron populates new keys\n if (!latestVersions[\"bluesky-pds\"]) {\n const legacy = await getMetadata(\"latest_pds_version\");\n if (legacy) latestVersions[\"bluesky-pds\"] = legacy;\n }\n\n c.header(\n \"Cache-Control\",\n \"public, max-age=3600, stale-while-revalidate=3600\",\n );\n return c.json({\n meta: {\n latest_pds_version: latestVersions[\"bluesky-pds\"] ?? null,\n latest_versions: latestVersions,\n total_known: counts.total,\n total_open: counts.open,\n updated_at: new Date().toISOString(),\n },\n servers,\n });\n});\n\nexport { api };\n",[],[198,375,377],"1e7af2d6-0a91-11f1-a09a-42dde27851f2",["D",1771175382290],[217,218],[198,375],"816b9e54-14c8-11f1-be81-42dde27851f2","queries.ts","1eb42916-0a91-11f1-a169-42dde27851f2","1e5c8756-0a91-11f1-8d35-42dde27851f2",73,["D",1772298682235],9,"import { sqlite } from \"https://esm.town/v/stevekrouse/sqlite?v=13\";\nimport { METADATA_TABLE, SERVERS_TABLE } from \"../../shared/constants.ts\";\nimport type {\n LatestVersionMap,\n PdsServer,\n ServerToEnrich,\n} from \"../../shared/types.ts\";\n\n// --- Server operations ---\n\nexport async function upsertServer(\n url: string,\n opts: {\n inviteCodeRequired: boolean;\n version: string | null;\n errorAt: number | null;\n isOpen: boolean;\n },\n): Promise {\n const now = new Date().toISOString();\n await sqlite.execute({\n sql: `\n INSERT INTO ${SERVERS_TABLE} (url, first_seen, last_seen, invite_code_required, version, error_at, is_open)\n VALUES (?, ?, ?, ?, ?, ?, ?)\n ON CONFLICT(url) DO UPDATE SET\n last_seen = ?,\n invite_code_required = ?,\n version = COALESCE(?, version),\n error_at = ?,\n is_open = ?\n `,\n args: [\n url,\n now,\n now,\n opts.inviteCodeRequired ? 1 : 0,\n opts.version,\n opts.errorAt,\n opts.isOpen ? 1 : 0,\n now,\n opts.inviteCodeRequired ? 1 : 0,\n opts.version,\n opts.errorAt,\n opts.isOpen ? 1 : 0,\n ],\n });\n}\n\nexport async function updateEnrichment(\n url: string,\n data: {\n version?: string | null;\n did?: string | null;\n phoneVerification?: boolean;\n userDomains?: string[];\n contactEmail?: string | null;\n privacyPolicy?: string | null;\n termsOfService?: string | null;\n userCount?: number | null;\n countryCode?: string | null;\n countryName?: string | null;\n ipAddress?: string | null;\n pdsSoftware?: string | null;\n },\n): Promise {\n const now = new Date().toISOString();\n await sqlite.execute({\n sql: `\n UPDATE ${SERVERS_TABLE} SET\n last_enriched = ?,\n version = COALESCE(?, version),\n did = COALESCE(?, did),\n phone_verification = ?,\n user_domains = ?,\n contact_email = ?,\n privacy_policy = ?,\n terms_of_service = ?,\n user_count = COALESCE(?, user_count),\n country_code = COALESCE(?, country_code),\n country_name = COALESCE(?, country_name),\n ip_address = COALESCE(?, ip_address),\n pds_software = COALESCE(?, pds_software)\n WHERE url = ?\n `,\n args: [\n now,\n data.version ?? null,\n data.did ?? null,\n data.phoneVerification ? 1 : 0,\n data.userDomains ? JSON.stringify(data.userDomains) : null,\n data.contactEmail ?? null,\n data.privacyPolicy ?? null,\n data.termsOfService ?? null,\n data.userCount ?? null,\n data.countryCode ?? null,\n data.countryName ?? null,\n data.ipAddress ?? null,\n data.pdsSoftware ?? null,\n url,\n ],\n });\n}\n\nexport async function getServersToEnrich(\n limit: number,\n): Promise {\n const result = await sqlite.execute({\n sql: `\n SELECT url, ip_address, country_code, country_name, last_enriched\n FROM ${SERVERS_TABLE}\n WHERE is_open = 1\n ORDER BY\n CASE WHEN last_enriched IS NULL THEN 0\n WHEN version IS NOT NULL AND user_count IS NULL THEN 1\n WHEN version IS NOT NULL THEN 2\n ELSE 3\n END,\n last_enriched ASC NULLS FIRST\n LIMIT ?\n `,\n args: [limit],\n });\n return result.rows.map((r) => ({\n url: r.url as string,\n ipAddress: (r.ip_address as string) || null,\n countryCode: (r.country_code as string) || null,\n countryName: (r.country_name as string) || null,\n lastEnriched: (r.last_enriched as string) || null,\n }));\n}\n\nexport async function getOpenServers(\n latestVersions: LatestVersionMap = {},\n): Promise {\n // Build per-software version CASE expression\n // Servers with known tracked software: compare against that software's latest\n // Servers with link-only software (not in latestVersions): pass (benefit of the doubt)\n // Servers with NULL pds_software: default to bluesky-pds comparison\n const trackedIds = Object.keys(latestVersions);\n const args: (string | number)[] = [];\n\n let versionCaseExpr: string;\n if (trackedIds.length === 0) {\n versionCaseExpr = \"0\";\n } else {\n const whenClauses: string[] = [];\n for (const id of trackedIds) {\n // Match servers assigned to this software\n whenClauses.push(\"WHEN pds_software = ? AND version = ? THEN 20\");\n args.push(id, latestVersions[id]);\n }\n // NULL pds_software defaults to bluesky-pds comparison\n if (latestVersions[\"bluesky-pds\"]) {\n whenClauses.push(\n \"WHEN pds_software IS NULL AND version = ? THEN 20\",\n );\n args.push(latestVersions[\"bluesky-pds\"]);\n }\n // Software with no entry in latestVersions (link-only): pass\n whenClauses.push(\n `WHEN pds_software IS NOT NULL AND pds_software NOT IN (${\n trackedIds.map(() => \"?\").join(\",\")\n }) THEN 20`,\n );\n args.push(...trackedIds);\n\n versionCaseExpr = `CASE ${whenClauses.join(\" \")} ELSE 0 END`;\n }\n\n const trustScoreExpr = `(\n (CASE WHEN contact_email IS NOT NULL THEN 20 ELSE 0 END) +\n (CASE WHEN terms_of_service IS NOT NULL THEN 20 ELSE 0 END) +\n (CASE WHEN privacy_policy IS NOT NULL THEN 20 ELSE 0 END) +\n (CASE WHEN user_count > 5 THEN 20 ELSE 0 END) +\n ${versionCaseExpr}\n )`;\n\n const result = await sqlite.execute({\n sql: `\n SELECT * FROM ${SERVERS_TABLE}\n WHERE is_open = 1 AND last_enriched IS NOT NULL AND version IS NOT NULL\n ORDER BY ${trustScoreExpr} DESC, user_count DESC NULLS LAST\n `,\n args,\n });\n\n return result.rows.map(rowToServer);\n}\n\nexport async function getAllServers(): Promise {\n const result = await sqlite.execute(\n `SELECT * FROM ${SERVERS_TABLE} WHERE is_open = 1 AND version IS NOT NULL ORDER BY user_count DESC NULLS LAST`,\n );\n return result.rows.map(rowToServer);\n}\n\nexport async function getServerCount(): Promise<\n { open: number; total: number }\n> {\n const result = await sqlite.execute(\n `SELECT COUNT(*) as total, SUM(CASE WHEN is_open = 1 THEN 1 ELSE 0 END) as open FROM ${SERVERS_TABLE}`,\n );\n const row = result.rows[0];\n return {\n total: (row.total as number) || 0,\n open: (row.open as number) || 0,\n };\n}\n\n// --- Metadata operations ---\n\nexport async function getMetadata(key: string): Promise {\n const result = await sqlite.execute({\n sql: `SELECT value FROM ${METADATA_TABLE} WHERE key = ?`,\n args: [key],\n });\n return result.rows.length > 0 ? (result.rows[0].value as string) : null;\n}\n\nexport async function setMetadata(key: string, value: string): Promise {\n await sqlite.execute({\n sql: `\n INSERT INTO ${METADATA_TABLE} (key, value) VALUES (?, ?)\n ON CONFLICT(key) DO UPDATE SET value = ?\n `,\n args: [key, value, value],\n });\n}\n\n// --- Helpers ---\n\nfunction rowToServer(row: Record): PdsServer {\n return {\n url: row.url as string,\n first_seen: row.first_seen as string,\n last_seen: row.last_seen as string,\n last_enriched: (row.last_enriched as string) || null,\n version: (row.version as string) || null,\n pds_software: (row.pds_software as string) || null,\n did: (row.did as string) || null,\n invite_code_required: Boolean(row.invite_code_required),\n phone_verification: Boolean(row.phone_verification),\n user_domains: row.user_domains\n ? JSON.parse(row.user_domains as string)\n : [],\n contact_email: (row.contact_email as string) || null,\n privacy_policy: (row.privacy_policy as string) || null,\n terms_of_service: (row.terms_of_service as string) || null,\n user_count: row.user_count != null ? Number(row.user_count) : null,\n country_code: (row.country_code as string) || null,\n country_name: (row.country_name as string) || null,\n ip_address: (row.ip_address as string) || null,\n is_open: Boolean(row.is_open),\n error_at: row.error_at != null ? Number(row.error_at) : null,\n };\n}\n",[],[198,399,390],"database","818ffeb6-14c8-11f1-958b-42dde27851f2","migrations.ts","1ebd23c2-0a91-11f1-9740-42dde27851f2",77,["D",1772298682439],"import { sqlite } from \"https://esm.town/v/stevekrouse/sqlite?v=13\";\nimport { METADATA_TABLE, SERVERS_TABLE } from \"../../shared/constants.ts\";\n\nexport async function runMigrations(): Promise {\n await sqlite.execute(`\n CREATE TABLE IF NOT EXISTS ${SERVERS_TABLE} (\n url TEXT PRIMARY KEY,\n first_seen TEXT NOT NULL,\n last_seen TEXT NOT NULL,\n last_enriched TEXT,\n version TEXT,\n did TEXT,\n invite_code_required INTEGER NOT NULL DEFAULT 0,\n phone_verification INTEGER NOT NULL DEFAULT 0,\n user_domains TEXT,\n contact_email TEXT,\n privacy_policy TEXT,\n terms_of_service TEXT,\n user_count INTEGER,\n country_code TEXT,\n country_name TEXT,\n ip_address TEXT,\n is_open INTEGER NOT NULL DEFAULT 0,\n error_at INTEGER\n )\n `);\n\n await sqlite.execute(`\n CREATE INDEX IF NOT EXISTS idx_${SERVERS_TABLE}_is_open\n ON ${SERVERS_TABLE} (is_open)\n `);\n\n await sqlite.execute(`\n CREATE INDEX IF NOT EXISTS idx_${SERVERS_TABLE}_last_enriched\n ON ${SERVERS_TABLE} (last_enriched)\n `);\n\n await sqlite.execute(`\n CREATE TABLE IF NOT EXISTS ${METADATA_TABLE} (\n key TEXT PRIMARY KEY,\n value TEXT NOT NULL\n )\n `);\n\n // Add pds_software column (idempotent — ignore if it already exists)\n try {\n await sqlite.execute(\n `ALTER TABLE ${SERVERS_TABLE} ADD COLUMN pds_software TEXT`,\n );\n } catch {\n // Column already exists\n }\n}\n",[],[198,399,401],"1e5c86ac-0a91-11f1-8d35-42dde27851f2",5,["D",1771175382101],[214,215],[198,399],["D",1771175381220],[213,216,219,224],[198],["D",1771175379615],{"_92":91,"_100":96},{"_92":91,"_93":94,"_95":96,"_18":52,"_97":98,"_99":24},{"_13":81,"_31":82,"_40":39,"_83":41,"_84":-5,"_85":-5,"_86":-5,"_87":-5,"_88":-5,"_89":42,"_90":91},"ctx",{"_74":-5,"_121":453,"_454":455,"_456":457,"_458":24,"_459":24,"_460":24,"_461":119,"_462":-5,"_463":-7,"_464":-7,"_465":58,"_466":24,"_467":24,"_468":-5,"_469":24,"_470":24,"_471":24,"_472":-5},"ENV",{"_424":425,"_426":427,"_428":82,"_429":430,"_431":432,"_433":434,"_435":436,"_437":438,"_439":440,"_441":442,"_443":444,"_445":446,"_447":448,"_449":450,"_451":452},"REACT_APP_SENTRY_DSN","https://586020d86f05489db63a554690acf1e9@o1398359.ingest.sentry.io/6724499","RENDER_GIT_COMMIT","e87eb04e707cf64e7e532c8e8ec395f209e17f15","RENDER_GIT_BRANCH","POSTHOG_API_TOKEN","phc_nmoyuAkStEZuUp69rYlg1DZgrIt19Gx0Y4Hwf8tGgJP","POSTHOG_API_HOST","https://wart.val.town","WEB_API_TEMPLATE","https://{val}.web.val.run","APP_URL","https://www.val.town","MODULE_URL","https://esm.town","VANITY_WEB_API_TEMPLATE","https://{label}.val.run/","DENOLS_URL","https://lsp.val.town","NODE_ENV","production","CLOUDFLARE_TURNSTILE_SITE_KEY","0x4AAAAAACtaIZJH7s9rBMZ6","GOOGLE_CLIENT_ID","875989696899-jtsqkhlbdv5jrlsk8631p7ipjg3c6o62.apps.googleusercontent.com","STRIPE_PUBLISHABLE_KEY","pk_live_51N2zvWEpZTTLipIkVEwXrUG9AT0yeOOEYxszarZT1jpsZV58Ly6wlg3SltZpHN26CUalOBmUSY7adQRQiSkCZz2500qSXNkf8Y","API_URL","https://api.val.town",[],"preferencesKeybindings","default","preferencesTheme","light","preferencesFixers","preferencesCopilot","preferencesSelectionAi","preferencesCloseBrackets","preferencesChatPanelState","preferencesDprint","preferencesDenofmt","notificationCount","flagDenols","isBusinessOrgMember","businessOrgHandle","isBusinessOrgAdmin","isHigherTownieTier","navCollapsed","currentOrgId"]

Diff · v92