Hi

\"\n});\n```\n\n## Val Town Utility Functions\n\nVal Town provides several utility functions to help with common project tasks.\n\n### Importing Utilities\n\nAlways import utilities with version pins to avoid breaking changes:\n\n```ts\nimport { parseProject, readFile, serveFile } from \"https://esm.town/v/std/utils@85-main/index.ts\";\n```\n\n### Available Utilities\n\n\n#### **serveFile** - Serve project files with proper content types\n\nFor example, in Hono:\n\n```ts\n// serve all files in frontend/ and shared/\napp.get(\"/frontend/*\", c => serveFile(c.req.path, import.meta.url));\napp.get(\"/shared/*\", c => serveFile(c.req.path, import.meta.url));\n```\n\n#### **readFile** - Read files from within the project:\n\n```ts\n// Read a file from the project\nconst fileContent = await readFile(\"/frontend/index.html\", import.meta.url);\n```\n\n#### **listFiles** - List all files in the project\n\n```ts\nconst files = await listFiles(import.meta.url);\n```\n\n#### **parseProject** - Extract information about the current project from import.meta.url\n\nThis is useful for including info for linking back to a val, ie in \"view source\" urls:\n\n```ts\nconst projectVal = parseProject(import.meta.url);\nconsole.log(projectVal.username); // Owner of the project\nconsole.log(projectVal.name); // Project name\nconsole.log(projectVal.version); // Version number\nconsole.log(projectVal.branch); // Branch name\nconsole.log(projectVal.links.self.project); // URL to the project page\n```\n\nHowever, it's *extremely importing* to note that `parseProject` and other Standard Library utilities ONLY RUN ON THE SERVER.\nIf you need access to this data on the client, run it in the server and pass it to the client by splicing it into the HTML page\nor by making an API request for it.\n\n## Val Town Platform Specifics\n\n- **Redirects:** Use `return new Response(null, { status: 302, headers: { Location: \"/place/to/redirect\" }})` instead of `Response.redirect` which is broken\n- **Images:** Avoid external images or base64 images. Use emojis, unicode symbols, or icon fonts/libraries instead\n- **AI Image:** To inline generate an AI image use: `

`\n- **Storage:** DO NOT use the Deno KV module for storage\n- **Browser APIs:** DO NOT use the `alert()`, `prompt()`, or `confirm()` methods\n- **Weather Data:** Use open-meteo for weather data (doesn't require API keys) unless otherwise specified\n- **View Source:** Add a view source link by importing & using `import.meta.url.replace(\"ems.sh\", \"val.town)\"` (or passing this data to the client) and include `target=\"_top\"` attribute\n- **Error Debugging:** Add `` to HTML to capture client-side errors\n- **Error Handling:** Only use try...catch when there's a clear local resolution; Avoid catches that merely log or return 500s. Let errors bubble up with full context\n- **Environment Variables:** Use `Deno.env.get('keyname')` when you need to, but generally prefer APIs that don't require keys\n- **Imports:** Use `https://esm.sh` for npm and Deno dependencies to ensure compatibility on server and browser\n- **Storage Strategy:** Only use backend storage if explicitly required; prefer simple static client-side sites\n- **React Configuration:** When using React libraries, pin versions with `?deps=react@18.2.0,react-dom@18.2.0` and start the file with `/** @jsxImportSource https://esm.sh/react@18.2.0 */`\n- Ensure all React dependencies and sub-dependencies are pinned to the same version\n- **Styling:** Default to using TailwindCSS via `` unless otherwise specified\n\n## Project Structure and Design Patterns\n\n### Recommended Directory Structure\n```\n├── backend/\n│ ├── database/\n│ │ ├── migrations.ts # Schema definitions\n│ │ ├── queries.ts # DB query functions\n│ │ └── README.md\n│ └── routes/ # Route modules\n│ ├── [route].ts\n│ └── static.ts # Static file serving\n│ ├── index.ts # Main entry point\n│ └── README.md\n├── frontend/\n│ ├── components/\n│ │ ├── App.tsx\n│ │ └── [Component].tsx\n│ ├── favicon.svg\n│ ├── index.html # Main HTML template\n│ ├── index.tsx # Frontend JS entry point\n│ ├── README.md\n│ └── style.css\n├── README.md\n└── shared/\n ├── README.md\n └── utils.ts # Shared types and functions\n```\n\n### Backend (Hono) Best Practices\n\n- Hono is the recommended API framework\n- Main entry point should be `backend/index.ts`\n- **Static asset serving:** Use the utility functions to read and serve project files:\n ```ts\n import { readFile, serveFile } from \"https://esm.town/v/std/utils@85-main/index.ts\";\n \n // serve all files in frontend/ and shared/\n app.get(\"/frontend/*\", c => serveFile(c.req.path, import.meta.url));\n app.get(\"/shared/*\", c => serveFile(c.req.path, import.meta.url));\n \n // For index.html, often you'll want to bootstrap with initial data\n app.get(\"/\", async c => {\n let html = await readFile(\"/frontend/index.html\", import.meta.url);\n \n // Inject data to avoid extra round-trips\n const initialData = await fetchInitialData();\n const dataScript = ``;\n \n html = html.replace(\"\", `${dataScript}`);\n return c.html(html);\n });\n ```\n- Create RESTful API routes for CRUD operations\n- Always include this snippet at the top-level Hono app to re-throwing errors to see full stack traces:\n ```ts\n // Unwrap Hono errors to see original error details\n app.onError((err, c) => {\n throw err;\n });\n ```\n\n### Database Patterns\n- Run migrations on startup or comment out for performance\n- Change table names when modifying schemas rather than altering\n- Export clear query functions with proper TypeScript typing\n\n## Common Gotchas and Solutions\n\n1. **Environment Limitations:** \n - Val Town runs on Deno in a serverless context, not Node.js\n - Code in `shared/` must work in both frontend and backend environments\n - Cannot use `Deno` keyword in shared code\n - Use `https://esm.sh` for imports that work in both environments\n\n2. **SQLite Peculiarities:**\n - Limited support for ALTER TABLE operations\n - Create new tables with updated schemas and copy data when needed\n - Always run table creation before querying\n\n3. **React Configuration:**\n - All React dependencies must be pinned to 18.2.0\n - Always include `@jsxImportSource https://esm.sh/react@18.2.0` at the top of React files\n - Rendering issues often come from mismatched React versions\n\n4. **File Handling:**\n - Val Town only supports text files, not binary\n - Use the provided utilities to read files across branches and forks\n - For files in the project, use `readFile` helpers\n\n5. **API Design:**\n - `fetch` handler is the entry point for HTTP vals\n - Run the Hono app with `export default app.fetch // This is the entry point for HTTP vals`\n\n",[],[194],"b3f0f2ce-a3f4-11f0-b63b-0224a6c84d84",".vtignore","b3f0f3be-a3f4-11f0-b63b-0224a6c84d84",10,["D",1759893183389],".git\n.vscode\n.cursorrules\n.DS_Store\nnode_modules\nvendor",[],[202],"b3d8c726-a3f4-11f0-b63b-0224a6c84d84","atprotoTestData.ts","b3d8c83e-a3f4-11f0-b63b-0224a6c84d84","b3a2ee94-a3f4-11f0-8e27-0224a6c84d84",8,["D",1759893183308],"script","export const TESTDATA_COLLECTION = \"org.newtoncivic.atproto.testdata\" as const;\n\nexport const TESTDATA_LEXICON = `{\n \"$schema\": \"https://lexicon.atproto.com/schema.json\",\n \"lexicon\": 1,\n \"id\": \"org.newtoncivic.atproto.testdata\",\n \"defs\": {\n \"main\": {\n \"type\": \"record\",\n \"key\": \"tid\",\n \"record\": {\n \"type\": \"object\",\n \"description\": \"Demo record for publishing structured telemetry readings to Bluesky.\",\n \"required\": [\n \"createdAt\",\n \"schemaVersion\",\n \"label\",\n \"value\"\n ],\n \"properties\": {\n \"createdAt\": {\n \"type\": \"datetime\",\n \"description\": \"ISO8601 timestamp for when this reading was created.\"\n },\n \"schemaVersion\": {\n \"type\": \"integer\",\n \"minimum\": 1,\n \"description\": \"Schema version of the payload to allow evolution over time.\"\n },\n \"label\": {\n \"type\": \"string\",\n \"maxLength\": 128,\n \"description\": \"Short identifier for the kind of reading.\"\n },\n \"value\": {\n \"type\": \"number\",\n \"description\": \"Numeric reading captured for the label.\"\n },\n \"unit\": {\n \"type\": \"string\",\n \"maxLength\": 16,\n \"description\": \"Optional unit describing the numeric value (e.g. %, ms, C).\"\n },\n \"notes\": {\n \"type\": \"string\",\n \"maxLength\": 512,\n \"description\": \"Optional human readable context for this reading.\"\n },\n \"metadata\": {\n \"type\": \"ref\",\n \"ref\": \"lex:com.atproto.repo.strongRef\",\n \"description\": \"Optional pointer to a related record for richer correlation.\"\n }\n }\n }\n }\n }\n}`;\n\nexport interface TestDataRecord {\n $type: typeof TESTDATA_COLLECTION;\n createdAt: string;\n schemaVersion: number;\n label: string;\n value: number;\n unit?: string;\n notes?: string;\n metadata?: {\n cid: string;\n uri: string;\n };\n}\n\nexport interface CreateTestDataInput {\n label: string;\n value: number;\n unit?: string;\n notes?: string;\n metadata?: {\n cid: string;\n uri: string;\n };\n}\n\nexport function buildTestDataRecord(input: CreateTestDataInput): TestDataRecord {\n const { label, value, unit, notes, metadata } = input;\n if (!label?.trim()) {\n throw new Error(\"label must be a non-empty string\");\n }\n if (!Number.isFinite(value)) {\n throw new Error(\"value must be a finite number\");\n }\n const record: TestDataRecord = {\n $type: TESTDATA_COLLECTION,\n createdAt: new Date().toISOString(),\n schemaVersion: 1,\n label: label.trim(),\n value,\n };\n if (unit) {\n record.unit = unit;\n }\n if (notes) {\n record.notes = notes;\n }\n if (metadata) {\n if (!metadata.cid || !metadata.uri) {\n throw new Error(\"metadata must include cid and uri when provided\");\n }\n record.metadata = metadata;\n }\n return record;\n}\n",[],[219,210],"shared","b3a2edfe-a3f4-11f0-8e27-0224a6c84d84",2,["D",1759893182958],[180],[219],["D",1760496487923],[],[18,64],["D",1760496487746],[178],[18],"a0682148-a7df-11f0-b16b-0224a6c84d84","viewCreatorRecords.http.ts","279e5a76-a7ac-11f0-8da6-0224a6c84d84","b39211d2-a3f4-11f0-99aa-0224a6c84d84",32,["D",1760323935907],6,"http","import { BskyAgent } from \"https://esm.sh/@atproto/api@0.13.18?target=deno\";\nimport {\n TESTDATA_COLLECTION,\n TestDataRecord,\n} from \"../shared/atprotoTestData.ts\";\n\nconst SERVICE_URL = Deno.env.get(\"BLUESKY_SERVICE_URL\") ??\n \"https://bsky.social\";\nconst IDENTIFIER = Deno.env.get(\"BLUESKY_HANDLE\");\nconst APP_PASSWORD = Deno.env.get(\"BLUESKY_APP_PASSWORD\");\nconst MAX_TOTAL = Number(Deno.env.get(\"LIST_MAX_RECORDS\") ?? 500);\n\ninterface RepoRecord {\n uri: string;\n cid: string;\n value: TRecord;\n repo: string;\n collection: string;\n rkey: string;\n indexedAt: string;\n}\n\ninterface CreatorRecordsResponse {\n repo: string;\n did: string | null;\n collection: string;\n count: number;\n truncated: boolean;\n records: Array>;\n}\n\nexport default async function viewCreatorRecords(\n req: Request,\n): Promise {\n if (req.method !== \"GET\") {\n return new Response(\"Method Not Allowed\", { status: 405 });\n }\n\n const { identifier, appPassword } = ensureCredentials();\n const agent = new BskyAgent({ service: SERVICE_URL });\n await agent.login({ identifier, password: appPassword });\n\n const repoDid = agent.session?.did ?? null;\n const repo = repoDid ?? identifier;\n const records = await fetchAllRecords(agent, { repoDid, repo });\n\n const body: CreatorRecordsResponse = {\n repo,\n did: repoDid,\n collection: TESTDATA_COLLECTION,\n count: records.length,\n truncated: records.length >= MAX_TOTAL,\n records,\n };\n\n return json(body);\n}\n\nasync function fetchAllRecords(\n agent: BskyAgent,\n params: { repoDid: string | null; repo: string },\n): Promise>> {\n const { repoDid, repo } = params;\n const items: Array> = [];\n let cursor: string | undefined;\n\n while (items.length < MAX_TOTAL) {\n const limit = Math.min(100, MAX_TOTAL - items.length);\n const repoParam = repoDid ?? repo;\n if (!repoParam) {\n throw new Error(\"Unable to determine repo identifier for listRecords\");\n }\n const response = await agent.com.atproto.repo.listRecords({\n repo: repoParam,\n collection: TESTDATA_COLLECTION,\n limit,\n cursor,\n reverse: true,\n });\n\n for (const record of response.data.records ?? []) {\n items.push(record as RepoRecord);\n }\n\n if (!response.data.cursor) {\n break;\n }\n cursor = response.data.cursor;\n }\n\n return items;\n}\n\nfunction ensureCredentials(): { identifier: string; appPassword: string } {\n if (!IDENTIFIER) {\n throw new Error(\"BLUESKY_HANDLE environment variable is required\");\n }\n if (!APP_PASSWORD) {\n throw new Error(\"BLUESKY_APP_PASSWORD environment variable is required\");\n }\n return { identifier: IDENTIFIER, appPassword: APP_PASSWORD };\n}\n\nfunction json(body: unknown, status = 200): Response {\n return new Response(JSON.stringify(body, null, 2), {\n status,\n headers: { \"content-type\": \"application/json; charset=utf-8\" },\n });\n}\n",[],[242,232],"backend","b3d4a16e-a3f4-11f0-8549-0224a6c84d84","testDataViewer.http.tsx","b3d4a236-a3f4-11f0-8549-0224a6c84d84",7,["D",1759893183249],"import { Hono } from \"https://esm.sh/hono@3.11.12?target=deno\";\nimport {\n ensureTestDataTable,\n listRecentTestData,\n TESTDATA_TABLE,\n} from \"./database/queries.ts\";\n\nconst DEFAULT_LIMIT = 20;\n\nconst app = new Hono();\n\n// Unwrap Hono errors so Deno surfaces full stack traces in logs\napp.onError((err) => {\n throw err;\n});\n\napp.get(\"/data.json\", async (c) => {\n await ensureTestDataTable();\n const limit = getLimitFromRequest(c.req.query(\"limit\"));\n const rows = await listRecentTestData(limit);\n return c.json({\n table: TESTDATA_TABLE,\n limit,\n count: rows.length,\n rows,\n });\n});\n\napp.get(\"/\", async (c) => {\n await ensureTestDataTable();\n const limit = getLimitFromRequest(c.req.query(\"limit\"));\n const rows = await listRecentTestData(limit);\n const viewSourceUrl = import.meta.url.replace(\"ems.sh\", \"val.town\");\n const body = renderHtml({ rows, limit, viewSourceUrl });\n return c.html(body);\n});\n\nfunction getLimitFromRequest(limitParam: string | undefined): number {\n const limit = Number(limitParam ?? DEFAULT_LIMIT);\n if (!Number.isFinite(limit) || limit <= 0) {\n return DEFAULT_LIMIT;\n }\n return Math.min(Math.floor(limit), 200);\n}\n\ninterface RenderHtmlParams {\n rows: Awaited>;\n limit: number;\n viewSourceUrl: string;\n}\n\nfunction renderHtml({ rows, limit, viewSourceUrl }: RenderHtmlParams): string {\n const rowsMarkup = rows\n .map((row) => {\n const record = JSON.stringify(row.record, null, 2);\n return `

#${row.cursor} ${escapeHtml(row.record.label)} — ${new Date(row.record.createdAt).toLocaleString()} (${row.repo})

${escapeHtml(record)}

repo: ${escapeHtml(row.repo)}
collection: ${escapeHtml(row.collection)}
rkey: ${escapeHtml(row.rkey)}
event time: ${escapeHtml(row.eventTime)}
received at: ${escapeHtml(row.receivedAt)}

`;\n })\n .join(\"\\n\");\n\n return `\n\n \n \n \n \n Bluesky Test Data Feed\n \n \n \n \n

org.newtoncivic Test Data Feed

Showing up to ${limit} most recent records saved from Jetstream.

\n \n

\n ${rows.length ? rowsMarkup : \"

No records found yet.

\"}\n

\n \n`;\n}\n\nfunction escapeHtml(value: string): string {\n return value\n .replace(/&/g, \"&\")\n .replace(//g, \">\")\n .replace(/\"/g, \""\")\n .replace(/'/g, \"'\");\n}\n\nexport default app.fetch;\n",[],[242,244],"a061ac00-a7df-11f0-9f98-0224a6c84d84","postTestData.http.ts",31,["D",1760323935858],"import { BskyAgent } from \"https://esm.sh/@atproto/api@0.13.18?target=deno\";\nimport {\n buildTestDataRecord,\n TESTDATA_COLLECTION,\n TESTDATA_LEXICON,\n} from \"../shared/atprotoTestData.ts\";\n\ninterface PostRequestBody {\n label?: string;\n value?: number;\n unit?: string;\n notes?: string;\n metadata?: {\n cid: string;\n uri: string;\n };\n}\n\nconst SERVICE_URL = Deno.env.get(\"BLUESKY_SERVICE_URL\") ??\n \"https://bsky.social\";\nconst IDENTIFIER = Deno.env.get(\"BLUESKY_HANDLE\");\nconst APP_PASSWORD = Deno.env.get(\"BLUESKY_APP_PASSWORD\");\n\nfunction ensureCredentials(): { identifier: string; appPassword: string } {\n if (!IDENTIFIER) {\n throw new Error(\"BLUESKY_HANDLE environment variable is required\");\n }\n if (!APP_PASSWORD) {\n throw new Error(\"BLUESKY_APP_PASSWORD environment variable is required\");\n }\n return { identifier: IDENTIFIER, appPassword: APP_PASSWORD };\n}\n\nfunction okJson(data: unknown, status = 200) {\n return new Response(JSON.stringify(data, null, 2), {\n status,\n headers: { \"content-type\": \"application/json; charset=utf-8\" },\n });\n}\n\nexport default async function postTestData(req: Request): Promise {\n if (req.method === \"GET\") {\n return okJson({\n message:\n \"POST to this endpoint to create a custom testdata record on Bluesky\",\n expectedBody: {\n label: \"string\",\n value: \"number\",\n unit: \"string?\",\n notes: \"string?\",\n metadata: { cid: \"string\", uri: \"at://...\" },\n },\n collection: TESTDATA_COLLECTION,\n lexicon: TESTDATA_LEXICON,\n });\n }\n\n if (req.method !== \"POST\") {\n return new Response(\"Method Not Allowed\", { status: 405 });\n }\n\n let body: PostRequestBody;\n try {\n body = (await req.json()) as PostRequestBody;\n } catch (error) {\n return okJson(\n { error: \"Invalid JSON payload\", details: String(error) },\n 400,\n );\n }\n\n const { label, value, unit, notes, metadata } = body;\n if (typeof value !== \"number\") {\n return okJson({ error: \"value must be provided as a number\" }, 400);\n }\n\n const record = buildTestDataRecord({\n label: label ?? \"demo\",\n value,\n unit,\n notes,\n metadata,\n });\n\n const { identifier, appPassword } = ensureCredentials();\n const agent = new BskyAgent({ service: SERVICE_URL });\n await agent.login({ identifier, password: appPassword });\n const repo = agent.session?.did ?? identifier;\n\n const creation = await agent.com.atproto.repo.createRecord({\n repo,\n collection: TESTDATA_COLLECTION,\n record,\n validate: false,\n });\n\n const latest = await agent.com.atproto.repo.listRecords({\n repo,\n collection: TESTDATA_COLLECTION,\n limit: 1,\n reverse: true,\n });\n\n const { uri, cid } = creation.data;\n const newest = latest.data.records?.[0];\n const confirmed = Boolean(newest && newest.cid === cid);\n const effectiveUri = uri ?? newest?.uri ?? null;\n const rkey = effectiveUri ? extractRkey(effectiveUri) : null;\n\n return okJson({ repo, uri: effectiveUri, cid, record, rkey, confirmed });\n}\n\nfunction extractRkey(uri: string | undefined): string {\n if (!uri) {\n return \"\";\n }\n const parts = uri.split(\"/\");\n return parts[parts.length - 1] ?? \"\";\n}\n",[],[242,252],"5f5a8e04-a972-11f0-a423-0224a6c84d84","jetstreamSimple.cron.ts","6169645a-a971-11f0-a039-0224a6c84d84",["D",1760496913921],"interval","// Simple Jetstream example that listens for custom test data records\n// This demonstrates the correct Jetstream API usage per the official docs\n\nimport { BskyAgent } from \"https://esm.sh/@atproto/api@0.13.18?target=deno\";\nimport {\n TESTDATA_COLLECTION,\n TestDataRecord,\n} from \"../shared/atprotoTestData.ts\";\nimport {\n ensureTestDataTable,\n getLatestCursor,\n insertTestDataRow,\n} from \"./database/queries.ts\";\n\n// Official Jetstream instances (configurable via env)\nconst JETSTREAM_URL = Deno.env.get(\"JETSTREAM_URL\") ??\n \"wss://jetstream2.us-east.bsky.network/subscribe\";\nconst APPVIEW_SERVICE_URL = Deno.env.get(\"BLUESKY_SERVICE_URL\") ??\n \"https://bsky.social\";\n\n// Timeout and limits for the cron job\nconst STREAM_TIMEOUT_MS = 15000; // 15 seconds\nconst MAX_EVENTS = 50; // Process up to 50 events per run\n\n// Jetstream message structure per the official docs\ninterface JetstreamCommitEvent {\n did: string;\n time_us: number; // Unix microseconds timestamp\n kind: \"commit\";\n commit: {\n rev: string;\n operation: \"create\" | \"update\" | \"delete\";\n collection: string;\n rkey: string;\n record?: unknown; // Only present for create/update\n cid?: string;\n };\n}\n\nexport default async function jetstreamSimple(): Promise {\n // Ensure database is ready\n await ensureTestDataTable();\n\n // Get our last known cursor (time_us from last event)\n const latestCursor = await getLatestCursor();\n\n // Build WebSocket URL with query parameters\n const url = new URL(JETSTREAM_URL);\n\n // Filter for only our custom collection\n url.searchParams.set(\"wantedCollections\", TESTDATA_COLLECTION);\n\n // Resume from last cursor if we have one (subtract 5 seconds for safety)\n if (typeof latestCursor === \"number\" && latestCursor > 0) {\n const rewindCursor = latestCursor - 500_000_000; // 500 seconds in microseconds\n url.searchParams.set(\"cursor\", rewindCursor.toString());\n }\n\n console.log(`Connecting to Jetstream: ${url.toString()}`);\n\n // Set up Bluesky agent for fetching full records\n const agent = new BskyAgent({ service: APPVIEW_SERVICE_URL });\n const identifier = Deno.env.get(\"BLUESKY_HANDLE\");\n const appPassword = Deno.env.get(\"BLUESKY_APP_PASSWORD\");\n\n if (!identifier || !appPassword) {\n throw new Error(\"BLUESKY_HANDLE and BLUESKY_APP_PASSWORD required\");\n }\n\n await agent.login({ identifier, password: appPassword });\n\n // Track what we process\n let eventsProcessed = 0;\n let eventsStored = 0;\n let highestCursor = latestCursor || 0;\n\n // Connect to Jetstream WebSocket\n const ws = new WebSocket(url.toString());\n\n await new Promise((resolve, reject) => {\n // Timeout to ensure cron doesn't run forever\n const timeout = setTimeout(() => {\n console.log(\"Timeout reached, closing connection\");\n ws.close();\n }, STREAM_TIMEOUT_MS);\n\n ws.addEventListener(\"open\", () => {\n console.log(\"Connected to Jetstream\");\n });\n\n ws.addEventListener(\"message\", async (event) => {\n try {\n const message = JSON.parse(event.data) as JetstreamCommitEvent;\n\n // Only process commit events for our collection\n if (\n message.kind === \"commit\" &&\n message.commit.collection === TESTDATA_COLLECTION &&\n (message.commit.operation === \"create\" ||\n message.commit.operation === \"update\")\n ) {\n console.log(\n `Processing ${message.commit.operation} for ${message.did}/${message.commit.rkey}`,\n );\n\n // Fetch the full record from the appview\n try {\n const recordResponse = await agent.com.atproto.repo.getRecord({\n repo: message.did,\n collection: TESTDATA_COLLECTION,\n rkey: message.commit.rkey,\n });\n\n const record = recordResponse.data.value as TestDataRecord;\n\n // Store in our database\n await insertTestDataRow({\n cursor: message.time_us,\n repo: message.did,\n collection: TESTDATA_COLLECTION,\n rkey: message.commit.rkey,\n record,\n eventTime: new Date(message.time_us / 1000).toISOString(),\n receivedAt: new Date().toISOString(),\n });\n\n eventsStored++;\n console.log(\n `Stored event: ${record.label} = ${record.value}${\n record.unit || \"\"\n }`,\n );\n } catch (error) {\n console.error(`Failed to fetch/store record:`, error);\n }\n\n eventsProcessed++;\n highestCursor = Math.max(highestCursor, message.time_us);\n\n // Stop if we hit our limit\n if (eventsProcessed >= MAX_EVENTS) {\n console.log(\"Max events reached, closing connection\");\n ws.close();\n }\n }\n } catch (error) {\n console.error(\"Error processing message:\", error);\n }\n });\n\n ws.addEventListener(\"error\", (error) => {\n console.error(\"WebSocket error:\", error);\n clearTimeout(timeout);\n reject(error);\n });\n\n ws.addEventListener(\"close\", () => {\n console.log(\"WebSocket closed\");\n clearTimeout(timeout);\n resolve();\n });\n });\n\n console.log(JSON.stringify(\n {\n eventsProcessed,\n eventsStored,\n startCursor: latestCursor,\n endCursor: highestCursor,\n },\n null,\n 2,\n ));\n}",[],[242,259],"7813bf98-a971-11f0-8e3a-0224a6c84d84","jetstreamAppview.cron.ts","b3d031f6-a3f4-11f0-8e27-0224a6c84d84",39,["D",1760496525929],"import { BskyAgent } from \"https://esm.sh/@atproto/api@0.13.18?target=deno\";\nimport {\n TESTDATA_COLLECTION,\n TestDataRecord,\n} from \"../shared/atprotoTestData.ts\";\nimport {\n ensureTestDataTable,\n getLatestCursor,\n insertTestDataRow,\n TESTDATA_TABLE,\n} from \"./database/queries.ts\";\n\n// The global Jetstream proxy only supports `commit` for now; additional wanted types\n// or other filters would require a custom Jetstream deployment.\nconst DEFAULT_WANTED = \"commit\";\n\nconst JETSTREAM_URL = Deno.env.get(\"JETSTREAM_URL\") ??\n \"https://jetstream.atproto.tools/subscribe\";\nconst APPVIEW_SERVICE_URL = Deno.env.get(\"BLUESKY_SERVICE_URL\") ??\n \"https://bsky.social\";\nconst IDENTIFIER = Deno.env.get(\"BLUESKY_HANDLE\");\nconst APP_PASSWORD = Deno.env.get(\"BLUESKY_APP_PASSWORD\");\nconst STREAM_TIMEOUT_MS = Number(Deno.env.get(\"JETSTREAM_TIMEOUT_MS\") ?? 15000);\nconst MAX_STREAM_EVENTS = Number(Deno.env.get(\"JETSTREAM_MAX_EVENTS\") ?? 64);\nconst REPLAY_MARGIN = Number(Deno.env.get(\"JETSTREAM_REPLAY_MARGIN\") ?? 5);\n\nfunction ensureCredentials(): { identifier: string; appPassword: string } {\n if (!IDENTIFIER) {\n throw new Error(\"BLUESKY_HANDLE environment variable is required\");\n }\n if (!APP_PASSWORD) {\n throw new Error(\"BLUESKY_APP_PASSWORD environment variable is required\");\n }\n return { identifier: IDENTIFIER, appPassword: APP_PASSWORD };\n}\n\ninterface JetstreamMessage {\n kind: string;\n seq: number;\n time: string;\n repo?: string;\n commit?: {\n rev: string;\n time: string;\n };\n ops?: Array<{\n action: \"create\" | \"update\" | \"delete\";\n path: string;\n cid?: string | { $link: string };\n }>;\n operations?: Array<{\n action: \"create\" | \"update\" | \"delete\";\n path: string;\n cid?: string | { $link: string };\n }>;\n}\n\ninterface StreamState {\n processedOps: number;\n storedEvents: number;\n highestCursor?: number;\n}\n\nexport default async function jetstreamCron(): Promise {\n await ensureTestDataTable();\n const latestCursor = await getLatestCursor();\n const startCursor = typeof latestCursor === \"number\"\n ? Math.max(latestCursor - REPLAY_MARGIN, 0)\n : undefined;\n\n const agent = new BskyAgent({ service: APPVIEW_SERVICE_URL });\n const { identifier, appPassword } = ensureCredentials();\n await agent.login({ identifier, password: appPassword });\n const state: StreamState = {\n processedOps: 0,\n storedEvents: 0,\n highestCursor: startCursor,\n };\n\n await processJetstream({ agent, startCursor, state });\n\n console.log(\n JSON.stringify(\n {\n event: \"jetstream.sync\",\n table: TESTDATA_TABLE,\n startCursor,\n lastCursor: state.highestCursor ?? startCursor ?? null,\n processedOps: state.processedOps,\n storedEvents: state.storedEvents,\n },\n null,\n 2,\n ),\n );\n}\n\nasync function processJetstream({\n agent,\n startCursor,\n state,\n}: {\n agent: BskyAgent;\n startCursor?: number;\n state: StreamState;\n}): Promise {\n const url = new URL(JETSTREAM_URL);\n if (url.hostname === \"jetstream.atproto.tools\") {\n // The public Jetstream proxy requires `wanted` to be provided explicitly.\n url.searchParams.set(\"wanted\", DEFAULT_WANTED);\n } else if (!url.searchParams.has(\"wanted\")) {\n url.searchParams.set(\"wanted\", DEFAULT_WANTED);\n }\n if (\n typeof startCursor === \"number\" && startCursor > 0 &&\n !url.searchParams.has(\"cursor\")\n ) {\n url.searchParams.set(\"cursor\", startCursor.toString());\n }\n\n const wsUrl = toWebSocketUrl(url);\n const ws = new WebSocket(wsUrl);\n ws.binaryType = \"arraybuffer\";\n\n const tasks: Promise[] = [];\n\n await new Promise((resolve, reject) => {\n const timeout = setTimeout(() => {\n ws.close(1000, \"stream timeout\");\n }, STREAM_TIMEOUT_MS);\n\n ws.addEventListener(\"open\", () => {\n // Connection established; nothing else to send.\n });\n\n ws.addEventListener(\"message\", (event) => {\n if (state.processedOps >= MAX_STREAM_EVENTS) {\n ws.close(1000, \"reached max events\");\n return;\n }\n const task = normalizeEventData(event.data)\n .then((payload) => handleJetstreamMessage(payload, agent, state))\n .catch((error) => {\n console.error(\"Jetstream message handling error\", error);\n });\n tasks.push(task);\n task.finally(() => {\n if (\n state.processedOps >= MAX_STREAM_EVENTS &&\n ws.readyState === WebSocket.OPEN\n ) {\n ws.close(1000, \"reached max events\");\n }\n });\n });\n\n ws.addEventListener(\"error\", (event) => {\n clearTimeout(timeout);\n reject(new Error(\"Jetstream WebSocket connection error\"));\n });\n\n ws.addEventListener(\"close\", () => {\n clearTimeout(timeout);\n resolve();\n });\n });\n\n if (tasks.length > 0) {\n await Promise.all(tasks);\n }\n}\nasync function handleJetstreamMessage(\n raw: string,\n agent: BskyAgent,\n state: StreamState,\n): Promise {\n if (!raw) {\n return;\n }\n let message: JetstreamMessage;\n try {\n message = JSON.parse(raw) as JetstreamMessage;\n } catch (error) {\n console.error(\"Failed to parse Jetstream payload\", error, raw);\n return;\n }\n const operations = message.ops ?? message.operations;\n if (message.kind !== \"commit\" || !message.repo || !operations) {\n return;\n }\n\n const relevantOps = operations.filter((op) =>\n op.path.startsWith(`${TESTDATA_COLLECTION}/`)\n );\n if (!relevantOps.length) {\n return;\n }\n\n const now = new Date().toISOString();\n for (const op of relevantOps) {\n const [, rkey] = op.path.split(\"/\");\n if (!rkey) {\n continue;\n }\n state.processedOps += 1;\n state.highestCursor = Math.max(state.highestCursor ?? 0, message.seq);\n if (op.action === \"delete\") {\n continue;\n }\n try {\n const recordResponse = await agent.com.atproto.repo.getRecord({\n repo: message.repo,\n collection: TESTDATA_COLLECTION,\n rkey,\n });\n const record = recordResponse.data.value as TestDataRecord;\n if (record.$type !== TESTDATA_COLLECTION) {\n continue;\n }\n await insertTestDataRow({\n cursor: message.seq,\n repo: message.repo,\n collection: TESTDATA_COLLECTION,\n rkey,\n record,\n eventTime: message.time,\n receivedAt: now,\n });\n state.storedEvents += 1;\n } catch (error) {\n console.error(\"Failed to fetch record for op\", { op, error });\n }\n }\n}\n\nfunction toWebSocketUrl(url: URL): string {\n const next = new URL(url.toString());\n if (next.protocol === \"https:\") {\n next.protocol = \"wss:\";\n } else if (next.protocol === \"http:\") {\n next.protocol = \"ws:\";\n }\n return next.toString();\n}\n\nconst binaryDecoder = new TextDecoder();\n\nfunction normalizeEventData(data: unknown): Promise {\n if (typeof data === \"string\") {\n return Promise.resolve(data);\n }\n if (data instanceof ArrayBuffer) {\n return Promise.resolve(binaryDecoder.decode(new Uint8Array(data)));\n }\n if (data instanceof Uint8Array) {\n return Promise.resolve(binaryDecoder.decode(data));\n }\n if (typeof Blob !== \"undefined\" && data instanceof Blob) {\n return data.text();\n }\n if (\n data &&\n typeof (data as { text?: () => Promise }).text === \"function\"\n ) {\n return (data as { text: () => Promise }).text();\n }\n return Promise.resolve(\"\");\n}\n",[],[242,267],"a07884fc-a7df-11f0-a438-0224a6c84d84","autoPostTestData.cron.ts","2055dbe8-a704-11f0-8ebb-0224a6c84d84",34,["D",1760323935858],"import { BskyAgent } from \"https://esm.sh/@atproto/api@0.13.18?target=deno\";\nimport {\n buildTestDataRecord,\n TESTDATA_COLLECTION,\n} from \"../shared/atprotoTestData.ts\";\n\nconst SERVICE_URL = Deno.env.get(\"BLUESKY_SERVICE_URL\") ??\n \"https://bsky.social\";\nconst IDENTIFIER = Deno.env.get(\"BLUESKY_HANDLE\");\nconst APP_PASSWORD = Deno.env.get(\"BLUESKY_APP_PASSWORD\");\n\nfunction ensureCredentials(): { identifier: string; appPassword: string } {\n if (!IDENTIFIER) {\n throw new Error(\"BLUESKY_HANDLE environment variable is required\");\n }\n if (!APP_PASSWORD) {\n throw new Error(\"BLUESKY_APP_PASSWORD environment variable is required\");\n }\n return { identifier: IDENTIFIER, appPassword: APP_PASSWORD };\n}\n\n// Generate random sensor readings for demo purposes\nfunction generateSensorData() {\n const sensors = [\n { label: \"temperature\", min: 65, max: 85, unit: \"°F\" },\n { label: \"humidity\", min: 30, max: 70, unit: \"%\" },\n { label: \"cpu_usage\", min: 10, max: 90, unit: \"%\" },\n { label: \"memory_usage\", min: 40, max: 80, unit: \"%\" },\n { label: \"response_time\", min: 50, max: 500, unit: \"ms\" },\n ];\n\n const sensor = sensors[Math.floor(Math.random() * sensors.length)];\n const value = Number(\n (Math.random() * (sensor.max - sensor.min) + sensor.min).toFixed(2),\n );\n\n return {\n label: sensor.label,\n value,\n unit: sensor.unit,\n notes: `Automated reading from ${new Date().toISOString()}`,\n };\n}\n\nexport default async function autoPostTestData(): Promise {\n const { identifier, appPassword } = ensureCredentials();\n\n // Generate sensor data\n const sensorData = generateSensorData();\n\n // Build the record\n const record = buildTestDataRecord({\n label: sensorData.label,\n value: sensorData.value,\n unit: sensorData.unit,\n notes: sensorData.notes,\n });\n\n // Authenticate and post to Bluesky\n const agent = new BskyAgent({ service: SERVICE_URL });\n await agent.login({ identifier, password: appPassword });\n const repo = agent.session?.did ?? identifier;\n\n const creation = await agent.com.atproto.repo.createRecord({\n repo,\n collection: TESTDATA_COLLECTION,\n record,\n // Skip server-side lexicon validation because this is a custom collection.\n validate: false,\n });\n\n const { uri, cid } = creation.data;\n\n const latest = await agent.com.atproto.repo.listRecords({\n repo,\n collection: TESTDATA_COLLECTION,\n limit: 1,\n reverse: true,\n });\n\n const newest = latest.data.records?.[0];\n const confirmed = Boolean(newest && newest.cid === cid);\n\n console.log({\n event: \"testdata.posted\",\n repo,\n uri: uri ?? newest?.uri ?? null,\n cid,\n label: record.label,\n value: record.value,\n unit: record.unit,\n confirmed,\n });\n}\n",[],[242,275],"b3c4dfea-a3f4-11f0-8e27-0224a6c84d84","queries.ts","b3c4e0d0-a3f4-11f0-8e27-0224a6c84d84","b3b16122-a3f4-11f0-b878-0224a6c84d84",4,["D",1759893183181],"import { sqlite } from \"https://esm.town/v/stevekrouse/sqlite\";\nimport { TESTDATA_COLLECTION, TestDataRecord } from \"../../shared/atprotoTestData.ts\";\n\nexport const TESTDATA_TABLE = \"atproto_test_data\";\n\nexport interface StoredTestDataRow {\n cursor: number;\n repo: string;\n collection: string;\n rkey: string;\n record: TestDataRecord;\n eventTime: string;\n receivedAt: string;\n}\n\nexport async function ensureTestDataTable(): Promise {\n await sqlite.execute(`CREATE TABLE IF NOT EXISTS ${TESTDATA_TABLE} (\n cursor INTEGER PRIMARY KEY,\n repo TEXT NOT NULL,\n collection TEXT NOT NULL,\n rkey TEXT NOT NULL,\n record_json TEXT NOT NULL,\n event_time TEXT NOT NULL,\n received_at TEXT NOT NULL\n )`);\n await sqlite.execute(`CREATE INDEX IF NOT EXISTS idx_${TESTDATA_TABLE}_collection ON ${TESTDATA_TABLE}(collection)`);\n}\n\nexport async function getLatestCursor(): Promise {\n const result = await sqlite.execute(`SELECT MAX(cursor) as cursor FROM ${TESTDATA_TABLE}`);\n const row = (result.rows?.[0] ?? {}) as { cursor?: number | null };\n return typeof row.cursor === \"number\" ? row.cursor : null;\n}\n\nexport async function insertTestDataRow(row: StoredTestDataRow): Promise {\n await sqlite.execute(\n `INSERT OR IGNORE INTO ${TESTDATA_TABLE} (cursor, repo, collection, rkey, record_json, event_time, received_at)\n VALUES (?, ?, ?, ?, ?, ?, ?)`,\n [\n row.cursor,\n row.repo,\n row.collection,\n row.rkey,\n JSON.stringify(row.record),\n row.eventTime,\n row.receivedAt,\n ],\n );\n}\n\nexport async function listRecentTestData(limit = 20): Promise {\n const result = await sqlite.execute(\n `SELECT cursor, repo, collection, rkey, record_json, event_time, received_at\n FROM ${TESTDATA_TABLE}\n WHERE collection = ?\n ORDER BY cursor DESC\n LIMIT ?`,\n [TESTDATA_COLLECTION, limit],\n );\n\n return (result.rows ?? []).map((row) => ({\n cursor: Number(row.cursor),\n repo: String(row.repo),\n collection: String(row.collection),\n rkey: String(row.rkey),\n record: JSON.parse(String(row.record_json)) as TestDataRecord,\n eventTime: String(row.event_time),\n receivedAt: String(row.received_at),\n }));\n}\n",[],[242,291,283],"database","b3b16078-a3f4-11f0-b878-0224a6c84d84",["D",1759893183054],[170],[242,291],"b3921114-a3f4-11f0-99aa-0224a6c84d84",["D",1759893182834],[169,171,172,173,174,175,176],[242],["D",1759843843402],{"_11":12,"_121":69},{"_11":12,"_117":-5,"_68":69,"_31":67,"_118":119,"_120":30},{"_39":108,"_13":16,"_33":36,"_109":73,"_110":-5,"_111":-5,"_112":-5,"_113":-5,"_114":-5,"_115":14,"_116":12},"ctx",{"_52":-5,"_140":337,"_338":339,"_340":341,"_342":30,"_343":30,"_344":30,"_345":24,"_346":-5,"_347":-7,"_348":-7,"_349":26,"_350":30,"_351":30,"_352":-5,"_353":30,"_354":30,"_355":30,"_356":-5},"ENV",{"_308":309,"_310":311,"_312":16,"_313":314,"_315":316,"_317":318,"_319":320,"_321":322,"_323":324,"_325":326,"_327":328,"_329":330,"_331":332,"_333":334,"_335":336},"REACT_APP_SENTRY_DSN","https://586020d86f05489db63a554690acf1e9@o1398359.ingest.sentry.io/6724499","RENDER_GIT_COMMIT","fdb67791413f4386b4dbf18f354029a617f6160f","RENDER_GIT_BRANCH","POSTHOG_API_TOKEN","phc_nmoyuAkStEZuUp69rYlg1DZgrIt19Gx0Y4Hwf8tGgJP","POSTHOG_API_HOST","https://wart.val.town","WEB_API_TEMPLATE","https://{val}.web.val.run","APP_URL","https://www.val.town","MODULE_URL","https://esm.town","VANITY_WEB_API_TEMPLATE","https://{label}.val.run/","DENOLS_URL","https://lsp.val.town","NODE_ENV","production","CLOUDFLARE_TURNSTILE_SITE_KEY","0x4AAAAAACtaIZJH7s9rBMZ6","GOOGLE_CLIENT_ID","875989696899-jtsqkhlbdv5jrlsk8631p7ipjg3c6o62.apps.googleusercontent.com","STRIPE_PUBLISHABLE_KEY","pk_live_51N2zvWEpZTTLipIkVEwXrUG9AT0yeOOEYxszarZT1jpsZV58Ly6wlg3SltZpHN26CUalOBmUSY7adQRQiSkCZz2500qSXNkf8Y","API_URL","https://api.val.town",[],"preferencesKeybindings","default","preferencesTheme","light","preferencesFixers","preferencesCopilot","preferencesSelectionAi","preferencesCloseBrackets","preferencesChatPanelState","preferencesDprint","preferencesDenofmt","notificationCount","flagDenols","isBusinessOrgMember","businessOrgHandle","isBusinessOrgAdmin","isHigherTownieTier","navCollapsed","currentOrgId"]

History · docs