Hi

\"\n});\n```\n\n## Val Town Utility Functions\n\nVal Town provides several utility functions to help with common project tasks.\n\n### Importing Utilities\n\nAlways import utilities with version pins to avoid breaking changes:\n\n```ts\nimport { parseProject, readFile, serveFile } from \"https://esm.town/v/std/utils@85-main/index.ts\";\n```\n\n### Available Utilities\n\n\n#### **serveFile** - Serve project files with proper content types\n\nFor example, in Hono:\n\n```ts\n// serve all files in frontend/ and shared/\napp.get(\"/frontend/*\", c => serveFile(c.req.path, import.meta.url));\napp.get(\"/shared/*\", c => serveFile(c.req.path, import.meta.url));\n```\n\n#### **readFile** - Read files from within the project:\n\n```ts\n// Read a file from the project\nconst fileContent = await readFile(\"/frontend/index.html\", import.meta.url);\n```\n\n#### **listFiles** - List all files in the project\n\n```ts\nconst files = await listFiles(import.meta.url);\n```\n\n#### **parseProject** - Extract information about the current project from import.meta.url\n\nThis is useful for including info for linking back to a val, ie in \"view source\" urls:\n\n```ts\nconst projectVal = parseProject(import.meta.url);\nconsole.log(projectVal.username); // Owner of the project\nconsole.log(projectVal.name); // Project name\nconsole.log(projectVal.version); // Version number\nconsole.log(projectVal.branch); // Branch name\nconsole.log(projectVal.links.self.project); // URL to the project page\n```\n\nHowever, it's *extremely importing* to note that `parseProject` and other Standard Library utilities ONLY RUN ON THE SERVER.\nIf you need access to this data on the client, run it in the server and pass it to the client by splicing it into the HTML page\nor by making an API request for it.\n\n## Val Town Platform Specifics\n\n- **Redirects:** Use `return new Response(null, { status: 302, headers: { Location: \"/place/to/redirect\" }})` instead of `Response.redirect` which is broken\n- **Images:** Avoid external images or base64 images. Use emojis, unicode symbols, or icon fonts/libraries instead\n- **AI Image:** To inline generate an AI image use: `

`\n- **Storage:** DO NOT use the Deno KV module for storage\n- **Browser APIs:** DO NOT use the `alert()`, `prompt()`, or `confirm()` methods\n- **Weather Data:** Use open-meteo for weather data (doesn't require API keys) unless otherwise specified\n- **View Source:** Add a view source link by importing & using `import.meta.url.replace(\"ems.sh\", \"val.town)\"` (or passing this data to the client) and include `target=\"_top\"` attribute\n- **Error Debugging:** Add `` to HTML to capture client-side errors\n- **Error Handling:** Only use try...catch when there's a clear local resolution; Avoid catches that merely log or return 500s. Let errors bubble up with full context\n- **Environment Variables:** Use `Deno.env.get('keyname')` when you need to, but generally prefer APIs that don't require keys\n- **Imports:** Use `https://esm.sh` for npm and Deno dependencies to ensure compatibility on server and browser\n- **Storage Strategy:** Only use backend storage if explicitly required; prefer simple static client-side sites\n- **React Configuration:** When using React libraries, pin versions with `?deps=react@18.2.0,react-dom@18.2.0` and start the file with `/** @jsxImportSource https://esm.sh/react@18.2.0 */`\n- Ensure all React dependencies and sub-dependencies are pinned to the same version\n- **Styling:** Default to using TailwindCSS via `` unless otherwise specified\n\n## Project Structure and Design Patterns\n\n### Recommended Directory Structure\n```\n├── backend/\n│ ├── database/\n│ │ ├── migrations.ts # Schema definitions\n│ │ ├── queries.ts # DB query functions\n│ │ └── README.md\n│ └── routes/ # Route modules\n│ ├── [route].ts\n│ └── static.ts # Static file serving\n│ ├── index.ts # Main entry point\n│ └── README.md\n├── frontend/\n│ ├── components/\n│ │ ├── App.tsx\n│ │ └── [Component].tsx\n│ ├── favicon.svg\n│ ├── index.html # Main HTML template\n│ ├── index.tsx # Frontend JS entry point\n│ ├── README.md\n│ └── style.css\n├── README.md\n└── shared/\n ├── README.md\n └── utils.ts # Shared types and functions\n```\n\n### Backend (Hono) Best Practices\n\n- Hono is the recommended API framework\n- Main entry point should be `backend/index.ts`\n- **Static asset serving:** Use the utility functions to read and serve project files:\n ```ts\n import { readFile, serveFile } from \"https://esm.town/v/std/utils@85-main/index.ts\";\n \n // serve all files in frontend/ and shared/\n app.get(\"/frontend/*\", c => serveFile(c.req.path, import.meta.url));\n app.get(\"/shared/*\", c => serveFile(c.req.path, import.meta.url));\n \n // For index.html, often you'll want to bootstrap with initial data\n app.get(\"/\", async c => {\n let html = await readFile(\"/frontend/index.html\", import.meta.url);\n \n // Inject data to avoid extra round-trips\n const initialData = await fetchInitialData();\n const dataScript = ``;\n \n html = html.replace(\"\", `${dataScript}`);\n return c.html(html);\n });\n ```\n- Create RESTful API routes for CRUD operations\n- Always include this snippet at the top-level Hono app to re-throwing errors to see full stack traces:\n ```ts\n // Unwrap Hono errors to see original error details\n app.onError((err, c) => {\n throw err;\n });\n ```\n\n### Database Patterns\n- Run migrations on startup or comment out for performance\n- Change table names when modifying schemas rather than altering\n- Export clear query functions with proper TypeScript typing\n\n## Common Gotchas and Solutions\n\n1. **Environment Limitations:** \n - Val Town runs on Deno in a serverless context, not Node.js\n - Code in `shared/` must work in both frontend and backend environments\n - Cannot use `Deno` keyword in shared code\n - Use `https://esm.sh` for imports that work in both environments\n\n2. **SQLite Peculiarities:**\n - Limited support for ALTER TABLE operations\n - Create new tables with updated schemas and copy data when needed\n - Always run table creation before querying\n\n3. **React Configuration:**\n - All React dependencies must be pinned to 18.2.0\n - Always include `@jsxImportSource https://esm.sh/react@18.2.0` at the top of React files\n - Rendering issues often come from mismatched React versions\n\n4. **File Handling:**\n - Val Town only supports text files, not binary\n - Use the provided utilities to read files across branches and forks\n - For files in the project, use `readFile` helpers\n\n5. **API Design:**\n - `fetch` handler is the entry point for HTTP vals\n - Run the Hono app with `export default app.fetch // This is the entry point for HTTP vals`\n\n",[135],"b3f0f2ce-a3f4-11f0-b63b-0224a6c84d84",".vtignore","b3f0f3be-a3f4-11f0-b63b-0224a6c84d84",10,["D",1759893183389],".git\n.vscode\n.cursorrules\n.DS_Store\nnode_modules\nvendor",[142],"b3a2edfe-a3f4-11f0-8e27-0224a6c84d84","shared","b3a2ee94-a3f4-11f0-8e27-0224a6c84d84",2,["D",1759893182958],"directory",[149],"615084a8-a971-11f0-8d13-0224a6c84d84","docs","61508570-a971-11f0-8d13-0224a6c84d84",35,["D",1760496487746],[156],"b3921114-a3f4-11f0-99aa-0224a6c84d84","backend","b39211d2-a3f4-11f0-99aa-0224a6c84d84",1,["D",1759893182834],[162],"pulls","forks","envVars",{"_173":175,"_176":54},"connections",{"_173":54,"_174":54},"count","unfilledCount",3,"emptyCount",{"_20":161,"_13":162,"_120":163,"_122":-5,"_123":21,"_124":164,"_126":50,"_22":289,"_29":54,"_128":153,"_129":-5,"_131":38,"_132":-5,"_194":290,"_90":291},{"_20":285,"_13":284,"_120":278,"_122":163,"_123":21,"_124":175,"_126":50,"_22":286,"_29":54,"_128":153,"_129":-5,"_131":38,"_132":-5,"_194":287,"_90":288},{"_20":275,"_13":276,"_120":277,"_122":278,"_123":21,"_124":279,"_126":50,"_22":280,"_29":54,"_128":208,"_129":281,"_131":38,"_132":-5,"_194":282,"_90":283},{"_20":267,"_13":268,"_120":269,"_122":163,"_123":21,"_124":270,"_126":50,"_22":271,"_29":125,"_128":255,"_129":272,"_131":38,"_132":-5,"_194":273,"_90":274},{"_20":259,"_13":260,"_120":261,"_122":163,"_123":21,"_124":262,"_126":50,"_22":263,"_29":239,"_128":208,"_129":264,"_131":38,"_132":-5,"_194":265,"_90":266},{"_20":251,"_13":252,"_120":253,"_122":163,"_123":21,"_124":30,"_126":50,"_22":254,"_29":164,"_128":255,"_129":256,"_131":38,"_132":-5,"_194":257,"_90":258},{"_20":244,"_13":245,"_120":48,"_122":163,"_123":21,"_124":246,"_126":50,"_22":247,"_29":125,"_128":232,"_129":248,"_131":38,"_132":-5,"_194":249,"_90":250},{"_20":236,"_13":237,"_120":238,"_122":163,"_123":21,"_124":239,"_126":50,"_22":240,"_29":54,"_128":232,"_129":241,"_131":38,"_132":-5,"_194":242,"_90":243},{"_20":226,"_13":227,"_120":228,"_122":163,"_123":21,"_124":229,"_126":50,"_22":230,"_29":231,"_128":232,"_129":233,"_131":38,"_132":-5,"_194":234,"_90":235},{"_20":155,"_13":156,"_120":157,"_122":-5,"_123":21,"_124":158,"_126":50,"_22":223,"_29":54,"_128":153,"_129":-5,"_131":38,"_132":-5,"_194":224,"_90":225},{"_20":215,"_13":216,"_120":217,"_122":157,"_123":21,"_124":218,"_126":50,"_22":219,"_29":54,"_128":101,"_129":220,"_131":38,"_132":-5,"_194":221,"_90":222},{"_20":148,"_13":149,"_120":150,"_122":-5,"_123":21,"_124":151,"_126":50,"_22":212,"_29":54,"_128":153,"_129":-5,"_131":38,"_132":-5,"_194":213,"_90":214},{"_20":203,"_13":204,"_120":205,"_122":150,"_123":21,"_124":206,"_126":50,"_22":207,"_29":54,"_128":208,"_129":209,"_131":38,"_132":-5,"_194":210,"_90":211},{"_20":141,"_13":142,"_120":143,"_122":-5,"_123":21,"_124":144,"_126":50,"_22":200,"_29":54,"_128":101,"_129":146,"_131":38,"_132":-5,"_194":201,"_90":202},{"_20":134,"_13":135,"_120":136,"_122":-5,"_123":21,"_124":137,"_126":50,"_22":197,"_29":54,"_128":101,"_129":139,"_131":38,"_132":-5,"_194":198,"_90":199},{"_20":118,"_13":119,"_120":121,"_122":-5,"_123":21,"_124":125,"_126":50,"_22":193,"_29":54,"_128":101,"_129":130,"_131":38,"_132":-5,"_194":195,"_90":196},["D",1759893183199],"children",[],[119],["D",1759893183343],[],[135],["D",1759893183389],[],[142],"b3d8c726-a3f4-11f0-b63b-0224a6c84d84","atprotoTestData.ts","b3d8c83e-a3f4-11f0-b63b-0224a6c84d84",8,["D",1759893183308],"script","export const TESTDATA_COLLECTION = \"org.newtoncivic.atproto.testdata\" as const;\n\nexport const TESTDATA_LEXICON = `{\n \"$schema\": \"https://lexicon.atproto.com/schema.json\",\n \"lexicon\": 1,\n \"id\": \"org.newtoncivic.atproto.testdata\",\n \"defs\": {\n \"main\": {\n \"type\": \"record\",\n \"key\": \"tid\",\n \"record\": {\n \"type\": \"object\",\n \"description\": \"Demo record for publishing structured telemetry readings to Bluesky.\",\n \"required\": [\n \"createdAt\",\n \"schemaVersion\",\n \"label\",\n \"value\"\n ],\n \"properties\": {\n \"createdAt\": {\n \"type\": \"datetime\",\n \"description\": \"ISO8601 timestamp for when this reading was created.\"\n },\n \"schemaVersion\": {\n \"type\": \"integer\",\n \"minimum\": 1,\n \"description\": \"Schema version of the payload to allow evolution over time.\"\n },\n \"label\": {\n \"type\": \"string\",\n \"maxLength\": 128,\n \"description\": \"Short identifier for the kind of reading.\"\n },\n \"value\": {\n \"type\": \"number\",\n \"description\": \"Numeric reading captured for the label.\"\n },\n \"unit\": {\n \"type\": \"string\",\n \"maxLength\": 16,\n \"description\": \"Optional unit describing the numeric value (e.g. %, ms, C).\"\n },\n \"notes\": {\n \"type\": \"string\",\n \"maxLength\": 512,\n \"description\": \"Optional human readable context for this reading.\"\n },\n \"metadata\": {\n \"type\": \"ref\",\n \"ref\": \"lex:com.atproto.repo.strongRef\",\n \"description\": \"Optional pointer to a related record for richer correlation.\"\n }\n }\n }\n }\n }\n}`;\n\nexport interface TestDataRecord {\n $type: typeof TESTDATA_COLLECTION;\n createdAt: string;\n schemaVersion: number;\n label: string;\n value: number;\n unit?: string;\n notes?: string;\n metadata?: {\n cid: string;\n uri: string;\n };\n}\n\nexport interface CreateTestDataInput {\n label: string;\n value: number;\n unit?: string;\n notes?: string;\n metadata?: {\n cid: string;\n uri: string;\n };\n}\n\nexport function buildTestDataRecord(input: CreateTestDataInput): TestDataRecord {\n const { label, value, unit, notes, metadata } = input;\n if (!label?.trim()) {\n throw new Error(\"label must be a non-empty string\");\n }\n if (!Number.isFinite(value)) {\n throw new Error(\"value must be a finite number\");\n }\n const record: TestDataRecord = {\n $type: TESTDATA_COLLECTION,\n createdAt: new Date().toISOString(),\n schemaVersion: 1,\n label: label.trim(),\n value,\n };\n if (unit) {\n record.unit = unit;\n }\n if (notes) {\n record.notes = notes;\n }\n if (metadata) {\n if (!metadata.cid || !metadata.uri) {\n throw new Error(\"metadata must include cid and uri when provided\");\n }\n record.metadata = metadata;\n }\n return record;\n}\n",[],[149,204],["D",1759893182958],[189],[149],"61708456-a971-11f0-bd6d-0224a6c84d84","jetstream.md","617084f6-a971-11f0-bd6d-0224a6c84d84",37,["D",1760496487923],"# Jetstream\n\nJetstream is a streaming service that consumes an ATProto `com.atproto.sync.subscribeRepos` stream and converts it into lightweight, friendly JSON.\n\nJetstream converts the CBOR-encoded MST blocks produced by the ATProto firehose and translates them into JSON objects that are easier to interface with using standard tooling available in programming languages.\n\n### Public Instances\n\nAs of writing, there are 4 official public Jetstream instances operated by Bluesky.\n\n| Hostname | Region |\n| --------------------------------- | ------- |\n| `jetstream1.us-east.bsky.network` | US-East |\n| `jetstream2.us-east.bsky.network` | US-East |\n| `jetstream1.us-west.bsky.network` | US-West |\n| `jetstream2.us-west.bsky.network` | US-West |\n\nConnect to these instances over WSS: `wss://jetstream2.us-west.bsky.network/subscribe`\n\nWe will monitor and operate these instances and do our best to keep them available for public use by developers.\n\nFeel free to have multiple connections to Jetstream instances if needed. We encourage you to make use of Jetstream wherever you may consider using the `com.atproto.sync.subscribeRepos` firehose if you don't need the features of the full sync protocol.\n\nBecause cursors for Jetstream are time-based (unix microseconds), you can use the same cursor for multiple instances to get roughly the same data.\n\nWhen switching between instances, it may be prudent to rewind your cursor a few seconds for gapless playback if you process events idempotently.\n\n## Running Jetstream\n\nTo run Jetstream, make sure you have docker and docker compose installed and run `make up` in the repo root.\n\nThis will pull the latest built image from GHCR and start a Jetstream instance at `http://localhost:6008`\n\n- To build Jetstream from source via Docker and start it up, run `make rebuild`\n\nOnce started, you can connect to the event stream at: `ws://localhost:6008/subscribe`\n\nPrometheus metrics are exposed at `http://localhost:6009/metrics`\n\nA [Grafana Dashboard](#dashboard-preview) for Jetstream is available at `./grafana-dashboard.json` and should be easy to copy/paste into Grafana's dashboard import prompt.\n\n- This dashboard has a few device-specific graphs for disk and network usage that require NodeExporter and may need to be tuned to your setup.\n\n## Consuming Jetstream\n\nTo consume Jetstream you can use any websocket client\n\nConnect to `ws://localhost:6008/subscribe` to start the stream\n\nThe following Query Parameters are supported:\n\n- `wantedCollections` - An array of [Collection NSIDs](https://atproto.com/specs/nsid) to filter which records you receive on your stream (default empty = all collections)\n - `wantedCollections` supports NSID path prefixes i.e. `app.bsky.graph.*`, or `app.bsky.*`. The prefix before the `.*` must pass NSID validation and Jetstream **does not** support incomplete prefixes i.e. `app.bsky.graph.fo*`.\n - Regardless of desired collections, all subscribers receive Account and Identity events.\n - You can specify at most 100 wanted collections/prefixes.\n- `wantedDids` - An array of Repo DIDs to filter which records you receive on your stream (Default empty = all repos)\n - You can specify at most 10,000 wanted DIDs.\n- `maxMessageSizeBytes` - The maximum size of a payload that this client would like to receive. Zero means no limit, negative values are treated as zero. (Default \"0\" or empty = no maximum size)\n- `cursor` - A unix microseconds timestamp cursor to begin playback from\n - An absent cursor or a cursor from the future will result in live-tail operation\n - When reconnecting, use the `time_us` from your most recently processed event and maybe provide a negative buffer (i.e. subtract a few seconds) to ensure gapless playback\n- `compress` - Set to `true` to enable `zstd` [compression](#compression)\n- `requireHello` - Set to `true` to pause replay/live-tail until the server receives a [`SubscriberOptionsUpdatePayload`](#options-updates) over the socket in a [Subscriber Sourced Message](#subscriber-sourced-messages)\n\n### Examples\n\nA simple example that hits the public instance looks like:\n\n```bash\n$ websocat wss://jetstream2.us-east.bsky.network/subscribe\\?wantedCollections=app.bsky.feed.post\n```\n\nA maximal example using all parameters looks like:\n\n```bash\n$ websocat \"ws://localhost:6008/subscribe?wantedCollections=app.bsky.feed.post&wantedCollections=app.bsky.feed.like&wantedCollections=app.bsky.graph.follow&wantedDids=did:plc:q6gjnaw2blty4crticxkmujt&cursor=1725519626134432\"\n```\n\n### Example events:\n\nJetstream events have 3 `kinds`s (so far):\n\n- `commit`: a Commit to a repo which involves either a create, update, or delete of a record\n- `identity`: an Identity update for a DID which indicates that you may want to purge an identity cache and revalidate the DID doc and handle\n- `account`: an Account event that indicates a change in account status i.e. from `active` to `deactivated`, or to `takendown` if the PDS has taken down the repo.\n\nJetstream Commits have 3 `operations`:\n\n- `create`: Create a new record with the contents provided\n- `update`: Update an existing record and replace it with the contents provided\n- `delete`: Delete an existing record with the DID, Collection, and RKey provided\n\n#### A like committed to a repo\n\n```json\n{\n \"did\": \"did:plc:eygmaihciaxprqvxpfvl6flk\",\n \"time_us\": 1725911162329308,\n \"kind\": \"commit\",\n \"commit\": {\n \"rev\": \"3l3qo2vutsw2b\",\n \"operation\": \"create\",\n \"collection\": \"app.bsky.feed.like\",\n \"rkey\": \"3l3qo2vuowo2b\",\n \"record\": {\n \"$type\": \"app.bsky.feed.like\",\n \"createdAt\": \"2024-09-09T19:46:02.102Z\",\n \"subject\": {\n \"cid\": \"bafyreidc6sydkkbchcyg62v77wbhzvb2mvytlmsychqgwf2xojjtirmzj4\",\n \"uri\": \"at://did:plc:wa7b35aakoll7hugkrjtf3xf/app.bsky.feed.post/3l3pte3p2e325\"\n }\n },\n \"cid\": \"bafyreidwaivazkwu67xztlmuobx35hs2lnfh3kolmgfmucldvhd3sgzcqi\"\n }\n}\n```\n\n#### A deleted follow record\n\n```json\n{\n \"did\": \"did:plc:rfov6bpyztcnedeyyzgfq42k\",\n \"time_us\": 1725516666833633,\n \"kind\": \"commit\",\n \"commit\": {\n \"rev\": \"3l3f6nzl3cv2s\",\n \"operation\": \"delete\",\n \"collection\": \"app.bsky.graph.follow\",\n \"rkey\": \"3l3dn7tku762u\"\n }\n}\n```\n\n#### An identity update\n\n```json\n{\n \"did\": \"did:plc:ufbl4k27gp6kzas5glhz7fim\",\n \"time_us\": 1725516665234703,\n \"kind\": \"identity\",\n \"identity\": {\n \"did\": \"did:plc:ufbl4k27gp6kzas5glhz7fim\",\n \"handle\": \"yohenrique.bsky.social\",\n \"seq\": 1409752997,\n \"time\": \"2024-09-05T06:11:04.870Z\"\n }\n}\n```\n\n#### An account becoming active\n\n```json\n{\n \"did\": \"did:plc:ufbl4k27gp6kzas5glhz7fim\",\n \"time_us\": 1725516665333808,\n \"kind\": \"account\",\n \"account\": {\n \"active\": true,\n \"did\": \"did:plc:ufbl4k27gp6kzas5glhz7fim\",\n \"seq\": 1409753013,\n \"time\": \"2024-09-05T06:11:04.870Z\"\n }\n}\n```\n\n### Compression\n\nJetstream supports `zstd`-based compression of messages. Jetstream uses a custom dictionary for compression that can be found in `pkg/models/zstd_dictionary` and is required to decode compressed messages from the server.\n\n`zstd` compressed Jetstream messages are ~56% smaller on average than the raw JSON version of the Jetstream firehose.\n\nThe provided client library uses compression by default, using an embedded copy of the Dictionary from the `models` package.\n\nTo request a compressed stream, pass the `Socket-Encoding: zstd` header through when initiating the websocket _or_ pass `compress=true` in the query string.\n\n### Subscriber Sourced messages\n\nSubscribers can send Text messages to Jetstream over the websocket using the `SubscriberSourcedMessage` framing below:\n\n```go\ntype SubscriberSourcedMessage struct {\n\tType string `json:\"type\"`\n\tPayload json.RawMessage `json:\"payload\"`\n}\n```\n\nThe supported message types are as follows:\n\n- `options_update`\n\n#### Options Updates\n\nA client can update their `wantedCollections` and `wantedDids` after connecting to the socket by sending a Subscriber Sourced Message.\n\nTo send an Options Update, provide the string `options_update` in the `type` field and a `SubscriberOptionsUpdatePayload` in the `payload` field.\n\nThe shape for a `SubscriberOptionsUpdatePayload` is as follows:\n\n```go\ntype SubscriberOptionsUpdateMsg struct {\n\tWantedCollections []string `json:\"wantedCollections\"`\n\tWantedDIDs []string `json:\"wantedDids\"`\n\tMaxMessageSizeBytes int `json:\"maxMessageSizeBytes\"`\n}\n```\n\nIf either array is empty, the relevant filter will be disabled (i.e. sending empty `wantedDids` will mean a client gets messages for all DIDs again).\n\nSome limitations apply around the size of the message: right now the message can be at most 10MB in size and can contain up to 100 collection filters _and_ up to 10,000 DID filters.\n\nAdditionally, a client can connect with `?requireHello=true` in the query params to pause replay/live-tail until the first Options Update message is sent by the client over the socket.\n\nInvalid Options Updates in `requireHello` mode or normal operating mode will result in the client being disconnected.\n\nAn example Subscriber Sourced Message with an Options Update payload is as follows:\n\n```json\n{\n \"type\": \"options_update\",\n \"payload\": {\n \"wantedCollections\": [\"app.bsky.feed.post\"],\n \"wantedDids\": [\"did:plc:q6gjnaw2blty4crticxkmujt\"],\n \"maxMessageSizeBytes\": 1000000\n }\n}\n```\n\nThe above payload will filter such that a client receives only posts, and only from a the specified DID.\n\n### Dashboard Preview\n\n![A screenshot of the Jetstream Grafana Dashboard](./docs/dash.png)",[],[156,216],["D",1760496487746],[187],[156],"a0682148-a7df-11f0-b16b-0224a6c84d84","viewCreatorRecords.http.ts","279e5a76-a7ac-11f0-8da6-0224a6c84d84",32,["D",1760323935907],6,"http","import { BskyAgent } from \"https://esm.sh/@atproto/api@0.13.18?target=deno\";\nimport {\n TESTDATA_COLLECTION,\n TestDataRecord,\n} from \"../shared/atprotoTestData.ts\";\n\nconst SERVICE_URL = Deno.env.get(\"BLUESKY_SERVICE_URL\") ??\n \"https://bsky.social\";\nconst IDENTIFIER = Deno.env.get(\"BLUESKY_HANDLE\");\nconst APP_PASSWORD = Deno.env.get(\"BLUESKY_APP_PASSWORD\");\nconst MAX_TOTAL = Number(Deno.env.get(\"LIST_MAX_RECORDS\") ?? 500);\n\ninterface RepoRecord {\n uri: string;\n cid: string;\n value: TRecord;\n repo: string;\n collection: string;\n rkey: string;\n indexedAt: string;\n}\n\ninterface CreatorRecordsResponse {\n repo: string;\n did: string | null;\n collection: string;\n count: number;\n truncated: boolean;\n records: Array>;\n}\n\nexport default async function viewCreatorRecords(\n req: Request,\n): Promise {\n if (req.method !== \"GET\") {\n return new Response(\"Method Not Allowed\", { status: 405 });\n }\n\n const { identifier, appPassword } = ensureCredentials();\n const agent = new BskyAgent({ service: SERVICE_URL });\n await agent.login({ identifier, password: appPassword });\n\n const repoDid = agent.session?.did ?? null;\n const repo = repoDid ?? identifier;\n const records = await fetchAllRecords(agent, { repoDid, repo });\n\n const body: CreatorRecordsResponse = {\n repo,\n did: repoDid,\n collection: TESTDATA_COLLECTION,\n count: records.length,\n truncated: records.length >= MAX_TOTAL,\n records,\n };\n\n return json(body);\n}\n\nasync function fetchAllRecords(\n agent: BskyAgent,\n params: { repoDid: string | null; repo: string },\n): Promise>> {\n const { repoDid, repo } = params;\n const items: Array> = [];\n let cursor: string | undefined;\n\n while (items.length < MAX_TOTAL) {\n const limit = Math.min(100, MAX_TOTAL - items.length);\n const repoParam = repoDid ?? repo;\n if (!repoParam) {\n throw new Error(\"Unable to determine repo identifier for listRecords\");\n }\n const response = await agent.com.atproto.repo.listRecords({\n repo: repoParam,\n collection: TESTDATA_COLLECTION,\n limit,\n cursor,\n reverse: true,\n });\n\n for (const record of response.data.records ?? []) {\n items.push(record as RepoRecord);\n }\n\n if (!response.data.cursor) {\n break;\n }\n cursor = response.data.cursor;\n }\n\n return items;\n}\n\nfunction ensureCredentials(): { identifier: string; appPassword: string } {\n if (!IDENTIFIER) {\n throw new Error(\"BLUESKY_HANDLE environment variable is required\");\n }\n if (!APP_PASSWORD) {\n throw new Error(\"BLUESKY_APP_PASSWORD environment variable is required\");\n }\n return { identifier: IDENTIFIER, appPassword: APP_PASSWORD };\n}\n\nfunction json(body: unknown, status = 200): Response {\n return new Response(JSON.stringify(body, null, 2), {\n status,\n headers: { \"content-type\": \"application/json; charset=utf-8\" },\n });\n}\n",[],[162,227],"b3d4a16e-a3f4-11f0-8549-0224a6c84d84","testDataViewer.http.tsx","b3d4a236-a3f4-11f0-8549-0224a6c84d84",7,["D",1759893183249],"import { Hono } from \"https://esm.sh/hono@3.11.12?target=deno\";\nimport {\n ensureTestDataTable,\n listRecentTestData,\n TESTDATA_TABLE,\n} from \"./database/queries.ts\";\n\nconst DEFAULT_LIMIT = 20;\n\nconst app = new Hono();\n\n// Unwrap Hono errors so Deno surfaces full stack traces in logs\napp.onError((err) => {\n throw err;\n});\n\napp.get(\"/data.json\", async (c) => {\n await ensureTestDataTable();\n const limit = getLimitFromRequest(c.req.query(\"limit\"));\n const rows = await listRecentTestData(limit);\n return c.json({\n table: TESTDATA_TABLE,\n limit,\n count: rows.length,\n rows,\n });\n});\n\napp.get(\"/\", async (c) => {\n await ensureTestDataTable();\n const limit = getLimitFromRequest(c.req.query(\"limit\"));\n const rows = await listRecentTestData(limit);\n const viewSourceUrl = import.meta.url.replace(\"ems.sh\", \"val.town\");\n const body = renderHtml({ rows, limit, viewSourceUrl });\n return c.html(body);\n});\n\nfunction getLimitFromRequest(limitParam: string | undefined): number {\n const limit = Number(limitParam ?? DEFAULT_LIMIT);\n if (!Number.isFinite(limit) || limit <= 0) {\n return DEFAULT_LIMIT;\n }\n return Math.min(Math.floor(limit), 200);\n}\n\ninterface RenderHtmlParams {\n rows: Awaited>;\n limit: number;\n viewSourceUrl: string;\n}\n\nfunction renderHtml({ rows, limit, viewSourceUrl }: RenderHtmlParams): string {\n const rowsMarkup = rows\n .map((row) => {\n const record = JSON.stringify(row.record, null, 2);\n return `

#${row.cursor} ${escapeHtml(row.record.label)} — ${new Date(row.record.createdAt).toLocaleString()} (${row.repo})

${escapeHtml(record)}

repo: ${escapeHtml(row.repo)}
collection: ${escapeHtml(row.collection)}
rkey: ${escapeHtml(row.rkey)}
event time: ${escapeHtml(row.eventTime)}
received at: ${escapeHtml(row.receivedAt)}

`;\n })\n .join(\"\\n\");\n\n return `\n\n \n \n \n \n Bluesky Test Data Feed\n \n \n \n \n

org.newtoncivic Test Data Feed

Showing up to ${limit} most recent records saved from Jetstream.

\n \n

\n ${rows.length ? rowsMarkup : \"

No records found yet.

\"}\n

\n \n`;\n}\n\nfunction escapeHtml(value: string): string {\n return value\n .replace(/&/g, \"&\")\n .replace(//g, \">\")\n .replace(/\"/g, \""\")\n .replace(/'/g, \"'\");\n}\n\nexport default app.fetch;\n",[],[162,237],"a061ac00-a7df-11f0-9f98-0224a6c84d84","postTestData.http.ts",31,["D",1760323935858],"import { BskyAgent } from \"https://esm.sh/@atproto/api@0.13.18?target=deno\";\nimport {\n buildTestDataRecord,\n TESTDATA_COLLECTION,\n TESTDATA_LEXICON,\n} from \"../shared/atprotoTestData.ts\";\n\ninterface PostRequestBody {\n label?: string;\n value?: number;\n unit?: string;\n notes?: string;\n metadata?: {\n cid: string;\n uri: string;\n };\n}\n\nconst SERVICE_URL = Deno.env.get(\"BLUESKY_SERVICE_URL\") ??\n \"https://bsky.social\";\nconst IDENTIFIER = Deno.env.get(\"BLUESKY_HANDLE\");\nconst APP_PASSWORD = Deno.env.get(\"BLUESKY_APP_PASSWORD\");\n\nfunction ensureCredentials(): { identifier: string; appPassword: string } {\n if (!IDENTIFIER) {\n throw new Error(\"BLUESKY_HANDLE environment variable is required\");\n }\n if (!APP_PASSWORD) {\n throw new Error(\"BLUESKY_APP_PASSWORD environment variable is required\");\n }\n return { identifier: IDENTIFIER, appPassword: APP_PASSWORD };\n}\n\nfunction okJson(data: unknown, status = 200) {\n return new Response(JSON.stringify(data, null, 2), {\n status,\n headers: { \"content-type\": \"application/json; charset=utf-8\" },\n });\n}\n\nexport default async function postTestData(req: Request): Promise {\n if (req.method === \"GET\") {\n return okJson({\n message:\n \"POST to this endpoint to create a custom testdata record on Bluesky\",\n expectedBody: {\n label: \"string\",\n value: \"number\",\n unit: \"string?\",\n notes: \"string?\",\n metadata: { cid: \"string\", uri: \"at://...\" },\n },\n collection: TESTDATA_COLLECTION,\n lexicon: TESTDATA_LEXICON,\n });\n }\n\n if (req.method !== \"POST\") {\n return new Response(\"Method Not Allowed\", { status: 405 });\n }\n\n let body: PostRequestBody;\n try {\n body = (await req.json()) as PostRequestBody;\n } catch (error) {\n return okJson(\n { error: \"Invalid JSON payload\", details: String(error) },\n 400,\n );\n }\n\n const { label, value, unit, notes, metadata } = body;\n if (typeof value !== \"number\") {\n return okJson({ error: \"value must be provided as a number\" }, 400);\n }\n\n const record = buildTestDataRecord({\n label: label ?? \"demo\",\n value,\n unit,\n notes,\n metadata,\n });\n\n const { identifier, appPassword } = ensureCredentials();\n const agent = new BskyAgent({ service: SERVICE_URL });\n await agent.login({ identifier, password: appPassword });\n const repo = agent.session?.did ?? identifier;\n\n const creation = await agent.com.atproto.repo.createRecord({\n repo,\n collection: TESTDATA_COLLECTION,\n record,\n validate: false,\n });\n\n const latest = await agent.com.atproto.repo.listRecords({\n repo,\n collection: TESTDATA_COLLECTION,\n limit: 1,\n reverse: true,\n });\n\n const { uri, cid } = creation.data;\n const newest = latest.data.records?.[0];\n const confirmed = Boolean(newest && newest.cid === cid);\n const effectiveUri = uri ?? newest?.uri ?? null;\n const rkey = effectiveUri ? extractRkey(effectiveUri) : null;\n\n return okJson({ repo, uri: effectiveUri, cid, record, rkey, confirmed });\n}\n\nfunction extractRkey(uri: string | undefined): string {\n if (!uri) {\n return \"\";\n }\n const parts = uri.split(\"/\");\n return parts[parts.length - 1] ?? \"\";\n}\n",[],[162,245],"5f5a8e04-a972-11f0-a423-0224a6c84d84","jetstreamSimple.cron.ts","6169645a-a971-11f0-a039-0224a6c84d84",["D",1760496913921],"interval","// Simple Jetstream example that listens for custom test data records\n// This demonstrates the correct Jetstream API usage per the official docs\n\nimport { BskyAgent } from \"https://esm.sh/@atproto/api@0.13.18?target=deno\";\nimport {\n TESTDATA_COLLECTION,\n TestDataRecord,\n} from \"../shared/atprotoTestData.ts\";\nimport {\n ensureTestDataTable,\n getLatestCursor,\n insertTestDataRow,\n} from \"./database/queries.ts\";\n\n// Official Jetstream instances (configurable via env)\nconst JETSTREAM_URL = Deno.env.get(\"JETSTREAM_URL\") ??\n \"wss://jetstream2.us-east.bsky.network/subscribe\";\nconst APPVIEW_SERVICE_URL = Deno.env.get(\"BLUESKY_SERVICE_URL\") ??\n \"https://bsky.social\";\n\n// Timeout and limits for the cron job\nconst STREAM_TIMEOUT_MS = 15000; // 15 seconds\nconst MAX_EVENTS = 50; // Process up to 50 events per run\n\n// Jetstream message structure per the official docs\ninterface JetstreamCommitEvent {\n did: string;\n time_us: number; // Unix microseconds timestamp\n kind: \"commit\";\n commit: {\n rev: string;\n operation: \"create\" | \"update\" | \"delete\";\n collection: string;\n rkey: string;\n record?: unknown; // Only present for create/update\n cid?: string;\n };\n}\n\nexport default async function jetstreamSimple(): Promise {\n // Ensure database is ready\n await ensureTestDataTable();\n\n // Get our last known cursor (time_us from last event)\n const latestCursor = await getLatestCursor();\n\n // Build WebSocket URL with query parameters\n const url = new URL(JETSTREAM_URL);\n\n // Filter for only our custom collection\n url.searchParams.set(\"wantedCollections\", TESTDATA_COLLECTION);\n\n // Resume from last cursor if we have one (subtract 5 seconds for safety)\n if (typeof latestCursor === \"number\" && latestCursor > 0) {\n const rewindCursor = latestCursor - 500_000_000; // 500 seconds in microseconds\n url.searchParams.set(\"cursor\", rewindCursor.toString());\n }\n\n console.log(`Connecting to Jetstream: ${url.toString()}`);\n\n // Set up Bluesky agent for fetching full records\n const agent = new BskyAgent({ service: APPVIEW_SERVICE_URL });\n const identifier = Deno.env.get(\"BLUESKY_HANDLE\");\n const appPassword = Deno.env.get(\"BLUESKY_APP_PASSWORD\");\n\n if (!identifier || !appPassword) {\n throw new Error(\"BLUESKY_HANDLE and BLUESKY_APP_PASSWORD required\");\n }\n\n await agent.login({ identifier, password: appPassword });\n\n // Track what we process\n let eventsProcessed = 0;\n let eventsStored = 0;\n let highestCursor = latestCursor || 0;\n\n // Connect to Jetstream WebSocket\n const ws = new WebSocket(url.toString());\n\n await new Promise((resolve, reject) => {\n // Timeout to ensure cron doesn't run forever\n const timeout = setTimeout(() => {\n console.log(\"Timeout reached, closing connection\");\n ws.close();\n }, STREAM_TIMEOUT_MS);\n\n ws.addEventListener(\"open\", () => {\n console.log(\"Connected to Jetstream\");\n });\n\n ws.addEventListener(\"message\", async (event) => {\n try {\n const message = JSON.parse(event.data) as JetstreamCommitEvent;\n\n // Only process commit events for our collection\n if (\n message.kind === \"commit\" &&\n message.commit.collection === TESTDATA_COLLECTION &&\n (message.commit.operation === \"create\" ||\n message.commit.operation === \"update\")\n ) {\n console.log(\n `Processing ${message.commit.operation} for ${message.did}/${message.commit.rkey}`,\n );\n\n // Fetch the full record from the appview\n try {\n const recordResponse = await agent.com.atproto.repo.getRecord({\n repo: message.did,\n collection: TESTDATA_COLLECTION,\n rkey: message.commit.rkey,\n });\n\n const record = recordResponse.data.value as TestDataRecord;\n\n // Store in our database\n await insertTestDataRow({\n cursor: message.time_us,\n repo: message.did,\n collection: TESTDATA_COLLECTION,\n rkey: message.commit.rkey,\n record,\n eventTime: new Date(message.time_us / 1000).toISOString(),\n receivedAt: new Date().toISOString(),\n });\n\n eventsStored++;\n console.log(\n `Stored event: ${record.label} = ${record.value}${\n record.unit || \"\"\n }`,\n );\n } catch (error) {\n console.error(`Failed to fetch/store record:`, error);\n }\n\n eventsProcessed++;\n highestCursor = Math.max(highestCursor, message.time_us);\n\n // Stop if we hit our limit\n if (eventsProcessed >= MAX_EVENTS) {\n console.log(\"Max events reached, closing connection\");\n ws.close();\n }\n }\n } catch (error) {\n console.error(\"Error processing message:\", error);\n }\n });\n\n ws.addEventListener(\"error\", (error) => {\n console.error(\"WebSocket error:\", error);\n clearTimeout(timeout);\n reject(error);\n });\n\n ws.addEventListener(\"close\", () => {\n console.log(\"WebSocket closed\");\n clearTimeout(timeout);\n resolve();\n });\n });\n\n console.log(JSON.stringify(\n {\n eventsProcessed,\n eventsStored,\n startCursor: latestCursor,\n endCursor: highestCursor,\n },\n null,\n 2,\n ));\n}",[],[162,252],"7813bf98-a971-11f0-8e3a-0224a6c84d84","jetstreamAppview.cron.ts","b3d031f6-a3f4-11f0-8e27-0224a6c84d84",39,["D",1760496525929],"import { BskyAgent } from \"https://esm.sh/@atproto/api@0.13.18?target=deno\";\nimport {\n TESTDATA_COLLECTION,\n TestDataRecord,\n} from \"../shared/atprotoTestData.ts\";\nimport {\n ensureTestDataTable,\n getLatestCursor,\n insertTestDataRow,\n TESTDATA_TABLE,\n} from \"./database/queries.ts\";\n\n// The global Jetstream proxy only supports `commit` for now; additional wanted types\n// or other filters would require a custom Jetstream deployment.\nconst DEFAULT_WANTED = \"commit\";\n\nconst JETSTREAM_URL = Deno.env.get(\"JETSTREAM_URL\") ??\n \"https://jetstream.atproto.tools/subscribe\";\nconst APPVIEW_SERVICE_URL = Deno.env.get(\"BLUESKY_SERVICE_URL\") ??\n \"https://bsky.social\";\nconst IDENTIFIER = Deno.env.get(\"BLUESKY_HANDLE\");\nconst APP_PASSWORD = Deno.env.get(\"BLUESKY_APP_PASSWORD\");\nconst STREAM_TIMEOUT_MS = Number(Deno.env.get(\"JETSTREAM_TIMEOUT_MS\") ?? 15000);\nconst MAX_STREAM_EVENTS = Number(Deno.env.get(\"JETSTREAM_MAX_EVENTS\") ?? 64);\nconst REPLAY_MARGIN = Number(Deno.env.get(\"JETSTREAM_REPLAY_MARGIN\") ?? 5);\n\nfunction ensureCredentials(): { identifier: string; appPassword: string } {\n if (!IDENTIFIER) {\n throw new Error(\"BLUESKY_HANDLE environment variable is required\");\n }\n if (!APP_PASSWORD) {\n throw new Error(\"BLUESKY_APP_PASSWORD environment variable is required\");\n }\n return { identifier: IDENTIFIER, appPassword: APP_PASSWORD };\n}\n\ninterface JetstreamMessage {\n kind: string;\n seq: number;\n time: string;\n repo?: string;\n commit?: {\n rev: string;\n time: string;\n };\n ops?: Array<{\n action: \"create\" | \"update\" | \"delete\";\n path: string;\n cid?: string | { $link: string };\n }>;\n operations?: Array<{\n action: \"create\" | \"update\" | \"delete\";\n path: string;\n cid?: string | { $link: string };\n }>;\n}\n\ninterface StreamState {\n processedOps: number;\n storedEvents: number;\n highestCursor?: number;\n}\n\nexport default async function jetstreamCron(): Promise {\n await ensureTestDataTable();\n const latestCursor = await getLatestCursor();\n const startCursor = typeof latestCursor === \"number\"\n ? Math.max(latestCursor - REPLAY_MARGIN, 0)\n : undefined;\n\n const agent = new BskyAgent({ service: APPVIEW_SERVICE_URL });\n const { identifier, appPassword } = ensureCredentials();\n await agent.login({ identifier, password: appPassword });\n const state: StreamState = {\n processedOps: 0,\n storedEvents: 0,\n highestCursor: startCursor,\n };\n\n await processJetstream({ agent, startCursor, state });\n\n console.log(\n JSON.stringify(\n {\n event: \"jetstream.sync\",\n table: TESTDATA_TABLE,\n startCursor,\n lastCursor: state.highestCursor ?? startCursor ?? null,\n processedOps: state.processedOps,\n storedEvents: state.storedEvents,\n },\n null,\n 2,\n ),\n );\n}\n\nasync function processJetstream({\n agent,\n startCursor,\n state,\n}: {\n agent: BskyAgent;\n startCursor?: number;\n state: StreamState;\n}): Promise {\n const url = new URL(JETSTREAM_URL);\n if (url.hostname === \"jetstream.atproto.tools\") {\n // The public Jetstream proxy requires `wanted` to be provided explicitly.\n url.searchParams.set(\"wanted\", DEFAULT_WANTED);\n } else if (!url.searchParams.has(\"wanted\")) {\n url.searchParams.set(\"wanted\", DEFAULT_WANTED);\n }\n if (\n typeof startCursor === \"number\" && startCursor > 0 &&\n !url.searchParams.has(\"cursor\")\n ) {\n url.searchParams.set(\"cursor\", startCursor.toString());\n }\n\n const wsUrl = toWebSocketUrl(url);\n const ws = new WebSocket(wsUrl);\n ws.binaryType = \"arraybuffer\";\n\n const tasks: Promise[] = [];\n\n await new Promise((resolve, reject) => {\n const timeout = setTimeout(() => {\n ws.close(1000, \"stream timeout\");\n }, STREAM_TIMEOUT_MS);\n\n ws.addEventListener(\"open\", () => {\n // Connection established; nothing else to send.\n });\n\n ws.addEventListener(\"message\", (event) => {\n if (state.processedOps >= MAX_STREAM_EVENTS) {\n ws.close(1000, \"reached max events\");\n return;\n }\n const task = normalizeEventData(event.data)\n .then((payload) => handleJetstreamMessage(payload, agent, state))\n .catch((error) => {\n console.error(\"Jetstream message handling error\", error);\n });\n tasks.push(task);\n task.finally(() => {\n if (\n state.processedOps >= MAX_STREAM_EVENTS &&\n ws.readyState === WebSocket.OPEN\n ) {\n ws.close(1000, \"reached max events\");\n }\n });\n });\n\n ws.addEventListener(\"error\", (event) => {\n clearTimeout(timeout);\n reject(new Error(\"Jetstream WebSocket connection error\"));\n });\n\n ws.addEventListener(\"close\", () => {\n clearTimeout(timeout);\n resolve();\n });\n });\n\n if (tasks.length > 0) {\n await Promise.all(tasks);\n }\n}\nasync function handleJetstreamMessage(\n raw: string,\n agent: BskyAgent,\n state: StreamState,\n): Promise {\n if (!raw) {\n return;\n }\n let message: JetstreamMessage;\n try {\n message = JSON.parse(raw) as JetstreamMessage;\n } catch (error) {\n console.error(\"Failed to parse Jetstream payload\", error, raw);\n return;\n }\n const operations = message.ops ?? message.operations;\n if (message.kind !== \"commit\" || !message.repo || !operations) {\n return;\n }\n\n const relevantOps = operations.filter((op) =>\n op.path.startsWith(`${TESTDATA_COLLECTION}/`)\n );\n if (!relevantOps.length) {\n return;\n }\n\n const now = new Date().toISOString();\n for (const op of relevantOps) {\n const [, rkey] = op.path.split(\"/\");\n if (!rkey) {\n continue;\n }\n state.processedOps += 1;\n state.highestCursor = Math.max(state.highestCursor ?? 0, message.seq);\n if (op.action === \"delete\") {\n continue;\n }\n try {\n const recordResponse = await agent.com.atproto.repo.getRecord({\n repo: message.repo,\n collection: TESTDATA_COLLECTION,\n rkey,\n });\n const record = recordResponse.data.value as TestDataRecord;\n if (record.$type !== TESTDATA_COLLECTION) {\n continue;\n }\n await insertTestDataRow({\n cursor: message.seq,\n repo: message.repo,\n collection: TESTDATA_COLLECTION,\n rkey,\n record,\n eventTime: message.time,\n receivedAt: now,\n });\n state.storedEvents += 1;\n } catch (error) {\n console.error(\"Failed to fetch record for op\", { op, error });\n }\n }\n}\n\nfunction toWebSocketUrl(url: URL): string {\n const next = new URL(url.toString());\n if (next.protocol === \"https:\") {\n next.protocol = \"wss:\";\n } else if (next.protocol === \"http:\") {\n next.protocol = \"ws:\";\n }\n return next.toString();\n}\n\nconst binaryDecoder = new TextDecoder();\n\nfunction normalizeEventData(data: unknown): Promise {\n if (typeof data === \"string\") {\n return Promise.resolve(data);\n }\n if (data instanceof ArrayBuffer) {\n return Promise.resolve(binaryDecoder.decode(new Uint8Array(data)));\n }\n if (data instanceof Uint8Array) {\n return Promise.resolve(binaryDecoder.decode(data));\n }\n if (typeof Blob !== \"undefined\" && data instanceof Blob) {\n return data.text();\n }\n if (\n data &&\n typeof (data as { text?: () => Promise }).text === \"function\"\n ) {\n return (data as { text: () => Promise }).text();\n }\n return Promise.resolve(\"\");\n}\n",[],[162,260],"a07884fc-a7df-11f0-a438-0224a6c84d84","autoPostTestData.cron.ts","2055dbe8-a704-11f0-8ebb-0224a6c84d84",34,["D",1760323935858],"import { BskyAgent } from \"https://esm.sh/@atproto/api@0.13.18?target=deno\";\nimport {\n buildTestDataRecord,\n TESTDATA_COLLECTION,\n} from \"../shared/atprotoTestData.ts\";\n\nconst SERVICE_URL = Deno.env.get(\"BLUESKY_SERVICE_URL\") ??\n \"https://bsky.social\";\nconst IDENTIFIER = Deno.env.get(\"BLUESKY_HANDLE\");\nconst APP_PASSWORD = Deno.env.get(\"BLUESKY_APP_PASSWORD\");\n\nfunction ensureCredentials(): { identifier: string; appPassword: string } {\n if (!IDENTIFIER) {\n throw new Error(\"BLUESKY_HANDLE environment variable is required\");\n }\n if (!APP_PASSWORD) {\n throw new Error(\"BLUESKY_APP_PASSWORD environment variable is required\");\n }\n return { identifier: IDENTIFIER, appPassword: APP_PASSWORD };\n}\n\n// Generate random sensor readings for demo purposes\nfunction generateSensorData() {\n const sensors = [\n { label: \"temperature\", min: 65, max: 85, unit: \"°F\" },\n { label: \"humidity\", min: 30, max: 70, unit: \"%\" },\n { label: \"cpu_usage\", min: 10, max: 90, unit: \"%\" },\n { label: \"memory_usage\", min: 40, max: 80, unit: \"%\" },\n { label: \"response_time\", min: 50, max: 500, unit: \"ms\" },\n ];\n\n const sensor = sensors[Math.floor(Math.random() * sensors.length)];\n const value = Number(\n (Math.random() * (sensor.max - sensor.min) + sensor.min).toFixed(2),\n );\n\n return {\n label: sensor.label,\n value,\n unit: sensor.unit,\n notes: `Automated reading from ${new Date().toISOString()}`,\n };\n}\n\nexport default async function autoPostTestData(): Promise {\n const { identifier, appPassword } = ensureCredentials();\n\n // Generate sensor data\n const sensorData = generateSensorData();\n\n // Build the record\n const record = buildTestDataRecord({\n label: sensorData.label,\n value: sensorData.value,\n unit: sensorData.unit,\n notes: sensorData.notes,\n });\n\n // Authenticate and post to Bluesky\n const agent = new BskyAgent({ service: SERVICE_URL });\n await agent.login({ identifier, password: appPassword });\n const repo = agent.session?.did ?? identifier;\n\n const creation = await agent.com.atproto.repo.createRecord({\n repo,\n collection: TESTDATA_COLLECTION,\n record,\n // Skip server-side lexicon validation because this is a custom collection.\n validate: false,\n });\n\n const { uri, cid } = creation.data;\n\n const latest = await agent.com.atproto.repo.listRecords({\n repo,\n collection: TESTDATA_COLLECTION,\n limit: 1,\n reverse: true,\n });\n\n const newest = latest.data.records?.[0];\n const confirmed = Boolean(newest && newest.cid === cid);\n\n console.log({\n event: \"testdata.posted\",\n repo,\n uri: uri ?? newest?.uri ?? null,\n cid,\n label: record.label,\n value: record.value,\n unit: record.unit,\n confirmed,\n });\n}\n",[],[162,268],"b3c4dfea-a3f4-11f0-8e27-0224a6c84d84","queries.ts","b3c4e0d0-a3f4-11f0-8e27-0224a6c84d84","b3b16122-a3f4-11f0-b878-0224a6c84d84",4,["D",1759893183181],"import { sqlite } from \"https://esm.town/v/stevekrouse/sqlite\";\nimport { TESTDATA_COLLECTION, TestDataRecord } from \"../../shared/atprotoTestData.ts\";\n\nexport const TESTDATA_TABLE = \"atproto_test_data\";\n\nexport interface StoredTestDataRow {\n cursor: number;\n repo: string;\n collection: string;\n rkey: string;\n record: TestDataRecord;\n eventTime: string;\n receivedAt: string;\n}\n\nexport async function ensureTestDataTable(): Promise {\n await sqlite.execute(`CREATE TABLE IF NOT EXISTS ${TESTDATA_TABLE} (\n cursor INTEGER PRIMARY KEY,\n repo TEXT NOT NULL,\n collection TEXT NOT NULL,\n rkey TEXT NOT NULL,\n record_json TEXT NOT NULL,\n event_time TEXT NOT NULL,\n received_at TEXT NOT NULL\n )`);\n await sqlite.execute(`CREATE INDEX IF NOT EXISTS idx_${TESTDATA_TABLE}_collection ON ${TESTDATA_TABLE}(collection)`);\n}\n\nexport async function getLatestCursor(): Promise {\n const result = await sqlite.execute(`SELECT MAX(cursor) as cursor FROM ${TESTDATA_TABLE}`);\n const row = (result.rows?.[0] ?? {}) as { cursor?: number | null };\n return typeof row.cursor === \"number\" ? row.cursor : null;\n}\n\nexport async function insertTestDataRow(row: StoredTestDataRow): Promise {\n await sqlite.execute(\n `INSERT OR IGNORE INTO ${TESTDATA_TABLE} (cursor, repo, collection, rkey, record_json, event_time, received_at)\n VALUES (?, ?, ?, ?, ?, ?, ?)`,\n [\n row.cursor,\n row.repo,\n row.collection,\n row.rkey,\n JSON.stringify(row.record),\n row.eventTime,\n row.receivedAt,\n ],\n );\n}\n\nexport async function listRecentTestData(limit = 20): Promise {\n const result = await sqlite.execute(\n `SELECT cursor, repo, collection, rkey, record_json, event_time, received_at\n FROM ${TESTDATA_TABLE}\n WHERE collection = ?\n ORDER BY cursor DESC\n LIMIT ?`,\n [TESTDATA_COLLECTION, limit],\n );\n\n return (result.rows ?? []).map((row) => ({\n cursor: Number(row.cursor),\n repo: String(row.repo),\n collection: String(row.collection),\n rkey: String(row.rkey),\n record: JSON.parse(String(row.record_json)) as TestDataRecord,\n eventTime: String(row.event_time),\n receivedAt: String(row.received_at),\n }));\n}\n",[],[162,284,276],"database","b3b16078-a3f4-11f0-b878-0224a6c84d84",["D",1759893183054],[179],[162,284],["D",1759893182834],[178,180,181,182,183,184,185],[162],["D",1759843843402],{"_11":12,"_88":84},{"_11":12,"_82":-5,"_83":84,"_45":46,"_85":86,"_87":38},{"_29":30,"_13":26,"_20":21,"_27":28,"_31":-5,"_32":-5,"_77":-5,"_78":-5,"_79":-5,"_80":14,"_81":12},"ctx",{"_70":-5,"_109":329,"_330":331,"_332":333,"_334":38,"_335":38,"_336":38,"_337":50,"_338":-5,"_339":-7,"_340":-7,"_341":54,"_342":38,"_343":38,"_344":-5,"_345":38,"_346":38,"_347":38,"_348":-5},"ENV",{"_300":301,"_302":303,"_304":26,"_305":306,"_307":308,"_309":310,"_311":312,"_313":314,"_315":316,"_317":318,"_319":320,"_321":322,"_323":324,"_325":326,"_327":328},"REACT_APP_SENTRY_DSN","https://586020d86f05489db63a554690acf1e9@o1398359.ingest.sentry.io/6724499","RENDER_GIT_COMMIT","e87eb04e707cf64e7e532c8e8ec395f209e17f15","RENDER_GIT_BRANCH","POSTHOG_API_TOKEN","phc_nmoyuAkStEZuUp69rYlg1DZgrIt19Gx0Y4Hwf8tGgJP","POSTHOG_API_HOST","https://wart.val.town","WEB_API_TEMPLATE","https://{val}.web.val.run","APP_URL","https://www.val.town","MODULE_URL","https://esm.town","VANITY_WEB_API_TEMPLATE","https://{label}.val.run/","DENOLS_URL","https://lsp.val.town","NODE_ENV","production","CLOUDFLARE_TURNSTILE_SITE_KEY","0x4AAAAAACtaIZJH7s9rBMZ6","GOOGLE_CLIENT_ID","875989696899-jtsqkhlbdv5jrlsk8631p7ipjg3c6o62.apps.googleusercontent.com","STRIPE_PUBLISHABLE_KEY","pk_live_51N2zvWEpZTTLipIkVEwXrUG9AT0yeOOEYxszarZT1jpsZV58Ly6wlg3SltZpHN26CUalOBmUSY7adQRQiSkCZz2500qSXNkf8Y","API_URL","https://api.val.town",[],"preferencesKeybindings","default","preferencesTheme","light","preferencesFixers","preferencesCopilot","preferencesSelectionAi","preferencesCloseBrackets","preferencesChatPanelState","preferencesDprint","preferencesDenofmt","notificationCount","flagDenols","isBusinessOrgMember","businessOrgHandle","isBusinessOrgAdmin","isHigherTownieTier","navCollapsed","currentOrgId"]

Branches1

Branches
1