Hi

\"\n});\n```\n\n## Val Town Utility Functions\n\nVal Town provides several utility functions to help with common project tasks.\n\n### Importing Utilities\n\nAlways import utilities with version pins to avoid breaking changes:\n\n```ts\nimport { parseProject, readFile, serveFile } from \"https://esm.town/v/std/utils@85-main/index.ts\";\n```\n\n### Available Utilities\n\n\n#### **serveFile** - Serve project files with proper content types\n\nFor example, in Hono:\n\n```ts\n// serve all files in frontend/ and shared/\napp.get(\"/frontend/*\", c => serveFile(c.req.path, import.meta.url));\napp.get(\"/shared/*\", c => serveFile(c.req.path, import.meta.url));\n```\n\n#### **readFile** - Read files from within the project:\n\n```ts\n// Read a file from the project\nconst fileContent = await readFile(\"/frontend/index.html\", import.meta.url);\n```\n\n#### **listFiles** - List all files in the project\n\n```ts\nconst files = await listFiles(import.meta.url);\n```\n\n#### **parseProject** - Extract information about the current project from import.meta.url\n\nThis is useful for including info for linking back to a val, ie in \"view source\" urls:\n\n```ts\nconst projectVal = parseProject(import.meta.url);\nconsole.log(projectVal.username); // Owner of the project\nconsole.log(projectVal.name); // Project name\nconsole.log(projectVal.version); // Version number\nconsole.log(projectVal.branch); // Branch name\nconsole.log(projectVal.links.self.project); // URL to the project page\n```\n\nHowever, it's *extremely importing* to note that `parseProject` and other Standard Library utilities ONLY RUN ON THE SERVER.\nIf you need access to this data on the client, run it in the server and pass it to the client by splicing it into the HTML page\nor by making an API request for it.\n\n## Val Town Platform Specifics\n\n- **Redirects:** Use `return new Response(null, { status: 302, headers: { Location: \"/place/to/redirect\" }})` instead of `Response.redirect` which is broken\n- **Images:** Avoid external images or base64 images. Use emojis, unicode symbols, or icon fonts/libraries instead\n- **AI Image:** To inline generate an AI image use: `

`\n- **Storage:** DO NOT use the Deno KV module for storage\n- **Browser APIs:** DO NOT use the `alert()`, `prompt()`, or `confirm()` methods\n- **Weather Data:** Use open-meteo for weather data (doesn't require API keys) unless otherwise specified\n- **View Source:** Add a view source link by importing & using `import.meta.url.replace(\"ems.sh\", \"val.town)\"` (or passing this data to the client) and include `target=\"_top\"` attribute\n- **Error Debugging:** Add `` to HTML to capture client-side errors\n- **Error Handling:** Only use try...catch when there's a clear local resolution; Avoid catches that merely log or return 500s. Let errors bubble up with full context\n- **Environment Variables:** Use `Deno.env.get('keyname')` when you need to, but generally prefer APIs that don't require keys\n- **Imports:** Use `https://esm.sh` for npm and Deno dependencies to ensure compatibility on server and browser\n- **Storage Strategy:** Only use backend storage if explicitly required; prefer simple static client-side sites\n- **React Configuration:** When using React libraries, pin versions with `?deps=react@18.2.0,react-dom@18.2.0` and start the file with `/** @jsxImportSource https://esm.sh/react@18.2.0 */`\n- Ensure all React dependencies and sub-dependencies are pinned to the same version\n- **Styling:** Default to using TailwindCSS via `` unless otherwise specified\n\n## Project Structure and Design Patterns\n\n### Recommended Directory Structure\n```\n├── backend/\n│ ├── database/\n│ │ ├── migrations.ts # Schema definitions\n│ │ ├── queries.ts # DB query functions\n│ │ └── README.md\n│ └── routes/ # Route modules\n│ ├── [route].ts\n│ └── static.ts # Static file serving\n│ ├── index.ts # Main entry point\n│ └── README.md\n├── frontend/\n│ ├── components/\n│ │ ├── App.tsx\n│ │ └── [Component].tsx\n│ ├── favicon.svg\n│ ├── index.html # Main HTML template\n│ ├── index.tsx # Frontend JS entry point\n│ ├── README.md\n│ └── style.css\n├── README.md\n└── shared/\n ├── README.md\n └── utils.ts # Shared types and functions\n```\n\n### Backend (Hono) Best Practices\n\n- Hono is the recommended API framework\n- Main entry point should be `backend/index.ts`\n- **Static asset serving:** Use the utility functions to read and serve project files:\n ```ts\n import { readFile, serveFile } from \"https://esm.town/v/std/utils@85-main/index.ts\";\n \n // serve all files in frontend/ and shared/\n app.get(\"/frontend/*\", c => serveFile(c.req.path, import.meta.url));\n app.get(\"/shared/*\", c => serveFile(c.req.path, import.meta.url));\n \n // For index.html, often you'll want to bootstrap with initial data\n app.get(\"/\", async c => {\n let html = await readFile(\"/frontend/index.html\", import.meta.url);\n \n // Inject data to avoid extra round-trips\n const initialData = await fetchInitialData();\n const dataScript = ``;\n \n html = html.replace(\"\", `${dataScript}`);\n return c.html(html);\n });\n ```\n- Create RESTful API routes for CRUD operations\n- Always include this snippet at the top-level Hono app to re-throwing errors to see full stack traces:\n ```ts\n // Unwrap Hono errors to see original error details\n app.onError((err, c) => {\n throw err;\n });\n ```\n\n### Database Patterns\n- Run migrations on startup or comment out for performance\n- Change table names when modifying schemas rather than altering\n- Export clear query functions with proper TypeScript typing\n\n## Common Gotchas and Solutions\n\n1. **Environment Limitations:** \n - Val Town runs on Deno in a serverless context, not Node.js\n - Code in `shared/` must work in both frontend and backend environments\n - Cannot use `Deno` keyword in shared code\n - Use `https://esm.sh` for imports that work in both environments\n\n2. **SQLite Peculiarities:**\n - Limited support for ALTER TABLE operations\n - Create new tables with updated schemas and copy data when needed\n - Always run table creation before querying\n\n3. **React Configuration:**\n - All React dependencies must be pinned to 18.2.0\n - Always include `@jsxImportSource https://esm.sh/react@18.2.0` at the top of React files\n - Rendering issues often come from mismatched React versions\n\n4. **File Handling:**\n - Val Town only supports text files, not binary\n - Use the provided utilities to read files across branches and forks\n - For files in the project, use `readFile` helpers\n\n5. **API Design:**\n - `fetch` handler is the entry point for HTTP vals\n - Run the Hono app with `export default app.fetch // This is the entry point for HTTP vals`\n\n",[],[201],{"_104":209,"_95":210,"_153":211,"_155":-5,"_156":138,"_157":212,"_159":160,"_106":213,"_100":32,"_162":195,"_164":214,"_165":22,"_166":-5,"_167":215,"_98":216},"d5c0f660-c8ac-11f0-bd2f-42dde27851f2","deno.json","d5c0f73c-c8ac-11f0-bd2f-42dde27851f2",7,["D",1763930509382],"{\n \"$schema\": \"https://raw.githubusercontent.com/denoland/deno/98f62cee78e85bfc47c62ed703777c6bc8794f1c/cli/schemas/config-file.v1.json\",\n \"lock\": false,\n \"compilerOptions\": {\n \"noImplicitAny\": false,\n \"strict\": true,\n \"types\": [\"https://www.val.town/types/valtown.d.ts\"],\n \"lib\": [\n \"dom\",\n \"dom.iterable\",\n \"dom.asynciterable\",\n \"deno.ns\",\n \"deno.unstable\"\n ]\n },\n \"lint\": {\n \"include\": [\"deno:/https/esm.town/**/*\"],\n \"rules\": {\n \"exclude\": [\"no-explicit-any\"]\n }\n },\n \"node_modules_dir\": false,\n \"experimental\": {\n \"unstable-node-globals\": true,\n \"unstable-temporal\": true,\n \"unstable-worker-options\": true,\n \"unstable-sloppy-imports\": true\n }\n}",[],[210],{"_104":218,"_95":99,"_153":219,"_155":-5,"_156":138,"_157":101,"_159":22,"_106":220,"_100":221,"_162":222,"_164":223,"_165":22,"_166":-5,"_167":224,"_98":225},"6a185342-c96d-11f0-8199-42dde27851f2","0026de34-c8ac-11f0-aa7c-42dde27851f2",["D",1764013221678],13,"http","// URL Enqueue Val - Independent HTTP endpoint with web form UI\nimport { enqueueUrl, bulkEnqueue, getQueueItems, getStats } from \"./src/database.ts\";\n\n// Dual Authentication: X-API-Key header OR Basic Auth fallback\nfunction checkAuth(req: Request): boolean {\n const expectedKey = Deno.env.get(\"URL_PROCESSOR_PASSWORD\");\n\n // Method 1: X-API-Key header (for curl/scripts)\n const apiKey = req.headers.get(\"X-API-Key\");\n if (apiKey && apiKey === expectedKey) {\n return true;\n }\n\n // Method 2: Basic Auth fallback (for browser popup)\n const auth = req.headers.get(\"Authorization\");\n if (auth?.startsWith(\"Basic \")) {\n try {\n const credentials = atob(auth.slice(6));\n const [user, pass] = credentials.split(\":\");\n return user === \"admin\" && pass === expectedKey;\n } catch {\n return false;\n }\n }\n\n return false;\n}\n\n// HTML template for the enqueue form\nfunction renderEnqueueForm(message?: { type: \"success\" | \"error\"; text: string }): string {\n return `\n\n\n \n \n URL Queue - Enqueue\n \n\n\n

URL Queue - Enqueue

Add URLs to the processing queue

\n\n ${message ? `

${message.text}

` : \"\"}\n\n

Add Single URL

\n \n

\n\n

Bulk Add URLs

\n \n

\n\n

Queue Status

Total

Pending

Processing

Completed

Failed

\n View as JSON\n

\n\n \n\n`;\n}\n\nexport default async function handler(req: Request): Promise {\n // Check authentication\n if (!checkAuth(req)) {\n return new Response(\"Unauthorized\", {\n status: 401,\n headers: { \"WWW-Authenticate\": 'Basic realm=\"URL Enqueue\"' },\n });\n }\n\n const url = new URL(req.url);\n const action = url.searchParams.get(\"action\");\n\n // Handle API endpoints\n if (action === \"enqueue\") {\n let urlToEnqueue: string | null = null;\n\n if (req.method === \"POST\") {\n const contentType = req.headers.get(\"content-type\") || \"\";\n if (contentType.includes(\"application/x-www-form-urlencoded\")) {\n const formData = await req.formData();\n urlToEnqueue = formData.get(\"url\") as string;\n } else if (contentType.includes(\"application/json\")) {\n const json = await req.json();\n urlToEnqueue = json.url;\n }\n } else {\n urlToEnqueue = decodeURIComponent(url.searchParams.get(\"url\") || \"\");\n const urlToAdd = decodeURIComponent(url.searchParams.get(\"url\") || \"\");\n }\n\n if (!urlToEnqueue) {\n if (req.method === \"POST\") {\n return new Response(renderEnqueueForm({ type: \"error\", text: \"Missing URL parameter\" }), {\n headers: { \"Content-Type\": \"text/html\" },\n });\n }\n return Response.json({ success: false, error: \"Missing url parameter\" }, { status: 400 });\n }\n\n const result = await enqueueUrl(urlToEnqueue);\n\n // If it's a form submission, show the UI with message\n if (req.method === \"POST\" && req.headers.get(\"content-type\")?.includes(\"form\")) {\n const message = result.success\n ? { type: \"success\" as const, text: result.error || `URL added to queue (ID: ${result.id})` }\n : { type: \"error\" as const, text: result.error || \"Failed to add URL\" };\n return new Response(renderEnqueueForm(message), {\n headers: { \"Content-Type\": \"text/html\" },\n });\n }\n\n return Response.json(result, {\n status: result.success ? 200 : 400,\n headers: { \"Content-Type\": \"application/json\" },\n });\n }\n\n if (action === \"bulk\") {\n let urls: string[] = [];\n\n if (req.method === \"POST\") {\n const contentType = req.headers.get(\"content-type\") || \"\";\n if (contentType.includes(\"application/x-www-form-urlencoded\")) {\n const formData = await req.formData();\n const urlsText = formData.get(\"urls\") as string;\n urls = urlsText.split(\"\\n\").filter((u) => u.trim());\n } else if (contentType.includes(\"application/json\")) {\n const json = await req.json();\n urls = Array.isArray(json) ? json : json.urls || [];\n }\n }\n\n if (urls.length === 0) {\n if (req.method === \"POST\" && req.headers.get(\"content-type\")?.includes(\"form\")) {\n return new Response(renderEnqueueForm({ type: \"error\", text: \"No URLs provided\" }), {\n headers: { \"Content-Type\": \"text/html\" },\n });\n }\n return Response.json({ success: false, error: \"No URLs provided\" }, { status: 400 });\n }\n\n const result = await bulkEnqueue(urls);\n\n // If it's a form submission, show the UI with message\n if (req.method === \"POST\" && req.headers.get(\"content-type\")?.includes(\"form\")) {\n const message = {\n type: result.errors.length === 0 ? (\"success\" as const) : (\"error\" as const),\n text: `Added ${result.queued} URLs, skipped ${result.skipped} duplicates${\n result.errors.length > 0 ? `. Errors: ${result.errors.join(\", \")}` : \"\"\n }`,\n };\n return new Response(renderEnqueueForm(message), {\n headers: { \"Content-Type\": \"text/html\" },\n });\n }\n\n return Response.json(result, {\n headers: { \"Content-Type\": \"application/json\" },\n });\n }\n\n if (action === \"status\") {\n const id = url.searchParams.get(\"id\");\n if (!id) {\n return Response.json({ success: false, error: \"Missing id parameter\" }, { status: 400 });\n }\n\n const items = await getQueueItems();\n const item = items.find((i) => i.id === parseInt(id));\n\n if (!item) {\n return Response.json({ success: false, error: \"Item not found\" }, { status: 404 });\n }\n\n return Response.json({ success: true, item }, {\n headers: { \"Content-Type\": \"application/json\" },\n });\n }\n\n if (action === \"stats\") {\n const stats = await getStats();\n return Response.json(stats, {\n headers: { \"Content-Type\": \"application/json\" },\n });\n }\n\n if (action === \"list\") {\n const limit = parseInt(url.searchParams.get(\"limit\") || \"100\");\n const items = await getQueueItems({ limit });\n return Response.json({ success: true, items }, {\n headers: { \"Content-Type\": \"application/json\" },\n });\n }\n\n // Default: show the web UI\n return new Response(renderEnqueueForm(), {\n headers: { \"Content-Type\": \"text/html\" },\n });\n}\n",[],[99],"files",[150,169,179,189,199,208,217],"counts",{"_230":32,"_231":158,"_232":32,"_233":234},"pulls","branches","forks","envVars",{"_235":158,"_236":32},"count","emptyCount","contents",[],{"_104":218,"_95":99,"_153":219,"_155":-5,"_156":138,"_157":101,"_159":22,"_106":240,"_100":221,"_162":222,"_164":223,"_165":22,"_166":-5,"_98":241},["D",1764013221678],[99],"upstreamProject","upstreamBranch","emptyEnvVars","isNew","flags",[],"routes/_app.x.$handle.$name.branch.$branch.version.$version.code.$",{"_93":94,"_95":96,"_97":43,"_100":101,"_98":99,"_102":250,"_148":255,"_226":277,"_195":278,"_237":280,"_281":-5,"_282":-5,"_283":-5,"_284":-5,"_285":286},{"_104":105,"_95":96,"_106":251,"_108":-5,"_109":22,"_110":111,"_112":-5,"_113":-5,"_14":114,"_115":-5,"_116":22,"_117":-5,"_118":32,"_16":119,"_120":121,"_122":121,"_123":124,"_125":124,"_126":124,"_127":121,"_128":121,"_23":252,"_132":253,"_135":254,"_147":22},["D",1763930150033],{"_93":94,"_130":131},{"_93":94,"_134":131,"_14":114},{"_100":137,"_95":43,"_104":138,"_139":105,"_140":-5,"_141":-5,"_142":-5,"_143":-5,"_144":-5,"_145":96,"_146":94},[256,265,268,271,274],{"_104":151,"_95":152,"_153":154,"_155":-5,"_156":138,"_157":158,"_159":160,"_106":161,"_100":32,"_162":163,"_164":-5,"_165":22,"_166":-5,"_167":257,"_98":264},[258,261],{"_104":170,"_95":171,"_153":172,"_155":154,"_156":138,"_157":173,"_159":160,"_106":174,"_100":32,"_162":175,"_164":176,"_165":22,"_166":-5,"_167":259,"_98":260},[],[152,171],{"_104":180,"_95":181,"_153":182,"_155":154,"_156":138,"_157":183,"_159":160,"_106":184,"_100":32,"_162":175,"_164":185,"_165":22,"_166":-5,"_167":262,"_98":263},[],[152,181],[152],{"_104":190,"_95":191,"_153":192,"_155":-5,"_156":138,"_157":193,"_159":160,"_106":194,"_100":32,"_162":195,"_164":196,"_165":22,"_166":-5,"_167":266,"_98":267},[],[191],{"_104":200,"_95":201,"_153":202,"_155":-5,"_156":138,"_157":203,"_159":160,"_106":204,"_100":32,"_162":195,"_164":205,"_165":22,"_166":-5,"_167":269,"_98":270},[],[201],{"_104":209,"_95":210,"_153":211,"_155":-5,"_156":138,"_157":212,"_159":160,"_106":213,"_100":32,"_162":195,"_164":214,"_165":22,"_166":-5,"_167":272,"_98":273},[],[210],{"_104":218,"_95":99,"_153":219,"_155":-5,"_156":138,"_157":101,"_159":22,"_106":220,"_100":221,"_162":222,"_164":223,"_165":22,"_166":-5,"_167":275,"_98":276},[],[99],[256,258,261,265,268,271,274],{"_104":218,"_95":99,"_153":219,"_155":-5,"_156":138,"_157":101,"_159":22,"_106":240,"_100":221,"_162":222,"_164":223,"_165":22,"_166":-5,"_98":279},[99],[],"upstream","pull","ahead","behind","templates",[],"actionData","errors"]

dl4senses

url_enqueue