Hi

\",\n});\n```\n\n## Val Town Utility Functions\n\nVal Town provides several utility functions to help with common project tasks.\n\n### Importing Utilities\n\nAlways import utilities with version pins to avoid breaking changes:\n\n```ts\nimport {\n parseProject,\n readFile,\n serveFile,\n} from \"https://esm.town/v/std/utils@85-main/index.ts\";\n```\n\n### Available Utilities\n\n#### **serveFile** - Serve project files with proper content types\n\nFor example, in Hono:\n\n```ts\n// serve all files in frontend/ and shared/\napp.get(\"/frontend/*\", (c) => serveFile(c.req.path, import.meta.url));\napp.get(\"/shared/*\", (c) => serveFile(c.req.path, import.meta.url));\n```\n\n#### **readFile** - Read files from within the project:\n\n```ts\n// Read a file from the project\nconst fileContent = await readFile(\"/frontend/index.html\", import.meta.url);\n```\n\n#### **listFiles** - List all files in the project\n\n```ts\nconst files = await listFiles(import.meta.url);\n```\n\n#### **parseProject** - Extract information about the current project from import.meta.url\n\nThis is useful for including info for linking back to a val, ie in \"view source\"\nurls:\n\n```ts\nconst projectVal = parseProject(import.meta.url);\nconsole.log(projectVal.username); // Owner of the project\nconsole.log(projectVal.name); // Project name\nconsole.log(projectVal.version); // Version number\nconsole.log(projectVal.branch); // Branch name\nconsole.log(projectVal.links.self.project); // URL to the project page\n```\n\nHowever, it's _extremely importing_ to note that `parseProject` and other\nStandard Library utilities ONLY RUN ON THE SERVER. If you need access to this\ndata on the client, run it in the server and pass it to the client by splicing\nit into the HTML page or by making an API request for it.\n\n## Val Town Platform Specifics\n\n- **Redirects:** Use\n `return new Response(null, { status: 302, headers: { Location: \"/place/to/redirect\" }})`\n instead of `Response.redirect` which is broken\n- **Images:** Avoid external images or base64 images. Use emojis, unicode\n symbols, or icon fonts/libraries instead\n- **AI Image:** To inline generate an AI image use:\n `

`\n- **Storage:** DO NOT use the Deno KV module for storage\n- **Browser APIs:** DO NOT use the `alert()`, `prompt()`, or `confirm()` methods\n- **Weather Data:** Use open-meteo for weather data (doesn't require API keys)\n unless otherwise specified\n- **View Source:** Add a view source link by importing & using\n `import.meta.url.replace(\"ems.sh\", \"val.town)\"` (or passing this data to the\n client) and include `target=\"_top\"` attribute\n- **Error Debugging:** Add\n `` to HTML to capture\n client-side errors\n- **Error Handling:** Only use try...catch when there's a clear local\n resolution; Avoid catches that merely log or return 500s. Let errors bubble up\n with full context\n- **Environment Variables:** Use `Deno.env.get('keyname')` when you need to, but\n generally prefer APIs that don't require keys\n- **Imports:** Use `https://esm.sh` for npm and Deno dependencies to ensure\n compatibility on server and browser\n- **Storage Strategy:** Only use backend storage if explicitly required; prefer\n simple static client-side sites\n- **React Configuration:** When using React libraries, pin versions with\n `?deps=react@18.2.0,react-dom@18.2.0` and start the file with\n `/** @jsxImportSource https://esm.sh/react@18.2.0 */`\n- Ensure all React dependencies and sub-dependencies are pinned to the same\n version\n- **Styling:** Default to using TailwindCSS via\n `` unless otherwise\n specified\n\n## Project Structure and Design Patterns\n\n### Recommended Directory Structure\n\n```\n├── backend/\n│ ├── database/\n│ │ ├── migrations.ts # Schema definitions\n│ │ ├── queries.ts # DB query functions\n│ │ └── README.md\n│ └── routes/ # Route modules\n│ ├── [route].ts\n│ └── static.ts # Static file serving\n│ ├── index.ts # Main entry point\n│ └── README.md\n├── frontend/\n│ ├── components/\n│ │ ├── App.tsx\n│ │ └── [Component].tsx\n│ ├── favicon.svg\n│ ├── index.html # Main HTML template\n│ ├── index.tsx # Frontend JS entry point\n│ ├── README.md\n│ └── style.css\n├── README.md\n└── shared/\n ├── README.md\n └── utils.ts # Shared types and functions\n```\n\n### Backend (Hono) Best Practices\n\n- Hono is the recommended API framework\n- Main entry point should be `backend/index.ts`\n- **Static asset serving:** Use the utility functions to read and serve project\n files:\n ```ts\n import {\n readFile,\n serveFile,\n } from \"https://esm.town/v/std/utils@85-main/index.ts\";\n\n // serve all files in frontend/ and shared/\n app.get(\"/frontend/*\", (c) => serveFile(c.req.path, import.meta.url));\n app.get(\"/shared/*\", (c) => serveFile(c.req.path, import.meta.url));\n\n // For index.html, often you'll want to bootstrap with initial data\n app.get(\"/\", async (c) => {\n let html = await readFile(\"/frontend/index.html\", import.meta.url);\n\n // Inject data to avoid extra round-trips\n const initialData = await fetchInitialData();\n const dataScript = ``;\n\n html = html.replace(\"\", `${dataScript}`);\n return c.html(html);\n });\n ```\n- Create RESTful API routes for CRUD operations\n- Always include this snippet at the top-level Hono app to re-throwing errors to\n see full stack traces:\n ```ts\n // Unwrap Hono errors to see original error details\n app.onError((err, c) => {\n throw err;\n });\n ```\n\n### Database Patterns\n\n- Run migrations on startup or comment out for performance\n- Change table names when modifying schemas rather than altering\n- Export clear query functions with proper TypeScript typing\n\n## Common Gotchas and Solutions\n\n1. **Environment Limitations:**\n - Val Town runs on Deno in a serverless context, not Node.js\n - Code in `shared/` must work in both frontend and backend environments\n - Cannot use `Deno` keyword in shared code\n - Use `https://esm.sh` for imports that work in both environments\n\n2. **SQLite Peculiarities:**\n - Limited support for ALTER TABLE operations\n - Create new tables with updated schemas and copy data when needed\n - Always run table creation before querying\n\n3. **React Configuration:**\n - All React dependencies must be pinned to 18.2.0\n - Always include `@jsxImportSource https://esm.sh/react@18.2.0` at the top of\n React files\n - Rendering issues often come from mismatched React versions\n\n4. **File Handling:**\n - Val Town only supports text files, not binary\n - Use the provided utilities to read files across branches and forks\n - For files in the project, use `readFile` helpers\n\n5. **API Design:**\n - `fetch` handler is the entry point for HTTP vals\n - Run the Hono app with\n `export default app.fetch // This is the entry point for HTTP vals`",[],[272],"f78560a4-eb86-11f0-ae23-42dde27851f2",".vtignore","019b96db-a5eb-708a-9889-26898fd1859a",["D",1767762535836],".git\n.vscode\n.cursorrules\n.DS_Store\nnode_modules\nvendor",[],[279],["D",1767762535836],[],[18,75],["D",1767762535836],[],[18,87],["D",1767762535836],[],[18,92],["D",1767762535836],[225,226,227],[18],"f784f9a2-eb86-11f0-ae23-42dde27851f2","skills-indexer.ts","019b96db-a5eb-708a-9889-0c5afb8b4feb","019b96db-a5eb-708a-9889-139226190499",["D",1767762535836],"interval","import { parseSkillMd, transformToDbSkill } from \"./skill-parser.ts\";\nimport { Bucket, GitHubClient } from \"../clients/github.ts\";\nimport { db } from \"../database/db.ts\";\nimport { skills, skillStats } from \"../database/schema.ts\";\nimport { sql } from \"npm:drizzle-orm@0.44.2\";\nimport { blob } from \"https://esm.town/v/std/blob\";\nimport {\n type Logger,\n withLogger,\n} from \"https://esm.town/v/kamalnrf/axiom-logger/standalone.ts\";\n\ntype SkillsIndexerRunState = {\n lastIndexProcessed: number; // exclusive end of last batch (next run starts here)\n batchSize: number;\n totalBuckets: number;\n sortedBy: \"count_desc_min_asc\";\n startedAt: string;\n completedAt?: string;\n};\nconst LAST_RUN_STATE_KEY = \"skills-indexer:last-run-state\";\nexport async function getLastRunState(): Promise {\n try {\n return await blob.getJSON(LAST_RUN_STATE_KEY);\n } catch {\n return null;\n }\n}\n\nfunction computeEndIndexByItemCount(\n buckets: Array,\n start: number,\n maxItems: number,\n): number {\n let total = 0;\n let i = start;\n while (i < buckets.length && total + buckets[i].count <= maxItems) {\n total += buckets[i].count;\n i++;\n }\n // If the very first bucket exceeds maxItems, still process at least one bucket\n return i === start ? Math.min(start + 1, buckets.length) : i;\n}\n\nexport async function setLastRunState(\n state: SkillsIndexerRunState,\n): Promise {\n await blob.setJSON(LAST_RUN_STATE_KEY, state);\n}\n\nconst github = new GitHubClient();\n\ntype IndexSkillsArgs = {\n minSize: number;\n maxSize: number;\n};\n\nasync function indexSkills({ minSize, maxSize }: IndexSkillsArgs, log: Logger) {\n let indexed = 0;\n let invalid = 0;\n let failed = 0;\n\n // Search for SKILL.md files in skills/ directories (exclude archived repos)\n const searchQuery =\n `filename:SKILL.md language:Markdown \"---\" \"name:\" \"description:\" size:${minSize}..${maxSize}`;\n log.info(`Searching: ${searchQuery}`);\n\n const firstPage = await github.searchCode(searchQuery);\n log.info(`Found ${firstPage.total_count} SKILL.md files`);\n\n // Calculate total pages (max 10 pages = 1000 results)\n const maxPages = Math.min(Math.ceil(firstPage.total_count / 100), 10);\n if (firstPage.total_count > 1000) {\n log.warn(\n `Found ${firstPage.total_count} results. GitHub limits to 1000, only first 1000 will be indexed.`,\n );\n }\n\n // Process all pages\n for (let page = 1; page <= maxPages; page++) {\n log.info(`\\nProcessing page ${page}/${maxPages}...`);\n\n const searchResults = page === 1\n ? firstPage\n : await github.searchCode(searchQuery, page);\n\n log.info(`Processing ${searchResults.items.length} items...`);\n\n for (const item of searchResults.items) {\n try {\n // Fetch SKILL.md content\n const content = await github.fetchFileContent(\n item.repository.full_name,\n item.path,\n );\n\n // Parse and validate SKILL.md\n const skillData = parseSkillMd(content, item.repository.full_name);\n if (!skillData) {\n log.warn(\n `Invalid SKILL.md from ${item.repository.full_name}/${item.path}`,\n );\n invalid++;\n continue;\n }\n\n // Fetch repository metadata (stars)\n const repoMetadata = await github.fetchRepoMetadata(\n item.repository.full_name,\n );\n\n // Extract directory path (remove SKILL.md from path)\n const directoryPath = item.path.replace(/\\/SKILL\\.md$/, \"\");\n\n // Build raw file URL\n const rawFileUrl =\n `https://raw.githubusercontent.com/${item.repository.full_name}/${repoMetadata.default_branch}/${item.path}`;\n\n // Extract repo name from full_name\n const [repoOwner, repoName] = item.repository.full_name.split(\"/\");\n\n // Skip forks\n if (repoMetadata.fork) {\n log.info(`Skipping forked repository ${repoOwner}/${repoName}`);\n continue;\n }\n\n // Transform to database format\n const dbSkill = transformToDbSkill(\n skillData,\n repoOwner,\n repoName,\n directoryPath,\n item.repository.html_url,\n repoMetadata.stargazers_count,\n rawFileUrl,\n repoMetadata.default_branch,\n );\n\n // Check if skill exists\n const existing = await db\n .select()\n .from(skills)\n .where(\n sql`${skills.namespace} = ${dbSkill.namespace}`,\n )\n .get();\n\n // Use existing ID if skill already exists\n const skillId = existing?.id || dbSkill.id;\n\n // Upsert skill\n await db\n .insert(skills)\n .values({\n ...dbSkill,\n id: skillId,\n deleted: 0,\n })\n .onConflictDoUpdate({\n target: [skills.namespace],\n set: {\n name: sql`excluded.name`,\n description: sql`excluded.description`,\n version: sql`excluded.version`,\n dependencies: sql`excluded.dependencies`,\n sourceUrl: sql`excluded.source_url`,\n stars: sql`excluded.stars`,\n metadata: sql`excluded.metadata`,\n updatedAt: sql`CURRENT_TIMESTAMP`,\n },\n })\n .run();\n\n // Ensure stats entry exists\n await db\n .insert(skillStats)\n .values({ skillId })\n .onConflictDoNothing()\n .run();\n\n indexed++;\n } catch (error) {\n log.error(\n `Failed to process ${item.repository.full_name}/${item.path}:`,\n error,\n );\n failed++;\n }\n }\n }\n\n return {\n indexed,\n invalid,\n failed,\n };\n}\n\nexport default withLogger({\n valName: \"skills-indexer\",\n console: \"warn\",\n type: \"CRON\",\n}, async (log) => {\n const startTime = Date.now();\n\n try {\n log.info(\"GitHub Skills indexer started\");\n const skillsSearchBuckets = await blob.getJSON(\n \"skills-search-buckets\",\n );\n log.info(\"skillSearchBuckets =>\", { skillsSearchBuckets });\n const sortedBuckets = skillsSearchBuckets.sort((a, b) => {\n if (b.count !== a.count) return b.count - a.count;\n return a.min - b.min;\n });\n\n const BATCH_SIZE = 2000;\n const prevState = await getLastRunState();\n const startIdx = Math.min(\n Math.max(prevState?.lastIndexProcessed ?? 0, 0),\n sortedBuckets.length,\n );\n const endIdx = computeEndIndexByItemCount(\n sortedBuckets,\n startIdx,\n BATCH_SIZE,\n );\n\n const runState: SkillsIndexerRunState = {\n lastIndexProcessed: startIdx,\n batchSize: BATCH_SIZE,\n totalBuckets: sortedBuckets.length,\n sortedBy: \"count_desc_min_asc\",\n startedAt: (new Date(startTime)).toISOString(),\n };\n console.log(\"Run State =>\", runState);\n await setLastRunState(runState);\n const currentBatch = sortedBuckets.slice(startIdx, endIdx);\n log.info(\n `Processing buckets ${startIdx}..${endIdx} of ${sortedBuckets.length} (batch size ${currentBatch.length})`,\n );\n\n let indexed = 0;\n let invalid = 0;\n let failed = 0;\n\n const results = await Promise.all(\n currentBatch.map(async ({ min, max }) => {\n try {\n return await indexSkills({ minSize: min, maxSize: max }, log);\n } catch (e) {\n console.error(\"indexSkills failed:\", e);\n return { indexed: 0, invalid: 0, failed: 1 };\n }\n }),\n );\n\n for (const res of results) {\n indexed += res.indexed;\n invalid += res.invalid;\n failed += res.failed;\n }\n\n const duration = ((Date.now() - startTime) / 1000).toFixed(2);\n console.log(\n `Skills indexer completed in ${duration}s: ✓ Indexed ${indexed} skills, ${invalid} invalid, ${failed} failed.`,\n );\n\n // Update Final Run State\n const completedState: SkillsIndexerRunState = {\n ...runState,\n lastIndexProcessed: endIdx,\n completedAt: new Date().toISOString(),\n };\n\n if (endIdx >= sortedBuckets.length) {\n const resetState: SkillsIndexerRunState = {\n ...completedState,\n lastIndexProcessed: 0,\n };\n await setLastRunState(resetState);\n log.info(\"All buckets processed. Checkpoint reset to 0.\");\n } else {\n await setLastRunState(completedState);\n }\n } catch (e) {\n log.error(\"Skills indexer CRON job failed:\", e);\n throw e;\n }\n});",[],[306,298],"cron","f784e8e0-eb86-11f0-ae23-42dde27851f2","skill-parser.ts","019b96db-a5eb-708a-9889-080909c297bb",["D",1767762535836],"import { z } from \"https://esm.sh/zod@4.1.12\";\n\n/**\n * Zod schema for SKILL.md YAML frontmatter\n * Based on Claude Code Skills documentation\n */\nconst SkillFrontmatterSchema = z\n .object({\n name: z.string().min(1).max(64), // Required, max 64 chars\n description: z.string().min(1),\n version: z.string().optional(),\n dependencies: z.string().optional(),\n })\n .passthrough(); // Allow other fields\n\nexport type SkillFrontmatter = z.infer;\n\n/**\n * Parse and validate SKILL.md content\n * Extracts YAML frontmatter and validates required fields\n */\nexport function parseSkillMd(\n content: string,\n repoFullName: string,\n): SkillFrontmatter | null {\n try {\n // Extract YAML frontmatter\n const frontmatterMatch = content.match(/^---\\n([\\s\\S]*?)\\n---/);\n\n if (!frontmatterMatch) {\n console.warn(\n `No YAML frontmatter found in SKILL.md from ${repoFullName}`,\n );\n return null;\n }\n\n const yamlContent = frontmatterMatch[1];\n\n // Simple YAML parser (handles basic key: value pairs)\n const frontmatter: Record = {};\n const lines = yamlContent.split(\"\\n\");\n\n for (const line of lines) {\n const match = line.match(/^(\\w+):\\s*(.+)$/);\n if (match) {\n const [, key, value] = match;\n // Remove quotes if present\n frontmatter[key] = value.replace(/^[\"']|[\"']$/g, \"\").trim();\n }\n }\n\n // Validate with Zod\n const result = SkillFrontmatterSchema.safeParse(frontmatter);\n\n if (!result.success) {\n console.error(`Invalid SKILL.md frontmatter from ${repoFullName}:`);\n console.error(\n `Validation errors: ${JSON.stringify(result.error.errors, null, 2)}`,\n );\n return null;\n }\n\n return result.data;\n } catch (error) {\n console.error(\n `Failed to parse SKILL.md from ${repoFullName}:`,\n error instanceof Error ? error.message : String(error),\n );\n return null;\n }\n}\n\n/**\n * Transform skill data into database record\n */\nexport function transformToDbSkill(\n skillData: SkillFrontmatter,\n repoOwner: string,\n repoName: string,\n directoryPath: string,\n repoUrl: string,\n repoStars: number,\n rawFileUrl: string,\n defaultBranch: string = \"main\",\n): {\n id: string;\n name: string;\n namespace: string;\n sourceUrl: string;\n sourceType: string;\n description: string;\n version: string | null;\n dependencies: string | null;\n author: string;\n stars: number;\n installs: number;\n verified: boolean;\n metadata: string;\n createdAt: string;\n updatedAt: string;\n} {\n // Extract skill directory name from path\n const skillDirName = directoryPath.split(\"/\").filter(Boolean).pop() ||\n \"unknown\";\n\n // Build namespace: @owner/repo/skillName\n const namespace = `@${repoOwner}/${repoName}/${skillDirName}`;\n\n // Build source URL (GitHub tree URL to skill directory)\n const sourceUrl = `${repoUrl}/tree/${defaultBranch}/${directoryPath}`;\n\n // Metadata blob\n const metadata = {\n repoOwner,\n repoName,\n directoryPath,\n rawFileUrl,\n };\n\n return {\n id: crypto.randomUUID(),\n name: skillData.name,\n namespace,\n sourceUrl,\n sourceType: \"github\",\n description: skillData.description,\n version: skillData.version || null,\n dependencies: skillData.dependencies || null,\n author: repoOwner,\n stars: repoStars,\n installs: 0,\n verified: false,\n metadata: JSON.stringify(metadata),\n createdAt: new Date().toISOString(),\n updatedAt: new Date().toISOString(),\n };\n}",[],[306,308],"f784da3a-eb86-11f0-ae23-42dde27851f2","search-buckets.ts","019b96db-a5eb-708a-9889-06c18854ea48",["D",1767762535836],"import { GitHubClient } from \"../clients/github.ts\";\nimport { blob } from \"https://esm.town/v/std/blob\";\n\nconst MIN_SIZE = 500;\nconst MAX_SIZE = 150_000;\nconst BASE_QUERY =\n `filename:SKILL.md language:Markdown \"---\" \"name:\" \"description:\"`;\nconst BUCKET_NAME = \"skills-search-buckets\";\n\nconst MAX_PER_BUCKET = 950;\nconst MIN_SPAN = 200;\n\n// Helper to read previously stored buckets (returns [] if none)\nasync function getStoredBuckets(): Promise<\n Array<{ min: number; max: number; count: number }>\n> {\n try {\n const existing = await blob.getJSON<\n Array<{ min: number; max: number; count: number }>\n >(BUCKET_NAME);\n return Array.isArray(existing) ? existing : [];\n } catch {\n return [];\n }\n}\n\nexport default async function (interval: Interval) {\n const startTime = Date.now();\n\n try {\n console.log(\"GitHub Search Buckets for skills started\");\n const github = new GitHubClient();\n\n // 1) Load stored buckets. If empty, create initial buckets for full range.\n let buckets = await getStoredBuckets();\n if (buckets.length === 0) {\n console.log(\n \"No stored buckets found. Creating initial buckets from full size range.\",\n );\n buckets = await github.findBuckets(BASE_QUERY, {\n min: MIN_SIZE,\n max: MAX_SIZE,\n maxPerBucket: MAX_PER_BUCKET,\n minSpan: MIN_SPAN,\n });\n } else {\n console.log(\n `Loaded ${buckets.length} stored buckets. Refining oversized ones if needed…`,\n );\n }\n\n // Sort by Size Range\n buckets.sort((a, b) => (b.max - b.min) - (a.max - a.min));\n console.log(\"Existing Buckets =>\", buckets);\n\n // 2) Iterate stored (or newly created) buckets.\n // For any bucket with count > MAX_PER_BUCKET, reuse findBuckets over that bucket’s range to downsize.\n const refined: Array<{ min: number; max: number; count: number }> = [];\n for (const b of buckets) {\n const subs = await github.findBuckets(BASE_QUERY, {\n min: b.min,\n max: b.max,\n maxPerBucket: MAX_PER_BUCKET,\n minSpan: MIN_SPAN,\n });\n refined.push(...subs);\n }\n\n // 3) Persist the updated buckets\n await blob.setJSON(BUCKET_NAME, refined);\n\n const duration = ((Date.now() - startTime) / 1000).toFixed(2);\n console.log(\n `Search Buckets completed in ${duration}s, and created ${refined.length} buckets`,\n );\n } catch (e) {\n console.error(\"Skills indexer CRON job failed:\", e);\n throw e;\n }\n}",[],[306,315],"f784d1de-eb86-11f0-ae23-42dde27851f2","refresh-skills.ts","019b96db-a5eb-708a-9889-00075e831d4a",["D",1767762535836],"import { db } from \"../database/db.ts\";\nimport { skills } from \"../database/schema.ts\";\nimport { blob } from \"https://esm.town/v/std/blob\";\nimport { eq } from \"npm:drizzle-orm@0.44.2\";\n\ntype SkillsRefreshRunState = {\n limit: number; // exclusive end of last batch (next run starts here)\n offset: number;\n startedAt: string;\n completedAt?: string;\n};\nconst LAST_RUN_STATE_KEY = \"refresh-skills:last-run-state\";\nexport async function getLastRunState(): Promise {\n try {\n return await blob.getJSON(LAST_RUN_STATE_KEY);\n } catch {\n return null;\n }\n}\n\nconst isDeleted = async (rawFileUrl: string) => {\n const result = await fetch(rawFileUrl, { method: \"HEAD\" });\n if (result.status === 404) {\n return true;\n }\n\n return false;\n};\n\nasync function markSkillDeleted(skillId: string): Promise {\n return await db\n .update(skills)\n .set({ deleted: 1, updated_at: new Date().toISOString() })\n .where(eq(skills.id, skillId));\n}\n\n// Learn more: https://docs.val.town/vals/cron/\nexport default async function (interval: Interval) {\n const state = await getLastRunState();\n const data = await db\n .select()\n .from(skills)\n .where(eq(skills.deleted, 0))\n .all();\n\n return Promise.all(data.map(async (skill) => {\n const metadata = JSON.parse(skill.metadata);\n if (metadata.rawFileUrl === null) {\n return;\n }\n\n const isDeletedSkill = await isDeleted(metadata.rawFileUrl);\n if (isDeletedSkill) {\n await markSkillDeleted(skill.id);\n }\n }));\n}",[],[306,322],"f784bb5e-eb86-11f0-ae23-42dde27851f2","plugins-indexer.ts","019b96db-a5eb-708a-9888-fdf466b54db3",["D",1767762535836],"import { parseMarketplace, transformToDbPlugins } from \"./parser.ts\";\nimport { GitHubClient } from \"../clients/github.ts\";\nimport { db } from \"../database/db.ts\";\nimport { plugins, pluginStats } from \"../database/schema.ts\";\nimport { sql } from \"npm:drizzle-orm@0.44.2\";\n\n// Learn more: https://docs.val.town/vals/cron/\nexport default async function (interval: Interval) {\n const startTime = Date.now();\n\n try {\n console.log(\"GitHub plugin indexer started\");\n const github = new GitHubClient();\n const searchQuery = \"filename:marketplace.json path:.claude-plugin\";\n\n const firstPage = await github.searchCode(searchQuery);\n console.log(`Found ${firstPage.total_count} marketplace.json files`);\n\n let indexed = 0;\n let failed = 0;\n\n // Calculate total pages (max 10 pages = 1000 results)\n const maxPages = Math.min(Math.ceil(firstPage.total_count / 100), 10);\n if (firstPage.total_count > 1000) {\n console.warn(\n `Found ${firstPage.total_count} results. GitHub limits to 1000, only first 1000 will be indexed.`,\n );\n }\n\n // Process all pages\n for (let page = 1; page <= maxPages; page++) {\n console.log(`\\nProcessing page ${page}/${maxPages}...`);\n\n const searchResults = page === 1\n ? firstPage\n : await github.searchCode(searchQuery, page);\n\n console.log(`Processing ${searchResults.items.length} items...`);\n\n for (const item of searchResults.items) {\n try {\n //console.log(`Processing ${item.repository.full_name}...`);\n\n // Fetch repository metadata (stars, updated_at)\n const repoMetadata = await github.fetchRepoMetadata(\n item.repository.full_name,\n );\n\n // Fetch marketplace.json content\n const content = await github.fetchFileContent(\n item.repository.full_name,\n item.path,\n );\n\n // Parse and validate\n const marketplace = parseMarketplace(\n content,\n item.repository.full_name,\n );\n if (!marketplace) {\n console.warn(\n `Invalid marketplace.json from ${item.repository.full_name}`,\n );\n failed++;\n continue;\n }\n\n // Transform to database format with repo metadata\n const dbPlugins = transformToDbPlugins(\n marketplace,\n item.repository.owner.login,\n item.repository.html_url,\n repoMetadata.stargazers_count,\n );\n\n // Upsert each plugin\n for (const plugin of dbPlugins) {\n try {\n // Check if plugin exists to get existing ID\n const existing = await db\n .select()\n .from(plugins)\n .where(\n sql`${plugins.namespace} = ${plugin.namespace} AND ${plugins.name} = ${plugin.name}`,\n )\n .get();\n\n // Use existing ID if plugin already exists, otherwise use new UUID\n const pluginId = existing?.id || plugin.id;\n\n // Upsert plugin with correct ID\n await db\n .insert(plugins)\n .values({\n ...plugin,\n id: pluginId,\n })\n .onConflictDoUpdate({\n target: [plugins.namespace, plugins.name],\n set: {\n description: sql`excluded.description`,\n keywords: sql`excluded.keywords`,\n category: sql`excluded.category`,\n version: sql`excluded.version`,\n author: sql`excluded.author`,\n metadata: sql`excluded.metadata`,\n gitUrl: sql`excluded.git_url`,\n stars: sql`excluded.stars`,\n skills: sql`COALESCE(excluded.skills, ${plugin.skills})`,\n updatedAt: sql`CURRENT_TIMESTAMP`,\n },\n })\n .run();\n\n // Ensure stats entry exists (using the correct plugin ID)\n await db\n .insert(pluginStats)\n .values({ pluginId })\n .onConflictDoNothing()\n .run();\n\n indexed++;\n } catch (dbError) {\n console.error(\n `Failed to upsert plugin ${plugin.namespace}/${plugin.name}:`,\n dbError,\n );\n }\n }\n } catch (error) {\n console.error(\n `Failed to process ${item.repository.full_name}:`,\n error,\n );\n failed++;\n }\n }\n }\n } catch (e) {\n console.error(\"Indexer CRON job failed:\", e);\n // so Val.town will notify\n throw e;\n }\n}",[],[306,329],"f784a0f6-eb86-11f0-ae23-42dde27851f2","parser.ts","019b96db-a5eb-708a-9888-f9bce44ef879",["D",1767762535836],"import { z } from \"https://esm.sh/zod@4.1.12\";\n\n/**\n * Zod schema for marketplace.json structure\n */\nconst PluginSchema = z\n .object({\n name: z.string().min(1),\n description: z.string().optional(),\n version: z.string().optional(),\n category: z.string().optional(),\n skills: z.array(z.string()).optional(),\n })\n .passthrough(); // Allow ALL other fields\n\nconst MarketplaceSchema = z\n .object({\n name: z.string().min(1),\n plugins: z.array(PluginSchema),\n })\n .passthrough();\n\nexport type MarketplaceData = z.infer;\nexport type PluginData = z.infer;\n\n/**\n * Parse and validate marketplace.json content\n * Handles both standard marketplace format and non-standard single plugin format\n */\nexport function parseMarketplace(\n jsonString: string,\n repoFullName: string,\n): MarketplaceData | null {\n try {\n const jsonData = JSON.parse(jsonString);\n\n // First, try standard marketplace.json format\n const result = MarketplaceSchema.safeParse(jsonData);\n\n if (result.success) {\n return result.data;\n }\n\n // If standard format fails, check if this is a single plugin definition\n // (no marketplace wrapper, just a plugin object)\n if (jsonData.name && !jsonData.plugins) {\n console.log(\n `Detected single plugin format in ${repoFullName}, attempting to wrap...`,\n );\n\n // Try to wrap it as a marketplace with one plugin\n const wrapped = {\n name: jsonData.name,\n owner: jsonData.author || jsonData.owner || { name: \"Unknown\" },\n plugins: [jsonData],\n };\n\n const wrappedResult = MarketplaceSchema.safeParse(wrapped);\n if (wrappedResult.success) {\n console.log(`Successfully wrapped single plugin from ${repoFullName}`);\n return wrappedResult.data;\n }\n }\n\n // Still failed - log the errors\n console.error(`Invalid marketplace.json from ${repoFullName}:`);\n console.error(\n `Validation errors: ${JSON.stringify(result.error.errors, null, 2)}`,\n );\n return null;\n } catch (error) {\n console.error(\n `Failed to parse JSON from ${repoFullName}:`,\n error instanceof Error ? error.message : String(error),\n );\n console.error(`Stack: ${error instanceof Error ? error.stack : \"\"}`);\n return null;\n }\n}\n\n/**\n * Transform marketplace data into database plugin records\n */\nexport function transformToDbPlugins(\n marketplace: MarketplaceData,\n repoOwner: string,\n repoUrl: string,\n repoStars: number = 0,\n): Array<{\n id: string;\n name: string;\n namespace: string;\n gitUrl: string;\n description: string;\n keywords: string;\n skills: string;\n category: string | null;\n version: string;\n author: string;\n metadata: string;\n stars: number;\n verified: boolean;\n downloads: number;\n createdAt: string;\n updatedAt: string;\n}> {\n return marketplace.plugins.map((plugin: any) => {\n // Safe getter helper\n const get = (obj: any, key: string, defaultValue: any = null) => {\n return obj?.[key] ?? defaultValue;\n };\n\n // Simple author extraction - just get a string\n let author = \"Unknown\";\n const pluginAuthor = get(plugin, \"author\");\n if (typeof pluginAuthor === \"string\") {\n author = pluginAuthor;\n } else if (pluginAuthor?.name) {\n author = pluginAuthor.name;\n } else {\n const marketplaceOwner = get(marketplace, \"owner\");\n const marketplacePublisher = get(marketplace, \"publisher\");\n if (typeof marketplacePublisher === \"string\") {\n author = marketplacePublisher;\n } else if (marketplaceOwner?.name) {\n author = marketplaceOwner.name;\n } else {\n author = repoOwner;\n }\n }\n\n // Simple version - use plugin version, fallback to marketplace, then default\n let version = get(plugin, \"version\");\n if (!version || !/^\\d+\\.\\d+\\.\\d+/.test(version)) {\n const marketplaceVersion = get(marketplace, \"version\");\n version = marketplaceVersion && /^\\d+\\.\\d+\\.\\d+/.test(marketplaceVersion)\n ? marketplaceVersion\n : \"1.0.0\";\n }\n\n // Extract keywords from various sources\n const keywords = get(plugin, \"keywords\", []);\n const tags = get(plugin, \"tags\", []);\n const allKeywords = [...keywords, ...tags].filter(\n (k: any) => typeof k === \"string\",\n );\n\n // Everything else goes into metadata\n const metadata = {\n homepage: get(plugin, \"homepage\"),\n repository: get(plugin, \"repository\"),\n license: get(plugin, \"license\"),\n commands: get(plugin, \"commands\"),\n agents: get(plugin, \"agents\"),\n mcpServers: get(plugin, \"mcpServers\"),\n // Include any other fields that might be useful later\n ...(plugin.bugs && { bugs: plugin.bugs }),\n ...(plugin.features && { features: plugin.features }),\n ...(plugin.requirements && { requirements: plugin.requirements }),\n };\n\n return {\n id: crypto.randomUUID(),\n name: plugin.name,\n namespace: `@${repoOwner}/${marketplace.name}`,\n gitUrl: repoUrl,\n description: get(plugin, \"description\", \"\"),\n keywords: JSON.stringify(allKeywords),\n category: get(plugin, \"category\"),\n skills: JSON.stringify(plugin.skills || []),\n version: version,\n author: author,\n metadata: JSON.stringify(metadata),\n stars: repoStars,\n verified: false,\n downloads: 0,\n createdAt: new Date().toISOString(),\n updatedAt: new Date().toISOString(),\n };\n });\n}",[],[306,336],"f785212a-eb86-11f0-ae23-42dde27851f2",["D",1767762535836],[218,219,220,221,222,223],[306],"f7847dba-eb86-11f0-ae23-42dde27851f2","github.ts","019b96db-a5eb-708a-9888-f1bb131384a4","019b96db-a5eb-708a-9888-f47eadbcde1f",["D",1767762535836],"import {\n getToken,\n syncTokenHealth,\n} from \"https://esm.town/v/kamalnrf/token-pool/lib/pool.ts\";\nimport { z } from \"npm:zod@3.24.2\";\n\nconst REQUESTS_PER_INTERVAL = 80;\nconst INTERVAL_MS = 1000;\n\nexport type Bucket = {\n min: number;\n max: number;\n count: number;\n};\n\n/**\n * GitHub code search response types\n */\nconst GitHubSearchItemSchema = z.object({\n name: z.string(),\n path: z.string(),\n sha: z.string(),\n url: z.string().url(),\n html_url: z.string().url(),\n repository: z.object({\n id: z.number(),\n full_name: z.string(),\n html_url: z.string().url(),\n owner: z.object({\n login: z.string(),\n }),\n }),\n});\n\nconst GitHubRepoSchema = z.object({\n id: z.number(),\n full_name: z.string(),\n stargazers_count: z.number(),\n updated_at: z.string(),\n html_url: z.string().url(),\n fork: z.boolean(),\n default_branch: z.string(),\n});\n\nconst GitHubSearchResponseSchema = z.object({\n total_count: z.number(),\n incomplete_results: z.boolean(),\n items: z.array(GitHubSearchItemSchema),\n});\n\nexport type GitHubSearchItem = z.infer;\nexport type GitHubSearchResponse = z.infer;\nexport type GitHubRepo = z.infer;\n\n/**\n * GitHub API client with rate limit handling\n */\nexport class GitHubClient {\n private baseUrl = \"https://api.github.com\";\n private apiVersion = \"2022-11-28\";\n private tokens = REQUESTS_PER_INTERVAL;\n private lastRefill = Date.now();\n\n /**\n * Search for files matching a path pattern\n */\n async searchCode(\n query: string,\n page: number = 1,\n ): Promise {\n const url = `${this.baseUrl}/search/code?q=${\n encodeURIComponent(query)\n }&per_page=100&page=${page}`;\n\n const response = await this.fetchWithRetry(url);\n\n // Check rate limit\n const remaining = parseInt(\n response.headers.get(\"x-ratelimit-remaining\") || \"10\",\n );\n const resetTime = parseInt(\n response.headers.get(\"x-ratelimit-reset\") || \"0\",\n );\n\n console.log(\n `GitHub rate limit: ${remaining}/10 remaining, resets at ${\n new Date(resetTime * 1000).toISOString()\n }`,\n );\n\n if (remaining <= 2) {\n const waitSeconds = resetTime - Math.floor(Date.now() / 1000) + 5;\n if (waitSeconds > 0) {\n console.warn(\n `Rate limit low. Waiting ${waitSeconds}s before continuing...`,\n );\n await this.sleep(waitSeconds * 1000);\n }\n }\n\n if (!response.ok) {\n throw new Error(\n `GitHub search failed: ${response.status} ${response.statusText}`,\n );\n }\n\n const data = await response.json();\n return GitHubSearchResponseSchema.parse(data);\n }\n\n /**\n * Fetch raw file content from repository\n */\n async fetchFileContent(repoFullName: string, path: string): Promise {\n const url = `${this.baseUrl}/repos/${repoFullName}/contents/${path}`;\n\n const response = await this.fetchWithRetry(url);\n\n if (!response.ok) {\n throw new Error(\n `Failed to fetch ${path} from ${repoFullName}: ${response.status}`,\n );\n }\n\n const data = await response.json();\n\n // Decode base64 content\n if (data.encoding === \"base64\" && data.content) {\n return atob(data.content.replace(/\\n/g, \"\"));\n }\n\n throw new Error(`Unexpected content encoding: ${data.encoding}`);\n }\n\n /**\n * Fetch repository metadata (stars, updated_at, etc.)\n */\n async fetchRepoMetadata(repoFullName: string): Promise {\n const url = `${this.baseUrl}/repos/${repoFullName}`;\n\n const response = await this.fetchWithRetry(url);\n\n if (!response.ok) {\n throw new Error(\n `Failed to fetch repo metadata for ${repoFullName}: ${response.status}`,\n );\n }\n\n const data = await response.json();\n return GitHubRepoSchema.parse(data);\n }\n\n async findBuckets(\n baseQuery: string,\n {\n min,\n max,\n maxPerBucket = 950,\n minSpan = 100,\n }: {\n min: number;\n max: number;\n maxPerBucket?: number;\n minSpan?: number;\n },\n ): Promise> {\n const query = `${baseQuery} size:${min}..${max}`;\n const count = (await this.searchCode(query)).total_count ?? 0;\n console.log(\"Query =>\", {\n query,\n count,\n });\n\n if (count === 0) return [];\n\n if (count <= maxPerBucket || (max - min) <= minSpan) {\n return [{ min, max, count }];\n }\n\n // Split the range and recurse\n const mid = Math.floor((min + max) / 2);\n const left = await this.findBuckets(\n baseQuery,\n { min: min, max: mid, maxPerBucket, minSpan },\n );\n const right = await this.findBuckets(\n baseQuery,\n { min: mid + 1, max: max, maxPerBucket, minSpan },\n );\n return [...left, ...right];\n }\n\n /**\n * Fetch with exponential backoff retry\n */\n private async fetchWithRetry(\n url: string,\n maxRetries: number = 3,\n ): Promise {\n // Throttling requests to Github before any attempts\n await this.waitForToken();\n\n let lastError: Error | null = null;\n\n for (let attempt = 0; attempt <= maxRetries; attempt++) {\n try {\n const t = await getToken();\n if (!t?.token) {\n throw new Error(\"No Github token found\");\n }\n\n const response = await fetch(url, {\n headers: {\n Accept: \"application/vnd.github+json\",\n Authorization: `Bearer ${t.token}`,\n \"X-GitHub-Api-Version\": this.apiVersion,\n },\n });\n\n await syncTokenHealth(t.id, response);\n // Handle rate limiting with Retry-After\n if (response.status === 429 || response.status === 403) {\n console.log(\n `Rate limited. with ${t.id}, retrying with new token`,\n );\n continue;\n }\n\n return response;\n } catch (error) {\n lastError = error as Error;\n\n if (attempt < maxRetries) {\n const delay = Math.min(1000 * Math.pow(2, attempt), 10000);\n console.log(\n `Request failed, retrying in ${delay}ms... (attempt ${\n attempt + 1\n }/${maxRetries})`,\n );\n await this.sleep(delay);\n }\n }\n }\n\n throw lastError || new Error(\"Request failed after retries\");\n }\n\n private async waitForToken(): Promise {\n const now = Date.now();\n const elapsed = now - this.lastRefill;\n if (elapsed >= INTERVAL_MS) {\n const intervals = Math.floor(elapsed / INTERVAL_MS);\n this.tokens = Math.min(\n REQUESTS_PER_INTERVAL,\n this.tokens + intervals * REQUESTS_PER_INTERVAL,\n );\n this.lastRefill = now;\n }\n\n if (this.tokens > 0) {\n this.tokens--;\n return;\n }\n\n const delay = Math.max(0, INTERVAL_MS - (Date.now() - this.lastRefill));\n await this.sleep(delay);\n // After waiting, consume a token\n if (this.tokens > 0) this.tokens--;\n else this.tokens = Math.max(0, this.tokens - 1);\n }\n\n private sleep(ms: number): Promise {\n return new Promise((resolve) => setTimeout(resolve, ms));\n }\n}",[],[354,347],"clients","f7849f84-eb86-11f0-ae23-42dde27851f2",["D",1767762535836],[216],[354],"f7845b46-eb86-11f0-ae23-42dde27851f2","skills.ts","019b96db-a5eb-708a-9888-e9665a164018","019b96db-a5eb-708a-9888-ef86595f3038",["D",1767762535836],"/**\n * Skills API endpoints\n */\nimport type { Context } from \"https://esm.sh/hono@4.9\";\nimport { and, asc, desc, eq, like, or, sql } from \"npm:drizzle-orm@0.44.2\";\nimport { db } from \"../database/db.ts\";\nimport { skills, skillStats } from \"../database/schema.ts\";\nimport { getLogger } from \"https://esm.town/v/kamalnrf/axiom-logger/hono.ts\";\n\nconst ALLOWED_SORT_COLUMNS = new Set([\n \"downloads\",\n \"stars\",\n]);\n\nfunction getSkillColumn(field: string) {\n switch (field) {\n case \"downloads\":\n return skills.installs;\n case \"stars\":\n return skills.stars;\n default:\n return null;\n }\n}\n\n/**\n * GET /api/skills/:owner/:repo/:skillName\n * Get skill info (read-only, no install increment)\n */\nexport async function getSkill(c: Context) {\n const { owner, repo, skillName } = c.req.param();\n\n if (!owner || !repo || !skillName) {\n return c.json({ error: \"Missing owner, repo, or skill name\" }, 400);\n }\n\n const namespace = `${owner}/${repo}/${skillName}`;\n\n const skill = await db\n .select()\n .from(skills)\n .where(eq(skills.namespace, namespace))\n .get();\n\n if (!skill) {\n return c.json({\n error: `Skill ${namespace} not found`,\n }, 404);\n }\n\n const metadata = skill.metadata ? JSON.parse(skill.metadata) : {};\n\n return c.json({\n id: skill.id,\n name: skill.name,\n namespace: skill.namespace,\n sourceUrl: skill.sourceUrl,\n sourceType: skill.sourceType,\n description: skill.description,\n version: skill.version,\n dependencies: skill.dependencies,\n author: skill.author,\n stars: skill.stars,\n installs: skill.installs,\n verified: Boolean(skill.verified),\n metadata,\n createdAt: skill.createdAt,\n updatedAt: skill.updatedAt,\n });\n}\n\n/**\n * POST /api/skills/:owner/:repo/:skillName/install\n * Track skill installation\n */\nexport async function installSkill(c: Context) {\n const logger = getLogger(c);\n const { owner, repo, skillName } = c.req.param();\n logger.info(\"resolved values\", { owner, repo, skillName });\n\n if (!owner || !repo || !skillName) {\n return c.json({ error: \"Missing owner, repo, or skill name\" }, 400);\n }\n\n const namespace = `${owner}/${repo}/${skillName}`;\n\n const skill = await db\n .select()\n .from(skills)\n .where(and(eq(skills.deleted, 0), eq(skills.namespace, namespace)))\n .get();\n\n if (!skill) {\n return c.json({\n error: `Skill ${namespace} not found`,\n }, 404);\n }\n\n try {\n await incrementInstalls(skill.id);\n return c.json({ success: true });\n } catch (error) {\n logger.error(\"Failed to increment installs:\", { error });\n return c.json({ error: \"Failed to track installation\" }, 500);\n }\n}\n\n/**\n * GET /api/skills/search?q=query&limit=20&offset=0\n * Search skills\n */\nexport async function searchSkills(c: Context) {\n const query = c.req.query(\"q\") || \"\";\n const limit = Math.min(parseInt(c.req.query(\"limit\") || \"20\"), 50000);\n const offset = parseInt(c.req.query(\"offset\") || \"0\");\n const orderByParam = c.req.query(\"orderBy\");\n const orderParam = c.req.query(\"order\") ?? \"desc\";\n\n if (orderByParam && !ALLOWED_SORT_COLUMNS.has(orderByParam)) {\n return c.json({ error: \"Invalid orderBy parameter\" }, 400);\n }\n\n let queryBuilder = db.select().from(skills);\n\n const conditions = [\n eq(skills.deleted, 0),\n ];\n\n if (query) {\n const searchTerm = `%${query.toLowerCase()}%`;\n conditions.push(\n or(\n like(sql`LOWER(${skills.name})`, searchTerm),\n like(sql`LOWER(${skills.description})`, searchTerm),\n like(sql`LOWER(${skills.namespace})`, searchTerm),\n like(sql`LOWER(${skills.author})`, searchTerm),\n ),\n );\n }\n\n const finalWhere = conditions.length === 0\n ? null\n : conditions.length === 1\n ? conditions[0]\n : and(...conditions);\n\n let countBuilder = db.select({ count: sql`count(*)` }).from(skills);\n if (finalWhere) {\n countBuilder = countBuilder.where(finalWhere);\n }\n\n if (finalWhere) {\n queryBuilder = queryBuilder.where(finalWhere);\n }\n\n if (orderByParam && ALLOWED_SORT_COLUMNS.has(orderByParam)) {\n const column = getSkillColumn(orderByParam);\n const sortDirection = orderParam === \"asc\" ? asc : desc;\n\n if (!column) {\n throw new Error(`Invalid orderBy param: ${orderByParam}`);\n }\n queryBuilder = queryBuilder.orderBy(sortDirection(column));\n } else {\n queryBuilder = queryBuilder.orderBy(\n desc(skills.installs),\n desc(skills.stars),\n );\n }\n\n const [{ count: total }] = await countBuilder.all();\n const results = await queryBuilder.limit(limit).offset(offset).all();\n\n const formattedSkills = results.map((skill) => ({\n id: skill.id,\n name: skill.name,\n namespace: skill.namespace,\n sourceUrl: skill.sourceUrl,\n description: skill.description,\n version: skill.version,\n dependencies: skill.dependencies,\n author: skill.author,\n stars: skill.stars,\n installs: skill.installs,\n verified: Boolean(skill.verified),\n metadata: skill.metadata ? JSON.parse(skill.metadata) : {},\n createdAt: skill.createdAt,\n updatedAt: skill.updatedAt,\n }));\n\n return c.json({\n skills: formattedSkills,\n total,\n limit,\n offset,\n });\n}\n\n/**\n * GET /api/skills/:owner/:repo/:skillName/stats\n * Get skill statistics\n */\nexport async function getSkillStats(c: Context) {\n const { owner, repo, skillName } = c.req.param();\n const namespace = `@${owner}/${repo}/${skillName}`;\n\n const result = await db\n .select({\n skill: skills,\n stats: skillStats,\n })\n .from(skills)\n .leftJoin(skillStats, eq(skills.id, skillStats.skillId))\n .where(eq(skills.namespace, namespace))\n .get();\n\n if (!result || !result.skill) {\n return c.json({\n error: `Skill ${namespace} not found`,\n }, 404);\n }\n\n return c.json({\n installs: {\n total: result.stats?.installsTotal || 0,\n week: result.stats?.installsWeek || 0,\n month: result.stats?.installsMonth || 0,\n },\n lastInstalled: result.stats?.lastInstalledAt || null,\n });\n}\n\n/**\n * Increment install statistics for a skill\n */\nasync function incrementInstalls(skillId: string) {\n await db\n .update(skills)\n .set({ installs: sql`${skills.installs} + 1` })\n .where(eq(skills.id, skillId));\n\n const now = new Date().toISOString();\n\n const existing = await db\n .select()\n .from(skillStats)\n .where(eq(skillStats.skillId, skillId))\n .get();\n\n if (existing) {\n await db\n .update(skillStats)\n .set({\n installsTotal: sql`${skillStats.installsTotal} + 1`,\n installsWeek: sql`${skillStats.installsWeek} + 1`,\n installsMonth: sql`${skillStats.installsMonth} + 1`,\n lastInstalledAt: now,\n })\n .where(eq(skillStats.skillId, skillId));\n } else {\n await db.insert(skillStats).values({\n skillId,\n installsTotal: 1,\n installsWeek: 1,\n installsMonth: 1,\n lastInstalledAt: now,\n });\n }\n}",[],[367,360],"api","f7844048-eb86-11f0-ae23-42dde27851f2","search.ts","019b96db-a5eb-708a-9888-e4177356181f",["D",1767762535836],"/**\n * Plugin search endpoint\n * Search and filter plugins by query, category, etc.\n */\nimport type { Context } from \"https://esm.sh/hono@4.9\";\nimport { and, asc, desc, eq, like, or, sql } from \"npm:drizzle-orm@0.44.2\";\nimport { db } from \"../database/db.ts\";\nimport { plugins } from \"../database/schema.ts\";\n\nconst ALLOWED_SORT_COLUMNS = new Set([\n \"downloads\",\n \"stars\",\n]);\n\nfunction getPluginColumn(field: string) {\n switch (field) {\n case \"downloads\":\n return plugins.downloads;\n case \"stars\":\n return plugins.stars;\n default:\n return null;\n }\n}\n\nexport function getSkillName(path: string): string {\n const prefix = \"./skills/\";\n return path.startsWith(prefix) ? path.slice(prefix.length) : path;\n}\n\n/**\n * GET /api/search?q=supabase&category=database&limit=20&offset=0\n * Search plugins with optional filters\n */\nexport async function searchPlugins(c: Context) {\n const query = c.req.query(\"q\") || \"\";\n const category = c.req.query(\"category\");\n const hasSkills = c.req.query(\"hasSkills\");\n const limit = Math.min(parseInt(c.req.query(\"limit\") || \"20\"), 100); // Max 100\n const offset = parseInt(c.req.query(\"offset\") || \"0\");\n const orderByParam = c.req.query(\"orderBy\");\n const orderParam = c.req.query(\"order\") ?? \"desc\";\n\n if (orderByParam && !ALLOWED_SORT_COLUMNS.has(orderByParam)) {\n return c.json({ error: \"Invalid orderBy parameter\" }, 400);\n }\n\n let queryBuilder = db.select().from(plugins);\n\n // Build where conditions\n const conditions = [];\n\n if (query) {\n const searchTerm = `%${query.toLowerCase()}%`;\n conditions.push(\n or(\n like(sql`LOWER(${plugins.name})`, searchTerm),\n like(sql`LOWER(${plugins.description})`, searchTerm),\n like(sql`LOWER(${plugins.keywords})`, searchTerm),\n like(sql`LOWER(${plugins.namespace})`, searchTerm),\n like(sql`LOWER(${plugins.skills})`, searchTerm),\n ),\n );\n }\n\n if (category) {\n conditions.push(eq(plugins.category, category));\n }\n\n // Only return plugins with at least 1 skill when hasSkills=true\n if (hasSkills === \"true\") {\n // Guard that it's a JSON array and has length >= 1\n const hasSkillsFilter =\n sql`json_type(${plugins.skills}) = 'array' AND json_array_length(${plugins.skills}) >= 1`;\n conditions.push(hasSkillsFilter);\n }\n\n const finalWhere = conditions.length === 0\n ? null\n : conditions.length === 1\n ? conditions[0]\n : and(...conditions);\n\n // Get total count before pagination\n let countBuilder = db.select({ count: sql`count(*)` }).from(plugins);\n if (finalWhere) {\n countBuilder = countBuilder.where(finalWhere);\n }\n\n // Apply where to data query\n if (finalWhere) {\n queryBuilder = queryBuilder.where(finalWhere);\n }\n\n if (orderByParam && ALLOWED_SORT_COLUMNS.has(orderByParam)) {\n const column = getPluginColumn(orderByParam);\n const sortDirection = orderParam === \"asc\" ? asc : desc;\n\n if (!column) {\n throw new Error(`Invalid orderBy param: ${orderByParam}`);\n }\n queryBuilder = queryBuilder.orderBy(sortDirection(column));\n } else {\n queryBuilder = queryBuilder.orderBy(\n desc(plugins.downloads),\n desc(plugins.stars),\n );\n }\n\n const [{ count: total }] = await countBuilder.all();\n const results = await queryBuilder.limit(limit).offset(offset).all();\n const parseSkills = (skills: string) => {\n const parsedSkills = JSON.parse(skills);\n if (Array.isArray(parsedSkills) && parsedSkills.length > 0) {\n return parsedSkills?.map(getSkillName);\n }\n\n return parsedSkills;\n };\n\n // Format results\n const formattedPlugins = results.map((plugin) => ({\n id: plugin.id,\n name: plugin.name,\n namespace: plugin.namespace,\n gitUrl: plugin.gitUrl,\n description: plugin.description,\n version: plugin.version,\n author: plugin.author,\n keywords: plugin.keywords ? JSON.parse(plugin.keywords) : [],\n skills: plugin.skills ? parseSkills(plugin.skills) : [],\n category: plugin.category,\n stars: plugin.stars,\n verified: Boolean(plugin.verified),\n downloads: plugin.downloads,\n metadata: plugin.metadata ? JSON.parse(plugin.metadata) : {},\n createdAt: plugin.createdAt,\n updatedAt: plugin.updatedAt,\n }));\n\n return c.json({\n plugins: formattedPlugins,\n total,\n limit,\n offset,\n });\n}",[],[367,369],"f78420b8-eb86-11f0-ae23-42dde27851f2","resolve.ts","019b96db-a5eb-708a-9888-e3ac3cda3c8f",["D",1767762535836],"/**\n * Plugin resolution endpoint\n * Resolves @namespace/name to git URL\n */\nimport type { Context } from \"https://esm.sh/hono@4.9\";\nimport { and, eq, sql } from \"npm:drizzle-orm@0.44.2\";\nimport { db } from \"../database/db.ts\";\nimport { plugins, pluginStats } from \"../database/schema.ts\";\nimport { getLogger } from \"https://esm.town/v/kamalnrf/axiom-logger/hono.ts\";\n\n/**\n * GET /api/resolve/:owner/:marketplace/:plugin\n * Resolves plugin identifier to git URL and metadata\n *\n * Examples:\n * /api/resolve/davila7/claude-code-templates/supabase-toolkit\n * /api/resolve/anthropics/claude-code-plugins/agent-sdk-dev\n */\nexport async function resolvePlugin(c: Context) {\n const logger = getLogger(c);\n const { owner, marketplace, plugin: pluginName } = c.req.param();\n logger.info(\"Resolved Fields\", { owner, marketplace, pluginName });\n\n if (!owner || !marketplace || !pluginName) {\n return c.json({ error: \"Missing owner, marketplace, or plugin name\" }, 400);\n }\n\n const ownerName = owner.startsWith(\"@\") ? owner : `@${owner}`;\n\n const namespace = `${ownerName}/${marketplace}`;\n logger.info(\"Namespace:\", { namespace });\n\n // Query database\n const plugin = await db\n .select()\n .from(plugins)\n .where(and(eq(plugins.namespace, namespace), eq(plugins.name, pluginName)))\n .get();\n\n if (!plugin) {\n return c.json({\n error: `Plugin ${owner}/${marketplace}/${pluginName} not found`,\n }, 404);\n }\n\n // Increment download count\n try {\n await incrementDownloads(plugin.id);\n } catch (error) {\n logger.error(\"Failed to increment downloads:\", { error });\n // Don't fail the request if stats update fails\n }\n\n // Parse JSON fields\n const keywords = plugin.keywords ? JSON.parse(plugin.keywords) : [];\n const metadata = plugin.metadata ? JSON.parse(plugin.metadata) : {};\n\n return c.json({\n name: plugin.name,\n namespace: plugin.namespace,\n gitUrl: plugin.gitUrl,\n description: plugin.description,\n version: plugin.version,\n author: plugin.author,\n keywords,\n category: plugin.category,\n stars: plugin.stars,\n verified: Boolean(plugin.verified),\n downloads: plugin.downloads,\n metadata, // All other fields (homepage, license, commands, agents, mcpServers, etc.)\n });\n}\n\n/**\n * Increment download statistics for a plugin\n */\nasync function incrementDownloads(pluginId: string) {\n // Update total downloads in plugins table\n await db\n .update(plugins)\n .set({ downloads: sql`${plugins.downloads} + 1` })\n .where(eq(plugins.id, pluginId));\n\n // Update stats table\n const now = new Date().toISOString();\n\n // Check if stats entry exists\n const existing = await db\n .select()\n .from(pluginStats)\n .where(eq(pluginStats.pluginId, pluginId))\n .get();\n\n if (existing) {\n await db\n .update(pluginStats)\n .set({\n downloadsTotal: sql`${pluginStats.downloadsTotal} + 1`,\n downloadsWeek: sql`${pluginStats.downloadsWeek} + 1`,\n downloadsMonth: sql`${pluginStats.downloadsMonth} + 1`,\n lastDownloadedAt: now,\n })\n .where(eq(pluginStats.pluginId, pluginId));\n } else {\n // Create new stats entry\n await db.insert(pluginStats).values({\n pluginId,\n downloadsTotal: 1,\n downloadsWeek: 1,\n downloadsMonth: 1,\n lastDownloadedAt: now,\n });\n }\n}",[],[367,376],"f783fd18-eb86-11f0-ae23-42dde27851f2","plugins.ts","019b96db-a5eb-708a-9888-df67db5aca6d",["D",1767762535836],"/**\n * Plugin stats endpoint\n */\nimport type { Context } from \"https://esm.sh/hono@4.9\";\nimport { and, eq } from \"npm:drizzle-orm@0.44.2\";\nimport { db } from \"../database/db.ts\";\nimport { plugins, pluginStats } from \"../database/schema.ts\";\n\n/**\n * GET /api/plugins/:owner/:marketplace/:plugin/stats\n * Get plugin download statistics\n */\nexport async function getPluginStats(c: Context) {\n const { owner, marketplace, plugin: pluginName } = c.req.param();\n const namespace = `${owner}/${marketplace}`;\n\n const result = await db\n .select({\n plugin: plugins,\n stats: pluginStats,\n })\n .from(plugins)\n .leftJoin(pluginStats, eq(plugins.id, pluginStats.pluginId))\n .where(and(eq(plugins.namespace, namespace), eq(plugins.name, pluginName)))\n .get();\n\n if (!result || !result.plugin) {\n return c.json({\n error: `Plugin ${owner}/${marketplace}/${pluginName} not found`,\n }, 404);\n }\n\n return c.json({\n downloads: {\n total: result.stats?.downloadsTotal || 0,\n week: result.stats?.downloadsWeek || 0,\n month: result.stats?.downloadsMonth || 0,\n },\n lastDownloaded: result.stats?.lastDownloadedAt || null,\n });\n}",[],[367,383],"f7847c48-eb86-11f0-ae23-42dde27851f2",["D",1767762535836],[211,212,213,214],[367],["D",1767762535836],{"_11":12,"_145":81},{"_11":12,"_141":-5,"_80":81,"_31":79,"_142":143,"_144":30},{"_39":40,"_13":16,"_33":36,"_130":96,"_131":70,"_132":133,"_134":100,"_135":136,"_137":138,"_139":14,"_140":12},"ctx",{"_52":-5,"_166":430,"_431":432,"_433":434,"_435":30,"_436":30,"_437":30,"_438":24,"_439":-5,"_440":-7,"_441":-7,"_442":26,"_443":30,"_444":30,"_445":-5,"_446":30,"_447":30,"_448":30,"_449":-5},"ENV",{"_401":402,"_403":404,"_405":16,"_406":407,"_408":409,"_410":411,"_412":413,"_414":415,"_416":417,"_418":419,"_420":421,"_422":423,"_424":425,"_426":427,"_428":429},"REACT_APP_SENTRY_DSN","https://586020d86f05489db63a554690acf1e9@o1398359.ingest.sentry.io/6724499","RENDER_GIT_COMMIT","a3e067d4463eea85f6334f8e583e8516ae58c4f6","RENDER_GIT_BRANCH","POSTHOG_API_TOKEN","phc_nmoyuAkStEZuUp69rYlg1DZgrIt19Gx0Y4Hwf8tGgJP","POSTHOG_API_HOST","https://wart.val.town","WEB_API_TEMPLATE","https://{val}.web.val.run","APP_URL","https://www.val.town","MODULE_URL","https://esm.town","VANITY_WEB_API_TEMPLATE","https://{label}.val.run/","DENOLS_URL","https://lsp.val.town","NODE_ENV","production","CLOUDFLARE_TURNSTILE_SITE_KEY","0x4AAAAAACtaIZJH7s9rBMZ6","GOOGLE_CLIENT_ID","875989696899-jtsqkhlbdv5jrlsk8631p7ipjg3c6o62.apps.googleusercontent.com","STRIPE_PUBLISHABLE_KEY","pk_live_51N2zvWEpZTTLipIkVEwXrUG9AT0yeOOEYxszarZT1jpsZV58Ly6wlg3SltZpHN26CUalOBmUSY7adQRQiSkCZz2500qSXNkf8Y","API_URL","https://api.val.town",[],"preferencesKeybindings","default","preferencesTheme","light","preferencesFixers","preferencesCopilot","preferencesSelectionAi","preferencesCloseBrackets","preferencesChatPanelState","preferencesDprint","preferencesDenofmt","notificationCount","flagDenols","isBusinessOrgMember","businessOrgHandle","isBusinessOrgAdmin","isHigherTownieTier","navCollapsed","currentOrgId"]

History · database