SQLite Table Export Utils

This allows for a val.town-hosted SQLite table to be exported as:

• JSON (Record<string, unknown>[])
• Arrow IPC (Uint8Array)
• TODO: Others?

This can then be used by a HTTP endpoint, like so:

Create valimport { exportSQLiteTable, SQLiteTableExportFormat } from "https://esm.town/v/rlesser/sqliteTableExportUtils";

export default async function(req: Request): Promise<Response> {
  const tableName = new URL(req.url).searchParams.get("table");
  if (!tableName) {
    return new Response("Table name is required", { status: 400 });
  }
  const format = (new URL(req.url).searchParams.get("format") || "arrowIPC") as SQLiteTableExportFormat;
  const data = await exportSQLiteTable(tableName, format);
  if (data instanceof Uint8Array) {
    return new Response(data, {
      headers: { "Content-Type": "application/octet-stream" },
    });
  } else {
    return Response.json(data);
  }
}

TODO

• Specify limit and offset of export, for pagination
• Smart assessment of if the export is going to be over the val.town limit of 10MB, adjust to paginated of so.
• Support other export formats.

PRs welcome!

Dependency Graph Explorer

This val allows for dependency graph exploration.

getDependencyGraph

Iteratively explores the dependency graph of a val and its children, returning the results.

arguments

• valUrlOrSlug string - the full val url or slug (author/name) of the val

returns

An object containing:

• dependencyMap Map<string, string[]> - A map of vals (by id) to dependencies (vals or non-val id)
• moduleMap Map<string, Module> - A map of modules (by val or non-val id) to module information. Module object contains:
• • slug string - the slug of the module, how it should be displayed visually
• • id string - the id of the module, corresponding to how it's displayed in the code, normally as a url.
• • websiteUrl string - the website link for the module, a normally a link to either valtown or npm.
• • category string|null - the category of the module, such as "valtown", "esm.sh", or "npm". Those without a predefined category are in null.