Val Town is a collaborative website to build and scale JavaScript apps.
Deploy APIs, crons, & store data – all from the browser, and deployed in milliseconds.
Part of Val Town Semantic Search.
Generates OpenAI embeddings for all public vals, and stores them in Val Town's blob storage.
- Create a new metadata object. Also has support for getting the previous metadata and only adding new vals, but that's currently disabled.
- Get all val names from the database of public vals, made by Achille Lacoin.
- Put val names in batches. Vals in the same batch will have their embeddings stored in the same blob, at different offsets.
- Iterate through all each batch, get code for all the vals, get embeddings from OpenAI, and store the result in a blob.
- When finished, save the metadata JSON to its own blob.
- Can now be searched using janpaul123/semanticSearchBlobs.
Migrated from folder: semanticSearchPrototype/indexValsBlobs