`\n- **Storage:** DO NOT use the Deno KV module for storage\n- **Browser APIs:** DO NOT use the `alert()`, `prompt()`, or `confirm()` methods\n- **Weather Data:** Use open-meteo for weather data (doesn't require API keys)\n unless otherwise specified\n- **View Source:** Add a view source link by importing & using\n `import.meta.url.replace(\"ems.sh\", \"val.town)\"` (or passing this data to the\n client) and include `target=\"_top\"` attribute\n- **Error Debugging:** Add\n `` to HTML to capture\n client-side errors\n- **Environment Variables:** Use `Deno.env.get('keyname')` with defensive checks:\n ```ts\n const apiKey = Deno.env.get(\"API_KEY\");\n if (!apiKey) {\n throw new Error(\"API_KEY not configured\");\n }\n ```\n Generally prefer APIs that don't require keys when possible.\n- **Imports:** Use `https://esm.sh` for npm and Deno dependencies to ensure\n compatibility on server and browser\n- **Storage Strategy:** Only use backend storage if explicitly required; prefer\n simple static client-side sites\n- **React Configuration:** When using React libraries, pin versions with\n `?deps=react@18.2.0,react-dom@18.2.0` and start the file with\n `/** @jsxImportSource https://esm.sh/react@18.2.0 */`\n- Ensure all React dependencies and sub-dependencies are pinned to the same\n version\n- **Styling:** Default to using TailwindCSS via\n `` unless otherwise\n specified\n\n### Error Handling\n\nFor HTTP vals, handle errors gracefully and return appropriate status codes:\n\n```ts\nexport default async function (req: Request): Promise {\n try {\n // Your logic here\n return new Response(\"Success\");\n } catch (error) {\n return new Response(`Error: ${error.message}`, { status: 500 });\n }\n}\n```\n\nFor non-HTTP vals, let errors bubble up with full context rather than catching\nand merely logging them.\n\n### CORS Headers\n\nWhen building APIs consumed by browsers, include CORS headers:\n\n```ts\nreturn new Response(JSON.stringify(data), {\n headers: {\n \"Content-Type\": \"application/json\",\n \"Access-Control-Allow-Origin\": \"*\",\n },\n});\n```\n\n## Project Structure and Design Patterns\n\n### Recommended Directory Structure\n\n```\n├── backend/\n│ ├── database/\n│ │ ├── migrations.ts # Schema definitions\n│ │ ├── queries.ts # DB query functions\n│ │ └── README.md\n│ └── routes/ # Route modules\n│ ├── [route].ts\n│ └── static.ts # Static file serving\n│ ├── index.ts # Main entry point\n│ └── README.md\n├── frontend/\n│ ├── components/\n│ │ ├── App.tsx\n│ │ └── [Component].tsx\n│ ├── favicon.svg\n│ ├── index.html # Main HTML template\n│ ├── index.tsx # Frontend JS entry point\n│ ├── README.md\n│ └── style.css\n├── README.md\n└── shared/\n ├── README.md\n └── utils.ts # Shared types and functions\n```\n\n### Backend (Hono) Best Practices\n\n- Hono is the recommended API framework\n- Main entry point should be `backend/index.ts`\n- **Static asset serving:** Use the utility functions to read and serve project\n files:\n\n ```ts\n import {\n readFile,\n serveFile,\n } from \"https://esm.town/v/std/utils@85-main/index.ts\";\n\n // serve all files in frontend/ and shared/\n app.get(\"/frontend/*\", (c) => serveFile(c.req.path, import.meta.url));\n app.get(\"/shared/*\", (c) => serveFile(c.req.path, import.meta.url));\n\n // For index.html, often you'll want to bootstrap with initial data\n app.get(\"/\", async (c) => {\n let html = await readFile(\"/frontend/index.html\", import.meta.url);\n\n // Inject data to avoid extra round-trips\n const initialData = await fetchInitialData();\n const dataScript = ``;\n\n html = html.replace(\"\", `${dataScript}`);\n return c.html(html);\n });\n ```\n\n- Create RESTful API routes for CRUD operations\n- Always include this snippet at the top-level Hono app to re-throwing errors to\n see full stack traces:\n ```ts\n // Unwrap Hono errors to see original error details\n app.onError((err, c) => {\n throw err;\n });\n ```\n\n### Database Patterns\n\n- Run migrations on startup or comment out for performance\n- Change table names when modifying schemas rather than altering\n- Export clear query functions with proper TypeScript typing\n\n## Common Gotchas and Solutions\n\n1. **Environment Limitations:**\n - Val Town runs on Deno in a serverless context, not Node.js\n - Code in `shared/` must work in both frontend and backend environments\n - Cannot use `Deno` keyword in shared code\n - Use `https://esm.sh` for imports that work in both environments\n\n2. **SQLite Peculiarities:**\n - Limited support for ALTER TABLE operations\n - Create new tables with updated schemas and copy data when needed\n - Always run table creation before querying\n\n3. **React Configuration:**\n - All React dependencies must be pinned to 18.2.0\n - Always include `@jsxImportSource https://esm.sh/react@18.2.0` at the top of\n React files\n - Rendering issues often come from mismatched React versions\n\n4. **File Handling:**\n - Val Town only supports text files, not binary\n - Use the provided utilities to read files across branches and forks\n - For files in the project, use `readFile` helpers\n\n5. **API Design:**\n - `fetch` handler is the entry point for HTTP vals\n - Run the Hono app with\n `export default app.fetch // This is the entry point for HTTP vals`\n\n6. **HTTP Endpoint Discovery:**\n - HTTP vals have a `links.endpoint` field with the live deployment URL\n - Use this to test and verify your val is working correctly\n",[],[227],["D",1769387194903],[],[18],"d4811c80-fa4d-11f0-8f56-42dde27851f2","research.md","3439c0fc-fa4c-11f0-8dfc-42dde27851f2","ab80b020-fa4d-11f0-96ef-42dde27851f2",16,["D",1769387263304],"# Chicago Free Resident Days App - Exploration\n\n## Core Insight Deconstruction\n\nThe underlying insight here is threefold:\n\n1. **Information asymmetry creates missed value** - Chicago offers numerous free admission days at museums, zoos, gardens, and cultural institutions for residents, but this information is fragmented across dozens of websites, each with their own calendars, eligibility rules, and update schedules.\n\n2. **Temporal relevance is key** - A static list is nearly useless. The value comes from knowing what's free _today_, _this weekend_, or _when I'm actually free_. This is a calendar problem disguised as a directory problem.\n\n3. **Civic benefit meets personal planning** - These programs exist to increase cultural access, but friction in discovery undermines that goal. Reducing friction serves both individual users and the broader civic intent.\n\n## Directions to Explore\n\n### Direction 1: Pure Scraper + Static Site\n\n- **Description:** Build scrapers for each institution's calendar, aggregate into a single JSON feed, publish as a minimal static site (perhaps using the recutils format from your prior research for the data layer). No accounts, no backend, just a daily-updated list.\n- **Why it could work:** Extremely low maintenance cost, can be run on GitHub Actions for free, no infrastructure to manage. Fits the \"tools, not products\" ethos.\n- **Risks:** Scraping is brittle—sites change, some use JavaScript rendering, anti-bot measures. Could break silently. Also, no personalization.\n- **First step:** Audit 5-10 major Chicago institutions (Art Institute, Field Museum, Shedd, MSI, Lincoln Park Zoo, etc.) and catalog their calendar URL structures and data formats.\n\n### Direction 2: Calendar Subscription Feed (ICS)\n\n- **Description:** Instead of (or in addition to) a website, generate an ICS calendar feed that users can subscribe to in their existing calendar apps. Each free day becomes an all-day event with the institution name, address, and any eligibility notes.\n- **Why it could work:** Meets users where they already live—their calendar. Zero app switching. Passive discovery. Could reference your minimalist AI calendar research for sync patterns.\n- **Risks:** ICS feeds are pull-based and cache unpredictably. Users might see stale data. Also limited in richness—no images, no deep linking.\n- **First step:** Generate a sample ICS file manually with 10 upcoming free days and test subscription behavior across Google Calendar, Apple Calendar, and Outlook.\n\n### Direction 3: SMS/Push Notification Service\n\n- **Description:** Let users subscribe to alerts (SMS, email, or push) based on preferences: \"Tell me about any free days in the next 7 days\" or \"Alert me when the Art Institute has a free day.\" Proactive nudges rather than passive discovery.\n- **Why it could work:** Solves the \"I forgot to check\" problem. High engagement potential for time-sensitive info.\n- **Risks:** Requires user accounts, preferences storage, notification infrastructure. Much more complex. Potential cost at scale (SMS fees, push services).\n- **First step:** Define 3-5 notification \"recipes\" that would cover most use cases and sketch the preference UI.\n\n### Direction 4: Civic Data Partnership\n\n- **Description:** Instead of scraping, reach out to Choose Chicago, the Chicago Cultural Alliance, or individual institutions to get official data feeds or partnership. Position as a civic tech project that amplifies their programs.\n- **Why it could work:** Clean data, no scraping fragility, potential for co-promotion. Some cities have official APIs for this kind of civic info.\n- **Risks:** Slow—requires relationship building, likely bureaucratic. Might never materialize. Also removes the \"just build it\" energy.\n- **First step:** Research whether Chicago has any existing open data portals covering cultural events. Check data.cityofchicago.org.\n\n### Direction 5: Community-Sourced Corrections\n\n- **Description:** Accept that scrapers will break. Build a lightweight community layer—maybe just a GitHub repo where anyone can submit corrections, add new institutions, or flag outdated info. Use GitHub Actions to merge validated changes into the live feed.\n- **Why it could work:** Distributes the maintenance burden. Creates investment from users. Aligns with open-source ethos.\n- **Risks:** Requires critical mass of contributors. Could become a ghost town. Also, spam/vandalism potential (though low for this niche).\n- **First step:** Design the contribution format—perhaps a simple YAML or recutils file per institution, with schema validation on PR.\n\n### Direction 6: \"Free Day Trip Planner\" with Context\n\n- **Description:** Go beyond listing free days—help users plan around them. Show nearby free parking, CTA routes, nearby restaurants with lunch specials, estimated crowd levels, what exhibits are currently showing. Turn a free museum day into a complete outing.\n- **Why it could work:** Dramatically higher value per visit. Differentiates from a simple calendar. Could integrate Schema.org data (your prior research).\n- **Risks:** Scope explosion. Each additional data source is another scraping target. Could become unwieldy.\n- **First step:** Pick one institution and manually assemble a \"complete outing\" data package to see what's actually useful.\n\n### Direction 7: Embeddable Widget for Local Media\n\n- **Description:** Build an embeddable widget that local news sites, blogs, or community organizations could drop into their pages. \"This week's free days\" as a reusable component.\n- **Why it could work:** Distribution through existing trusted channels. Could drive organic traffic back to main site. Serves local journalism's community mission.\n- **Risks:** Requires polished, reliable widget. Support burden if widely adopted. Also, modern sites might have CSP restrictions on embeds.\n- **First step:** Build a simple iframe-based widget and test embedding in a personal blog.\n\n### Direction 8: Hyperlocal Expansion Framework\n\n- **Description:** Design the architecture so the Chicago scraper is just the first instance. Build it as a framework where someone could fork and adapt for NYC, LA, or any city with similar programs. Parameterized by city + institution list.\n- **Why it could work:** Multiplies impact. Attracts contributors who want it for their city. Could become a mini-movement.\n- **Risks:** Premature generalization before proving value in one city. Different cities have wildly different program structures.\n- **First step:** Identify 2-3 other cities known for free museum days (NYC has culture pass, many cities have \"first Sunday free\" patterns) and assess structural similarities.\n\n## Unexpected Connections\n\n- **Recutils as data layer** - Your prior research on recutils could be perfect here. Each institution is a record, each free day is a record linked to it. Human-readable, git-diffable, no database needed.\n\n- **Card game generator logic** - The constraint-based generation from your card game research could apply here: \"Generate a weekend plan given: 2 free museums, 1 outdoor activity, must include lunch, budget $40.\" Combinatorial planning on top of the calendar data.\n\n- **Bookmarking app's \"surfacing\" problem** - Your bookmarking research was about re-surfacing saved items at the right moment. Same core problem: these free days are \"bookmarked\" by the city, but users need them surfaced when relevant.\n\n- **Weather integration** - A free day at Lincoln Park Zoo is very different in January vs. June. Layering weather data could help users decide which free days are actually worth taking.\n\n- **Proof of residency angle** - Many free days require proof of Chicago residency (utility bill, ID). The app could include \"what to bring\" reminders—a small but high-value detail.\n\n## Questions Worth Answering\n\n1. **What's the complete list of Chicago institutions offering free resident days?** This seems knowable but I've never seen a canonical list. Is it 15 places? 50?\n\n2. **How often do the free day schedules change?** Are they set annually, quarterly, or do they shift month-to-month? This determines scraping frequency.\n\n3. **Are there legal/ToS concerns with scraping these calendars?** Most are public info, but some sites have aggressive ToS. Worth reviewing before investing heavily.\n\n4. **What's the actual user journey today?** How do Chicagoans currently discover free days? Word of mouth? Googling per-institution? Is there a subreddit or Facebook group serving this need already?\n\n5. **Would a \"free day\" notification feel like a gift or like spam?** User psychology matters—is this delightful or annoying? Probably depends on frequency and relevance.\n\n6. **Is there a sustainable model here, or is this purely a public good project?** Not that it needs to make money, but understanding the long-term maintenance commitment is important.\n",[],[246,238],"docs","e96b2c84-fa4e-11f0-b1ca-42dde27851f2","implementation-spec.md","343e40fa-fa4c-11f0-8f11-42dde27851f2",22,["D",1769387727886],"# Chicago Free Museum Days - Val Town Implementation Spec\n\n## Overview\n\nA Bluesky bot that posts weekly updates about free museum days in Chicago, built on Val Town with SQLite storage, automated **scraping**, and a public API.\n\n## Architecture\n\n### Val Town Structure\n\n```\nVals:\n├── scrapeChooseChicago (function - extracts data from Choose Chicago)\n├── scraper (cron - orchestrates all scraper functions)\n├── utils (function - normalizeDates, date expansion helpers)\n├── db (function - loadToSQLite, query functions)\n├── bot (cron - postToBluesky, runs Monday mornings)\n└── api (HTTP - Hono API for data access)\n\nSQLite Database:\n├── scraped_free_days (auto-populated by scrapers)\n├── free_days_overrides (manual corrections/additions)\n└── Union query merges both (overrides win on conflicts)\n```\n\n### Data Flow\n\n```\nChoose Chicago (HTML)\n ↓\nscrapeChooseChicago() → [{name, rawDates[], url, notes}]\n ↓\nnormalizeDates() → [{institution, date, time, proof_required, notes}]\n ↓\nloadToSQLite() → scraped_free_days table\n ↓\nQuery (union with overrides)\n ↓\n[Branch 1] postToBluesky() → Bluesky post\n[Branch 2] API endpoint → JSON response\n```\n\n## Database Schema\n\n### Table: `scraped_free_days`\n\nAuto-populated by scrapers. Replaced on each scraper run.\n\n```sql\nCREATE TABLE IF NOT EXISTS scraped_free_days (\n id INTEGER PRIMARY KEY AUTOINCREMENT,\n institution TEXT NOT NULL,\n institution_key TEXT NOT NULL, -- Slugified institution name for matching\n date TEXT NOT NULL, -- ISO format YYYY-MM-DD\n time TEXT, -- e.g., \"9am-5pm\", \"11am-close\"\n proof_required TEXT, -- e.g., \"Illinois ID required\", \"ZIP code verification\"\n notes TEXT, -- Additional info (holidays, registration required, etc.)\n source TEXT NOT NULL, -- Source identifier (e.g., \"choose-chicago\")\n source_url TEXT, -- Where this data was scraped from\n scraped_at TEXT NOT NULL, -- ISO timestamp of scrape\n UNIQUE(institution_key, date) -- Prevent duplicate entries per institution/date\n);\n\nCREATE INDEX idx_scraped_date ON scraped_free_days(date);\nCREATE INDEX idx_scraped_institution_key ON scraped_free_days(institution_key);\nCREATE INDEX idx_scraped_source ON scraped_free_days(source);\n```\n\n### Table: `free_days_overrides`\n\nManual corrections for when scrapers fail or data needs fixing. Can also suppress incorrect scraped data.\n\n```sql\nCREATE TABLE IF NOT EXISTS free_days_overrides (\n id INTEGER PRIMARY KEY AUTOINCREMENT,\n institution TEXT NOT NULL,\n institution_key TEXT NOT NULL, -- Slugified institution name for matching\n date TEXT NOT NULL, -- ISO format YYYY-MM-DD\n time TEXT,\n proof_required TEXT,\n notes TEXT,\n is_cancelled INTEGER DEFAULT 0, -- Set to 1 to suppress a scraped entry\n override_reason TEXT, -- Why this override exists\n created_at TEXT NOT NULL, -- When override was added\n UNIQUE(institution_key, date)\n);\n\nCREATE INDEX idx_override_date ON free_days_overrides(date);\nCREATE INDEX idx_override_institution_key ON free_days_overrides(institution_key);\n```\n\n### Query Logic\n\nWhen querying for free days, overrides take precedence over scraped data. Use a LEFT JOIN anti-pattern for deterministic results (the previous GROUP BY approach was non-deterministic in SQLite):\n\n```sql\n-- Get free days for a date range (overrides win, cancelled entries excluded)\nSELECT s.institution, s.date, s.time, s.proof_required, s.notes\nFROM scraped_free_days s\nLEFT JOIN free_days_overrides o\n ON o.institution_key = s.institution_key AND o.date = s.date\nWHERE s.date BETWEEN ? AND ?\n AND o.id IS NULL -- No override exists for this entry\n\nUNION ALL\n\nSELECT o.institution, o.date, o.time, o.proof_required, o.notes\nFROM free_days_overrides o\nWHERE o.date BETWEEN ? AND ?\n AND COALESCE(o.is_cancelled, 0) = 0 -- Exclude cancelled entries\n\nORDER BY date, institution;\n```\n\n## Implementation Steps\n\n### Step 1: Database Setup (`db` val)\n\nCreate the `db` val with:\n\n**Functions:**\n\n- `initDatabase()` - Create tables and indexes\n- `loadToSQLite(data, source)` - Insert scraped data (deletes old entries from same source first)\n- `getFreeDays(startDate, endDate)` - Query with override logic\n- `addOverride(institution, date, details)` - Manual correction helper\n- `getUpcomingWeek()` - Helper for bot (next 7 days from today)\n- `getLatestScrapeTime()` - Get timestamp of most recent scrape (for staleness check)\n- `slugify(name)` - Generate institution_key from institution name\n- `chicagoDate(date?)` - Get ISO date string in America/Chicago timezone\n\n**Implementation:**\n\n```typescript\nimport { sqlite } from \"https://esm.town/v/std/sqlite\";\n\n// Get ISO date string in Chicago timezone (avoids UTC date offset issues)\nexport function chicagoDate(d = new Date()): string {\n const parts = new Intl.DateTimeFormat(\"en-CA\", {\n timeZone: \"America/Chicago\",\n year: \"numeric\",\n month: \"2-digit\",\n day: \"2-digit\",\n }).formatToParts(d);\n const y = parts.find((p) => p.type === \"year\")!.value;\n const m = parts.find((p) => p.type === \"month\")!.value;\n const day = parts.find((p) => p.type === \"day\")!.value;\n return `${y}-${m}-${day}`;\n}\n\n// Generate a stable key for matching institutions across sources/overrides\nexport function slugify(name: string): string {\n return name\n .toLowerCase()\n .replace(/[^a-z0-9]+/g, \"-\")\n .replace(/^-|-$/g, \"\");\n}\n\n// Initialize tables\nexport async function initDatabase() {\n // Create scraped_free_days table\n // Create free_days_overrides table\n // Create indexes\n}\n\n// Load scraped data (replaces old scraped data from same source)\nexport async function loadToSQLite(data: Array, source: string) {\n // Use sqlite.batch() for atomic transaction\n await sqlite.batch([\n { sql: \"DELETE FROM scraped_free_days WHERE source = ?\", args: [source] },\n ...data.map((entry) => ({\n sql: `INSERT INTO scraped_free_days \n (institution, institution_key, date, time, proof_required, notes, source, source_url, scraped_at)\n VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?)`,\n args: [\n entry.institution,\n slugify(entry.institution),\n entry.date,\n entry.time,\n entry.proof_required,\n entry.notes,\n source,\n entry.source_url,\n new Date().toISOString(),\n ],\n })),\n ]);\n}\n\n// Query with override logic\nexport async function getFreeDays(startDate: string, endDate: string) {\n // LEFT JOIN anti-pattern query as shown above\n}\n\n// Helper for bot (uses Chicago timezone)\nexport async function getUpcomingWeek() {\n const today = chicagoDate();\n const nextWeekDate = new Date();\n nextWeekDate.setDate(nextWeekDate.getDate() + 7);\n const nextWeek = chicagoDate(nextWeekDate);\n return getFreeDays(today, nextWeek);\n}\n\n// Check data freshness for bot staleness warning\nexport async function getLatestScrapeTime(): Promise {\n const result = await sqlite.execute(\n \"SELECT MAX(scraped_at) as latest FROM scraped_free_days\",\n );\n return result.rows[0]?.latest ?? null;\n}\n```\n\n### Step 2: Scraper (`scrapeChooseChicago` val)\n\n**Dependencies:**\n\n- `cheerio` (HTML parsing)\n\n**Function signature:**\n\n```typescript\nexport interface RawFreeDayData {\n institution: string;\n rawLines: string[]; // All lines from HTML (dates AND eligibility notes mixed)\n url?: string;\n}\n\nexport async function scrapeChooseChicago(): Promise;\n```\n\n**Scraping logic:**\n\n1. Fetch HTML from Choose Chicago (with timeout and User-Agent)\n2. Parse structure:\n - Find H3 headings (institution names)\n - Extract following `

` lists (all text, not just dates)\n3. Return structured data\n\n**Important:** Choose Chicago mixes date info and eligibility notes in the same `
` list. The normalizer will classify each line.\n\n**Example HTML structure to parse:**\n\n```html\n
Art Institute of Chicago
\n
- January 5 - February 28 (weekdays only, 11am-close)
- Illinois residents with ID
\n```\n\n**Pseudocode:**\n\n```typescript\nconst SOURCE_URL =\n \"https://www.choosechicago.com/articles/museums-art/free-museum-days-in-chicago/\";\n\n// Fetch with timeout and polite User-Agent\nconst controller = new AbortController();\nsetTimeout(() => controller.abort(), 15_000);\nconst response = await fetch(SOURCE_URL, {\n signal: controller.signal,\n headers: { \"User-Agent\": \"chicago-free-museum-days-bot/1.0\" },\n});\nconst html = await response.text();\n\nconst $ = cheerio.load(html);\nconst results = [];\n\n$(\"h3\").each((i, el) => {\n const institution = $(el).text().trim();\n const lines = [];\n\n // Find following ul/li elements (contains dates AND eligibility notes)\n $(el)\n .nextUntil(\"h3\", \"ul\")\n .find(\"li\")\n .each((j, li) => {\n lines.push($(li).text().trim());\n });\n\n results.push({ institution, rawLines: lines, url: SOURCE_URL });\n});\n\nreturn results;\n```\n\n### Step 3: Utilities (`utils` val)\n\n**Dependencies:**\n\n- `chrono-node` (natural language date parsing)\n\n**Functions:**\n\n- `classifyLine(line)` - Determine if a line is date-ish or note-ish\n- `normalizeDates(rawData)` - Parse raw strings into structured dates\n- `expandPattern(pattern, startDate, endDate)` - Expand \"every Wednesday\" into dates\n- `parseTimeRange(timeStr)` - Normalize time formats\n\n**Key logic:**\n\nChoose Chicago mixes date info and eligibility notes in the same `
` list. The normalizer uses a two-pass approach:\n1. **Classify** each line as date-ish or note-ish\n2. **Aggregate** note-ish lines into `proof_required` / `notes` for the institution\n3. **Expand** date-ish lines into individual `FreeDayEntry` records\n\n```typescript\nexport interface FreeDayEntry {\n institution: string;\n date: string; // ISO YYYY-MM-DD\n time?: string;\n proof_required?: string;\n notes?: string;\n source_url?: string;\n}\n\n// Patterns that indicate eligibility/requirements rather than dates\nconst NOTE_PATTERNS = [\n /illinois/i,\n /resident/i,\n /\\bID\\b/,\n /required/i,\n /must\\b/i,\n /free for/i,\n /tickets/i,\n /registration/i,\n /zip code/i,\n /proof/i,\n];\n\n// Patterns that indicate date information\nconst DATE_PATTERNS = [\n /january|february|march|april|may|june|july|august|september|october|november|december/i,\n /\\d{1,2}(st|nd|rd|th)?/,\n /every\\s+(monday|tuesday|wednesday|thursday|friday|saturday|sunday)/i,\n /weekdays?/i,\n /through|to|-/,\n];\n\nfunction classifyLine(line: string): \"date\" | \"note\" {\n const noteScore = NOTE_PATTERNS.filter((p) => p.test(line)).length;\n const dateScore = DATE_PATTERNS.filter((p) => p.test(line)).length;\n\n // If it looks more like a note, classify as note\n if (noteScore > dateScore) return \"note\";\n // If it has date indicators, classify as date\n if (dateScore > 0) return \"date\";\n // Default to note (safer to not generate bad date entries)\n return \"note\";\n}\n\nexport async function normalizeDates(\n rawData: RawFreeDayData[],\n): Promise
{\n const results: FreeDayEntry[] = [];\n\n for (const item of rawData) {\n // Pass 1: Classify all lines\n const dateLines: string[] = [];\n const noteLines: string[] = [];\n\n for (const line of item.rawLines) {\n if (classifyLine(line) === \"date\") {\n dateLines.push(line);\n } else {\n noteLines.push(line);\n }\n }\n\n // Aggregate notes for this institution\n const aggregatedNotes = noteLines.join(\"; \") || undefined;\n\n // Pass 2: Parse date lines\n for (const dateLine of dateLines) {\n // Try chrono-node parsing\n const parsed = chrono.parse(dateLine);\n\n if (parsed.length > 0) {\n // Extract date range if present, expand into individual dates\n // Add aggregatedNotes to each entry\n } else if (/every/i.test(dateLine)) {\n // Handle recurring patterns\n const expanded = expandPattern(dateLine, item.institution, aggregatedNotes);\n results.push(...expanded);\n } else {\n // Log unparseable entry for manual review\n console.warn(\"Could not parse date line:\", dateLine);\n }\n }\n }\n\n return results;\n}\n\n// Expand \"every Wednesday\" into next 12 months of Wednesdays\nfunction expandPattern(\n pattern: string,\n institution: string,\n notes?: string,\n): FreeDayEntry[] {\n // Parse day of week\n // Generate dates for next 12 months\n // Return array of entries with notes attached\n}\n```\n\n### Step 4: Scraper Orchestrator (`scraper` cron val)\n\n**Schedule:** Monthly (first Monday of each month)\n\n**Logic:**\n\n```typescript\nimport { scrapeChooseChicago } from \"./scrapeChooseChicago\";\nimport { normalizeDates } from \"./utils\";\nimport { loadToSQLite } from \"./db\";\n\nexport default async function () {\n try {\n // Run all scrapers\n const rawData = await scrapeChooseChicago();\n\n // Normalize dates\n const normalized = await normalizeDates(rawData);\n\n // Load to SQLite\n await loadToSQLite(normalized, \"choose-chicago\");\n\n console.log(`Scraped ${normalized.length} free day entries`);\n } catch (error) {\n console.error(\"Scraper failed:\", error);\n // Optional: send alert/email\n }\n}\n```\n\n**Future expansion:**\n\n- Add more scraper functions (Loop Chicago, individual museums)\n- Call them all in sequence\n- Each writes to same `scraped_free_days` table with different `source_url`\n\n### Step 5: Bluesky Bot (`bot` cron val)\n\n**Schedule:** Every Monday at 8am Central Time\n\n**Note:** Val Town cron schedules may run in UTC. To run at 8am Central:\n- Standard Time (CST, UTC-6): Use `0 14 * * 1` (14:00 UTC)\n- Daylight Time (CDT, UTC-5): Use `0 13 * * 1` (13:00 UTC)\n- Or check Val Town docs for timezone configuration options\n\n**Dependencies:**\n\n- `@atproto/api` (Bluesky SDK)\n\n**Logic:**\n\n```typescript\nimport { BskyAgent } from \"@atproto/api\";\nimport { getUpcomingWeek, getLatestScrapeTime } from \"./db\";\n\nconst agent = new BskyAgent({ service: \"https://bsky.social\" });\n\nexport default async function () {\n // Login to Bluesky\n await agent.login({\n identifier: Deno.env.get(\"BLUESKY_HANDLE\"),\n password: Deno.env.get(\"BLUESKY_PASSWORD\"),\n });\n\n // Get upcoming free days\n const freeDays = await getUpcomingWeek();\n\n // Guard: Don't post if no data available\n if (freeDays.length === 0) {\n console.warn(\"No free days found for upcoming week - skipping post\");\n return;\n }\n\n // Optional: Check data freshness\n const lastScrape = await getLatestScrapeTime();\n const daysSinceUpdate = lastScrape\n ? Math.floor((Date.now() - new Date(lastScrape).getTime()) / (1000 * 60 * 60 * 24))\n : null;\n\n // Format message\n const message = formatMessage(freeDays, daysSinceUpdate);\n\n // Post to Bluesky\n await agent.post({ text: message });\n}\n\nfunction formatMessage(freeDays: FreeDayEntry[], daysSinceUpdate?: number | null): string {\n // Group by institution\n // Format as readable list\n // Add footer with data source link\n\n let footer = \"Data: github.com/your-repo\";\n if (daysSinceUpdate && daysSinceUpdate > 14) {\n footer = `⚠️ Data last updated ${daysSinceUpdate} days ago\\n` + footer;\n }\n\n return `\n🏛️ Free museums in Chicago this week:\n\n• Art Institute: Mon-Fri (weekdays, 11am-close)\n• Field Museum: Wednesday\n• MCA: Tuesday evenings 5-9pm\n\n+${freeDays.length - 3} more → [link to API]\n\n${footer}\n `.trim();\n}\n```\n\n**Post format considerations:**\n\n- Keep under 300 characters for main post\n- Use thread if >5 museums\n- Link to full calendar/API\n- Emoji for visual interest\n\n### Step 6: API Endpoint (`api` HTTP val)\n\n**Dependencies:**\n\n- `hono` (lightweight web framework)\n\n**Routes:**\n\n```typescript\nimport { Hono } from 'hono';\nimport { getFreeDays, getUpcomingWeek } from './db';\n\nconst app = new Hono();\n\n// Get free days for date range\napp.get('/free-days', async (c) => {\n const start = c.req.query('start'); // YYYY-MM-DD\n const end = c.req.query('end'); // YYYY-MM-DD\n\n if (!start || !end) {\n return c.json({ error: 'start and end dates required' }, 400);\n }\n\n const data = await getFreeDays(start, end);\n return c.json({ data, count: data.length });\n});\n\n// Get upcoming week (convenience endpoint)\napp.get('/upcoming', async (c) => {\n const data = await getUpcomingWeek();\n return c.json({ data, count: data.length });\n});\n\n// Get all institutions (for filtering)\napp.get('/institutions', async (c) => {\n // Query distinct institutions from both tables\n return c.json({ institutions: [...] });\n});\n\nexport default app.fetch;\n```\n\n**Future additions:**\n\n- `/ics` endpoint to generate iCal feed\n- `/institution/:name` to filter by museum\n- `/today` for current day only\n\n## Environment Variables\n\nSet these in Val Town secrets:\n\n```\nBLUESKY_HANDLE=your-handle.bsky.social\nBLUESKY_PASSWORD=your-app-password\n```\n\n## Testing Strategy\n\n### Phase 1: Database\n\n1. Create `db` val\n2. Run `initDatabase()`\n3. Manually insert test data\n4. Verify queries work\n\n### Phase 2: Scraper + Normalizer\n\n1. Run `scrapeChooseChicago()` manually\n2. Inspect raw output\n3. Pass to `normalizeDates()`\n4. Verify date parsing quality\n5. Check for unparseable entries (aim for <20% failure rate)\n\n### Phase 3: Integration\n\n1. Run full scraper → normalizer → loader pipeline\n2. Query database, verify data looks correct\n3. Add manual overrides for failed parsing\n4. Re-query, confirm overrides work\n\n### Phase 4: Bot\n\n1. Test Bluesky post with hardcoded message\n2. Test with real database query\n3. Verify formatting looks good on Bluesky\n4. Enable cron schedule\n\n### Phase 5: API\n\n1. Test each endpoint locally\n2. Verify JSON responses\n3. Test date range edge cases\n4. Deploy and test public URL\n\n## Success Criteria\n\n### Minimum Viable Product (MVP)\n\n- ✅ Scraper runs monthly without errors\n- ✅ Database contains ≥15 Chicago institutions\n- ✅ Bot posts every Monday at 8am\n- ✅ API returns valid JSON for date ranges\n- ✅ Manual intervention <1 hour/month\n\n### Stretch Goals\n\n- Add Loop Chicago scraper\n- Add individual museum scrapers for missing institutions\n- Implement ICS calendar feed endpoint\n- Support filtering by neighborhood/museum type\n- Community contributions (PR process for corrections)\n\n## Known Limitations & Mitigations\n\n| Limitation | Impact | Mitigation |\n| ---------------------------------- | ------------------------ | ----------------------------------------------- |\n| Choose Chicago updates irregularly | Stale data | Run scraper monthly, add manual overrides |\n| Date parsing ~80% accurate | Missing/incorrect dates | Manual review process, improve parser over time |\n| Proof-of-residency rules change | Incorrect info | Version in git, add notes field |\n| Bluesky API rate limits | Posting failures | Respect rate limits, add retry logic |\n| SQLite size limits | Unlikely (450 rows/year) | Monitor, could archive old dates if needed |\n\n## Maintenance Schedule\n\n**Monthly:**\n\n- Review scraper logs for failures\n- Check for unparseable dates\n- Add manual overrides as needed\n\n**Quarterly:**\n\n- Audit data quality against official museum sites\n- Update parser for new date formats\n- Review Bluesky engagement metrics\n\n**Annually:**\n\n- Update recurring patterns (if museums change schedules)\n- Archive old dates (optional)\n- Expand to new data sources if successful\n\n## Future Enhancements\n\n1. **Multi-city support**: Expand to other cities with free museum programs\n2. **ICS calendar feed**: Users can subscribe in Google/Apple Calendar\n3. **Embeddable widget**: Iframe for community sites\n4. **SMS notifications**: Text alerts for favorite museums\n5. **Accessibility filters**: Filter by wheelchair access, sensory-friendly hours\n6. **Community contributions**: GitHub repo for data corrections/additions\n\n## Technical Debt to Avoid\n\n- ❌ Don't pre-optimize date parsing - start simple, improve as needed\n- ❌ Don't build complex admin UI - Val Town console + SQLite tool is enough\n- ❌ Don't add authentication to API - keep it open (rate limit if abused)\n- ❌ Don't overthink schema - simple tables work fine at this scale\n\n## Resources\n\n- [Val Town Docs](https://docs.val.town)\n- [Bluesky API](https://atproto.com)\n- [Choose Chicago Source](https://www.choosechicago.com/articles/museums-art/free-museum-days-in-chicago/)\n- [Cheerio Docs](https://cheerio.js.org/)\n- [Chrono Node](https://github.com/wanasit/chrono)\n- [Hono Framework](https://hono.dev)\n\n## Next Steps\n\nStart with **Step 1: Database Setup** - create the `db` val and initialize the schema. Once tables exist, you can test the entire pipeline with manual data before building the scraper.\n",[],[246,248],"b9cd414c-fa4e-11f0-b13f-42dde27851f2","bsky-bot-thesis.md","34474704-fa4c-11f0-98a8-42dde27851f2",20,["D",1769387648002],3,"# Chicago Free Museum Days Bluesky Bot\n\n## The Opportunity\n\nThere's a clear gap in the Chicago cultural information ecosystem: **no Bluesky bot exists to notify residents about free museum days.**\n\nThe information aggregation problem is largely solved by existing websites (Choose Chicago, Upparent, Do312), but the distribution/discoverability problem is not.\n\nA Bluesky bot would:\n\n- Passively surface free days to people who already use the platform\n- Fill a civic information niche that's underserved on Bluesky\n- Require minimal code and maintenance\n- Generate reusable data for other formats (ICS feed, embeddable widget)\n\n## Existing Landscape\n\n### Web Aggregators\n\n| Site | Format | Calendar | ICS/Subscribe | Filtering | Strengths | Gaps |\n| ------------------------------------------------------------------------------------------------- | ---------------- | ------------- | ------------------ | ------------- | ----------------------- | ------------------------ |\n| [Choose Chicago](https://www.choosechicago.com/articles/museums-art/free-museum-days-in-chicago/) | Editorial | ✗ | ✗ | ✗ | Official, comprehensive | Static, no interactivity |\n| [Upparent](https://www.upparent.com/lists/free-museum-days-chicago) | Interactive list | ✓ Date picker | Newsletter | ✓ Sort/filter | Calendar view, ratings | Parent-focused, no ICS |\n| [Do312](https://do312.com/p/chicago-free-museum-days) | Long-form guide | ✗ | Newsletter | ✗ | Rich descriptions | Must manually parse |\n| [My Kid List](https://mykidlist.com/museum-free-days/) | Editorial list | ✗ | Daily/weekly email | ✗ | Comprehensive, updated | Static layout |\n| [Loop Chicago](https://loopchicago.com/in-the-loop/2025-free-museum-days/) | Blog post | ✗ | ✗ | ✗ | Clean layout | Annual refresh only |\n\n### Existing Social Bot\n\n**[@FreeMuseumDay](https://twitter.com/FreeMuseumDay)** on Twitter\n\n- Covers: Portland, SF, Boston, Chicago, LA, NYC, Seattle\n- Links to freemuseumday.org for details\n- Status: Appears dormant or minimally active on Chicago posts\n\n### Bluesky Bot Space\n\n- **No free museum days bot exists on Bluesky**\n- Bluesky is growing rapidly but has fewer bots than Twitter\n- Civic information niche is underserved\n- Lower noise/competition for attention\n\n---\n\n## What Needs to Be Scraped\n\n### Data Sources (Priority Order)\n\n#### 1. **Aggregator Sites** (Recommended Primary)\n\nThese do the heavy lifting of compiling from individual institutions. Scrape these instead of hitting each museum:\n\n- **[Choose Chicago](https://www.choosechicago.com/articles/museums-art/free-museum-days-in-chicago/)**\n - Format: H3 headings per museum + bulleted date lists\n - Structure: Clean semantic HTML (`
- `)\n - Update frequency: Periodic (2-3x per year)\n - Scraping strategy: Parse H3 for institution name, extract `
- ` dates\n\n- **[Loop Chicago](https://loopchicago.com/in-the-loop/2025-free-museum-days/)**\n - Format: Museum section + free day listings\n - Structure: Similar semantic HTML layout\n - Update frequency: Annual refresh (early January)\n - Scraping strategy: Same as above\n\n#### 2. **Individual Museum Sites** (Fallback/Supplement)\n\n**Recurring patterns** (no scraping needed, hardcode rules):\n\n- Field Museum: Every Wednesday\n- DuSable Black History Museum: Every Wednesday\n- Peggy Notebaert Nature Museum: Every Thursday\n- MCA Chicago: Every Tuesday 5-9pm (year-round)\n- Lincoln Park Zoo: Every day (always free)\n- National Museum of Mexican Art: Every day (always free)\n- Chicago Cultural Center: Every day (always free)\n\n**Scattered/seasonal dates** (need scraping):\n\n- Art Institute: Seasonal weekday windows (Jan-Feb, etc.)\n- Shedd Aquarium: Specific date ranges, varies by month\n- Griffin MSI: 15-20 specific dates scattered across year\n- Chicago History Museum: Mix of holidays + promotional dates\n- Adler Planetarium: Scattered dates + seasonal Tuesday nights\n- Chicago Botanic Garden: Specific dates, requires registration\n\n**Scraping challenges:**\n\n- Some sites use JavaScript rendering (need Playwright/Puppeteer)\n- Some return 403 on direct fetches (Shedd)\n- Date formats inconsistent within and across sites\n- Eligibility rules embedded in prose\n\n#### 3. **City/Civic Data Sources** (Low Priority)\n\n- Checked [data.cityofchicago.org](https://data.cityofchicago.org/) — no dedicated museum free days API\n- Not likely to exist in the near future\n\n### Data Normalization Challenge\n\nFree days fall into two categories that need different handling:\n\n**Recurring patterns:**\n\n```yaml\n- institution: \"Field Museum\"\n free_day_type: \"recurring\"\n pattern: \"every Wednesday\"\n time: \"9am-5pm\"\n proof_of_residency: \"Illinois ID required\"\n```\n\n**Scattered/seasonal dates:**\n\n```yaml\n- institution: \"Art Institute\"\n free_day_type: \"dated\"\n dates:\n - start: \"2026-01-05\"\n end: \"2026-02-28\"\n pattern: \"weekdays only\"\n time: \"11am-close\"\n proof_of_residency: \"ZIP code verification\"\n```\n\n**Normalization needs:**\n\n- Convert prose patterns (\"January 19-23, 27-30\") → actual date lists\n- Standardize time formats\n- Document proof-of-residency requirements consistently\n- Flag when scraping source becomes stale\n\n---\n\n## Why a Bluesky Bot is the Right First Step\n\n### Advantages\n\n1. **Minimal code required**\n - ~100 lines of TypeScript/JavaScript\n - Bluesky SDK is simple and well-documented\n - GitHub Actions handles scheduling\n\n2. **Zero infrastructure cost**\n - GitHub Actions is free\n - No database (data lives in git)\n - No hosting fees\n\n3. **Low maintenance burden**\n - Monthly or quarterly scrape updates\n - GitHub Actions logs for monitoring\n - Community PRs can help maintain data\n\n4. **Proven format for Bluesky**\n - Simple daily/weekly posts work well on platform\n - Civic information is valued by Bluesky community\n - Low friction to follow and engage\n\n5. **Reusable data pipeline**\n - Scraper output feeds bot, ICS feed, future embeddable widget\n - Single source of truth in version control\n - Easy to validate and review changes\n\n### Why NOT a Website\n\n- Aggregator sites already solve this problem adequately\n- Users are fragmented across multiple platforms (email, calendar, social)\n- Web traffic for this niche is low\n- Maintenance burden higher than a bot\n\n### Why NOT an Email Newsletter\n\n- Lower engagement than social platform for casual discovery\n- Requires email list building and maintenance\n- Subject to spam filters\n- Already exists in limited form (My Kid List offers daily/weekly emails)\n\n### Why Bluesky Specifically\n\n- **No competition.** Twitter has @FreeMuseumDay (dormant). Bluesky has nothing.\n- **Growing audience.** Bluesky is experiencing rapid adoption, especially among civic-minded users.\n- **Civic information is valued.** Bluesky users appreciate local information, mutual aid bots, etc.\n- **Easier to build bot culture.** Fewer bots total = less noise, more discovery.\n- **Lower barrier to entry.** Small bots can find their audience; don't need millions of followers.\n\n---\n\n## Technical Approach\n\n### Data Pipeline\n\n```bash\nChoose Chicago / Loop Chicago (web)\n ↓\nScraper (Node.js + cheerio or similar)\n ↓\nNormalize to YAML (recutils format)\n ↓\nGitHub repo with git history\n ↓\n[Branch 1] Bluesky Bot (posts daily/weekly)\n[Branch 2] ICS Feed Generator (for calendar apps)\n[Branch 3] Future: Embeddable widget\n```\n\n### Minimal Bot Implementation\n\n**Stack:**\n\n- Node.js + TypeScript (or Python)\n- Bluesky SDK (`@atproto/api`)\n- GitHub Actions (cron schedule)\n- Data: YAML files in git\n\n**Posting schedule:**\n\n- Monday morning: \"Here's what's free this week\"\n- Could also do: Daily post, weekly digest, or real-time alerts\n\n**Example bot post:**\n\n```\n🏛️ What's free in Chicago this week:\n\n• Art Institute: Mon-Fri (weekdays only)\n• Field Museum: Wednesday\n• MCA: Tuesday evenings 5-9pm\n\n+ 3 more (thread 🧵)\n\nData source: github.com/your-repo\n```\n\n### Data Storage Format\n\nUse YAML or recutils (your prior research interest):\n\n**YAML approach:**\n\n```yaml\ninstitutions:\n - id: \"art-institute\"\n name: \"Art Institute of Chicago\"\n address: \"111 S Michigan Ave\"\n website: \"artic.edu\"\n free_days:\n - type: \"seasonal\"\n periods:\n - name: \"Winter Weekdays\"\n start: \"2026-01-05\"\n end: \"2026-02-28\"\n pattern: \"Mon, Wed, Thu, Fri\"\n time: \"11am-close\"\n proof_of_residency: \"ZIP code verification\"\n - type: \"permanent\"\n eligibility:\n - \"Children under 14 (always free)\"\n - \"Chicago residents under 18 (always free)\"\n\n - id: \"field-museum\"\n name: \"Field Museum\"\n address: \"1400 S Lake Shore Dr\"\n website: \"fieldmuseum.org\"\n free_days:\n - type: \"recurring\"\n pattern: \"every Wednesday\"\n time: \"9am-5pm\"\n proof_of_residency: \"Illinois ID required\"\n```\n\n**Recutils approach:**\n\n```\nid: art-institute\nname: Art Institute of Chicago\naddress: 111 S Michigan Ave\nwebsite: artic.edu\nfree_day_type: seasonal\nfree_period_start: 2026-01-05\nfree_period_end: 2026-02-28\nfree_pattern: Mon,Wed,Thu,Fri\nfree_time: 11am-close\nproof_of_residency: ZIP code verification\n```\n\nEither format works; choose based on preference.\n\n---\n\n## First Steps to Validate\n\n1. **Audit the scraping targets** (Done ✓)\n - Choose Chicago and Loop Chicago are primary targets\n - Both have semantic HTML suitable for scraping\n - Update frequency: 2-3x per year\n\n2. **Build a minimal scraper**\n - Extract one institution's data from Choose Chicago\n - Test date normalization logic\n - Validate against official museum sites\n\n3. **Create test data file**\n - Manually enter ~15 institutions with current free days\n - Structure in YAML/recutils\n - This becomes the seed for bot posts\n\n4. **Build minimal bot**\n - Post hardcoded message to test Bluesky SDK\n - Schedule with GitHub Actions\n - Verify it works\n\n5. **Automate scraper → data**\n - Hook scraper into GitHub Actions workflow\n - Run weekly/monthly, commit changes as PRs\n - Review diffs before merging\n\n6. **Launch bot**\n - Post sample messages for next week\n - Seed with followers (share in Chicago communities)\n - Monitor engagement\n\n---\n\n## Success Metrics\n\n- **Low bar for success:**\n - Bot posts on schedule without errors\n - Data stays in sync with institution calendars\n - Minimal manual maintenance (<1hr/month)\n\n- **Bonus outcomes:**\n - Community contributions (PRs with new institutions or corrections)\n - ICS feed reuse (users subscribe in calendar apps)\n - Potential expansion to other cities\n\n- **Failure case:**\n - Requires more than 2-3 hours of maintenance per month\n - Museums change data format too frequently\n - Bluesky account gets no engagement (unlikely, but acceptable)\n\nEven failure is low-cost: you've proven the concept and built reusable data/code.\n\n---\n\n## Risks & Mitigations\n\n| Risk | Likelihood | Mitigation |\n| -------------------------------- | -------------------------- | ------------------------------------------------------------------------------- |\n| Scraper breaks when site changes | Medium | Monitor scraper logs, pin HTML selectors to institutions, accept manual updates |\n| Date format inconsistencies | High | Build robust date parser, test against 2-3 years of historical data |\n| Proof-of-residency rules change | Low | Version control, document changes in git history |\n| Low bot engagement | Low (civic info is valued) | Share in Chicago subreddits, tag museums, local journalists |\n| Maintenance burden grows | Medium | Keep data structure simple, automate everything possible |\n\n---\n\n## Next: The ICS Feed\n\nOnce the bot is stable, generating an ICS calendar feed is trivial:\n\n```javascript\n// Pseudocode\ninstitutions.forEach((inst) => {\n inst.free_days.forEach((day) => {\n const event = {\n summary: `Free: ${inst.name}`,\n date: day.date,\n description: `Address: ${inst.address}\\nProof: ${day.proof_of_residency}`,\n };\n calendar.addEvent(event);\n });\n});\n\nfs.writeFileSync(\"chicago-free-days.ics\", calendar.toICS());\n```\n\nUsers could subscribe in Google Calendar, Apple Calendar, Outlook. This is Direction 2 from your research.\n\n---\n\n## Conclusion\n\n**Building a Bluesky bot is the highest-ROI first step** because it:\n\n- Validates the data collection and normalization process\n- Fills a genuine gap on the platform\n- Requires minimal code and infrastructure\n- Generates reusable data for ICS feed and future formats\n- Is low-cost to maintain or abandon\n\nThe bar for success is low. The potential upside is genuine (civic value + community engagement). The learning is high (data pipeline, scraping, bot APIs, git workflows).\n\nWorth building.\n",[],[246,256],"ab80af6c-fa4d-11f0-96ef-42dde27851f2",6,["D",1769387194518],"directory",[173,174,175],[246],"b0d780e6-fa50-11f0-8c8a-42dde27851f2","utils.ts","b0d7819a-fa50-11f0-8c8a-42dde27851f2","b0a9b882-fa50-11f0-9f52-42dde27851f2",30,["D",1769388491842],"import * as chrono from \"npm:chrono-node@2.7.7\";\nimport type { FreeDayEntry } from \"./db.ts\";\nimport { chicagoDate } from \"./db.ts\";\nimport type { RawFreeDayData } from \"./scrapeChooseChicago.ts\";\n\n// Patterns that indicate eligibility/requirements rather than dates\nconst NOTE_PATTERNS = [\n\t/illinois/i,\n\t/resident/i,\n\t/\\bID\\b/,\n\t/required/i,\n\t/must\\b/i,\n\t/free for/i,\n\t/tickets/i,\n\t/registration/i,\n\t/zip code/i,\n\t/proof/i,\n\t/children/i,\n\t/adults/i,\n\t/seniors/i,\n\t/members/i,\n\t/only\\b/i,\n];\n\n// Patterns that indicate date information\nconst DATE_PATTERNS = [\n\t/january|february|march|april|may|june|july|august|september|october|november|december/i,\n\t/\\d{1,2}(st|nd|rd|th)?/,\n\t/every\\s+(monday|tuesday|wednesday|thursday|friday|saturday|sunday)/i,\n\t/weekdays?/i,\n\t/weekends?/i,\n\t/through|thru/i,\n\t/\\d{1,2}\\s*[-–—]\\s*\\d{1,2}/,\n];\n\n// Day name to number mapping\nconst DAY_MAP: Record = {\n\tsunday: 0,\n\tmonday: 1,\n\ttuesday: 2,\n\twednesday: 3,\n\tthursday: 4,\n\tfriday: 5,\n\tsaturday: 6,\n};\n\nexport function classifyLine(line: string): \"date\" | \"note\" {\n\tconst noteScore = NOTE_PATTERNS.filter((p) => p.test(line)).length;\n\tconst dateScore = DATE_PATTERNS.filter((p) => p.test(line)).length;\n\n\t// If it looks more like a note, classify as note\n\tif (noteScore > dateScore) return \"note\";\n\t// If it has date indicators, classify as date\n\tif (dateScore > 0) return \"date\";\n\t// Default to note (safer to not generate bad date entries)\n\treturn \"note\";\n}\n\n// Extract time range from a date line (e.g., \"5pm-9pm\" or \"11am-close\")\nexport function parseTimeRange(line: string): string | undefined {\n\tconst timePattern =\n\t\t/(\\d{1,2}(?::\\d{2})?\\s*(?:am|pm)?)\\s*[-–—to]+\\s*(\\d{1,2}(?::\\d{2})?\\s*(?:am|pm)?|close)/i;\n\tconst match = line.match(timePattern);\n\tif (match) {\n\t\treturn `${match[1]}-${match[2]}`.toLowerCase();\n\t}\n\treturn undefined;\n}\n\n// Expand \"every Wednesday\" into individual dates for the next 12 months\nexport function expandPattern(\n\tpattern: string,\n\tinstitution: string,\n\tsourceUrl?: string,\n\tnotes?: string,\n): FreeDayEntry[] {\n\tconst results: FreeDayEntry[] = [];\n\tconst time = parseTimeRange(pattern);\n\n\t// Match \"every [day]\" pattern\n\tconst dayMatch = pattern.match(\n\t\t/every\\s+(monday|tuesday|wednesday|thursday|friday|saturday|sunday)/i,\n\t);\n\tif (dayMatch) {\n\t\tconst targetDay = DAY_MAP[dayMatch[1].toLowerCase()];\n\t\tconst today = new Date();\n\t\tconst endDate = new Date();\n\t\tendDate.setFullYear(endDate.getFullYear() + 1);\n\n\t\t// Find the first occurrence of target day\n\t\tconst current = new Date(today);\n\t\twhile (current.getDay() !== targetDay) {\n\t\t\tcurrent.setDate(current.getDate() + 1);\n\t\t}\n\n\t\t// Generate all occurrences for the next 12 months\n\t\twhile (current <= endDate) {\n\t\t\tresults.push({\n\t\t\t\tinstitution,\n\t\t\t\tdate: chicagoDate(current),\n\t\t\t\ttime,\n\t\t\t\tnotes,\n\t\t\t\tsource_url: sourceUrl,\n\t\t\t});\n\t\t\tcurrent.setDate(current.getDate() + 7);\n\t\t}\n\t\treturn results;\n\t}\n\n\t// Match \"weekdays\" pattern (Mon-Fri)\n\tif (/weekdays?/i.test(pattern)) {\n\t\tconst today = new Date();\n\t\tconst endDate = new Date();\n\t\tendDate.setFullYear(endDate.getFullYear() + 1);\n\n\t\tconst current = new Date(today);\n\t\twhile (current <= endDate) {\n\t\t\tconst day = current.getDay();\n\t\t\tif (day >= 1 && day <= 5) {\n\t\t\t\tresults.push({\n\t\t\t\t\tinstitution,\n\t\t\t\t\tdate: chicagoDate(current),\n\t\t\t\t\ttime,\n\t\t\t\t\tnotes,\n\t\t\t\t\tsource_url: sourceUrl,\n\t\t\t\t});\n\t\t\t}\n\t\t\tcurrent.setDate(current.getDate() + 1);\n\t\t}\n\t\treturn results;\n\t}\n\n\treturn results;\n}\n\n// Parse a date range and expand into individual dates\nfunction expandDateRange(\n\tstartDate: Date,\n\tendDate: Date,\n\tinstitution: string,\n\tsourceUrl?: string,\n\ttime?: string,\n\tnotes?: string,\n): FreeDayEntry[] {\n\tconst results: FreeDayEntry[] = [];\n\tconst current = new Date(startDate);\n\n\twhile (current <= endDate) {\n\t\tresults.push({\n\t\t\tinstitution,\n\t\t\tdate: chicagoDate(current),\n\t\t\ttime,\n\t\t\tnotes,\n\t\t\tsource_url: sourceUrl,\n\t\t});\n\t\tcurrent.setDate(current.getDate() + 1);\n\t}\n\n\treturn results;\n}\n\nexport async function normalizeDates(\n\trawData: RawFreeDayData[],\n): Promise {\n\tconst results: FreeDayEntry[] = [];\n\tconst referenceDate = new Date();\n\n\tfor (const item of rawData) {\n\t\t// Pass 1: Classify all lines\n\t\tconst dateLines: string[] = [];\n\t\tconst noteLines: string[] = [];\n\n\t\tfor (const line of item.rawLines) {\n\t\t\tif (classifyLine(line) === \"date\") {\n\t\t\t\tdateLines.push(line);\n\t\t\t} else {\n\t\t\t\tnoteLines.push(line);\n\t\t\t}\n\t\t}\n\n\t\t// Aggregate notes for this institution\n\t\tconst aggregatedNotes =\n\t\t\tnoteLines.length > 0 ? noteLines.join(\"; \") : undefined;\n\n\t\t// Detect proof requirements from notes\n\t\tconst proofRequired = noteLines.find(\n\t\t\t(line) =>\n\t\t\t\t/illinois/i.test(line) ||\n\t\t\t\t/resident/i.test(line) ||\n\t\t\t\t/\\bID\\b/.test(line) ||\n\t\t\t\t/zip code/i.test(line),\n\t\t);\n\n\t\t// Pass 2: Parse date lines\n\t\tfor (const dateLine of dateLines) {\n\t\t\tconst time = parseTimeRange(dateLine);\n\n\t\t\t// Check for recurring patterns first\n\t\t\tif (\n\t\t\t\t/every\\s+(monday|tuesday|wednesday|thursday|friday|saturday|sunday)/i.test(\n\t\t\t\t\tdateLine,\n\t\t\t\t)\n\t\t\t) {\n\t\t\t\tconst expanded = expandPattern(\n\t\t\t\t\tdateLine,\n\t\t\t\t\titem.institution,\n\t\t\t\t\titem.url,\n\t\t\t\t\taggregatedNotes,\n\t\t\t\t);\n\t\t\t\tfor (const entry of expanded) {\n\t\t\t\t\tentry.proof_required = proofRequired;\n\t\t\t\t}\n\t\t\t\tresults.push(...expanded);\n\t\t\t\tcontinue;\n\t\t\t}\n\n\t\t\tif (/weekdays?/i.test(dateLine)) {\n\t\t\t\tconst expanded = expandPattern(\n\t\t\t\t\tdateLine,\n\t\t\t\t\titem.institution,\n\t\t\t\t\titem.url,\n\t\t\t\t\taggregatedNotes,\n\t\t\t\t);\n\t\t\t\tfor (const entry of expanded) {\n\t\t\t\t\tentry.proof_required = proofRequired;\n\t\t\t\t}\n\t\t\t\tresults.push(...expanded);\n\t\t\t\tcontinue;\n\t\t\t}\n\n\t\t\t// Try chrono-node parsing\n\t\t\tconst parsed = chrono.parse(dateLine, referenceDate, {\n\t\t\t\tforwardDate: true,\n\t\t\t});\n\n\t\t\tif (parsed.length > 0) {\n\t\t\t\tfor (const result of parsed) {\n\t\t\t\t\tconst startDate = result.start.date();\n\t\t\t\t\tconst endDate = result.end?.date();\n\n\t\t\t\t\tif (endDate && endDate > startDate) {\n\t\t\t\t\t\t// Date range - expand into individual dates\n\t\t\t\t\t\tconst expanded = expandDateRange(\n\t\t\t\t\t\t\tstartDate,\n\t\t\t\t\t\t\tendDate,\n\t\t\t\t\t\t\titem.institution,\n\t\t\t\t\t\t\titem.url,\n\t\t\t\t\t\t\ttime,\n\t\t\t\t\t\t\taggregatedNotes,\n\t\t\t\t\t\t);\n\t\t\t\t\t\tfor (const entry of expanded) {\n\t\t\t\t\t\t\tentry.proof_required = proofRequired;\n\t\t\t\t\t\t}\n\t\t\t\t\t\tresults.push(...expanded);\n\t\t\t\t\t} else {\n\t\t\t\t\t\t// Single date\n\t\t\t\t\t\tresults.push({\n\t\t\t\t\t\t\tinstitution: item.institution,\n\t\t\t\t\t\t\tdate: chicagoDate(startDate),\n\t\t\t\t\t\t\ttime,\n\t\t\t\t\t\t\tproof_required: proofRequired,\n\t\t\t\t\t\t\tnotes: aggregatedNotes,\n\t\t\t\t\t\t\tsource_url: item.url,\n\t\t\t\t\t\t});\n\t\t\t\t\t}\n\t\t\t\t}\n\t\t\t} else {\n\t\t\t\t// Log unparseable entry for manual review\n\t\t\t\tconsole.warn(\n\t\t\t\t\t`Could not parse date line for ${item.institution}: \"${dateLine}\"`,\n\t\t\t\t);\n\t\t\t}\n\t\t}\n\t}\n\n\treturn results;\n}\n",[],[279,271],"backend","b0d0be82-fa50-11f0-92fc-42dde27851f2","scraper.cron.ts","b0d0bf40-fa50-11f0-92fc-42dde27851f2",28,["D",1769388491911],"interval","import { initDatabase, loadToSQLite } from \"./db.ts\";\nimport { scrapeChooseChicago } from \"./scrapeChooseChicago.ts\";\nimport { normalizeDates } from \"./utils.ts\";\n\nexport default async function () {\n\ttry {\n\t\t// Ensure tables exist\n\t\tawait initDatabase();\n\n\t\t// Run scraper\n\t\tconsole.log(\"Scraping Choose Chicago...\");\n\t\tconst rawData = await scrapeChooseChicago();\n\t\tconsole.log(`Found ${rawData.length} institutions`);\n\n\t\t// Normalize dates\n\t\tconsole.log(\"Normalizing dates...\");\n\t\tconst normalized = await normalizeDates(rawData);\n\t\tconsole.log(`Parsed ${normalized.length} free day entries`);\n\n\t\t// Load to SQLite\n\t\tconsole.log(\"Loading to SQLite...\");\n\t\tawait loadToSQLite(normalized, \"choose-chicago\");\n\n\t\tconsole.log(`Successfully scraped and loaded ${normalized.length} entries`);\n\t} catch (error) {\n\t\tconsole.error(\"Scraper failed:\", error);\n\t\tthrow error;\n\t}\n}\n",[],[279,281],"b0cc00ea-fa50-11f0-9f52-42dde27851f2","scrapeChooseChicago.ts","b0cc0194-fa50-11f0-9f52-42dde27851f2",27,["D",1769388491842],"import * as cheerio from \"npm:cheerio@1.0.0\";\n\nexport interface RawFreeDayData {\n\tinstitution: string;\n\trawLines: string[];\n\turl?: string;\n}\n\nconst SOURCE_URL =\n\t\"https://www.choosechicago.com/articles/museums-art/free-museum-days-in-chicago/\";\n\nexport async function scrapeChooseChicago(): Promise {\n\tconst controller = new AbortController();\n\tconst timeoutId = setTimeout(() => controller.abort(), 15_000);\n\n\ttry {\n\t\tconst response = await fetch(SOURCE_URL, {\n\t\t\tsignal: controller.signal,\n\t\t\theaders: { \"User-Agent\": \"chicago-free-museum-days-bot/1.0\" },\n\t\t});\n\n\t\tif (!response.ok) {\n\t\t\tthrow new Error(`HTTP ${response.status}: ${response.statusText}`);\n\t\t}\n\n\t\tconst html = await response.text();\n\t\tconst $ = cheerio.load(html);\n\t\tconst results: RawFreeDayData[] = [];\n\n\t\t$(\"h3\").each((_i, el) => {\n\t\t\tconst institution = $(el).text().trim();\n\n\t\t\t// Skip empty headings or navigation elements\n\t\t\tif (!institution || institution.length < 3) return;\n\n\t\t\tconst lines: string[] = [];\n\n\t\t\t// Find following ul/li elements (contains dates AND eligibility notes)\n\t\t\t$(el)\n\t\t\t\t.nextUntil(\"h3\", \"ul\")\n\t\t\t\t.find(\"li\")\n\t\t\t\t.each((_j, li) => {\n\t\t\t\t\tconst text = $(li).text().trim();\n\t\t\t\t\tif (text) {\n\t\t\t\t\t\tlines.push(text);\n\t\t\t\t\t}\n\t\t\t\t});\n\n\t\t\t// Only include if we found some content\n\t\t\tif (lines.length > 0) {\n\t\t\t\tresults.push({ institution, rawLines: lines, url: SOURCE_URL });\n\t\t\t}\n\t\t});\n\n\t\treturn results;\n\t} finally {\n\t\tclearTimeout(timeoutId);\n\t}\n}\n",[],[279,290],"b0d30b06-fa50-11f0-9864-42dde27851f2","db.ts","b0d30b9c-fa50-11f0-9864-42dde27851f2",29,["D",1769388491928],"import { sqlite } from \"https://esm.town/v/std/sqlite@14-main/main.ts\";\n\n// Types\nexport interface FreeDayEntry {\n\tinstitution: string;\n\tdate: string; // ISO YYYY-MM-DD\n\ttime?: string;\n\tproof_required?: string;\n\tnotes?: string;\n\tsource_url?: string;\n}\n\nexport interface FreeDayRow {\n\tinstitution: string;\n\tdate: string;\n\ttime: string | null;\n\tproof_required: string | null;\n\tnotes: string | null;\n}\n\n// Get ISO date string in Chicago timezone (avoids UTC date offset issues)\nexport function chicagoDate(d = new Date()): string {\n\tconst parts = new Intl.DateTimeFormat(\"en-CA\", {\n\t\ttimeZone: \"America/Chicago\",\n\t\tyear: \"numeric\",\n\t\tmonth: \"2-digit\",\n\t\tday: \"2-digit\",\n\t}).formatToParts(d);\n\tconst y = parts.find((p) => p.type === \"year\")?.value ?? \"0000\";\n\tconst m = parts.find((p) => p.type === \"month\")?.value ?? \"01\";\n\tconst day = parts.find((p) => p.type === \"day\")?.value ?? \"01\";\n\treturn `${y}-${m}-${day}`;\n}\n\n// Generate a stable key for matching institutions across sources/overrides\nexport function slugify(name: string): string {\n\treturn name\n\t\t.toLowerCase()\n\t\t.replace(/[^a-z0-9]+/g, \"-\")\n\t\t.replace(/^-|-$/g, \"\");\n}\n\n// Initialize tables and indexes\nexport async function initDatabase() {\n\tawait sqlite.batch([\n\t\t{\n\t\t\tsql: `CREATE TABLE IF NOT EXISTS scraped_free_days (\n id INTEGER PRIMARY KEY AUTOINCREMENT,\n institution TEXT NOT NULL,\n institution_key TEXT NOT NULL,\n date TEXT NOT NULL,\n time TEXT,\n proof_required TEXT,\n notes TEXT,\n source TEXT NOT NULL,\n source_url TEXT,\n scraped_at TEXT NOT NULL,\n UNIQUE(institution_key, date)\n )`,\n\t\t\targs: [],\n\t\t},\n\t\t{\n\t\t\tsql: `CREATE INDEX IF NOT EXISTS idx_scraped_date ON scraped_free_days(date)`,\n\t\t\targs: [],\n\t\t},\n\t\t{\n\t\t\tsql: `CREATE INDEX IF NOT EXISTS idx_scraped_institution_key ON scraped_free_days(institution_key)`,\n\t\t\targs: [],\n\t\t},\n\t\t{\n\t\t\tsql: `CREATE INDEX IF NOT EXISTS idx_scraped_source ON scraped_free_days(source)`,\n\t\t\targs: [],\n\t\t},\n\t\t{\n\t\t\tsql: `CREATE TABLE IF NOT EXISTS free_days_overrides (\n id INTEGER PRIMARY KEY AUTOINCREMENT,\n institution TEXT NOT NULL,\n institution_key TEXT NOT NULL,\n date TEXT NOT NULL,\n time TEXT,\n proof_required TEXT,\n notes TEXT,\n is_cancelled INTEGER DEFAULT 0,\n override_reason TEXT,\n created_at TEXT NOT NULL,\n UNIQUE(institution_key, date)\n )`,\n\t\t\targs: [],\n\t\t},\n\t\t{\n\t\t\tsql: `CREATE INDEX IF NOT EXISTS idx_override_date ON free_days_overrides(date)`,\n\t\t\targs: [],\n\t\t},\n\t\t{\n\t\t\tsql: `CREATE INDEX IF NOT EXISTS idx_override_institution_key ON free_days_overrides(institution_key)`,\n\t\t\targs: [],\n\t\t},\n\t]);\n}\n\n// Load scraped data (replaces old scraped data from same source)\nexport async function loadToSQLite(\n\tdata: FreeDayEntry[],\n\tsource: string,\n): Promise {\n\tconst scrapedAt = new Date().toISOString();\n\n\tawait sqlite.batch([\n\t\t{ sql: \"DELETE FROM scraped_free_days WHERE source = ?\", args: [source] },\n\t\t...data.map((entry) => ({\n\t\t\tsql: `INSERT OR REPLACE INTO scraped_free_days \n (institution, institution_key, date, time, proof_required, notes, source, source_url, scraped_at)\n VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?)`,\n\t\t\targs: [\n\t\t\t\tentry.institution,\n\t\t\t\tslugify(entry.institution),\n\t\t\t\tentry.date,\n\t\t\t\tentry.time ?? null,\n\t\t\t\tentry.proof_required ?? null,\n\t\t\t\tentry.notes ?? null,\n\t\t\t\tsource,\n\t\t\t\tentry.source_url ?? null,\n\t\t\t\tscrapedAt,\n\t\t\t],\n\t\t})),\n\t]);\n}\n\n// Query with override logic (LEFT JOIN anti-pattern for deterministic results)\nexport async function getFreeDays(\n\tstartDate: string,\n\tendDate: string,\n): Promise {\n\tconst result = await sqlite.execute({\n\t\tsql: `\n SELECT s.institution, s.date, s.time, s.proof_required, s.notes\n FROM scraped_free_days s\n LEFT JOIN free_days_overrides o\n ON o.institution_key = s.institution_key AND o.date = s.date\n WHERE s.date BETWEEN ? AND ?\n AND o.id IS NULL\n\n UNION ALL\n\n SELECT o.institution, o.date, o.time, o.proof_required, o.notes\n FROM free_days_overrides o\n WHERE o.date BETWEEN ? AND ?\n AND COALESCE(o.is_cancelled, 0) = 0\n\n ORDER BY date, institution\n `,\n\t\targs: [startDate, endDate, startDate, endDate],\n\t});\n\n\treturn result.rows as FreeDayRow[];\n}\n\n// Helper for bot (next 7 days from today in Chicago timezone)\nexport async function getUpcomingWeek(): Promise {\n\tconst today = chicagoDate();\n\tconst nextWeekDate = new Date();\n\tnextWeekDate.setDate(nextWeekDate.getDate() + 7);\n\tconst nextWeek = chicagoDate(nextWeekDate);\n\treturn getFreeDays(today, nextWeek);\n}\n\n// Check data freshness for bot staleness warning\nexport async function getLatestScrapeTime(): Promise {\n\tconst result = await sqlite.execute(\n\t\t\"SELECT MAX(scraped_at) as latest FROM scraped_free_days\",\n\t);\n\treturn (result.rows[0] as { latest: string | null })?.latest ?? null;\n}\n\n// Add manual override\nexport async function addOverride(\n\tinstitution: string,\n\tdate: string,\n\tdetails: {\n\t\ttime?: string;\n\t\tproof_required?: string;\n\t\tnotes?: string;\n\t\tis_cancelled?: boolean;\n\t\toverride_reason?: string;\n\t},\n): Promise {\n\tawait sqlite.execute({\n\t\tsql: `INSERT OR REPLACE INTO free_days_overrides \n (institution, institution_key, date, time, proof_required, notes, is_cancelled, override_reason, created_at)\n VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?)`,\n\t\targs: [\n\t\t\tinstitution,\n\t\t\tslugify(institution),\n\t\t\tdate,\n\t\t\tdetails.time ?? null,\n\t\t\tdetails.proof_required ?? null,\n\t\t\tdetails.notes ?? null,\n\t\t\tdetails.is_cancelled ? 1 : 0,\n\t\t\tdetails.override_reason ?? null,\n\t\t\tnew Date().toISOString(),\n\t\t],\n\t});\n}\n\n// Get all distinct institutions\nexport async function getInstitutions(): Promise {\n\tconst result = await sqlite.execute(`\n SELECT DISTINCT institution FROM (\n SELECT institution FROM scraped_free_days\n UNION\n SELECT institution FROM free_days_overrides WHERE COALESCE(is_cancelled, 0) = 0\n ) ORDER BY institution\n `);\n\treturn (result.rows as { institution: string }[]).map((r) => r.institution);\n}\n",[],[279,298],"f06c3d28-fae1-11f0-9420-42dde27851f2","bot.cron.ts","b0bc867e-fa50-11f0-9f52-42dde27851f2",["D",1769450875653],8,"import { AtpAgent } from \"npm:@atproto/api@0.18.17\";\nimport { email } from \"https://esm.town/v/std/email\";\nimport { type FreeDayRow, getLatestScrapeTime, getUpcomingWeek } from \"./db.ts\";\n\ntype InstitutionGroup = { institution: string; dates: string[] };\n\nfunction groupByInstitution(freeDays: FreeDayRow[]): InstitutionGroup[] {\n const byInstitution = new Map();\n for (const day of freeDays) {\n const existing = byInstitution.get(day.institution) ?? [];\n existing.push(day);\n byInstitution.set(day.institution, existing);\n }\n\n const groups: InstitutionGroup[] = [];\n for (const [institution, days] of byInstitution) {\n const dates = days.map((d) => {\n const date = new Date(`${d.date}T12:00:00`);\n const monthDay = `${date.getMonth() + 1}/${date.getDate()}`;\n const timeStr = d.time ? ` (${d.time})` : \"\";\n return `${monthDay}${timeStr}`;\n });\n groups.push({ institution, dates });\n }\n return groups;\n}\n\nfunction formatInstitutionPost(group: InstitutionGroup): string {\n return `🏛️ ${group.institution}\\n📅 Free: ${group.dates.join(\", \")}`;\n}\n\nexport default async function () {\n const handle = Deno.env.get(\"BLUESKY_HANDLE\");\n const password = Deno.env.get(\"BLUESKY_PASSWORD\");\n\n if (!handle || !password) {\n console.error(\"BLUESKY_HANDLE and BLUESKY_PASSWORD must be set\");\n return;\n }\n\n // Get upcoming free days\n const freeDays = await getUpcomingWeek();\n\n // Guard: Don't post if no data available\n if (freeDays.length === 0) {\n console.warn(\"No free days found for upcoming week - skipping post\");\n return;\n }\n\n // Check data freshness\n const lastScrape = await getLatestScrapeTime();\n const daysSinceUpdate = lastScrape\n ? Math.floor(\n (Date.now() - new Date(lastScrape).getTime()) / (1000 * 60 * 60 * 24),\n )\n : null;\n\n const groups = groupByInstitution(freeDays);\n\n // Login to Bluesky\n const agent = new AtpAgent({ service: \"https://bsky.social\" });\n await agent.login({ identifier: handle, password });\n\n // Post header\n let headerText =\n `🏛️ Free museums in Chicago this week (${groups.length} institutions):`;\n if (daysSinceUpdate && daysSinceUpdate > 14) {\n headerText += `\\n⚠️ Data last updated ${daysSinceUpdate} days ago`;\n }\n\n const headerPost = await agent.post({ text: headerText });\n console.log(`Posted header: ${headerText.length} characters`);\n\n // Post each institution as a reply in the thread\n let parentUri = headerPost.uri;\n let parentCid = headerPost.cid;\n const rootUri = headerPost.uri;\n const rootCid = headerPost.cid;\n\n for (const group of groups) {\n const text = formatInstitutionPost(group);\n const reply = await agent.post({\n text,\n reply: {\n root: { uri: rootUri, cid: rootCid },\n parent: { uri: parentUri, cid: parentCid },\n },\n });\n console.log(`Posted reply for ${group.institution}: ${text.length} chars`);\n parentUri = reply.uri;\n parentCid = reply.cid;\n }\n\n console.log(`Thread complete: 1 header + ${groups.length} replies`);\n\n // Send success notification email\n const postUrl = `https://bsky.app/profile/${handle}/post/${\n rootUri.split(\"/\").pop()\n }`;\n await email({\n subject: \"✅ Chicago Free Museums Thread Posted\",\n text:\n `Successfully posted thread with ${groups.length} institutions.\\n\\nView thread: ${postUrl}`,\n });\n}\n\nexport async function previewMessage(): Promise {\n const freeDays = await getUpcomingWeek();\n const lastScrape = await getLatestScrapeTime();\n const daysSinceUpdate = lastScrape\n ? Math.floor(\n (Date.now() - new Date(lastScrape).getTime()) / (1000 * 60 * 60 * 24),\n )\n : null;\n\n const groups = groupByInstitution(freeDays);\n\n console.log(\"=== Thread Preview ===\\n\");\n\n let headerText =\n `🏛️ Free museums in Chicago this week (${groups.length} institutions):`;\n if (daysSinceUpdate && daysSinceUpdate > 14) {\n headerText += `\\n⚠️ Data last updated ${daysSinceUpdate} days ago`;\n }\n console.log(`[HEADER] ${headerText}`);\n console.log(` (${headerText.length}/300 chars)\\n`);\n\n for (const group of groups) {\n const text = formatInstitutionPost(group);\n console.log(`[REPLY] ${text}`);\n console.log(` (${text.length}/300 chars)\\n`);\n }\n}",[],[279,306],"07bce2a6-fa57-11f0-b3fc-42dde27851f2","api.http.ts","b0c18a52-fa50-11f0-a870-42dde27851f2",45,["D",1769391214732],5,"http","import { Hono } from \"npm:hono@4.11.5\";\nimport {\n chicagoDate,\n getFreeDays,\n getInstitutions,\n getUpcomingWeek,\n initDatabase,\n} from \"./db.ts\";\n\nconst app = new Hono();\n\n// Unwrap Hono errors to see original error details\napp.onError((err, _c) => {\n throw err;\n});\n\n// Ensure database is initialized on first request\nlet dbInitialized = false;\napp.use(\"*\", async (_c, next) => {\n if (!dbInitialized) {\n await initDatabase();\n dbInitialized = true;\n }\n await next();\n});\n\n// Get free days for date range\napp.get(\"/free-days\", async (c) => {\n const start = c.req.query(\"start\");\n const end = c.req.query(\"end\");\n\n if (!start || !end) {\n return c.json({ error: \"start and end dates required (YYYY-MM-DD)\" }, 400);\n }\n\n // Validate date format\n const dateRegex = /^\\d{4}-\\d{2}-\\d{2}$/;\n if (!dateRegex.test(start) || !dateRegex.test(end)) {\n return c.json({ error: \"Dates must be in YYYY-MM-DD format\" }, 400);\n }\n\n const data = await getFreeDays(start, end);\n return c.json({ data, count: data.length });\n});\n\n// Get upcoming week (convenience endpoint)\napp.get(\"/upcoming\", async (c) => {\n const data = await getUpcomingWeek();\n return c.json({\n data,\n count: data.length,\n range: {\n start: chicagoDate(),\n end: chicagoDate(new Date(Date.now() + 7 * 24 * 60 * 60 * 1000)),\n },\n });\n});\n\napp.get(\"/today\", async (c) => {\n const today = chicagoDate();\n const data = await getFreeDays(today, today);\n return c.json({ data, count: data.length, date: today });\n});\n\napp.get(\"/institutions\", async (c) => {\n const institutions = await getInstitutions();\n return c.json({ institutions, count: institutions.length });\n});\n\napp.get(\"/health\", (c) => {\n return c.json({ status: \"ok\", timestamp: new Date().toISOString() });\n});\n\napp.get(\"/\", (c) => {\n return c.json({\n name: \"Chicago Free Museum Days API\",\n endpoints: {\n \"/free-days?start=YYYY-MM-DD&end=YYYY-MM-DD\":\n \"Get free days in date range\",\n \"/upcoming\": \"Get free days for the next 7 days\",\n \"/today\": \"Get today's free days\",\n \"/institutions\": \"List all institutions\",\n \"/health\": \"Health check\",\n },\n });\n});\n\nexport default app.fetch;",[],[279,314],"b0c597dc-fa50-11f0-92fc-42dde27851f2","b0c598c2-fa50-11f0-92fc-42dde27851f2",26,["D",1769388491829],"# Chicago Free Museum Days - Backend\n\nVal Town backend for scraping, storing, and serving Chicago free museum day data.\n\n## Vals\n\n| File | Type | Description |\n|------|------|-------------|\n| `db.ts` | Script | Database functions (SQLite) |\n| `scrapeChooseChicago.ts` | Script | Choose Chicago HTML scraper |\n| `utils.ts` | Script | Date normalization utilities |\n| `scraper.cron.ts` | Cron | Monthly scraper orchestrator |\n| `bot.cron.ts` | Cron | Weekly Bluesky poster (Mondays 8am CT) |\n| `api.http.ts` | HTTP | Public JSON API |\n\n## Setup\n\n1. Deploy to Val Town\n2. Set secrets: `BLUESKY_HANDLE`, `BLUESKY_PASSWORD`\n3. Run `scraper.cron.ts` manually to populate initial data\n4. Schedule `scraper.cron.ts` monthly (first Monday)\n5. Schedule `bot.cron.ts` weekly (Mondays 8am CT → `0 14 * * 1` UTC in winter, `0 13 * * 1` in summer)\n\n## API Endpoints\n\n- `GET /` - API documentation\n- `GET /free-days?start=YYYY-MM-DD&end=YYYY-MM-DD` - Free days in date range\n- `GET /upcoming` - Next 7 days\n- `GET /today` - Today's free days\n- `GET /institutions` - List all museums\n- `GET /health` - Health check\n\n## Database Tables\n\n- `scraped_free_days` - Auto-populated by scrapers\n- `free_days_overrides` - Manual corrections (win on conflicts)\n",[],[279,210],"b0a9b7e2-fa50-11f0-9f52-42dde27851f2",23,["D",1769388491662],[165,166,167,168,169,170,171],[279],"3432d6a2-fa4c-11f0-8dfc-42dde27851f2","settings.local.json","3432d7ba-fa4c-11f0-8dfc-42dde27851f2","34190b14-fa4c-11f0-b7e5-42dde27851f2",["D",1769386564860],"{\n \"permissions\": {\n \"allow\": [\n \"WebSearch\",\n \"WebFetch(domain:www.sheddaquarium.org)\",\n \"WebFetch(domain:www.fieldmuseum.org)\",\n \"WebFetch(domain:www.artic.edu)\",\n \"WebFetch(domain:www.msichicago.org)\",\n \"WebFetch(domain:www.griffinmsi.org)\",\n \"WebFetch(domain:visit.mcachicago.org)\",\n \"WebFetch(domain:www.choosechicago.com)\",\n \"WebFetch(domain:loopchicago.com)\",\n \"WebFetch(domain:www.chicagohistory.org)\",\n \"WebFetch(domain:naturemuseum.org)\",\n \"WebFetch(domain:www.upparent.com)\",\n \"WebFetch(domain:do312.com)\",\n \"WebFetch(domain:freemuseumday.org)\"\n ]\n }\n}\n",[],[343,336],".claude","34190a2e-fa4c-11f0-b7e5-42dde27851f2",["D",1769386564671],[163],[343],["D",1769386563309],["D",1789445472057],{"_11":12,"_119":67},{"_11":12,"_115":-5,"_66":67,"_30":65,"_116":117,"_118":24},{"_38":106,"_13":16,"_32":35,"_107":69,"_108":-5,"_109":-5,"_110":-5,"_111":-5,"_112":-5,"_113":14,"_114":12},"ctx",{"_51":-5,"_139":386,"_387":388,"_389":390,"_391":24,"_392":24,"_393":24,"_394":137,"_395":-5,"_396":-7,"_397":-7,"_398":26,"_399":24,"_400":24,"_401":-5,"_402":24,"_403":24,"_404":24,"_405":-5},"ENV",{"_357":358,"_359":360,"_361":16,"_362":363,"_364":365,"_366":367,"_368":369,"_370":371,"_372":373,"_374":375,"_376":377,"_378":379,"_380":381,"_382":383,"_384":385},"REACT_APP_SENTRY_DSN","https://586020d86f05489db63a554690acf1e9@o1398359.ingest.sentry.io/6724499","RENDER_GIT_COMMIT","e87eb04e707cf64e7e532c8e8ec395f209e17f15","RENDER_GIT_BRANCH","POSTHOG_API_TOKEN","phc_nmoyuAkStEZuUp69rYlg1DZgrIt19Gx0Y4Hwf8tGgJP","POSTHOG_API_HOST","https://wart.val.town","WEB_API_TEMPLATE","https://{val}.web.val.run","APP_URL","https://www.val.town","MODULE_URL","https://esm.town","VANITY_WEB_API_TEMPLATE","https://{label}.val.run/","DENOLS_URL","https://lsp.val.town","NODE_ENV","production","CLOUDFLARE_TURNSTILE_SITE_KEY","0x4AAAAAACtaIZJH7s9rBMZ6","GOOGLE_CLIENT_ID","875989696899-jtsqkhlbdv5jrlsk8631p7ipjg3c6o62.apps.googleusercontent.com","STRIPE_PUBLISHABLE_KEY","pk_live_51N2zvWEpZTTLipIkVEwXrUG9AT0yeOOEYxszarZT1jpsZV58Ly6wlg3SltZpHN26CUalOBmUSY7adQRQiSkCZz2500qSXNkf8Y","API_URL","https://api.val.town",[],"preferencesKeybindings","default","preferencesTheme","light","preferencesFixers","preferencesCopilot","preferencesSelectionAi","preferencesCloseBrackets","preferencesChatPanelState","preferencesDprint","preferencesDenofmt","notificationCount","flagDenols","isBusinessOrgMember","businessOrgHandle","isBusinessOrgAdmin","isHigherTownieTier","navCollapsed","currentOrgId"]

Art Institute of Chicago

History · .vtignore