/, else the whole document. */\nfunction mainContent(html: string): string {\n for (const t of [\"article\", \"main\"]) {\n const blocks = [...html.matchAll(new RegExp(`<${t}\\\\b[^>]*>([\\\\s\\\\S]*?)`, \"gi\"))]\n .map((m) => m[1])\n .sort((a, b) => b.length - a.length);\n if (blocks[0] && blocks[0].length > 500) return blocks[0];\n }\n return html.match(/]*>([\\s\\S]*?)<\\/body>/i)?.[1] ?? html;\n}\n\nexport async function fetchArticleText(url: string, maxChars: number): Promise {\n try {\n const res = await fetch(url, {\n headers: { \"user-agent\": USER_AGENT, accept: \"text/html,application/xhtml+xml\" },\n redirect: \"follow\",\n signal: AbortSignal.timeout(FETCH_TIMEOUT_MS),\n });\n if (!res.ok) return null;\n\n const type = res.headers.get(\"content-type\") ?? \"\";\n if (!/text\\/html|application\\/xhtml/i.test(type)) {\n await res.body?.cancel();\n return null;\n }\n const length = Number(res.headers.get(\"content-length\"));\n if (Number.isFinite(length) && length > MAX_BYTES) {\n await res.body?.cancel();\n return null;\n }\n\n const html = (await res.text()).slice(0, MAX_BYTES);\n const text = htmlToText(mainContent(html.replace(BOILERPLATE, \" \")));\n\n // Too short to be a real article — cookie wall, JS-only page, paywall stub\n if (text.length < 400) return null;\n return text.slice(0, maxChars);\n } catch {\n return null;\n }\n}\n",[201],"1b854e1f-b115-4049-ab34-d3c80547c3b0","_check.ts","2ccb1eda-a25b-11f1-8d82-1607ee4eb77e",51,["D",1787864790223],"// Throwaway: does including replies change the discussion summary? Delete when done.\nimport Anthropic from \"npm:@anthropic-ai/sdk\";\nimport { fetchArticleText } from \"./article.ts\";\nimport { getStory, topCommentThreads } from \"./hn.ts\";\nimport { summarize } from \"./summarize.ts\";\n\nconst client = new Anthropic({ apiKey: Deno.env.get(\"ANTHROPIC_API_KEY\") });\n\nfor (const id of [49458161, 49468083]) {\n const story = (await getStory(id))!;\n const [comments, articleText] = await Promise.all([\n topCommentThreads(story, 10, 3),\n story.url ? fetchArticleText(story.url, 8_000) : Promise.resolve(null),\n ]);\n\n const total = comments.reduce((n, c) => n + 1 + c.replies.length, 0);\n console.log(`\\n${\"=\".repeat(78)}\\n${story.title}`);\n console.log(`${comments.length} threads, ${total} comments total (was 15 flat)`);\n\n const r = await summarize(client, {\n title: story.title,\n url: story.url,\n score: story.score,\n commentCount: story.commentCount,\n comments,\n content: articleText ?? story.selfText,\n isSelfPost: story.url === null,\n });\n console.log(`\\nDISCUSSION: ${r.discussion}`);\n}\n",[209],"a19bc0d1-1276-477f-9516-608fedfb48c8","README.md","6dfc4c34-a257-11f1-9a7b-1607ee4eb77e",41,["D",1787864539021],4,"# hn-digest\n\nA daily email of the **top 5** Hacker News front-page stories, each with a summary of the\nlinked page and a summary of what the top comments are arguing about.\n\nSource is the official [HN Firebase API](https://github.com/HackerNews/API) — keyless and\nunauthenticated. Two cron jobs:\n\n| File | Schedule | Job |\n| --- | --- | --- |\n| `collect.ts` | hourly, `:07` | Record what's on the front page |\n| `main.ts` | `07:00 UTC` | Pick the top 5 and email them |\n\n## Why two jobs\n\n`topstories.json` is a live snapshot, so a single daily poll would miss anything that\npeaked overnight and fell off. The collector records every front-page story hourly into\n`hn-digest:pool`, keeping high-water marks for score and comment count. The digest then\npicks the highest **peak** score of the past 36 hours — a genuine top-of-day, not\nwhatever happened to be up at 07:00.\n\n## How the digest run works\n\n1. `pick()` takes the 5 highest-peak-score pool entries not already emailed.\n2. Each story is refetched for its live score and its `kids` list. **`kids` is in HN's own\n rank order** — comments carry no score in the API, so this is the only signal for \"top\n comment\". Algolia's `children` is chronological and `hnrss.org/item?id=` is\n reverse-chronological, so neither can rank.\n3. `article.ts` fetches the linked page and extracts text. Failures (paywalls, JS-only\n pages, video, PDFs) leave the summary leaning on the comments, and it says so. Ask/Show\n HN self-posts use the post body instead.\n4. `summarize.ts` makes one Claude call per story with the article text and 15 top-level\n comments. No comments means no discussion section rather than an invented one.\n5. `render.ts` builds the HTML + plain-text email, sent via `std/email`.\n6. The seen-set is written **after** the send succeeds, and only for stories that made it\n into the email. Anything that failed is retried on the next run. A blob read failure\n aborts the run rather than re-sending everything.\n\n## Env vars\n\n| Key | Required | Purpose |\n| --- | --- | --- |\n| `ANTHROPIC_API_KEY` | yes | Claude API |\n| `DIGEST_TO` | no | Recipient. Defaults to the val owner's address. |\n| `DIGEST_DRY_RUN` | no | `1` logs the email instead of sending it. |\n\n## Cost\n\nFive Claude calls a day on `claude-sonnet-5` — roughly **$2/month**.\n\n`claude-haiku-4-5` was measured against Sonnet on identical input for the same five\nstories and lost on specifics: it missed the Microduck's motor count, loop rate and\nlicence, missed three of the six argument threads on the Cloudflare post, and got the\nReachy Mini licence wrong. Haiku costs about $1/month less. Not worth it here, but the\n`model` argument to `summarize()` makes the comparison easy to re-run.\n\nThe collector makes ~31 HN API calls an hour; the digest makes ~5 × 31. All free.\n\n## Tuning\n\nKnobs at the top of `main.ts`: `DIGEST_SIZE`, `MIN_SCORE`, `MAX_AGE_HOURS`,\n`COMMENTS_PER_STORY`, `ARTICLE_MAX_CHARS`. `WATCH_TOP` and `POOL_TTL_DAYS` are in\n`collect.ts`. Prompt and tone live in `SYSTEM` in `summarize.ts`.\n",[216],"pulls","branches","forks","envVars",{"_230":165,"_232":61},"connections",{"_230":61,"_231":61},"count","unfilledCount","emptyCount",{"_43":215,"_32":216,"_30":217,"_143":-5,"_41":42,"_40":218,"_145":25,"_38":275,"_13":220,"_33":20,"_35":221,"_24":25,"_150":-5,"_245":276,"_27":277},{"_43":208,"_32":209,"_30":210,"_143":-5,"_41":42,"_40":211,"_145":25,"_38":272,"_13":61,"_33":148,"_35":213,"_24":25,"_150":-5,"_245":273,"_27":274},{"_43":200,"_32":201,"_30":202,"_143":-5,"_41":42,"_40":203,"_145":146,"_38":269,"_13":205,"_33":148,"_35":206,"_24":25,"_150":-5,"_245":270,"_27":271},{"_43":193,"_32":194,"_30":195,"_143":-5,"_41":42,"_40":196,"_145":146,"_38":266,"_13":61,"_33":34,"_35":198,"_24":25,"_150":-5,"_245":267,"_27":268},{"_43":186,"_32":187,"_30":188,"_143":-5,"_41":42,"_40":189,"_145":146,"_38":263,"_13":165,"_33":148,"_35":191,"_24":25,"_150":-5,"_245":264,"_27":265},{"_43":179,"_32":180,"_30":181,"_143":-5,"_41":42,"_40":182,"_145":146,"_38":260,"_13":61,"_33":148,"_35":184,"_24":25,"_150":-5,"_245":261,"_27":262},{"_43":175,"_32":28,"_30":31,"_143":-5,"_41":42,"_40":14,"_145":25,"_38":257,"_13":177,"_33":34,"_35":37,"_24":25,"_150":-5,"_245":258,"_27":259},{"_43":168,"_32":169,"_30":170,"_143":-5,"_41":42,"_40":171,"_145":25,"_38":254,"_13":165,"_33":148,"_35":173,"_24":25,"_150":-5,"_245":255,"_27":256},{"_43":160,"_32":161,"_30":162,"_143":-5,"_41":42,"_40":163,"_145":146,"_38":251,"_13":165,"_33":148,"_35":166,"_24":25,"_150":-5,"_245":252,"_27":253},{"_43":152,"_32":153,"_30":154,"_143":-5,"_41":42,"_40":155,"_145":25,"_38":248,"_13":157,"_33":148,"_35":158,"_24":25,"_150":-5,"_245":249,"_27":250},{"_43":140,"_32":141,"_30":142,"_143":-5,"_41":42,"_40":144,"_145":146,"_38":244,"_13":61,"_33":148,"_35":149,"_24":25,"_150":-5,"_245":246,"_27":247},["D",1787863854757],"children",[],[141],["D",1787864763848],[],[153],["D",1787863898404],[],[161],["D",1787863967414],[],[169],["D",1787864864926],[],[28],["D",1787863849452],[],[180],["D",1787864744015],[],[187],["D",1787863922615],[],[194],["D",1787863924903],[],[201],["D",1787864790223],[],[209],["D",1787864539021],[],[216],["D",1787862662938],["D",1789458074143],{"_98":97,"_106":102},{"_98":97,"_99":100,"_101":102,"_18":55,"_103":104,"_105":25},{"_13":87,"_32":88,"_43":42,"_89":44,"_90":-5,"_91":-5,"_92":-5,"_93":-5,"_94":-5,"_95":45,"_96":97},"ctx",{"_80":-5,"_126":316,"_317":318,"_319":320,"_321":25,"_322":25,"_323":25,"_324":146,"_325":-5,"_326":-7,"_327":-7,"_328":61,"_329":25,"_330":25,"_331":-5,"_332":25,"_333":25,"_334":25,"_335":-5},"ENV",{"_287":288,"_289":290,"_291":88,"_292":293,"_294":295,"_296":297,"_298":299,"_300":301,"_302":303,"_304":305,"_306":307,"_308":309,"_310":311,"_312":313,"_314":315},"REACT_APP_SENTRY_DSN","https://586020d86f05489db63a554690acf1e9@o1398359.ingest.sentry.io/6724499","RENDER_GIT_COMMIT","e87eb04e707cf64e7e532c8e8ec395f209e17f15","RENDER_GIT_BRANCH","POSTHOG_API_TOKEN","phc_nmoyuAkStEZuUp69rYlg1DZgrIt19Gx0Y4Hwf8tGgJP","POSTHOG_API_HOST","https://wart.val.town","WEB_API_TEMPLATE","https://{val}.web.val.run","APP_URL","https://www.val.town","MODULE_URL","https://esm.town","VANITY_WEB_API_TEMPLATE","https://{label}.val.run/","DENOLS_URL","https://lsp.val.town","NODE_ENV","production","CLOUDFLARE_TURNSTILE_SITE_KEY","0x4AAAAAACtaIZJH7s9rBMZ6","GOOGLE_CLIENT_ID","875989696899-jtsqkhlbdv5jrlsk8631p7ipjg3c6o62.apps.googleusercontent.com","STRIPE_PUBLISHABLE_KEY","pk_live_51N2zvWEpZTTLipIkVEwXrUG9AT0yeOOEYxszarZT1jpsZV58Ly6wlg3SltZpHN26CUalOBmUSY7adQRQiSkCZz2500qSXNkf8Y","API_URL","https://api.val.town",[],"preferencesKeybindings","default","preferencesTheme","light","preferencesFixers","preferencesCopilot","preferencesSelectionAi","preferencesCloseBrackets","preferencesChatPanelState","preferencesDprint","preferencesDenofmt","notificationCount","flagDenols","isBusinessOrgMember","businessOrgHandle","isBusinessOrgAdmin","isHigherTownieTier","navCollapsed","currentOrgId"]

`,\n `${esc(s.title)}

Diff · v53