\"\n}\n```\n\n```json\n{\n \"error\": \"PDF processing error: Document processing timed out\",\n \"code\": \"timeout-error\"\n}\n```\n\n```json\n{\n \"error\": \"Failed to fetch URL: 404 Not Found\"\n}\n```\n\n```json\n{\n \"error\": \"Invalid URL format\"\n}\n```\n\n**Text Processing:**\n- Removes excessive whitespace and formatting artifacts\n- Strips common header/footer patterns and page numbers\n- Optimizes text flow for natural TTS reading\n- Handles complex document structures (tables, lists, etc.)\n- For URLs: Extracts main article content using reader view algorithms\n- For Markdown: Converts to plain text while preserving readability\n- For PDFs: Uses AI when needed to handle complex layouts and maintain reading order\n\n### GET /api/usage\n\nGet usage statistics for the authenticated customer. Response includes legacy top-level fields for compatibility plus new `credits` field.\n\n**Plus/Pro User Response:**\n```json\n{\n \"user_tier\": \"premium\",\n \"monthly_limit\": 900000,\n \"current_usage\": 150000,\n \"remaining_characters\": 750000,\n \"usage_percentage\": 17,\n \"reset_date\": \"2024-02-01T00:00:00.000Z\",\n \"plan_key\": \"plus\",\n \"credits\": {\n \"subscription\": {\n \"plan_key\": \"plus\",\n \"monthly_limit\": 900000,\n \"current_usage\": 150000,\n \"remaining_characters\": 750000,\n \"usage_percentage\": 17,\n \"reset_date\": \"2024-02-01T00:00:00.000Z\"\n },\n \"non_expiring_tokens\": {\n \"balance\": 70000,\n \"total_granted\": 95000,\n \"total_consumed\": 25000,\n \"purchases\": [\n {\n \"source\": \"free_grant\",\n \"characters\": 45000,\n \"price_usd\": 0\n },\n {\n \"source\": \"iap\",\n \"product_lookup_key\": \"credit_pack_1hr\",\n \"characters\": 25000,\n \"price_usd\": 2.99\n }\n ]\n }\n }\n}\n```\n\n**Free User Response:**\n```json\n{\n \"user_tier\": \"free\",\n \"lifetime_limit\": 45000,\n \"current_usage\": 5000,\n \"remaining_characters\": 40000,\n \"usage_percentage\": 11,\n \"message\": \"Subscribe for monthly credits or purchase additional credits.\",\n \"credits\": {\n \"subscription\": null,\n \"non_expiring_tokens\": {\n \"balance\": 40000,\n \"total_granted\": 45000,\n \"total_consumed\": 5000,\n \"purchases\": [\n {\n \"source\": \"free_grant\",\n \"characters\": 45000,\n \"price_usd\": 0\n }\n ]\n }\n }\n}\n```\n\n**Admin User Response (no query parameter):**\n```json\n{\n \"message\": \"Admin users have unlimited usage\",\n \"is_admin\": true\n}\n```\n\n**Admin Query Parameter:**\n```\nGET /api/usage?customer_id=specific_customer_id\n```\nAllows admins to check usage for any specific customer ID.\n\n### GET /health\n\nHealth check endpoint that returns the service status.\n\n**Response:**\n```json\n{\n \"status\": \"ok\",\n \"timestamp\": \"2024-01-01T00:00:00.000Z\"\n}\n```\n\n### POST /revenuecat/webhook\n\nWebhook endpoint for RevenueCat to notify about purchases and refunds.\n\n**Headers:**\n- `Authorization: {REVENUECAT_WEBHOOK_AUTH}` (must match environment variable)\n\n**Handled Events:**\n- `NON_RENEWING_PURCHASE` - Grants credits for credit pack purchases\n- `REFUND` - Deducts credits for refunded purchases\n\n**Response:**\n```json\n{\n \"success\": true\n}\n```\n\n### GET /\n\nRoot endpoint that provides basic API information.\n\n**Response:**\n```json\n{\n \"message\": \"Text Extraction API\",\n \"version\": \"1.0.0\",\n \"endpoints\": {\n \"health\": \"/health\",\n \"speech\": \"/api/speech\",\n \"extractText\": \"/api/extract-text\",\n \"usage\": \"/api/usage\"\n },\n \"supportedFileTypes\": [\"txt\", \"rtf\", \"docx\", \"md\", \"pdf\"],\n \"timestamp\": \"2024-01-01T00:00:00.000Z\"\n}\n```\n\n## Database Schema\n\nThe system uses SQLite with multiple tables for comprehensive tracking:\n\n### Table: `customer_usage_v1`\nTracks all usage (both subscription and non-expiring):\n- `id` - Auto-incrementing primary key\n- `customer_id` - Customer identifier from RevenueCat\n- `character_count` - Number of characters in the request\n- `request_timestamp` - ISO timestamp of the request\n- `created_at` - Database insertion timestamp\n\n### Table: `credit_grants_v1`\nLedger of all credit additions:\n- `id` - Auto-incrementing primary key\n- `customer_id` - Customer identifier\n- `source` - Type of grant (free_grant, iap, admin, refund)\n- `product_lookup_key` - RevenueCat product ID for purchases\n- `revenuecat_tx_id` - Transaction ID for idempotency\n- `characters_granted` - Number of characters granted (negative for refunds)\n- `price_usd` - Price paid for the credits\n- `granted_at` - Timestamp of grant\n\n### Table: `credit_debits_v1`\nLedger of non-expiring credit consumption:\n- `id` - Auto-incrementing primary key\n- `customer_id` - Customer identifier\n- `usage_id` - Foreign key to customer_usage_v1\n- `characters_consumed` - Number of non-expiring characters used\n- `consumed_at` - Timestamp of consumption\n\n## Configuration\n\nThe API automatically configures:\n- `response_format`: Always set to \"mp3\"\n- `word_timestamps`: Always set to true\n\nOnly `voice` and `input` parameters need to be provided by the client.\n\n## External Services\n\n### PDFVector API\n- Used for PDF text extraction\n- Pricing: 1-2 credits per page depending on AI usage\n- AI Enhancement: Automatically enabled for complex layouts\n- Timeout: 3 minutes maximum per document\n- Supported formats: PDF and Word documents\n\n## Error Codes\n\n- `400` - Bad Request (missing required fields, invalid file type)\n- `401` - Unauthorized (missing/invalid auth header)\n- `403` - Forbidden (no active subscription)\n- `429` - Too Many Requests (monthly limit exceeded)\n- `500` - Internal Server Error\n\n## Dependencies\n\n- `hono` - Web framework\n- `mammoth` - DOCX text extraction\n- `rtf-parser` - RTF text extraction\n- `remove-markdown` - Markdown to plain text conversion\n- `pdfvector` - PDF text extraction via API\n- `@extractus/article-extractor` - Web page content extraction\n",[],[199],{"_104":438,"_96":439,"_157":440,"_159":-5,"_160":142,"_161":417,"_163":119,"_106":441,"_101":32,"_165":179,"_167":442,"_168":22,"_169":-5,"_170":443,"_99":444},"147a2a58-72e9-11f0-a843-0224a6c84d84","deno.json","147a2ad0-72e9-11f0-a843-0224a6c84d84",["D",1754500584486],"{\n \"$schema\": \"https://raw.githubusercontent.com/denoland/deno/348900b8b79f4a434cab4c74b3bc8d4d2fa8ee74/cli/schemas/config-file.v1.json\",\n \"lock\": false,\n \"compilerOptions\": {\n \"noImplicitAny\": false,\n \"strict\": false,\n \"types\": [\n \"https://www.val.town/types/valtown.d.ts\"\n ],\n \"lib\": [\n \"dom\",\n \"dom.iterable\",\n \"dom.asynciterable\",\n \"deno.ns\",\n \"deno.unstable\"\n ]\n },\n \"lint\": {\n \"files\": {\n \"include\": [\n \"deno:/https/esm.town/**/*\"\n ]\n },\n \"rules\": {\n \"exclude\": [\n \"no-explicit-any\"\n ]\n }\n },\n \"node_modules_dir\": false,\n \"experimental\": {\n \"unstable-node-globals\": true,\n \"unstable-temporal\": true,\n \"unstable-worker-options\": true,\n \"unstable-sloppy-imports\": true\n }\n}",[],[439],{"_104":446,"_96":447,"_157":448,"_159":-5,"_160":142,"_161":178,"_163":119,"_106":449,"_101":32,"_165":210,"_167":73,"_168":22,"_169":-5,"_170":450,"_99":451},"d84daf7c-4a12-11f0-8741-76b3cceeab13","main.tsx","d84db026-4a12-11f0-8741-76b3cceeab13",["D",1750010524725],[],[447],{"_104":453,"_96":454,"_157":455,"_159":-5,"_160":142,"_161":269,"_163":119,"_106":456,"_101":178,"_165":179,"_167":457,"_168":22,"_169":-5,"_170":458,"_99":459},"8c0ca422-b7e2-11f0-9bff-0224a6c84d84","test-upload.html","60b4e410-4aa0-11f0-bd2f-76b3cceeab13",["D",1762084408836],"\n\n\n Test Document Upload\n\n\n

Test Document Text Extraction

\n \n \n \n

\n \n \n\n\n",[],[454],{"_104":461,"_96":462,"_157":463,"_159":-5,"_160":142,"_161":464,"_163":119,"_106":465,"_101":32,"_165":179,"_167":466,"_168":22,"_169":-5,"_170":467,"_99":468},"c31e33ca-54de-11f0-986d-f69ea79377d9","test-url-extraction.html","c31e3474-54de-11f0-986d-f69ea79377d9",73,["D",1751197618141],"\n\n\n \n \n URL Text Extraction Test\n \n\n\n

URL Text Extraction Test

Test the new URL-based text extraction functionality of the /api/extract-text endpoint.

\n \n \n \n

\n\n \n\n",[],[462],"files",[154,172,184,190,197,205,214,222,230,240,247,256,265,272,280,288,298,304,313,319,328,336,346,352,361,368,378,387,398,404,413,422,430,437,445,452,460],"counts",{"_473":32,"_474":187,"_475":32,"_476":477},"pulls","branches","forks","envVars",{"_478":479,"_480":32},"count",7,"emptyCount","contents",[483,486,489,492,495,498,501],{"_104":191,"_96":192,"_157":193,"_159":186,"_160":142,"_161":194,"_163":119,"_106":484,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_99":485},["D",1750043208420],[100,192],{"_104":241,"_96":242,"_157":243,"_159":186,"_160":142,"_161":244,"_163":119,"_106":487,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_99":488},["D",1750043226033],[100,242],{"_104":266,"_96":267,"_157":268,"_159":186,"_160":142,"_161":269,"_163":119,"_106":490,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_99":491},["D",1762084408836],[100,267],{"_104":299,"_96":300,"_157":301,"_159":186,"_160":142,"_161":176,"_163":119,"_106":493,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_99":494},["D",1758484581786],[100,300],{"_104":314,"_96":315,"_157":316,"_159":186,"_160":142,"_161":292,"_163":119,"_106":496,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_99":497},["D",1762602165335],[100,315],{"_104":329,"_96":199,"_157":330,"_159":186,"_160":142,"_161":292,"_163":119,"_106":499,"_101":332,"_165":179,"_167":333,"_168":22,"_169":-5,"_99":500},["D",1762602165335],[100,199],{"_104":337,"_96":338,"_157":117,"_159":186,"_160":142,"_161":141,"_163":119,"_106":502,"_101":340,"_165":341,"_167":342,"_168":22,"_169":-5,"_99":503},["D",1763466387738],[100,338],{"_104":185,"_96":100,"_157":186,"_159":-5,"_160":142,"_161":187,"_163":119,"_106":505,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_99":506},["D",1750015912808],[100],"upstreamProject","upstreamBranch","emptyEnvVars","isNew","flags",[],"routes/_app.x.$handle.$name.code.$",{"_94":95,"_96":97,"_98":44,"_101":-7,"_99":100,"_102":515,"_152":520,"_469":632,"_179":633,"_481":635,"_650":-5,"_651":-5,"_652":-5,"_653":-5,"_654":655},{"_104":105,"_96":97,"_106":516,"_108":-5,"_109":22,"_110":111,"_112":113,"_114":-5,"_14":115,"_116":117,"_118":119,"_120":119,"_121":-5,"_122":32,"_16":123,"_124":125,"_126":125,"_127":128,"_129":128,"_130":128,"_131":125,"_132":125,"_23":517,"_136":518,"_139":519,"_151":22},["D",1750010524712],{"_94":95,"_134":135},{"_94":95,"_138":135,"_14":115},{"_101":141,"_96":44,"_104":142,"_143":105,"_144":-5,"_145":-5,"_146":-5,"_147":-5,"_148":-5,"_149":97,"_150":95},[521,527,587,593,605,611,614,617,620,623,626,629],{"_104":155,"_96":156,"_157":158,"_159":-5,"_160":142,"_161":162,"_163":119,"_106":164,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_170":522,"_99":526},[523],{"_104":173,"_96":174,"_157":175,"_159":158,"_160":142,"_161":176,"_163":119,"_106":177,"_101":178,"_165":179,"_167":180,"_168":22,"_169":-5,"_170":524,"_99":525},[],[156,174],[156],{"_104":185,"_96":100,"_157":186,"_159":-5,"_160":142,"_161":187,"_163":119,"_106":188,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_170":528,"_99":586},[529,547,556,568,574,580,583],{"_104":191,"_96":192,"_157":193,"_159":186,"_160":142,"_161":194,"_163":119,"_106":195,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_170":530,"_99":546},[531,534,537,540,543],{"_104":198,"_96":199,"_157":200,"_159":193,"_160":142,"_161":176,"_163":119,"_106":201,"_101":178,"_165":179,"_167":202,"_168":22,"_169":-5,"_170":532,"_99":533},[],[100,192,199],{"_104":206,"_96":207,"_157":208,"_159":193,"_160":142,"_161":176,"_163":119,"_106":209,"_101":32,"_165":210,"_167":211,"_168":22,"_169":-5,"_170":535,"_99":536},[],[100,192,207],{"_104":215,"_96":216,"_157":217,"_159":193,"_160":142,"_161":176,"_163":119,"_106":218,"_101":32,"_165":210,"_167":219,"_168":22,"_169":-5,"_170":538,"_99":539},[],[100,192,216],{"_104":223,"_96":224,"_157":225,"_159":193,"_160":142,"_161":176,"_163":119,"_106":226,"_101":32,"_165":210,"_167":227,"_168":22,"_169":-5,"_170":541,"_99":542},[],[100,192,224],{"_104":231,"_96":232,"_157":233,"_159":193,"_160":142,"_161":176,"_163":119,"_106":234,"_101":235,"_165":210,"_167":236,"_168":22,"_169":-5,"_170":544,"_99":545},[],[100,192,232],[100,192],{"_104":241,"_96":242,"_157":243,"_159":186,"_160":142,"_161":244,"_163":119,"_106":245,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_170":548,"_99":555},[549,552],{"_104":248,"_96":249,"_157":250,"_159":243,"_160":142,"_161":176,"_163":119,"_106":251,"_101":252,"_165":210,"_167":253,"_168":22,"_169":-5,"_170":550,"_99":551},[],[100,242,249],{"_104":257,"_96":232,"_157":258,"_159":243,"_160":142,"_161":176,"_163":119,"_106":259,"_101":260,"_165":210,"_167":261,"_168":22,"_169":-5,"_170":553,"_99":554},[],[100,242,232],[100,242],{"_104":266,"_96":267,"_157":268,"_159":186,"_160":142,"_161":269,"_163":119,"_106":270,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_170":557,"_99":567},[558,561,564],{"_104":273,"_96":274,"_157":275,"_159":268,"_160":142,"_161":269,"_163":119,"_106":276,"_101":32,"_165":210,"_167":277,"_168":22,"_169":-5,"_170":559,"_99":560},[],[100,267,274],{"_104":281,"_96":282,"_157":283,"_159":268,"_160":142,"_161":269,"_163":119,"_106":284,"_101":32,"_165":210,"_167":285,"_168":22,"_169":-5,"_170":562,"_99":563},[],[100,267,282],{"_104":289,"_96":290,"_157":291,"_159":268,"_160":142,"_161":292,"_163":119,"_106":293,"_101":32,"_165":210,"_167":294,"_168":22,"_169":-5,"_170":565,"_99":566},[],[100,267,290],[100,267],{"_104":299,"_96":300,"_157":301,"_159":186,"_160":142,"_161":176,"_163":119,"_106":302,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_170":569,"_99":573},[570],{"_104":305,"_96":306,"_157":307,"_159":301,"_160":142,"_161":176,"_163":119,"_106":308,"_101":32,"_165":210,"_167":309,"_168":22,"_169":-5,"_170":571,"_99":572},[],[100,300,306],[100,300],{"_104":314,"_96":315,"_157":316,"_159":186,"_160":142,"_161":292,"_163":119,"_106":317,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_170":575,"_99":579},[576],{"_104":320,"_96":321,"_157":322,"_159":316,"_160":142,"_161":292,"_163":119,"_106":323,"_101":32,"_165":210,"_167":324,"_168":22,"_169":-5,"_170":577,"_99":578},[],[100,315,321],[100,315],{"_104":329,"_96":199,"_157":330,"_159":186,"_160":142,"_161":292,"_163":119,"_106":331,"_101":332,"_165":179,"_167":333,"_168":22,"_169":-5,"_170":581,"_99":582},[],[100,199],{"_104":337,"_96":338,"_157":117,"_159":186,"_160":142,"_161":141,"_163":119,"_106":339,"_101":340,"_165":341,"_167":342,"_168":22,"_169":-5,"_170":584,"_99":585},[],[100,338],[100],{"_104":347,"_96":348,"_157":349,"_159":-5,"_160":142,"_161":176,"_163":119,"_106":350,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_170":588,"_99":592},[589],{"_104":353,"_96":354,"_157":355,"_159":349,"_160":142,"_161":176,"_163":119,"_106":356,"_101":32,"_165":179,"_167":357,"_168":22,"_169":-5,"_170":590,"_99":591},[],[348,354],[348],{"_104":362,"_96":363,"_157":364,"_159":-5,"_160":142,"_161":365,"_163":119,"_106":366,"_101":178,"_165":166,"_167":-5,"_168":22,"_169":-5,"_170":594,"_99":604},[595,598,601],{"_104":369,"_96":370,"_157":371,"_159":364,"_160":142,"_161":372,"_163":119,"_106":373,"_101":194,"_165":374,"_167":375,"_168":22,"_169":-5,"_170":596,"_99":597},[],[363,370],{"_104":379,"_96":380,"_157":381,"_159":364,"_160":142,"_161":382,"_163":119,"_106":383,"_101":252,"_165":341,"_167":384,"_168":22,"_169":-5,"_170":599,"_99":600},[],[363,380],{"_104":388,"_96":389,"_157":390,"_159":364,"_160":142,"_161":391,"_163":119,"_106":392,"_101":393,"_165":341,"_167":394,"_168":22,"_169":-5,"_170":602,"_99":603},[],[363,389],[363],{"_104":399,"_96":400,"_157":401,"_159":-5,"_160":142,"_161":176,"_163":119,"_106":402,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_170":606,"_99":610},[607],{"_104":405,"_96":406,"_157":407,"_159":401,"_160":142,"_161":176,"_163":119,"_106":408,"_101":32,"_165":210,"_167":409,"_168":22,"_169":-5,"_170":608,"_99":609},[],[400,406],[400],{"_104":414,"_96":415,"_157":416,"_159":-5,"_160":142,"_161":417,"_163":119,"_106":418,"_101":32,"_165":179,"_167":419,"_168":22,"_169":-5,"_170":612,"_99":613},[],[415],{"_104":423,"_96":424,"_157":425,"_159":-5,"_160":142,"_161":176,"_163":119,"_106":426,"_101":32,"_165":179,"_167":427,"_168":22,"_169":-5,"_170":615,"_99":616},[],[424],{"_104":431,"_96":199,"_157":432,"_159":-5,"_160":142,"_161":292,"_163":119,"_106":433,"_101":244,"_165":179,"_167":434,"_168":22,"_169":-5,"_170":618,"_99":619},[],[199],{"_104":438,"_96":439,"_157":440,"_159":-5,"_160":142,"_161":417,"_163":119,"_106":441,"_101":32,"_165":179,"_167":442,"_168":22,"_169":-5,"_170":621,"_99":622},[],[439],{"_104":446,"_96":447,"_157":448,"_159":-5,"_160":142,"_161":178,"_163":119,"_106":449,"_101":32,"_165":210,"_167":73,"_168":22,"_169":-5,"_170":624,"_99":625},[],[447],{"_104":453,"_96":454,"_157":455,"_159":-5,"_160":142,"_161":269,"_163":119,"_106":456,"_101":178,"_165":179,"_167":457,"_168":22,"_169":-5,"_170":627,"_99":628},[],[454],{"_104":461,"_96":462,"_157":463,"_159":-5,"_160":142,"_161":464,"_163":119,"_106":465,"_101":32,"_165":179,"_167":466,"_168":22,"_169":-5,"_170":630,"_99":631},[],[462],[521,523,527,529,531,534,537,540,543,547,549,552,556,558,561,564,568,570,574,576,580,583,587,589,593,595,598,601,605,607,611,614,617,620,623,626,629],{"_104":185,"_96":100,"_157":186,"_159":-5,"_160":142,"_161":187,"_163":119,"_106":505,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_99":634},[100],[636,638,640,642,644,646,648],{"_104":191,"_96":192,"_157":193,"_159":186,"_160":142,"_161":194,"_163":119,"_106":484,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_99":637},[100,192],{"_104":241,"_96":242,"_157":243,"_159":186,"_160":142,"_161":244,"_163":119,"_106":487,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_99":639},[100,242],{"_104":266,"_96":267,"_157":268,"_159":186,"_160":142,"_161":269,"_163":119,"_106":490,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_99":641},[100,267],{"_104":299,"_96":300,"_157":301,"_159":186,"_160":142,"_161":176,"_163":119,"_106":493,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_99":643},[100,300],{"_104":314,"_96":315,"_157":316,"_159":186,"_160":142,"_161":292,"_163":119,"_106":496,"_101":32,"_165":166,"_167":-5,"_168":22,"_169":-5,"_99":645},[100,315],{"_104":329,"_96":199,"_157":330,"_159":186,"_160":142,"_161":292,"_163":119,"_106":499,"_101":332,"_165":179,"_167":333,"_168":22,"_169":-5,"_99":647},[100,199],{"_104":337,"_96":338,"_157":117,"_159":186,"_160":142,"_161":141,"_163":119,"_106":502,"_101":340,"_165":341,"_167":342,"_168":22,"_169":-5,"_99":649},[100,338],"upstream","pull","ahead","behind","templates",[],"actionData","errors"]

tr3ntg

readback-api