Radical 90s Text Analyzer

\n RADICAL TEXT ANALYZER\n

\n setText(e.target.value)}\n placeholder=\"ENTER YOUR TOTALLY AWESOME TEXT HERE\"\n rows=\"10\"\n cols=\"40\"\n />\n \n \n

TF-IDF RESULTS

{phrase}: {score.toFixed(4)}
No results yet. Analyze some text!

WORD FREQUENCY

{word}: {count}
No results yet. Analyze some text!

\n $\"Spinning$ \n $\"Under$ \n

\n );\n}\n\nfunction client() {\n createRoot(document.getElementById(\"root\")).render();\n}\n\nif (typeof document !== \"undefined\") {\n client();\n}\n\nexport default async function(request: Request): Promise {\n return new Response(`\n \n \n \n \n \n Radical 90s Text Analyzer\n \n \n \n \n

\n \n \n \n \n `, {\n headers: { \"Content-Type\": \"text/html\" },\n });\n}\n\nconst css = `\n body, html {\n margin: 0;\n padding: 0;\n height: 100%;\n font-family: 'Comic Neue', cursive;\n background: #FF00FF;\n color: #FFFF00;\n overflow-x: hidden;\n }\n\n .container {\n max-width: 800px;\n margin: 0 auto;\n padding: 20px;\n background: #00FFFF;\n border: 5px solid #FF0000;\n box-shadow: 10px 10px 0 #000000;\n }\n\n .title {\n font-size: 36px;\n color: #FF0000;\n text-shadow: 2px 2px #FFFF00;\n background: #00FF00;\n padding: 10px;\n }\n\n .content {\n background: #FFFFFF;\n padding: 20px;\n border: 3px dashed #FF00FF;\n margin-top: 20px;\n }\n\n textarea {\n width: 100%;\n background-color: #FFFF00;\n color: #000000;\n border: 2px solid #FF0000;\n padding: 10px;\n font-family: 'Comic Neue', cursive;\n font-size: 16px;\n }\n\n button {\n display: block;\n width: 100%;\n background-color: #FF0000;\n color: #FFFFFF;\n border: none;\n padding: 10px;\n margin-top: 10px;\n font-family: 'Comic Neue', cursive;\n font-size: 18px;\n cursor: pointer;\n text-transform: uppercase;\n font-weight: bold;\n box-shadow: 5px 5px 0 #000000;\n }\n\n button:hover {\n background-color: #FF6600;\n }\n\n h2 {\n color: #FF00FF;\n text-align: center;\n text-transform: uppercase;\n text-shadow: 1px 1px #000000;\n }\n\n ul {\n list-style-type: none;\n padding: 0;\n }\n\n li {\n margin-bottom: 5px;\n background: #FFFF00;\n color: #000000;\n padding: 5px;\n border: 1px solid #FF0000;\n }\n\n .results {\n margin-top: 20px;\n border: 2px solid #00FF00;\n padding: 10px;\n background: #FF99CC;\n }\n\n .decorations {\n position: fixed;\n bottom: 10px;\n right: 10px;\n z-index: 1000;\n }\n\n .spinning-globe, .under-construction {\n width: 100px;\n height: 100px;\n margin: 10px;\n }\n\n @keyframes blink {\n 0% { opacity: 1; }\n 50% { opacity: 0; }\n 100% { opacity: 1; }\n }\n\n .blink {\n animation: blink 1s linear infinite;\n }\n`;","deleted","label",[115],"6bcabd86-2794-11f0-9d52-569c3dd06744","README.md","6bcabe26-2794-11f0-9d52-569c3dd06744",1,["D",1731086850651],"Project Name: Radical Text Analyser\nPrimary Purpose: A web-based text analysis tool that counts words, calculates TF-IDF, analyzes sentiment, and generates fun facts about the input text.\nMain Technologies: Hono framework, HTML parsing, JS Base64 encoding, and Node.js.\n\nWord and character counts\nTF-IDF score calculation for the importance of phrases\nWord frequency analysis\nBasic sentiment analysis (positive, negative, or neutral)\nFun fact generation about the text (e.g., average word length)\nSummary generation\nThe tool is implemented in JavaScript using Hono as a lightweight framework and integrates web APIs for fetching external content and analyzing it in real-time.\n\nCode Structure\nImports\n\nHono: Used for routing and handling API requests.\nencode (from JS Base64): Utility for encoding data.\nparse (from Node HTML Parser): Parses HTML content, used in fetchUrlContent to clean and extract text.\nCore Modules\n\napp: Initializes the main app instance with Hono.\nstopwords: Contains a list of common stop words and web-specific terms to filter out during text analysis.\nsynonyms: Dictionary mapping common words to their synonyms for highlighting in TF-IDF analysis.\nFunctions\nThe primary functions perform specific text analysis tasks, as detailed in the following sections.\n\nFunction Documentation\nEach function's purpose, parameters, and output are described below, along with notes on how they are used within the application.\n\nanalyseSentiment(text)\nPurpose: Analyzes the sentiment of a given text.\nParameters:\n\ntext (string): The text to be analyzed. Returns: An object with score (numerical sentiment score) and sentiment (positive, neutral, or negative).\nUsage: Called within the /analyse endpoint to evaluate the overall sentiment of the user’s input.\ncalculateTFIDF(text, outputSize=7)\nPurpose: Calculates TF-IDF scores to measure the importance of words/phrases in the text.\nParameters:\n\ntext (string): The text for analysis.\noutputSize (number, optional): Limits the number of phrases to return. Returns: Array of top phrases with scores, filtered for uniqueness and length constraints.\nUsage: Called in /analyse to highlight significant terms.\ncalculateWordFrequency(text, topN=30)\nPurpose: Counts word frequency, excluding stop words and web-specific terms.\nParameters:\n\ntext (string): Input text.\ntopN (number, optional): Number of top words to return. Returns: Array of most frequent words with counts.\nUsage: Used within /analyse to populate the word frequency analysis section.\ngenerateFunFact(text)\nPurpose: Generates a fun fact based on text statistics (e.g., word length).\nParameters:\n\ntext (string): Text for analysis. Returns: String with a randomly chosen fun fact.\nUsage: Triggered in /analyse to add a unique, informational element to results.\ngenerateSummary(text, sentenceCount=3)\nPurpose: Extracts a summary from the first few sentences of the input.\nParameters:\n\ntext (string): Text for summarization.\nsentenceCount (number, optional): Number of sentences in the summary. Returns: Summary string.\nUsage: Included in /analyse for quick overviews.\ncleanText(text)\nPurpose: Cleans HTML and unwanted characters from the fetched content.\nParameters:\n\ntext (string): Raw HTML/text. Returns: Cleaned text string.\nUsage: Essential for preprocessing content in fetchUrlContent.\nfetchUrlContent(url)\nPurpose: Fetches HTML content from a URL, removes unwanted elements, and extracts main text.\nParameters:\n\nurl (string): URL to fetch and clean content from. Returns: Cleaned text string or an error message.\nUsage: This function powers the URL input functionality.\nCore Functionalities\nText Analysis Form (HTML)\nThe form on the main page allows users to submit either raw text or a URL. The client-side JavaScript processes the form submission and, if needed, triggers a URL fetch to obtain content.\n\nBackend Processing (Routes)\n\nGET /: Serves the main HTML page.\nPOST /analyse: Analyzes submitted text and returns word count, sentiment, summary, TF-IDF, and word frequency results.\nPOST /fetch-url: Retrieves and cleans content from a URL, then prepares it for analysis.\nDark Mode and Interactivity\n\nDark Mode Toggle: Client-side JavaScript manages style changes.\nShare Feature: Allows users to copy a link with encoded text or URL.\nWord Cloud: jQCloud generates a word cloud based on frequency data.\nMaintenance Notes\nTesting\n\nIntegration Tests: Ensure calculateTFIDF, calculateWordFrequency, and fetchUrlContent produce consistent outputs.\nClient-Side Testing: Regularly test URL fetching functionality to ensure robustness, particularly with dynamic sites.\nError Handling\n\nMaintain try/catch blocks in asynchronous functions like fetchUrlContent to capture network issues.\nUpdate error messages to be user-friendly and provide feedback if inputs are invalid or exceed size limits.\nData Sanitization\n\nVerify that cleanText removes sensitive information from fetched URLs to prevent accidental disclosure.\nRate Limits and API Usage\n\nConsider implementing rate limiting or caching mechanisms to manage heavy usage or repeated requests for the same content.\n\nFuture Improvements\n\nEnhanced Synonym Dictionary\n\nExpand synonyms for better word variation support during analysis.\n\nAdvanced Sentiment Analysis\n\nImplement a sentiment analysis library or API for more nuanced scoring and classification.\n\nMultilingual Support\n\nExtend stop words, sentiment analysis, and cleaning functions to support languages beyond English.\n\nThe Radical Text Analyser code primarily uses the following APIs:\n1. Hono Framework API\n * Purpose: Used to set up routing and serve responses for different endpoints (GET /, POST /analyse, and POST /fetch-url).\n * Usage: The Hono framework handles HTTP requests and responses, forming the backbone of the server-side API.\n2. External Content Fetching API (via fetch)\n * Purpose: Retrieves HTML content from external URLs when users input a URL for analysis.\n * Usage: The fetchUrlContent function uses fetch to make a GET request to the user-provided URL, which allows the application to process content from web pages.\n * Error Handling: Includes logic to check response status and handle various network errors.\n3. Google Fonts API\n * Purpose: Loads the \"VT323\" font for styling the front-end.\n * Usage: Linked in the HTML section via .\n4. jQCloud Library (via CDN)\n * Purpose: Used for generating a word cloud from frequency data on the client side.\n * Usage: Loaded in the HTML section with and \n\n The TF-IDF analysis in this code is performed without using an external library. Instead, it’s implemented directly in the `calculateTFIDF` function. Here’s how it works:\n\n1. **Tokenization and Filtering**: The text is split into words and phrases, excluding stopwords and web-specific terms.\n2. **Term Frequency (TF)**: For each unique phrase, the code calculates how frequently it appears in the text relative to the total number of words.\n3. **Inverse Document Frequency (IDF)**: Each term’s IDF is calculated using a formula that reduces the weight of commonly occurring phrases.\n4. **Scoring**: TF and IDF are multiplied, adjusted by phrase length and rarity, to boost significant phrases.\n5. **Output**: Top phrases are sorted by score, filtered for uniqueness, and returned as the most relevant terms. \n\nThis custom implementation allows for added customization, such as phrase filtering and length adjustments, which wouldn’t be as easily configurable with a standard library.\n\nIDF = ln(Total Word Count / Document Frequency of Term) + 1\n\nTotal Word Count: The total number of words in the input text.\nDocument Frequency of Term: How many times the term appears across documents, which is set to 1 in this single-document context to avoid division by zero.\n+1 Adjustment: Adding 1 ensures that terms appearing once don't have an IDF of zero, which would nullify their score.",[131],"pulls","forks","envVars",{"_143":53,"_145":53},"connections",{"_143":53,"_144":53},"count","unfilledCount","emptyCount",{"_20":130,"_13":131,"_116":132,"_117":-5,"_118":21,"_119":133,"_120":49,"_22":152,"_29":53,"_123":101,"_125":135,"_127":38,"_128":-5,"_149":153,"_89":154},{"_20":114,"_13":115,"_116":47,"_117":-5,"_118":21,"_119":30,"_120":49,"_22":148,"_29":122,"_123":124,"_125":126,"_127":38,"_128":-5,"_149":150,"_89":151},["D",1731727634562],"children",[],[115],["D",1731086850651],[],[131],["D",1746217886539],{"_11":12,"_87":83},{"_11":12,"_81":-5,"_82":83,"_44":45,"_84":85,"_86":38},{"_29":30,"_13":26,"_20":21,"_27":28,"_31":-5,"_32":-5,"_76":-5,"_77":-5,"_78":-5,"_79":14,"_80":12},"ctx",{"_69":-5,"_109":192,"_193":194,"_195":196,"_197":38,"_198":38,"_199":38,"_200":49,"_201":-5,"_202":-7,"_203":-7,"_204":53,"_205":38,"_206":38,"_207":-5,"_208":38,"_209":38,"_210":38,"_211":-5},"ENV",{"_163":164,"_165":166,"_167":26,"_168":169,"_170":171,"_172":173,"_174":175,"_176":177,"_178":179,"_180":181,"_182":183,"_184":185,"_186":187,"_188":189,"_190":191},"REACT_APP_SENTRY_DSN","https://586020d86f05489db63a554690acf1e9@o1398359.ingest.sentry.io/6724499","RENDER_GIT_COMMIT","e87eb04e707cf64e7e532c8e8ec395f209e17f15","RENDER_GIT_BRANCH","POSTHOG_API_TOKEN","phc_nmoyuAkStEZuUp69rYlg1DZgrIt19Gx0Y4Hwf8tGgJP","POSTHOG_API_HOST","https://wart.val.town","WEB_API_TEMPLATE","https://{val}.web.val.run","APP_URL","https://www.val.town","MODULE_URL","https://esm.town","VANITY_WEB_API_TEMPLATE","https://{label}.val.run/","DENOLS_URL","https://lsp.val.town","NODE_ENV","production","CLOUDFLARE_TURNSTILE_SITE_KEY","0x4AAAAAACtaIZJH7s9rBMZ6","GOOGLE_CLIENT_ID","875989696899-jtsqkhlbdv5jrlsk8631p7ipjg3c6o62.apps.googleusercontent.com","STRIPE_PUBLISHABLE_KEY","pk_live_51N2zvWEpZTTLipIkVEwXrUG9AT0yeOOEYxszarZT1jpsZV58Ly6wlg3SltZpHN26CUalOBmUSY7adQRQiSkCZz2500qSXNkf8Y","API_URL","https://api.val.town",[],"preferencesKeybindings","default","preferencesTheme","light","preferencesFixers","preferencesCopilot","preferencesSelectionAi","preferencesCloseBrackets","preferencesChatPanelState","preferencesDprint","preferencesDenofmt","notificationCount","flagDenols","isBusinessOrgMember","businessOrgHandle","isBusinessOrgAdmin","isHigherTownieTier","navCollapsed","currentOrgId"]

Branches1

Branches
1