This Val Town project scrapes the content from the Val Town documentation website and displays it as markdown.

• Crawls all documentation pages from docs.val.town
• Converts HTML content to Markdown format
• Provides a combined view of all documentation
• Allows downloading the entire documentation as Markdown
• Supports viewing individual pages

1. Access the main endpoint without parameters to view all documentation pages combined
2. The crawler will fetch up to 100 pages and combine them into a single document

1. Use the path query parameter to view a specific documentation page
   • Example: ?path=/getting-started

1. Add the format=markdown query parameter to download the content as raw markdown
   • Example: ?format=markdown or ?path=/getting-started&format=markdown

• Uses a custom HTML to Markdown converter
• Implements a crawler to visit all documentation pages
• Extracts main content from each page
• Combines all content into a single document
• Renders markdown using the marked library

• Limited to crawling 100 pages to avoid timeouts
• Some formatting might not be perfectly preserved in the markdown conversion
• Images and other assets are still referenced from the original source
• The crawler might need adjustments if the structure of the docs.val.town website changes

• Add caching to improve performance
• Implement a search functionality
• Add a table of contents for easier navigation
• Support for dark mode
• Improve markdown conversion accuracy