{"repo":"ctokx/url-to-markdown","free":true,"listed":false,"github":"https://github.com/ctokx/url-to-markdown","clone":"git clone https://github.com/ctokx/url-to-markdown.git","description":"Convert webpages to clean Markdown for LLM and RAG workflows. Browser-based UI + Node.js CLI with selector drilling, metadata extraction, and batch processing.","language":"JavaScript","stars":11,"topics":["cli","content-extraction","developer-tools","html-parser","html-to-markdown","javascript","llm","markdown","nodejs","rag"],"license":"MIT","category":"ai-agents","readme_excerpt":"URL to Markdown Convert webpage HTML into Markdown that is easier to use in RAG/LLM pipelines. This repo has two parts: - Web app ( index.html ) for manual conversion - CLI ( cli/ ) for scripted and batch workflows What It Does - Converts HTML to Markdown (Turndown + GFM) - Supports CSS selector targeting ( --selector / selector input) - Cleans common page noise (ads, nav, cookie banners, hidden elements) - Optional media stripping with context placeholders - Optional link stripping - Table normalization/alignment - Code fence language detection from HTML classes - Metadata extraction (title/meta tags/canonical/Open Graph/Twitter + JSON-LD) - Basic boilerplate dedupe in output - Smart content fallback when converting full body Current Limits (Important) - Web app fetching relies on public CORS proxies. - Web app cannot reliably handle many JS-rendered, anti-bot, or authenticated pages. - CLI --render-js needs Playwright installed and a browser binary available. - This project does not do chunking, embedding, retrieval, or vector indexing. Quick Start Web App Open index.html directly, or serve locally: Then open http://localhost:8000 . CLI Optional JS-render support: CLI Examples Web Options - Align Tables - Strip Media - Smart Clean - Extract Meta - Keep Links Keyboard Shortcuts (Web) - Ctrl+Enter : Convert - Ctrl+Shift+C : Copy output - Ctrl+Shift+F : Fetch URL - Ctrl+Shift+X : Clear input - ? : Show help - Esc : Close modal Output Shape (JSON) RAG/LLM Use (Minimal Guidance)","default_branch":null,"files":null,"tree":[],"storefront":"/r/ctokx","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ctokx/url-to-markdown/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}