{"repo":"Dicklesworthstone/markdown_web_browser","free":true,"listed":false,"github":"https://github.com/Dicklesworthstone/markdown_web_browser","clone":"git clone https://github.com/Dicklesworthstone/markdown_web_browser.git","description":"Renders any URL via headless Chrome, tiles screenshots into OCR slices, and streams structured Markdown + provenance back to AI agents and pipelines","language":"Python","stars":178,"topics":["ai-agents","markdown","ocr","python","web-scraping"],"license":null,"category":"media-processing","readme_excerpt":"Markdown Web Browser 🌐→📝 Transform any website into clean, proveable Markdown with full OCR accuracy Render any URL with deterministic Chrome-for-Testing, tile screenshots into OCR-friendly slices, and stream structured Markdown + provenance back to AI agents, web apps, and automation pipelines. Two ways to use it: 1. 🌐 Browser UI ( /browser ) - Interactive web browsing with navigation history, address bar, and dual markdown views 2. ⚙️ CLI + API - Programmatic capture for automation, batch processing, and agent workflows 🎯 Example: finviz.com (Financial Market Dashboard) The Challenge: Finviz.com is protected by Cloudflare bot detection that blocks traditional web scrapers. Our system bypasses this with comprehensive stealth techniques. BEFORE: Original Website AFTER: Clean Markdown (Two Views) Rendered Markdown - Beautiful GitHub-styled formatting: Raw Markdown - Syntax-highlighted source with full provenance: Sample Output (truncated - actual output is 223 lines) What makes this work: - ✅ Bypasses Cloudflare bot detection - Chrome's --headless=new mode (undetectable) + 60+ lines of stealth JavaScript - ✅ Comprehensive fingerprint masking - navigator.webdriver, plugins, permissions API, hardware specs - ✅ Captures 4 tiles with overlapping regions for seamless stitching - ✅ 95%+ OCR accuracy - Extracts all stock tickers, prices, and percentages - ✅ Full provenance - Every section links back to exact pixel coordinates - ✅ Works on protected sites - finviz.com (Cloudflare)","default_branch":null,"files":null,"tree":[],"storefront":"/r/Dicklesworthstone","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Dicklesworthstone/markdown_web_browser/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}