{"repo":"Gaurav-Gosain/scraped","free":true,"listed":false,"github":"https://github.com/Gaurav-Gosain/scraped","clone":"git clone https://github.com/Gaurav-Gosain/scraped.git","description":"A fast, parallelized CLI tool that scrapes web pages and converts them to markdown with an interactive TUI browser.","language":"Go","stars":17,"topics":["bubbletea","cli","go","golang","html-to-markdown","markdown","scraper","terminal","tui","web-scraper"],"license":"MIT","category":"cli-tools","readme_excerpt":"scraped A fast, parallelized CLI tool that scrapes web pages and converts them to markdown with an interactive TUI browser. --- scraped takes one or more URLs, fetches them in parallel, and converts each page to clean markdown. It first tries requesting native markdown from the server ( Accept: text/markdown ), and falls back to converting HTML when that is not available. When scraping multiple pages, the results are presented in an interactive TUI browser where you can browse through pages, filter URLs, and search within content. Single-page results are rendered directly to the terminal. Table of Contents - Installation - Usage - Features - Interactive Browser - Development - License Installation Package Managers Homebrew (macOS/Linux): Arch Linux (AUR): Quick Install Script Linux/macOS: Other Methods - GitHub Releases - Download pre-built binaries - Go Install: go install github.com/Gaurav-Gosain/scraped@latest - Build from Source: See Development below Requirements: - A terminal with true color support (most modern terminals work fine) - Go 1.25+ (if building from source) Usage Flags Flag Short Default Description ------ ------- --------- ------------- --output-dir -o Save .md files to a directory instead of rendering to terminal --depth -d 0 Crawl depth (0 = only given URLs) --parallelism -p 10 Number of parallel requests --word-wrap -w 80 Word wrap width for terminal rendering --max-pages -m 0 Max pages to scrape (0 = unlimited) --cross-domains false Allow crawling acros","default_branch":null,"files":null,"tree":[],"storefront":"/r/Gaurav-Gosain","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Gaurav-Gosain/scraped/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}