{"repo":"KevinStreetCoder/harvestr","free":true,"listed":false,"github":"https://github.com/KevinStreetCoder/harvestr","clone":"git clone https://github.com/KevinStreetCoder/harvestr.git","description":"One username in, every video they've posted out. Archive mode: 50+ sites via yt-dlp + 25 custom scrapers (YouTube, Twitch, Pornhub, XVideos, Coomer, Kemono, RedGifs, X.com, Reddit, cam mirrors). Live recording: StripChat, Chaturbate, CamSoda, 19 cam sites. Web UI, dedup, drift detection.","language":"Python","stars":36,"topics":["archival","ffmpeg","flask","hls","python","scraper","video-downloader","web-ui","yt-dlp","cam-recorder"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"Harvestr One username in, every video they've ever posted, across 50+ sites out. Harvestr is a cross-platform video archival tool that probes dozens of video hosting, cam-archive, and creator-economy sites for a single username, then pulls down every video it finds — with a browser UI, an aggressive downloader stack (aria2c + ffmpeg + curl fallback), content-based deduplication, and an extensible custom-scraper framework for sites yt-dlp doesn't cover. Screenshots The Live dashboard, recording a real fleet — 1463 models tracked, 92 capturing concurrently at 12 MB/s: Monitoring row: write-speed sparkline, the current VPN exit (with auto-rotation armed), and per-site switches. Clicking a site stops or resumes recording for that whole site immediately — in-flight captures included, no restart: Archive mode — performers, per-run settings and the download controls: Screenshots are from a live instance. Performer names, event text and the VPN exit IP are blurred — the numbers and layout are otherwise untouched. --- Why If you follow a creator and want a local archive of their work, their content is usually scattered across 5-15 different sites: main platform, cross-posted mirrors, archive sites, fan sites, leak sites, etc. Chasing each site manually is tedious and you inevitably miss things, duplicate downloads, or fall behind. Harvestr solves this with one command: which fans out to 50+ sites in parallel, finds every profile/page for that name, and downloads every video — skipping","default_branch":null,"files":null,"tree":[],"storefront":"/r/KevinStreetCoder","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/KevinStreetCoder/harvestr/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}