{"repo":"amasen02/dupesweep","free":true,"listed":false,"github":"https://github.com/amasen02/dupesweep","clone":"git clone https://github.com/amasen02/dupesweep.git","description":"DupeSweep (dsweep) — a fast duplicate-file finder and reclaimer: three-stage size/hash detection, reversible quarantine + restore, .NET 10.","language":"C#","stars":96,"topics":["cli","deduplication","disk-space","dotnet","dotnet-core","duplicate-files","file-management"],"license":"MIT","category":"cli-tools","readme_excerpt":"DupeSweep ( dsweep ) — a fast duplicate-file finder and reclaimer Find exact duplicate files across one or more directories and reclaim the wasted space — safely. DupeSweep never deletes anything by default: it reports first, and when you do ask it to act, --apply quarantine moves duplicates into a folder with a manifest so the move can be undone with dsweep restore . Why another duplicate finder Most \"find duplicates\" scripts either trust file size alone (wrong — two different files can be the same size) or hash every file up front (slow — hashing a 4 GB video you'll never compare against anything is wasted work). DupeSweep runs a three-stage funnel so the expensive work only happens on real candidates: Stage Cost What it does --- --- --- 1. Group by size Free (already have it from the directory listing) Files with a unique size can't have a duplicate — discarded immediately. 2. Quick hash Cheap SHA-256 of just the first 64 KB, computed in parallel across CPU cores. Narrows same-size files down to real candidates. 3. Full hash Only for survivors Full-file SHA-256 confirms a true byte-for-byte match before anything is reported as a duplicate. The result: a /Downloads or photo library scan with tens of thousands of files only fully hashes the handful that are actually worth comparing. Install DupeSweep targets .NET 10 . Build a single-file executable from source: Or run it in Docker — no .NET install required The image runs the full test suite as part of the build (so a broken","default_branch":null,"files":null,"tree":[],"storefront":"/r/amasen02","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/amasen02/dupesweep/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}