{"repo":"michaelkrisper/duplicate-file-finder","free":true,"listed":false,"github":"https://github.com/michaelkrisper/duplicate-file-finder","clone":"git clone https://github.com/michaelkrisper/duplicate-file-finder.git","description":"A script to find duplicate files and displaying them on the screen","language":"Python","stars":54,"topics":["cli","deduplication","duplicate-files","file-management","filesystem","hashing","python"],"license":"MIT","category":"cli-tools","readme_excerpt":"duplicate-file-finder This is a python script to find duplicate files in a directory structure. For optimal performance, files are checked in 3 iterations: 1. Group by file size 2. Group by sha256-hash of the first 1024 Bytes 3. Group by sha256-hash of the whole file After the whole directory structure is searched, duplicate files are displayed. Usage: usage: duplicatefilefinder.py [-h] [-fast] [--delete] [--script-friendly] [-a] [-top X] [--hidden] [--empty] [--min-file-size MIN FILE SIZE] one-or-more-directories positional arguments: directory the directory which should be checked for duplicate files options: -h, --help show this help message and exit -fast Enables a faster but less thorough search by pruning files between comparison stages. May result in fewer duplicates being found than actually exist. Ineffective when used with -a. Note: the default is doing a hash of the entire file. --delete delete older duplicate files --script-friendly use machine-readable output -a display all duplicate files. equal to -top 0 -top X set the amount of displayed duplicates. If 0 is given, all results will be displayed. default=3 --hidden check hidden files and hidden directories too --empty check empty files too --min-file-size MIN FILE SIZE set the file filter so that file must be at least min- file-size to be examined, defaults to 1 EXAMPLES: (1) duplicatefilefinder.py /Downloads Description: Searches the Downloads directory for duplicate files and displays the top 3 duplicates (wit","default_branch":null,"files":null,"tree":[],"storefront":"/r/michaelkrisper","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/michaelkrisper/duplicate-file-finder/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}