Skip to content

Instantly share code, notes, and snippets.

View ashishdamania's full-sized avatar
🎯
Focusing

Ashish Damania ashishdamania

🎯
Focusing
  • MD Anderson
View GitHub Profile
ssdeep -r -c -d -t 90 /Directory/Location/file > list_of_duplicates;
cut -d"," -f2- list_of_duplicates >duplicates_filtered;
cat duplicates_filtered | cut -d "," -f1 | sort | uniq | xargs rm;
@ashishdamania
ashishdamania / gist:8497873
Last active January 3, 2016 17:49
Script to remove Duplicate files.
find . -type f | ua -s"|" - >duplicates;
cut -d"|" -f2- duplicates >duplicates_filtered;
tr '|' '\n' < duplicates_filtered >duplicates_filtered_2;
tr '\n' '|' < duplicates_filtered_2 >duplicates_filtered_3;
cat duplicates_filtered_3 | xargs -d "|" rm;