Skip to content

Instantly share code, notes, and snippets.

@ashishdamania

ashishdamania/ssdeep_find_and remove_duplicates.sh

Last active August 29, 2015 13:55
Show Gist options
  • Save ashishdamania/8757800 to your computer and use it in GitHub Desktop.
Save ashishdamania/8757800 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
ssdeep_find_and remove_duplicates.sh
ssdeep -r -c -d -t 90 /Directory/Location/file > list_of_duplicates;
cut -d"," -f2- list_of_duplicates >duplicates_filtered;
cat duplicates_filtered | cut -d "," -f1 | sort | uniq | xargs rm;
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment