Skip to content

Instantly share code, notes, and snippets.

@kaosf

kaosf/remove-same-files.sh

Created June 12, 2017 13:30
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save kaosf/a4d4864419afa0842cc2c14ce9455936 to your computer and use it in GitHub Desktop.
Save kaosf/a4d4864419afa0842cc2c14ce9455936 to your computer and use it in GitHub Desktop.
Download ZIP
Remove same files in /some/where directory.
Raw
remove-same-files.sh
mkdir workspace
cd workspace
mkdir src
mkdir dst
mv /some/where/* src
cd src
md5sum * > md5sum.txt
cat md5sum.txt | awk '{printf "%s %03d %s\n", $1, length, $0}' | sort -n | sort -u -k1,1 | cut -d " " -f 5- > left.txt
cat left.txt | xargs -i mv "{}" ../dst
rm -f *
cd ..
mv dst/* /some/where
rmdir src
rmdir dst
cd ..
rmdir workspace
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment