Skip to content

Instantly share code, notes, and snippets.

@terrywang

terrywang/gist:74d1617600dfc7c2fb4c6365c60b09db

Last active November 30, 2023 02:47
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save terrywang/74d1617600dfc7c2fb4c6365c60b09db to your computer and use it in GitHub Desktop.
Save terrywang/74d1617600dfc7c2fb4c6365c60b09db to your computer and use it in GitHub Desktop.
Download ZIP
Bash history HISTFILE deduplication while preserving order
Raw
gistfile1.txt
# backup HISTFILE
cp ~/.bash_history{,.bak}
# deduplicate - deprecated
nl ~/.bash_history.bak | sort -k2,2 -k1,1nr | uniq -f1 | sort -k1,1n | cut -f2 > ~/.bash_history
# dedupelicate
cp ~/.bash_history{,.bak-$(date -I)}
tac $HISTFILE | awk '!x[$0]++' | tac | sponge $HISTFILE
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment