Skip to content

Instantly share code, notes, and snippets.

@nateklaiber

nateklaiber/corpusify.sh

Forked from supernullset/corpusify.sh
Last active August 29, 2015 14:14
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save nateklaiber/dc5407bdeca148100b7e to your computer and use it in GitHub Desktop.
Save nateklaiber/dc5407bdeca148100b7e to your computer and use it in GitHub Desktop.
Download ZIP
Raw
corpusify.sh
cat *.json |\
jq 'map(select(.from.name=="Nate Klaiber"))' |\
jq '.[].message' |\
grep -v 'jq' |\
sed -e 's/\([[:punct:]]\)//g' |\
grep -v '^$' |\
tr '\n' ' ' |\
tr ' ' '\n' |\
tr '[:upper:]' '[:lower:]' |\
sort |\
uniq -u
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment