Skip to content

Instantly share code, notes, and snippets.

@supernullset

supernullset/corpusify.sh

Created January 26, 2015 19:03
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 1 You must be signed in to fork a gist
  • Save supernullset/855f87456b0db40ae117 to your computer and use it in GitHub Desktop.
Save supernullset/855f87456b0db40ae117 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
corpusify.sh
cat *.json |\
jq 'map(select(.from.name=="Nate Klaiber"))' |\
jq '.[].message' |\
grep -v 'jq' |\
sed -e 's/\([[:punct:]]\)//g' |\
grep -v '^$' |\
tr '\n' ' ' |\
tr ' ' '\n' |\
tr '[:upper:]' '[:lower:]' |\
sort |\
uniq -u
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment