Skip to content

Instantly share code, notes, and snippets.

@eschulte
Created November 29, 2011 20:15
Show Gist options
  • Save eschulte/1406278 to your computer and use it in GitHub Desktop.
Save eschulte/1406278 to your computer and use it in GitHub Desktop.
echo "(defvar tweets '(" > /tmp/tweet.lisp
cat tweet.TREC|sed 's/<TREC>//g; s/<\/TREC>/))/g; s/<DOC>//g; s/<\/DOC>//g; s/<DOCNO>/(:/g; s/<\/DOCNO>//g; s/\\/\\\\/g; s/"/\\"/g; s/<body>/"/g; s/<\/body>/")/g'>>/tmp/tweet.lisp
# then from CL
# (load "/tmp/tweet.lisp")
# (length tweets) ;; => 113201
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment