Skip to content

Instantly share code, notes, and snippets.

@cored cored/gist:3430574
Created Aug 22, 2012

Embed
What would you like to do?
(in-ns 'word)
(clojure/refer 'clojure)
(def token-regex #"\w+")
(defn to-lower-case [token-string]
(.toLowerCase token-string))
(defn tokenize-str [input-string]
(map to-lower-case (re-seq token-regex input-string)))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.