Skip to content

Instantly share code, notes, and snippets.

@Cowa

Cowa/ngram-source.scala

Last active October 21, 2015 19:34
Show Gist options
  • Save Cowa/005a3b44eb8450bc0315 to your computer and use it in GitHub Desktop.
Save Cowa/005a3b44eb8450bc0315 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
ngram-source.scala
val source = "The blue sky is near the red koala near the blue sky"
val tokens = source.split(" ").toList
// List(The, blue, sky, is, near, the, red, koala, near, the, blue, sky)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment