Skip to content

Instantly share code, notes, and snippets.

What would you like to do?
Learn Scalding with Alice
Get the last line of text in Alice in Wonderland that contains each of the top 20 frequent words in the book
NOT ACTUALLY TESTED, just logically combined. See fork source for original version that is mulch ore likely to work.
val alice = Source.fromURL("").getLines.zipWithIndex.toList
val aliceWords = TypedPipe.from(alice).flatMap { case (text, _) => text.split("\\s+").toList }
val wordCount = { word => (word, 1L) }.group.sum
val top20 = wordCount.groupAll.sortBy { case (word, count) => -count }.take(20).values
val lastLine = alicePipe.flatMap { case (text, line) => text.split("\\s+") { word => (word, line) }}.group.max { case (word, lastLine) => (lastLine, word) }.group.join(
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment