muhammetfaik/fd

Created July 26, 2017 03:19

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/muhammetfaik/eb26156eaabfef0c7e7d5619f90a4969.js"></script>
Save muhammetfaik/eb26156eaabfef0c7e7d5619f90a4969 to your computer and use it in GitHub Desktop.

Download ZIP

fsdf

Raw

fd

	text_file = spark.textFile("hdfs://...")

	text_file.flatMap(lambda line: line.split())
	.map(lambda word: (word, 1))
	.reduceByKey(lambda a, b: a+b)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment