poluektik/save to hadoop

Last active March 12, 2020 11:40

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/poluektik/7b15007bd94183deb0a8ea6acb71c684.js"></script>
Save poluektik/7b15007bd94183deb0a8ea6acb71c684 to your computer and use it in GitHub Desktop.

Download ZIP

Raw

save to hadoop

	recordsRDD
	.map(x => someFunc(x)) //drop the timestamp
	.saveAsHadoopFile(s"$datumBasePath")

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment