vzayaz/CountWithDataset.scala

Created September 6, 2020 20:40

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/vzayaz/06df77a9e851cf3a4b1c22f0804e21eb.js"></script>
Save vzayaz/06df77a9e851cf3a4b1c22f0804e21eb to your computer and use it in GitHub Desktop.

Download ZIP

Raw

CountWithDataset.scala

	val res = spark.range(1000L * 1000 * 1000)
	.filter(col("id") % 2 === 0)
	.select(count(col("id")))
	.first().getAs[Long](0)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment