Skip to content

Instantly share code, notes, and snippets.

@ahoy-jon
Created September 21, 2018 17:03
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save ahoy-jon/adb21e68fe0532071acf2e81ff88e76c to your computer and use it in GitHub Desktop.
Save ahoy-jon/adb21e68fe0532071acf2e81ff88e76c to your computer and use it in GitHub Desktop.
package io.univalence
import fr.jetoile.hadoopunit.HadoopUtils
import org.apache.spark.sql.SparkSession
object TestSpark {
def main(args: Array[String]): Unit = {
HadoopUtils.INSTANCE.loadConfigFile(null)
val ss = SparkSession.builder().master("local").appName("toto").getOrCreate()
import ss.implicits._
val ds = ss.createDataset(0 to 10)
ds.collect().foreach(println)
}
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment