Skip to content

Instantly share code, notes, and snippets.

@Orbifold
Created March 1, 2020 16:23
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Orbifold/722ac54b92e3890d0441c1ca5f566945 to your computer and use it in GitHub Desktop.
Save Orbifold/722ac54b92e3890d0441c1ca5f566945 to your computer and use it in GitHub Desktop.
Load a csv file into Spark with Kotlin.
import org.apache.spark.sql.Dataset
import org.apache.spark.sql.Row
import org.apache.spark.sql.SparkSession
public fun main() {
val session = SparkSession.Builder()
.appName("Swa Spark")
.master("local")
.orCreate
val df: Dataset<Row> = session.read().format("csv")
.option("header", "true")
.load("./data/Tester.csv")
df.show()
// println("works")
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment