Skip to content

Instantly share code, notes, and snippets.

@yaravind

yaravind/spark-shell-init-load-file

Last active April 10, 2020 01:38
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save yaravind/944fd9c65e7e19eb972add9d341fb1c0 to your computer and use it in GitHub Desktop.
Save yaravind/944fd9c65e7e19eb972add9d341fb1c0 to your computer and use it in GitHub Desktop.
Download ZIP
init file to load spark imports etc. You can use :load macro in the shell
Raw
spark-shell-init-load-file
:paste
import org.apache.spark.sql.types._
import com.databricks.spark.xml._
import org.apache.spark.sql.functions._
// For implicit conversions like converting RDDs to DataFrames
import spark.implicits._
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment