Skip to content

Instantly share code, notes, and snippets.

@hsuyuming

hsuyuming/spark-connector.scala

Last active July 3, 2019 02:19
Show Gist options
  • Save hsuyuming/ba433ecaa049c356f87f685bad5f3931 to your computer and use it in GitHub Desktop.
Save hsuyuming/ba433ecaa049c356f87f685bad5f3931 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
spark-connector.scala
import org.apache.spark.sql.SparkSession
import net.snowflake.spark.snowflake.Utils.SNOWFLAKE_SOURCE_NAME
val sparkSession = SparkSession.builder.master("local[*]").appName("spark session example").getOrCreate()
var sfOptions = Map ("sfUrl"->"<host>","sfAccount"->"<account>","sfUser"->"ABEHSU","sfPassword"->"<pwd>","sfDatabase"->"SPARK_TEST")
val df = sparkSession.read.format(SNOWFLAKE_SOURCE_NAME).options(sfOptions).option("query","SELECT * FROM SNOWFLAKE_SAMPLE_DATA.TPCDS_SF10TCL.CUSTOMER_ADDRESS;").load()
df.show
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment