Skip to content

Instantly share code, notes, and snippets.

@jmrr

jmrr/launch_spark_shell.sh

Last active December 25, 2019 07:35
Show Gist options
  • Save jmrr/30c21f28d43868ebd4d8 to your computer and use it in GitHub Desktop.
Save jmrr/30c21f28d43868ebd4d8 to your computer and use it in GitHub Desktop.
Download ZIP
Spark-shell (also PySpark, spark-submit, etc.) call including the MySQL JDBC driver
Raw
launch_spark_shell.sh
#!/bin/sh
# Assumes MySQL connector in /zeppelin/local-repo and Spark in /usr/spark It also assumes 8 cores
SPARK_CLASSPATH=/zeppelin/interpreter/jdbc/mysql-connector-java-5.1.35.jar /usr/spark/bin/spark-shell --master local[8]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment