Skip to content

Instantly share code, notes, and snippets.

@earthquakesan

earthquakesan/Dockerfile

Created April 28, 2017 13:20
Show Gist options
  • Save earthquakesan/e47b2f1c1a65d79c8f287e5138d87fd5 to your computer and use it in GitHub Desktop.
Save earthquakesan/e47b2f1c1a65d79c8f287e5138d87fd5 to your computer and use it in GitHub Desktop.
Download ZIP
Dockerfile for sample Spark Application running on Hadoop/Spark Workbench
Raw
Dockerfile
FROM bde2020/spark-submit:2.1.0-hadoop2.8-hive-java8
RUN mkdir -p /app
COPY examples/target/original-spark-examples_2.11-2.3.0-SNAPSHOT.jar /app/spark-examples.jar
ENV SPARK_MASTER_NAME spark-master
ENV SPARK_MASTER_PORT 7077
ENV SPARK_APPLICATION_JAR_LOCATION /app/spark-examples.jar
ENV SPARK_APPLICATION_MAIN_CLASS org.apache.spark.examples.SparkPi
ENV SPARK_APPLICATION_ARGS ""
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment