Skip to content

Instantly share code, notes, and snippets.

@haiy

haiy/yarn-spark Test

Created October 28, 2014 06:16
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save haiy/c8ed11f8d121a2ca4eac to your computer and use it in GitHub Desktop.
Save haiy/c8ed11f8d121a2ca4eac to your computer and use it in GitHub Desktop.
Download ZIP
yarn spark test
Raw
yarn-spark Test
1 清理日志
j log
cd $SPARK_HOME &&spark-submit --class org.apache.spark.examples.SparkPi \
--master yarn-cluster \
--num-executors 3 \
--driver-memory 4g \
--executor-memory 2g \
--executor-cores 1 \
lib/spark-examples*.jar \
10
@haiy
Copy link
Author

haiy commented Nov 22, 2014

spark-submit --class org.apache.spark.examples.SparkPi
--master yarn-cluster
--num-executors 3
--driver-memory 4g
--executor-memory 20g
--executor-cores 1
lib/spark-examples*.jar
10

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment