Skip to content

Instantly share code, notes, and snippets.

View thadguidry's full-sized avatar
🏠
Home, likely researching

Thad Guidry thadguidry

🏠
Home, likely researching
View GitHub Profile
# Default system properties included when running spark-submit.
# This is useful for setting default environmental settings.
# Example:
# spark.master spark://master:7077
spark.eventLog.enabled true
spark.eventLog.dir file:///home/ozawa/sparkeventlogs
# spark.serializer org.apache.spark.serializer.KryoSerializer
# spark.driver.memory 5g
# spark.executor.extraJavaOptions -XX:+PrintGCDetails -Dkey=value -Dnumbers="one two three"