Skip to content

Instantly share code, notes, and snippets.

@bluesmilery

bluesmilery/spark

Created September 20, 2018 02:57
Show Gist options
  • Save bluesmilery/0454b2de9413215647905268c62760ed to your computer and use it in GitHub Desktop.
Save bluesmilery/0454b2de9413215647905268c62760ed to your computer and use it in GitHub Desktop.
Download ZIP
spark
Raw
spark
# 组合开启spark历史日志可在spark ui中查看
spark.eventLog.enabled true
spark.eventLog.dir hdfs://nn-cluster/user/strategy/sparklog1.6
spark.history.fs.logDirectory hdfs://nn-cluster/user/strategy/sparklog1.6
spark.history.fs.cleaner.enabled true
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment