Skip to content

Instantly share code, notes, and snippets.

@1ambda

1ambda/spark-init.sh

Created January 2, 2022 01:07
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save 1ambda/3639bbb6acd901d366ebd2ccf5fdc1dd to your computer and use it in GitHub Desktop.
Save 1ambda/3639bbb6acd901d366ebd2ccf5fdc1dd to your computer and use it in GitHub Desktop.
Download ZIP
Raw
spark-init.sh
# 사용자 별 제공되는 Jupyter 컨테이너에 Jupyter Hub 리소스 타입별로 환경변수를 미리 세팅
SPARK_OPTS=--master=local[6] --driver-memory=20g
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment