Skip to content

Instantly share code, notes, and snippets.

@NicolaeNMV

NicolaeNMV/start_notebook_with_spark.sh

Created January 7, 2017 08:51
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save NicolaeNMV/3e1d77a9a00c8b496cf880e08c951af4 to your computer and use it in GitHub Desktop.
Save NicolaeNMV/3e1d77a9a00c8b496cf880e08c951af4 to your computer and use it in GitHub Desktop.
Download ZIP
Start jupyter notebook with spark
Raw
start_notebook_with_spark.sh
#!/bin/sh
export PYSPARK_DRIVER_PYTHON="/usr/local/bin/jupyter"
export PYSPARK_DRIVER_PYTHON_OPTS="notebook --NotebookApp.open_browser=False --NotebookApp.ip='*' --NotebookApp.port=8880"
export PYSPARK_PYTHON="/usr/bin/python"
pyspark
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment