Skip to content

Instantly share code, notes, and snippets.

@deroneriksson
Last active August 12, 2016 18:12
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save deroneriksson/b539035ac199d0a0eabc6b318ed12eda to your computer and use it in GitHub Desktop.
Save deroneriksson/b539035ac199d0a0eabc6b318ed12eda to your computer and use it in GitHub Desktop.

SystemML with Jupyter Notes

Install Jupyter

brew install -U python (update my already installed python)
brew install python3
pip3 install jupyter
pip3 install numpy matplotlib scipy scikit-learn pandas

Ended up upgrading python3:

brew update
brew upgrade python3

Start up a Jupyter Notebook

jupyter notebook (start up a jupyter notebook)

Start up Jupyter with SystemML Jar on Classpath

PYSPARK_PYTHON=python3 PYSPARK_DRIVER_PYTHON=jupyter PYSPARK_DRIVER_PYTHON_OPTS="notebook" pyspark --master local[*] --driver-class-path /Users/deroneriksson/Documents/workspace/incubator-systemml/target/SystemML.jar

Start up Jupyter with SystemML Classes on Classpath

PYSPARK_PYTHON=python3 PYSPARK_DRIVER_PYTHON=jupyter PYSPARK_DRIVER_PYTHON_OPTS="notebook" pyspark --master local[*] --driver-class-path "/Users/deroneriksson/Documents/workspace/incubator-systemml/target/classes:/Users/deroneriksson/Documents/workspace/incubator-systemml/target/lib/antlr4-annotations-4.3.jar:/Users/deroneriksson/Documents/workspace/incubator-systemml/target/lib/antlr4-runtime-4.3.jar:/Users/deroneriksson/Documents/workspace/incubator-systemml/target/lib/org.abego.treelayout.core-1.0.1.jar:/Users/deroneriksson/Documents/workspace/incubator-systemml/target/lib/wink-json4j-1.4.jar"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment