Skip to content

Instantly share code, notes, and snippets.

View deroneriksson's full-sized avatar

Deron Eriksson deroneriksson

75 followers · 53 following
View GitHub Profile
@deroneriksson
deroneriksson / test-md-for-github-rendering.md
Last active January 16, 2016 21:56
This is a little test file for seeing how things render on github.
@deroneriksson
deroneriksson / systemml-release-checklist.md
Last active May 24, 2016 23:35
Description of the SystemML release process and validation.

Release Candidate Version: 0.10.0-incubating-rc1

Release Candidate Checklist

ItemStatusNotes
@deroneriksson
deroneriksson / systemml-jupyter-notes.md
Last active August 12, 2016 18:12

SystemML with Jupyter Notes

Install Jupyter

brew install -U python (update my already installed python)
brew install python3
pip3 install jupyter
pip3 install numpy matplotlib scipy scikit-learn pandas
@deroneriksson
deroneriksson / jupyter-notes.md
Last active August 12, 2016 21:06

Jupyter Notes for SystemML Cancer Project

Install Python 3

brew update
brew install python3

Install Python Packages including Jupyter

@deroneriksson
deroneriksson / systemml-python-notes.md
Created September 8, 2016 21:15

SystemML Python Notes

Running SystemML Python Tests

pip3 install -U -e src/main/python
mvn clean package
PYSPARK_PYTHON=python3 spark-submit --master local[*] --driver-class-path target/SystemML.jar src/main/python/tests/test_mllearn.py
PYSPARK_PYTHON=python3 spark-submit --master local[*] --driver-class-path target/SystemML.jar src/main/python/tests/test_mlcontext.py
@deroneriksson
deroneriksson / systemml-stuff.md
Last active February 2, 2017 19:28

SystemML Stuff

Run SystemML via MLContext in Spark Shell with SystemML jar file

spark-shell --executor-memory 4G --driver-memory 4G --driver-class-path=target/SystemML.jar

Run SystemML via MLContext in Spark Shell without SystemML jar file

spark-shell --executor-memory 4G --driver-memory 4G --driver-class-path="target/classes:target/lib/antlr4-runtime-4.5.3.jar:target/lib/wink-json4j-1.4.jar"

@deroneriksson
deroneriksson / OS X Stuff
Created February 8, 2017 20:22
Recursively remove .DS_Store files
find . -name '.DS_Store' -type f -delete
@deroneriksson
deroneriksson / regular-expressions.md
Last active March 16, 2017 23:08

Handy Regular Expressions

Javadoc match: /\*\*(?s:(?!\*/).)*\*/

Javadoc match public methods: /\*\*(?s:(?!\*/).)*\*/(\s*)public

Trailing whitespace: [ \t]+$

Four spaces at beginning of line: ^[ ]{4}

@deroneriksson
deroneriksson / useful-git-commands.md
Last active April 11, 2017 17:42
Useful Git Commands

Useful Git Commands

Create a local branch based on a remote branch

$ git fetch --all

Fetching origin
Fetching apache-github
From https://github.com/apache/incubator-systemml
 * [new branch]      branch-0.9 -> apache-github/branch-0.9
 * [new branch] gh-pages -> apache-github/gh-pages
@deroneriksson
deroneriksson / systemml-examples.md
Last active May 25, 2017 23:03
SystemML Examples

MNIST LeNet

import org.apache.sysml.api.mlcontext._
val ml = new MLContext(spark)
val clf = ml.nn.examples.Mnist_lenet
val dummy = clf.generate_dummy_data
val dummyVal = clf.generate_dummy_data
val params = clf.train(dummy.X, dummy.Y, dummyVal.X, dummyVal.Y, dummy.C, dummy.Hin, dummy.Win, 1)
val probs = clf.predict(dummy.X, dummy.C, dummy.Hin, dummy.Win, params.W1, params.b1, params.W2, params.b2, params.W3, params.b3, params.W4, params.b4)