Skip to content

Instantly share code, notes, and snippets.

@erikerlandson
Last active August 29, 2015 14:04
Show Gist options
  • Save erikerlandson/8518b1879f8748cb9120 to your computer and use it in GitHub Desktop.
Save erikerlandson/8518b1879f8748cb9120 to your computer and use it in GitHub Desktop.
start up spark master and slaves in a sandbox
# start-slaves wants sshd running
# start up master
# web ui: http://localhost:8080/
$ ./sbin/start-master.sh
# start up 2 slaves
# web ui: http://localhost:8081/ (8082, 8083, ...)
$ env SPARK_WORKER_INSTANCES=2 ./sbin/start-slaves.sh
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment