Skip to content

Instantly share code, notes, and snippets.

@nelsonsequiera

nelsonsequiera/AWS Glue Dev Endpoint.md

Last active May 2, 2019 14:38
Show Gist options
  • Save nelsonsequiera/d0fbc5c71c912120d94bdcd168f62f79 to your computer and use it in GitHub Desktop.
Save nelsonsequiera/d0fbc5c71c912120d94bdcd168f62f79 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
AWS Glue Dev Endpoint.md

  • http://archive.apache.org/dist/zeppelin/zeppelin-0.7.3/zeppelin-0.7.3-bin-all.tgz

  • https://www.oracle.com/technetwork/java/javaee/downloads/jdk8-downloads-2133151.html

  • export JAVA_HOME=`/usr/libexec/java_home -v 1.8`

  • bin/zeppelin-daemon.sh start

  • http://localhost:8080

  • In Zeppelin in the browser, open the drop-down menu at anonymous in the upper-right corner of the page, and choose Interpreter. On the interpreters page, search for spark, and choose edit on the right. Make the following changes: Select the Connect to existing process check box, and then set Host to localhost and Port to 9007 (or whatever other port you are using for port forwarding). In Properties, set master to yarn-client. If there is a spark.executor.memory property, delete it by choosing the x in the action column. If there is a spark.driver.memory property, delete it by choosing the x in the action column.

  • ssh -NTL 9007:169.254.76.1:9007 glue@ bin/zeppelin-daemon.sh stop

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment