Skip to content

Instantly share code, notes, and snippets.

@jumping

jumping/emr_spark_thrift_on_yarn

Forked from elliottcordo/emr_spark_thrift_on_yarn
Created August 6, 2017 06:34
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save jumping/af0288cb0224e9e867276b70991d6356 to your computer and use it in GitHub Desktop.
Save jumping/af0288cb0224e9e867276b70991d6356 to your computer and use it in GitHub Desktop.
Download ZIP
EMR spark thrift server
Raw
emr_spark_thrift_on_yarn
#on cluster
thrift /spark/sbin/start-thriftserver.sh --master yarn-client
#ssh tunnel, direct 10000 to unused 8157
ssh -i ~/caserta-1.pem -N -L 8157:ec2-54-221-27-21.compute-1.amazonaws.com:10000 hadoop@ec2-54-221-27-21.compute-1.amazonaws.com
#see this for JDBC config on client http://blogs.aws.amazon.com/bigdata/post/TxT7CJ0E7CRX88/Using-Amazon-EMR-with-SQL-Workbench-and-other-BI-Tools
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment