Skip to content

Instantly share code, notes, and snippets.

@qi-qi
Last active March 8, 2019 13:55
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save qi-qi/0467ff5caf61ba39ec729cc88ab148e3 to your computer and use it in GitHub Desktop.
Save qi-qi/0467ff5caf61ba39ec729cc88ab148e3 to your computer and use it in GitHub Desktop.
emr-5.21
[hadoop@ip-192-168-47-191 ~]$ sudo find / -iname "*amzn*.jar"
/mnt/var/lib/hadoop-httpfs/tomcat-deployment/webapps/webhdfs/WEB-INF/lib/hadoop-hdfs-client-2.8.5-amzn-1.jar
/mnt/var/lib/hadoop-httpfs/tomcat-deployment/webapps/webhdfs/WEB-INF/lib/hadoop-auth-2.8.5-amzn-1.jar
/mnt/var/lib/hadoop-httpfs/tomcat-deployment/webapps/webhdfs/WEB-INF/lib/hadoop-hdfs-2.8.5-amzn-1.jar
/mnt/var/lib/hadoop-httpfs/tomcat-deployment/webapps/webhdfs/WEB-INF/lib/hadoop-annotations-2.8.5-amzn-1.jar
/mnt/var/lib/hadoop-httpfs/tomcat-deployment/webapps/webhdfs/WEB-INF/lib/hadoop-common-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-core-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-rumen-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-distcp-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-azure-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-streaming-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-openstack-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-sls-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs-plugins-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-extras-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-datajoin-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-auth-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-shuffle-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.8.5-amzn-1-tests.jar
/usr/lib/hadoop-mapreduce/hadoop-archive-logs-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-gridmix-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-ant-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-app-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-aws-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-archives-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-azure-datalake-2.8.5-amzn-1.jar
/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-common-2.8.5-amzn-1.jar
/usr/lib/livy/jars/hadoop-hdfs-client-2.8.5-amzn-1.jar
/usr/lib/livy/jars/hadoop-mapreduce-client-core-2.8.5-amzn-1.jar
/usr/lib/livy/jars/hadoop-yarn-api-2.8.5-amzn-1.jar
/usr/lib/livy/jars/hadoop-mapreduce-client-jobclient-2.8.5-amzn-1.jar
/usr/lib/livy/jars/hadoop-client-2.8.5-amzn-1.jar
/usr/lib/livy/jars/hadoop-yarn-server-common-2.8.5-amzn-1.jar
/usr/lib/livy/jars/hadoop-yarn-client-2.8.5-amzn-1.jar
/usr/lib/livy/jars/hadoop-auth-2.8.5-amzn-1.jar
/usr/lib/livy/jars/hadoop-mapreduce-client-shuffle-2.8.5-amzn-1.jar
/usr/lib/livy/jars/hadoop-annotations-2.8.5-amzn-1.jar
/usr/lib/livy/jars/hadoop-yarn-common-2.8.5-amzn-1.jar
/usr/lib/livy/jars/hadoop-mapreduce-client-app-2.8.5-amzn-1.jar
/usr/lib/livy/jars/hadoop-common-2.8.5-amzn-1.jar
/usr/lib/livy/jars/hadoop-mapreduce-client-common-2.8.5-amzn-1.jar
/usr/lib/hadoop/client/hadoop-hdfs-client-2.8.5-amzn-1.jar
/usr/lib/hadoop/client/hadoop-mapreduce-client-core-2.8.5-amzn-1.jar
/usr/lib/hadoop/client/hadoop-yarn-api-2.8.5-amzn-1.jar
/usr/lib/hadoop/client/hadoop-mapreduce-client-jobclient-2.8.5-amzn-1.jar
/usr/lib/hadoop/client/hadoop-yarn-server-common-2.8.5-amzn-1.jar
/usr/lib/hadoop/client/hadoop-yarn-client-2.8.5-amzn-1.jar
/usr/lib/hadoop/client/hadoop-auth-2.8.5-amzn-1.jar
/usr/lib/hadoop/client/hadoop-mapreduce-client-shuffle-2.8.5-amzn-1.jar
/usr/lib/hadoop/client/hadoop-annotations-2.8.5-amzn-1.jar
/usr/lib/hadoop/client/hadoop-yarn-common-2.8.5-amzn-1.jar
/usr/lib/hadoop/client/hadoop-mapreduce-client-app-2.8.5-amzn-1.jar
/usr/lib/hadoop/client/hadoop-common-2.8.5-amzn-1.jar
/usr/lib/hadoop/client/hadoop-mapreduce-client-common-2.8.5-amzn-1.jar
/usr/lib/hadoop/hadoop-rumen-2.8.5-amzn-1.jar
/usr/lib/hadoop/hadoop-distcp-2.8.5-amzn-1.jar
/usr/lib/hadoop/hadoop-azure-2.8.5-amzn-1.jar
/usr/lib/hadoop/hadoop-streaming-2.8.5-amzn-1.jar
/usr/lib/hadoop/hadoop-openstack-2.8.5-amzn-1.jar
/usr/lib/hadoop/hadoop-sls-2.8.5-amzn-1.jar
/usr/lib/hadoop/hadoop-extras-2.8.5-amzn-1.jar
/usr/lib/hadoop/hadoop-datajoin-2.8.5-amzn-1.jar
/usr/lib/hadoop/hadoop-auth-2.8.5-amzn-1.jar
/usr/lib/hadoop/hadoop-annotations-2.8.5-amzn-1.jar
/usr/lib/hadoop/hadoop-common-2.8.5-amzn-1-tests.jar
/usr/lib/hadoop/hadoop-archive-logs-2.8.5-amzn-1.jar
/usr/lib/hadoop/hadoop-gridmix-2.8.5-amzn-1.jar
/usr/lib/hadoop/hadoop-ant-2.8.5-amzn-1.jar
/usr/lib/hadoop/hadoop-nfs-2.8.5-amzn-1.jar
/usr/lib/hadoop/hadoop-aws-2.8.5-amzn-1.jar
/usr/lib/hadoop/hadoop-common-2.8.5-amzn-1.jar
/usr/lib/hadoop/hadoop-archives-2.8.5-amzn-1.jar
/usr/lib/hadoop/hadoop-azure-datalake-2.8.5-amzn-1.jar
/usr/lib/tez/lib/hadoop-mapreduce-client-core-2.8.5-amzn-1.jar
/usr/lib/tez/lib/hadoop-mapreduce-client-common-2.8.5-amzn-1.jar
/usr/lib/hadoop-httpfs/webapps/webhdfs/WEB-INF/lib/hadoop-hdfs-client-2.8.5-amzn-1.jar
/usr/lib/hadoop-httpfs/webapps/webhdfs/WEB-INF/lib/hadoop-auth-2.8.5-amzn-1.jar
/usr/lib/hadoop-httpfs/webapps/webhdfs/WEB-INF/lib/hadoop-hdfs-2.8.5-amzn-1.jar
/usr/lib/hadoop-httpfs/webapps/webhdfs/WEB-INF/lib/hadoop-annotations-2.8.5-amzn-1.jar
/usr/lib/hadoop-httpfs/webapps/webhdfs/WEB-INF/lib/hadoop-common-2.8.5-amzn-1.jar
/usr/lib/hive-hcatalog/share/hcatalog/hive-hcatalog-streaming-2.3.4-amzn-0.jar
/usr/lib/hive-hcatalog/share/hcatalog/hive-hcatalog-core-2.3.4-amzn-0.jar
/usr/lib/hive-hcatalog/share/hcatalog/hive-hcatalog-server-extensions-2.3.4-amzn-0.jar
/usr/lib/hive-hcatalog/share/hcatalog/hive-hcatalog-pig-adapter-2.3.4-amzn-0.jar
/usr/lib/hadoop-kms/share/hadoop/kms/tomcat/webapps/kms/WEB-INF/lib/hadoop-kms-2.8.5-amzn-1.jar
/usr/lib/hadoop-kms/share/hadoop/kms/tomcat/webapps/kms/WEB-INF/lib/hadoop-auth-2.8.5-amzn-1.jar
/usr/lib/hadoop-kms/share/hadoop/kms/tomcat/webapps/kms/WEB-INF/lib/hadoop-annotations-2.8.5-amzn-1.jar
/usr/lib/hadoop-kms/share/hadoop/kms/tomcat/webapps/kms/WEB-INF/lib/hadoop-common-2.8.5-amzn-1.jar
/usr/lib/hadoop-hdfs/hadoop-hdfs-client-2.8.5-amzn-1-tests.jar
/usr/lib/hadoop-hdfs/hadoop-hdfs-client-2.8.5-amzn-1.jar
/usr/lib/hadoop-hdfs/hadoop-hdfs-2.8.5-amzn-1.jar
/usr/lib/hadoop-hdfs/hadoop-hdfs-native-client-2.8.5-amzn-1.jar
/usr/lib/hadoop-hdfs/hadoop-hdfs-nfs-2.8.5-amzn-1.jar
/usr/lib/hadoop-hdfs/hadoop-hdfs-2.8.5-amzn-1-tests.jar
/usr/lib/hadoop-hdfs/hadoop-hdfs-native-client-2.8.5-amzn-1-tests.jar
/usr/lib/hadoop-yarn/hadoop-yarn-server-tests-2.8.5-amzn-1.jar
/usr/lib/hadoop-yarn/hadoop-yarn-server-timeline-pluginstorage-2.8.5-amzn-1.jar
/usr/lib/hadoop-yarn/hadoop-yarn-api-2.8.5-amzn-1.jar
/usr/lib/hadoop-yarn/hadoop-yarn-server-nodemanager-2.8.5-amzn-1.jar
/usr/lib/hadoop-yarn/hadoop-yarn-server-sharedcachemanager-2.8.5-amzn-1.jar
/usr/lib/hadoop-yarn/hadoop-yarn-server-resourcemanager-2.8.5-amzn-1.jar
/usr/lib/hadoop-yarn/hadoop-yarn-server-common-2.8.5-amzn-1.jar
/usr/lib/hadoop-yarn/hadoop-yarn-client-2.8.5-amzn-1.jar
/usr/lib/hadoop-yarn/hadoop-yarn-server-web-proxy-2.8.5-amzn-1.jar
/usr/lib/hadoop-yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.8.5-amzn-1.jar
/usr/lib/hadoop-yarn/hadoop-yarn-applications-distributedshell-2.8.5-amzn-1.jar
/usr/lib/hadoop-yarn/hadoop-yarn-common-2.8.5-amzn-1.jar
/usr/lib/hadoop-yarn/hadoop-yarn-server-applicationhistoryservice-2.8.5-amzn-1.jar
/usr/lib/hadoop-yarn/hadoop-yarn-registry-2.8.5-amzn-1.jar
/usr/lib/hive/jdbc/hive-jdbc-2.3.4-amzn-0-standalone.jar
/usr/lib/hive/lib/hive-llap-common-2.3.4-amzn-0-tests.jar
/usr/lib/hive/lib/hive-accumulo-handler-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-common-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-service-rpc-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-metastore-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-serde-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-vector-code-gen-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-hcatalog-core-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-llap-client-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-contrib-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-hbase-handler-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-shims-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-testutils-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-llap-ext-client-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-llap-server-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-exec-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-jdbc-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-llap-tez-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-druid-handler-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-service-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-cli-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-shims-scheduler-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-shims-common-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-hcatalog-server-extensions-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-hplsql-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-llap-common-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-jdbc-handler-2.3.4-amzn-0.jar
/usr/lib/hive/lib/hive-beeline-2.3.4-amzn-0.jar
/usr/lib/spark/jars/hadoop-hdfs-client-2.8.5-amzn-1.jar
/usr/lib/spark/jars/hive-jdbc-1.2.1-spark2-amzn-0.jar
/usr/lib/spark/jars/hadoop-mapreduce-client-core-2.8.5-amzn-1.jar
/usr/lib/spark/jars/hadoop-yarn-api-2.8.5-amzn-1.jar
/usr/lib/spark/jars/hadoop-mapreduce-client-jobclient-2.8.5-amzn-1.jar
/usr/lib/spark/jars/hive-beeline-1.2.1-spark2-amzn-0.jar
/usr/lib/spark/jars/hive-cli-1.2.1-spark2-amzn-0.jar
/usr/lib/spark/jars/hadoop-client-2.8.5-amzn-1.jar
/usr/lib/spark/jars/hadoop-yarn-server-common-2.8.5-amzn-1.jar
/usr/lib/spark/jars/hadoop-yarn-client-2.8.5-amzn-1.jar
/usr/lib/spark/jars/hadoop-auth-2.8.5-amzn-1.jar
/usr/lib/spark/jars/hadoop-mapreduce-client-shuffle-2.8.5-amzn-1.jar
/usr/lib/spark/jars/hadoop-yarn-server-web-proxy-2.8.5-amzn-1.jar
/usr/lib/spark/jars/hadoop-annotations-2.8.5-amzn-1.jar
/usr/lib/spark/jars/hive-exec-1.2.1-spark2-amzn-0.jar
/usr/lib/spark/jars/hive-metastore-1.2.1-spark2-amzn-0.jar
/usr/lib/spark/jars/hadoop-yarn-common-2.8.5-amzn-1.jar
/usr/lib/spark/jars/hadoop-mapreduce-client-app-2.8.5-amzn-1.jar
/usr/lib/spark/jars/hadoop-common-2.8.5-amzn-1.jar
/usr/lib/spark/jars/hadoop-mapreduce-client-common-2.8.5-amzn-1.jar
/usr/share/aws/emr/instance-controller/lib/hadoop-hdfs-client-2.8.5-amzn-1.jar
/usr/share/aws/emr/instance-controller/lib/curator-recipes-4.0.1-amzn-0.jar
/usr/share/aws/emr/instance-controller/lib/curator-framework-4.0.1-amzn-0.jar
/usr/share/aws/emr/instance-controller/lib/hadoop-auth-2.8.5-amzn-1.jar
/usr/share/aws/emr/instance-controller/lib/hadoop-hdfs-2.8.5-amzn-1.jar
/usr/share/aws/emr/instance-controller/lib/hadoop-annotations-2.8.5-amzn-1.jar
/usr/share/aws/emr/instance-controller/lib/curator-client-4.0.1-amzn-0.jar
/usr/share/aws/emr/instance-controller/lib/hadoop-common-2.8.5-amzn-1.jar
/usr/share/aws/emr/hadoop-state-pusher/lib/hadoop-annotations-2.7.3-amzn-3.jar
/usr/share/aws/emr/hadoop-state-pusher/lib/hadoop-mapreduce-client-common-2.7.3-amzn-3.jar
/usr/share/aws/emr/hadoop-state-pusher/lib/hadoop-yarn-server-common-2.7.3-amzn-3.jar
/usr/share/aws/emr/hadoop-state-pusher/lib/hadoop-yarn-server-nodemanager-2.7.3-amzn-3.jar
/usr/share/aws/emr/hadoop-state-pusher/lib/hadoop-mapreduce-client-app-2.7.3-amzn-3.jar
/usr/share/aws/emr/hadoop-state-pusher/lib/hadoop-common-2.7.3-amzn-3.jar
/usr/share/aws/emr/hadoop-state-pusher/lib/hadoop-mapreduce-client-shuffle-2.7.3-amzn-3.jar
/usr/share/aws/emr/hadoop-state-pusher/lib/hadoop-hdfs-2.7.3-amzn-3.jar
/usr/share/aws/emr/hadoop-state-pusher/lib/hadoop-yarn-common-2.7.3-amzn-3.jar
/usr/share/aws/emr/hadoop-state-pusher/lib/hadoop-mapreduce-client-jobclient-2.7.3-amzn-3.jar
/usr/share/aws/emr/hadoop-state-pusher/lib/hadoop-auth-2.7.3-amzn-3.jar
/usr/share/aws/emr/hadoop-state-pusher/lib/hadoop-yarn-server-web-proxy-2.7.3-amzn-3.jar
/usr/share/aws/emr/hadoop-state-pusher/lib/hadoop-yarn-api-2.7.3-amzn-3.jar
/usr/share/aws/emr/hadoop-state-pusher/lib/hadoop-yarn-client-2.7.3-amzn-3.jar
/usr/share/aws/emr/hadoop-state-pusher/lib/hadoop-mapreduce-client-core-2.7.3-amzn-3.jar
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment