Skip to content

Instantly share code, notes, and snippets.

@costin

costin/es-yarn-log-hdp-2.2 Secret

Last active August 29, 2015 14:18
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save costin/68b6bb3e72261522c05c to your computer and use it in GitHub Desktop.
Save costin/68b6bb3e72261522c05c to your computer and use it in GitHub Desktop.
Download ZIP
testing es-yarn on Hadoop 2.6
Raw
es-yarn-log-hdp-2.2
[root@sandbox yarn-test]# hadoop version
Hadoop 2.6.0.2.2.0.0-2041
Subversion git@github.com:hortonworks/hadoop.git -r 7d56f02902b436d46efba030651a2fbe7c1cf1e9
Compiled by jenkins on 2014-11-19T19:42Z
Compiled with protoc 2.5.0
From source with checksum f0c0406cc910a79f206d2ee4c2a68773
This command was run using /usr/hdp/2.2.0.0-2041/hadoop/hadoop-common-2.6.0.2.2.0.0-2041.jar
[root@sandbox yarn-test]# ls
downloads elasticsearch-yarn-2.1.0.BUILD-SNAPSHOT.jar
[root@sandbox yarn-test]# hadoop jar elasticsearch-yarn-2.1.0.BUILD-SNAPSHOT.jar
No command specified
Usage:
-download-es : Downloads Elasticsearch.zip
-install : Installs/Provisions Elasticsearch-YARN into HDFS
-install-es : Installs/Provisions Elasticsearch into HDFS
-start : Starts provisioned Elasticsearch in YARN
-status : Reports status of Elasticsearch in YARN
-stop : Stops Elasticsearch in YARN
-help : Prints this help
Configuration options can be specified _after_ each command; see the documentation for more information.
[root@sandbox yarn-test]# hadoop jar elasticsearch-yarn-2.1.0.BUILD-SNAPSHOT.jar -download-es es.version=1.5.0
Destination file ./downloads/elasticsearch-1.5.0.zip already exists; aborting download...
[root@sandbox yarn-test]# hadoop jar elasticsearch-yarn-2.1.0.BUILD-SNAPSHOT.jar -install es.version=1.5.0
Uploaded /root/yarn-test/elasticsearch-yarn-2.1.0.BUILD-SNAPSHOT.jar to HDFS at hdfs://sandbox.hortonworks.com:8020/apps/elasticsearch/elasticsearch-yarn-2.1.0.BUILD-SNAPSHOT.jar
[root@sandbox yarn-test]# hadoop jar elasticsearch-yarn-2.1.0.BUILD-SNAPSHOT.jar -install-es es.version=1.5.0
Uploaded /root/yarn-test/./downloads/elasticsearch-1.5.0.zip to HDFS at hdfs://sandbox.hortonworks.com:8020/apps/elasticsearch/elasticsearch-1.5.0.zip
[root@sandbox yarn-test]# hadoop jar elasticsearch-yarn-2.1.0.BUILD-SNAPSHOT.jar -status es.version=1.5.0
15/04/07 16:13:57 INFO impl.TimelineClientImpl: Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/
15/04/07 16:13:57 INFO client.RMProxy: Connecting to ResourceManager at sandbox.hortonworks.com/192.168.1.176:8050
No Elasticsearch YARN clusters found at sandbox.hortonworks.com:8050, webapp at sandbox.hortonworks.com:8088
[root@sandbox yarn-test]# hadoop jar elasticsearch-yarn-2.1.0.BUILD-SNAPSHOT.jar -start es.version=1.5.0
15/04/07 16:14:04 INFO impl.TimelineClientImpl: Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/
15/04/07 16:14:04 INFO client.RMProxy: Connecting to ResourceManager at sandbox.hortonworks.com/192.168.1.176:8050
15/04/07 16:14:06 INFO impl.YarnClientImpl: Submitted application application_1428422938889_0001
Launched a 1 node Elasticsearch-YARN cluster [application_1428422938889_0001@http://sandbox.hortonworks.com:8088/proxy/application_1428422938889_0001/] at Tue Apr 07 16:14:06 UTC 2015
[root@sandbox yarn-test]# hadoop jar elasticsearch-yarn-2.1.0.BUILD-SNAPSHOT.jar -status es.version=1.5.0
15/04/07 16:14:16 INFO impl.TimelineClientImpl: Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/
15/04/07 16:14:17 INFO client.RMProxy: Connecting to ResourceManager at sandbox.hortonworks.com/192.168.1.176:8050
Id State Status Start Time Finish Time Tracking URL
application_1428422938889_0001 RUNNING UNDEFINED 4/7/15 4:14 PM N/A http://sandbox.hortonworks.com:8088/proxy/application_1428422938889_0001/A
[root@sandbox yarn-test]# hadoop jar elasticsearch-yarn-2.1.0.BUILD-SNAPSHOT.jar -status es.version=1.5.0
15/04/07 16:14:24 INFO impl.TimelineClientImpl: Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/
15/04/07 16:14:24 INFO client.RMProxy: Connecting to ResourceManager at sandbox.hortonworks.com/192.168.1.176:8050
Id State Status Start Time Finish Time Tracking URL
application_1428422938889_0001 RUNNING UNDEFINED 4/7/15 4:14 PM N/A http://sandbox.hortonworks.com:8088/proxy/application_1428422938889_0001/A
[root@sandbox yarn-test]# hadoop jar elasticsearch-yarn-2.1.0.BUILD-SNAPSHOT.jar -stop es.version=1.5.0
15/04/07 16:19:42 INFO impl.TimelineClientImpl: Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/
15/04/07 16:19:42 INFO client.RMProxy: Connecting to ResourceManager at sandbox.hortonworks.com/192.168.1.176:8050
Stopping Elasticsearch-YARN Cluster with id application_1428422938889_0001
15/04/07 16:19:43 INFO impl.YarnClientImpl: Killed application application_1428422938889_0001
Stopped Elasticsearch-YARN cluster with id application_1428422938889_0001
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment