SwathiMystery
/ whirr untar
Created
February 11, 2013 11:26
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ tar -xzvf whirr-0.8.1.tar.gz | |
| $ cd whirr-0.8.1 |
SwathiMystery
/ key-gen
Created
February 11, 2013 11:34
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa_whirr | |
| $ cd whirr-0.8.1 |
SwathiMystery
/ mrv1 cdh4
Created
February 11, 2013 11:38
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Cluster name goes here | |
| whirr.cluster-name=testcluster | |
| # Change the number of machines in the cluster here | |
| # Using 3 DN and TT and 1JT and NN# Ganglia is configured | |
| whirr.instance-templates=1 hadoop-jobtracker+hadoop-namenode+ganglia-monitor+ganglia-metad,3 hadoop-datanode+hadoop-tasktracker+ganglia-monitor | |
| # Install JAVA | |
| whirr.java.install-function=install_openjdk | |
| whirr.java.install-function=install_oab_java |
SwathiMystery
/ cluster user
Created
February 11, 2013 11:40
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| whirr.cluster-user=whirr |
SwathiMystery
/ launch-whirr
Created
February 11, 2013 11:41
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ cd whirr-0.8.1 | |
| $ bin/whirr launch-cluster --config whirr_cdh.properties |
SwathiMystery
/ files-generated
Created
February 11, 2013 11:43
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ cd ~/.whirr/testcluster |
SwathiMystery
/ start-proxy
Created
February 11, 2013 11:44
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ sh hadoop-proxy.sh |
SwathiMystery
/ list files hdfs
Created
February 11, 2013 11:45
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ export HADOOP_CONF_DIR=~/.whirr/testcluster/hadoop-site.xml | |
| $ hadoop fs -ls / |
SwathiMystery
/ from tool
Created
February 11, 2013 11:47
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ bin/hadoop --config ~/.whirr/testcluster fs -ls / |
SwathiMystery
/ mrv2-cdh4
Created
February 11, 2013 11:50
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ## Cluster name goes here. | |
| whirr.cluster-name=yarncluster | |
| # Change the number of machines in the cluster here | |
| whirr.instance-templates=1 hadoop-namenode+yarn-resourcemanager+mapreduce-historyserver,2 hadoop-datanode+yarn-nodemanager | |
| # Install JAVA | |
| whirr.java.install-function=install_openjdk | |
| whirr.java.install-function=install_oab_java |
OlderNewer