Skip to content

Instantly share code, notes, and snippets.

@sunzcdev
Last active January 18, 2019 06:45
Show Gist options
  • Save sunzcdev/af9bc6ad557a00aba9507cc4b19ac5f1 to your computer and use it in GitHub Desktop.
Save sunzcdev/af9bc6ad557a00aba9507cc4b19ac5f1 to your computer and use it in GitHub Desktop.
master上初始化全节点集群
#!/bin/bash
sudo apt install -y wget unzip software-properties-common dirmngr
echo "deb http://ppa.launchpad.net/webupd8team/java/ubuntu xenial main" | \
sudo tee /etc/apt/sources.list.d/webupd8team-java.list
echo "deb-src http://ppa.launchpad.net/webupd8team/java/ubuntu xenial main" | \
sudo tee -a /etc/apt/sources.list.d/webupd8team-java.list
sudo apt-key adv --keyserver hkp://keyserver.ubuntu.com:80 --recv-keys EEA14886
sudo apt-get update
sudo apt-get -y install oracle-java8-installer
wget "https://www-us.apache.org/dist/hadoop/common/hadoop-2.9.2/hadoop-2.9.2.tar.gz"
tar -xzf hadoop-2.9.2.tar.gz &&rm hadoop-2.9.2.tar.gz
rm -rf ~/hadoop-2.9.2/etc/hadoop
wget "https://github.com/sunzcdev/hadoop_config/archive/master.zip"
unzip master.zip -d ~/hadoop-2.9.2/etc/ && rm master.zip
mv ~/hadoop-2.9.2/etc/hadoop_config-master/ ~/hadoop-2.9.2/etc/hadoop/
echo "export JAVA_HOME=/usr/lib/jvm/java-8-oracle" >> ~/.bashrc
echo "export HADOOP_INSTALL=/home/hduser/hadoop-2.9.2/" >> ~/.bashrc
echo "export PATH=\$PATH:\${HADOOP_INSTALL}/bin:\${HADOOP_INSTALL}/sbin" >> ~/.bashrc
source ~/.bashrc
java -version
hadoop version
ssh hduser@$1 'bash -s' < init.sh
ssh hduser@$2 'bash -s' < init.sh
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment