Skip to content

Instantly share code, notes, and snippets.

@kingspp

kingspp/horovod_installation_ami.sh

Last active January 22, 2019 14:51
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save kingspp/39a0d5518003005fad23a213ff4b92d1 to your computer and use it in GitHub Desktop.
Save kingspp/39a0d5518003005fad23a213ff4b92d1 to your computer and use it in GitHub Desktop.
Download ZIP
AWS Deep Learning AMI with NCCL
Raw
horovod_installation_ami.sh
# Install fish
cd /etc/yum.repos.d/
sudo wget https://download.opensuse.org/repositories/shells:fish:release:2/RedHat_RHEL-6/shells:fish:release:2.repo
sudo yum install fish
# Update locatedb
sudo ionice -c3 updatedb
# Install g++
sudo yum install gcc72-c++
# Install Open MPI v4
wget https://download.open-mpi.org/release/open-mpi/v4.0/openmpi-4.0.0.tar.gz
tar -xvf openmpi-4.0.0.tar.gz
cd openmpi-4.0.0
./configure --prefix=/usr/local
make all
sudo make install
sudo ldconfig
# Install tensorflow
sudo python3 -m pip3 install tensorflow-gpu==1.8.0
# Install horovod
HOROVOD_CUDA_HOME=/usr/local/cuda-9.0 HOROVOD_GPU_ALLREDUCE=NCCL sudo python3 -m pip install --no-cache-dir horovod
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment