Skip to content

Instantly share code, notes, and snippets.

@1duo
Created July 25, 2018 21:13
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save 1duo/43acb5349578a414291195f892ed874b to your computer and use it in GitHub Desktop.
Save 1duo/43acb5349578a414291195f892ed874b to your computer and use it in GitHub Desktop.
Install Uber's Horovod distributed training framework for TensorFlow, Keras, and PyTorch on CentOS 7.

CentOS7, Python 2.7, CUDA 9.1, OpenMPI 3.10.0.

  • Install dependencies:
yum groupinstall -y "Development Tools"
yum install -y epel-release
yum install -y python-pip python-devel wget
  • Install OpenMPI, validate with mpirun --version.

  • Install training frameworks

# TensorFlow
pip install tensorflow-gpu

# Keras
pip install keras

# PyTorch
pip install http://download.pytorch.org/whl/cu91/torch-0.4.0-cp27-cp27mu-linux_x86_64.whl 
pip install torchvision
pip install horovod
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment