CentOS7, Python 2.7, CUDA 9.1, OpenMPI 3.10.0.
- Install dependencies:
yum groupinstall -y "Development Tools"
yum install -y epel-release
yum install -y python-pip python-devel wget
-
Install OpenMPI, validate with
mpirun --version
. -
Install training frameworks
# TensorFlow
pip install tensorflow-gpu
# Keras
pip install keras
# PyTorch
pip install http://download.pytorch.org/whl/cu91/torch-0.4.0-cp27-cp27mu-linux_x86_64.whl
pip install torchvision
- Install Horovod:
pip install horovod