Install NCCL for GPU communications on CentOS 7.

centos.install.nccl.md

NCCL1

git clone https://github.com/NVIDIA/nccl.git
cd nccl
make -j$(nproc) install

NCCL2

• Download from: https://developer.nvidia.com/nccl

• Extract the NCCL package to your home directory or in /usr/local if installed as root for all users:

cd /usr/local
tar xvf nccl-<version>.txz

• When compiling applications, specify the directory path to where you installed NCCL, for example

/usr/local/nccl-<version>/