-
Install OpenMPI, make sure enable CUDA support by adding
--with-cuda
flag. -
Verify GPU Direct RDMA Information
$ ompi_info --all | grep btl_openib_have_cuda_gdr
MCA btl: informational "btl_openib_have_cuda_gdr" (current value: "true", data source: default, level: 4 tuner/basic, type: bool)
- Add flag to
mpirun