Skip to content

Instantly share code, notes, and snippets.

@dineshadepu
Created October 26, 2023 13:37
Show Gist options
  • Save dineshadepu/e0acac4184db51e0eee341986203d28e to your computer and use it in GitHub Desktop.
Save dineshadepu/e0acac4184db51e0eee341986203d28e to your computer and use it in GitHub Desktop.
MFIX learn

The current documentation is given after installation

For Linux 64, Open MPI is built with CUDA awareness but this support is disabled by default.                                                                              
To enable it, please set the environment variable OMPI_MCA_opal_cuda_support=true before                                                                                  
launching your MPI processes. Equivalently, you can set the MCA parameter in the command line:                                                                            
mpiexec --mca opal_cuda_support 1 ...                                                
                                                                                     
In addition, the UCX support is also built but disabled by default.                  
To enable it, first install UCX (conda install -c conda-forge ucx). Then, set the environment                                                                             
variables OMPI_MCA_pml="ucx" OMPI_MCA_osc="ucx" before launching your MPI processes. 
Equivalently, you can set the MCA parameters in the command line:                    
mpiexec --mca pml ucx --mca osc ucx ...                                              
Note that you might also need to set UCX_MEMTYPE_CACHE=n for CUDA awareness via UCX. 
Please consult UCX's documentation for detail.  
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment