Skip to content

Instantly share code, notes, and snippets.

@sean-smith
Last active May 15, 2022 18:33
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save sean-smith/6ae22e00e483d253b2e36b6e45c84810 to your computer and use it in GitHub Desktop.
Save sean-smith/6ae22e00e483d253b2e36b6e45c84810 to your computer and use it in GitHub Desktop.
Start CUDA MPS Server on each node

👾 Slurm CUDA MPS Prolog

The following Slurm Prolog starts the CUDA MPS server on each compute node before the job is started.

cat << EOF > /opt/slurm/etc/prolog.sh
#!/bin/sh

# start mps
nvidia-cuda-mps-control -d

EOF
chmod 744 /opt/slurm/etc/prolog.sh

echo "Prolog=/opt/slurm/etc/prolog.sh" >> /opt/slurm/etc/slurm.conf
systemctl restart slurmctld
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment