Skip to content

Instantly share code, notes, and snippets.

@sean-smith
Created January 17, 2024 21:01
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save sean-smith/00909da24d222b2a46d6b392cd72347e to your computer and use it in GitHub Desktop.
Save sean-smith/00909da24d222b2a46d6b392cd72347e to your computer and use it in GitHub Desktop.

Switch Enroot to NVME

  1. Create a file enroot_nvme.sh:
#!/bin/bash

# Change the /etc/enroot/enroot.conf file to use local nvme storage:
#ENROOT_RUNTIME_PATH        /tmp/enroot/user-$(id -u) -> /opt/dlami/nvme/enroot/user-$(id -u)
#ENROOT_CONFIG_PATH         ${HOME}/enroot
#ENROOT_CACHE_PATH          /opt/enroot
#ENROOT_DATA_PATH           /tmp/enroot/data/user-$(id -u) -> /opt/dlami/nvme/enroot/data/user-$(id -u)

sudo sed -i 's/\/tmp/\/opt\/dlami\/nvme/g' /etc/enroot/enroot.conf
  1. Next submit to the number of compute nodes you have:
sbatch -N 8 enroot_nvme.sh
  1. Spot check to make sure it worked:
srun head /etc/enroot/enroot.conf

This should show:

#Please refer https://github.com/NVIDIA/enroot/blob/master/doc/configuration.md for details about individual options.
#ENROOT_LIBRARY_PATH        /usr/lib/enroot
#ENROOT_SYSCONF_PATH        /etc/enroot
ENROOT_RUNTIME_PATH        /opt/dlami/nvme/enroot/user-$(id -u)
ENROOT_CONFIG_PATH         ${HOME}/enroot
ENROOT_CACHE_PATH          /opt/enroot
ENROOT_DATA_PATH           /opt/dlami/nvme/enroot/data/user-$(id -u)
#ENROOT_TEMP_PATH           ${TMPDIR:-/opt/dlami/nvme}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment