Skip to content

Instantly share code, notes, and snippets.

@sean-smith
Last active May 7, 2024 23:55
Show Gist options
  • Save sean-smith/537add51abfddfeac79aa4fd54d93fd1 to your computer and use it in GitHub Desktop.
Save sean-smith/537add51abfddfeac79aa4fd54d93fd1 to your computer and use it in GitHub Desktop.

Setup Mountpoint CSI driver.

First setup mountpoint following the instructions in the docs.

Steps to setup nvme w/ mountpoint:

Next we'll tell S3 Mountpoint to cache on the 28TB of local NVME available on each P5 instance.

  1. Mount the nvme disks as a single mount - this needs to be done on each p5 instance:
/bin/setup-local-disks raid0
  1. Check to see if they got mounted:
$ df -h
...
/dev/md127       28T  216G   28T   1% /mnt/k8s-disks/0
  1. Next mount that volume on the container:
volumeMounts:
  - name: local-nvme
    mountPath: /opt/nvme
...
volumes:
  - name: local-nvme
    hostPath:
      path: /mnt/k8s-disks/0
  1. Enable it in S3 Mountpoint CSI plugin
- cache /opt/nvme # specify cache directory, relative to root host filesystem
                              # the directory must be unique per mount on a host
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment