First setup mountpoint following the instructions in the docs.
Next we'll tell S3 Mountpoint to cache on the 28TB of local NVME available on each P5 instance.
- Mount the nvme disks as a single mount - this needs to be done on each p5 instance:
/bin/setup-local-disks raid0
- Check to see if they got mounted:
$ df -h
...
/dev/md127 28T 216G 28T 1% /mnt/k8s-disks/0
- Next mount that volume on the container:
volumeMounts:
- name: local-nvme
mountPath: /opt/nvme
...
volumes:
- name: local-nvme
hostPath:
path: /mnt/k8s-disks/0
- Enable it in S3 Mountpoint CSI plugin
- cache /opt/nvme # specify cache directory, relative to root host filesystem
# the directory must be unique per mount on a host