Skip to content

Instantly share code, notes, and snippets.

@wooyey
Last active March 22, 2022 08:30
Show Gist options
  • Save wooyey/64b4b5096ba1c8353e7039e64cfb859e to your computer and use it in GitHub Desktop.
Save wooyey/64b4b5096ba1c8353e7039e64cfb859e to your computer and use it in GitHub Desktop.
One Panel

OnePanel and Kuberenets

Minikube

memory cgroup issue (not needed?)

GRUB_CMDLINE_LINUX="cgroup_enable=memory swapaccount=1"
sudo update-grub

NVIDIA setup

Do so inside minikube container only is enough:

distribution=$(. /etc/os-release;echo $ID$VERSION_ID) \
   && curl -s -L https://nvidia.github.io/nvidia-docker/gpgkey | sudo apt-key add - \
   && curl -s -L https://nvidia.github.io/nvidia-docker/$distribution/nvidia-docker.list | sudo tee /etc/apt/sources.list.d/nvidia-docker.list

sudo apt-get update
sudo apt-get install -y nvidia-docker2 nvidia-utils-470
sudo systemctl restart docker

nice to have:

sudo apt-get install -y nvtop

Inside minikube container only?

Cert manager

helm repo add jetstack https://charts.jetstack.io
helm repo update
helm install \
  cert-manager jetstack/cert-manager \
  --namespace cert-manager \
  --create-namespace \
  --version v1.5.3 \
  --set installCRDs=true

Test

docker run --rm --gpus all nvidia/cuda:11.0-base nvidia-smi

Kubernetes plugin install

Prereq:

  • helm
  • running k8s ;)
helm repo add nvdp https://nvidia.github.io/k8s-device-plugin
helm repo update

Each minikube start ...

helm install --generate-name nvdp/nvidia-device-plugin

Trow (local images)

?

minikube addons enable ingress-dns

values.yaml

ingress:
    enabled: true
    annotations:
        cert-manager.io/cluster-issuer: nameOfClusterIssuer
    tls:
    - hosts:
      - registry.dev.local
      secretName: myingress-cert

Put to /etc/hosts:

192.168.49.3 registry.dev.local
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment