Skip to content

Instantly share code, notes, and snippets.

@jseguillon
Last active November 17, 2020 14:02
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save jseguillon/538f3f2474785c12c719be88b1a3a100 to your computer and use it in GitHub Desktop.
Save jseguillon/538f3f2474785c12c719be88b1a3a100 to your computer and use it in GitHub Desktop.
Kubevirt Netwok annotations
apiVersion: kubevirt.io/v1alpha3
kind: VirtualMachine
metadata:
labels:
kubevirt.io/os: linux
name: centos7-master-x
spec:
running: true
template:
spec:
networks:
- name: default
pod: {}
- name: test
multus:
networkName: a-bridge-network
domain:
devices:
blockMultiQueue: true
disks:
- disk:
bus: virtio
name: disk0
cache: writethrough
- disk:
bus: virtio
name: etcd
- disk:
bus: virtio
name: kubelet
- disk:
bus: virtio
name: rook
- disk:
bus: virtio
name: docker
# - name: cloudinitdisk
# disk:
# bus: virtio
- cdrom:
bus: sata
readonly: true
name: cloudinitdisk
interfaces:
- name: default
bridge: {}
- name: test
bridge: {}
machine:
type: q35
resources:
requests:
cpu: 6000m
memory: 12Gi
limits:
cpu: 6000m
memory: 12Gi
volumes:
- name: disk0
containerDisk:
image: mycoorp/cloud-tools-public/kubevirt/centos7-2003-pre-fill-1-0:latest
- name: etcd
persistentVolumeClaim:
claimName: etcd-centos7-master-x
- name: kubelet
persistentVolumeClaim:
claimName: kubelet-centos7-master-x
- name: rook
persistentVolumeClaim:
claimName: rook-centos7-master-x
- name: docker
persistentVolumeClaim:
claimName: docker-centos7-master-x
- name: cloudinitdisk
cloudInitNoCloud:
secretRef:
name: centos7-init
apiVersion: "k8s.cni.cncf.io/v1"
kind: NetworkAttachmentDefinition
metadata:
name: a-bridge-network
spec:
config: '{
"cniVersion": "0.3.0",
"name": "a-bridge-network",
"type": "bridge",
"bridge": "br0",
"isGateway": true,
"ipam": {
"type": "host-local",
"subnet": "192.168.5.0/24",
"dataDir": "/mnt/cluster-ipam"
}
}'
kubectl describe pod
Name: virt-launcher-centos7-master-1-9mqq2
Namespace: default
Priority: 0
Node: devops-master19/10.128.17.19
Start Time: Mon, 16 Nov 2020 18:03:14 +0000
Labels: kubevirt.io=virt-launcher
kubevirt.io/created-by=da5a0693-0fb7-4b26-b226-1fb4adcabf09
Annotations: k8s.v1.cni.cncf.io/network-status:
[{
"name": "cni0",
"ips": [
"10.233.73.58"
],
"default": true,
"dns": {}
},{
"name": "a-bridge-network",
"interface": "net1",
"ips": [
"192.168.5.2"
],
"mac": "7a:b0:9f:89:16:66",
"dns": {}
}]
k8s.v1.cni.cncf.io/networks: [{"interface":"net1","name":"a-bridge-network","namespace":"default"}]
k8s.v1.cni.cncf.io/networks-status:
[{
"name": "cni0",
"ips": [
"10.233.73.58"
],
"default": true,
"dns": {}
},{
"name": "a-bridge-network",
"interface": "net1",
"ips": [
"192.168.5.2"
],
"mac": "7a:b0:9f:89:16:66",
"dns": {}
}]
kubevirt.io/domain: centos7-master-1
Status: Pending
IP: 10.233.73.58
IPs:
IP: 10.233.73.58
Controlled By: VirtualMachineInstance/centos7-master-1
Init Containers:
container-disk-binary:
Container ID: docker://bb051bc14a838ab46faff4595964978f81738dddcdd8dd439daa78a5275647c1
Image: index.docker.io/kubevirt/virt-launcher@sha256:c82e420fb4220c1f945a51dbf459813e86301784f71eb8cd797faf23e9dca295
Image ID: docker-pullable://kubevirt/virt-launcher@sha256:c82e420fb4220c1f945a51dbf459813e86301784f71eb8cd797faf23e9dca295
Port: <none>
Host Port: <none>
Command:
/usr/bin/cp
/usr/bin/container-disk
/init/usr/bin/container-disk
State: Terminated
Reason: Completed
Exit Code: 0
Started: Mon, 16 Nov 2020 18:03:24 +0000
Finished: Mon, 16 Nov 2020 18:03:24 +0000
Ready: True
Restart Count: 0
Limits:
cpu: 10m
memory: 40M
Requests:
cpu: 10m
memory: 40M
Environment: <none>
Mounts:
/init/usr/bin from virt-bin-share-dir (rw)
Containers:
compute:
Container ID:
Image: index.docker.io/kubevirt/virt-launcher@sha256:c82e420fb4220c1f945a51dbf459813e86301784f71eb8cd797faf23e9dca295
Image ID:
Port: <none>
Host Port: <none>
Command:
/usr/bin/virt-launcher
--qemu-timeout
5m
--name
centos7-master-1
--uid
da5a0693-0fb7-4b26-b226-1fb4adcabf09
--namespace
default
--kubevirt-share-dir
/var/run/kubevirt
--ephemeral-disk-dir
/var/run/kubevirt-ephemeral-disks
--container-disk-dir
/var/run/kubevirt/container-disks
--grace-period-seconds
45
--hook-sidecars
0
--less-pvc-space-toleration
10
--ovmf-path
/usr/share/OVMF
State: Waiting
Reason: PodInitializing
Ready: False
Restart Count: 0
Limits:
cpu: 6
devices.kubevirt.io/kvm: 1
devices.kubevirt.io/tun: 1
devices.kubevirt.io/vhost-net: 1
memory: 12765256Ki
Requests:
cpu: 6
devices.kubevirt.io/kvm: 1
devices.kubevirt.io/tun: 1
devices.kubevirt.io/vhost-net: 1
memory: 12765256Ki
Environment:
KUBEVIRT_RESOURCE_NAME_test:
Mounts:
/var/run/kubevirt-ephemeral-disks from ephemeral-disks (rw)
/var/run/kubevirt-private/secret/cloudinitdisk/userdata from cloudinitdisk-udata (ro,path="userdata")
/var/run/kubevirt-private/vmi-disks/docker from docker (rw)
/var/run/kubevirt-private/vmi-disks/etcd from etcd (rw)
/var/run/kubevirt-private/vmi-disks/kubelet from kubelet (rw)
/var/run/kubevirt-private/vmi-disks/rook from rook (rw)
/var/run/kubevirt/container-disks from container-disks (rw)
/var/run/kubevirt/sockets from sockets (rw)
/var/run/libvirt from libvirt-runtime (rw)
volumedisk0:
Container ID:
Image: XXX/centos7-2003-pre-fill-1-0:latest
Image ID:
Port: <none>
Host Port: <none>
Command:
/usr/bin/container-disk
Args:
--copy-path
/var/run/kubevirt-ephemeral-disks/container-disk-data/da5a0693-0fb7-4b26-b226-1fb4adcabf09/disk_0
State: Waiting
Reason: PodInitializing
Ready: False
Restart Count: 0
Limits:
cpu: 10m
memory: 40M
Requests:
cpu: 10m
memory: 40M
Environment: <none>
Mounts:
/usr/bin from virt-bin-share-dir (rw)
/var/run/kubevirt-ephemeral-disks/container-disk-data/da5a0693-0fb7-4b26-b226-1fb4adcabf09 from container-disks (rw)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
sockets:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
etcd:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
ClaimName: etcd-centos7-master-1
ReadOnly: false
kubelet:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
ClaimName: kubelet-centos7-master-1
ReadOnly: false
rook:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
ClaimName: rook-centos7-master-1
ReadOnly: false
docker:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
ClaimName: docker-centos7-master-1
ReadOnly: false
cloudinitdisk-udata:
Type: Secret (a volume populated by a Secret)
SecretName: centos7-init
Optional: false
virt-bin-share-dir:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
libvirt-runtime:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
ephemeral-disks:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
container-disks:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
QoS Class: Guaranteed
Node-Selectors: kubevirt.io/schedulable=true
Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s
node.kubernetes.io/unreachable:NoExecute for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling <unknown> default-scheduler running "VolumeBinding" filter plugin for pod "virt-launcher-centos7-master-1-9mqq2": pod has unbound immediate PersistentVolumeClaims
Warning FailedScheduling <unknown> default-scheduler running "VolumeBinding" filter plugin for pod "virt-launcher-centos7-master-1-9mqq2": pod has unbound immediate PersistentVolumeClaims
Normal Scheduled <unknown> default-scheduler Successfully assigned default/virt-launcher-centos7-master-1-9mqq2 to devops-master19
Normal SuccessfulAttachVolume 2m39s attachdetach-controller AttachVolume.Attach succeeded for volume "pvc-4e119349-c571-47a4-a3ef-0376227cc846"
Normal SuccessfulAttachVolume 2m39s attachdetach-controller AttachVolume.Attach succeeded for volume "pvc-cb48fbf2-1777-4dbd-a1f6-b8150c541976"
Normal SuccessfulAttachVolume 2m39s attachdetach-controller AttachVolume.Attach succeeded for volume "pvc-65524cab-7842-4ea1-b0c6-5064aff7bb7e"
Normal SuccessfulAttachVolume 2m39s attachdetach-controller AttachVolume.Attach succeeded for volume "pvc-6a650f91-69f4-4c30-8beb-af9411a882f9"
Normal Pulling 2m32s kubelet, devops-master19 Pulling image "index.docker.io/kubevirt/virt-launcher@sha256:c82e420fb4220c1f945a51dbf459813e86301784f71eb8cd797faf23e9dca295"
Normal Pulled 2m30s kubelet, devops-master19 Successfully pulled image "index.docker.io/kubevirt/virt-launcher@sha256:c82e420fb4220c1f945a51dbf459813e86301784f71eb8cd797faf23e9dca295"
Normal Created 2m30s kubelet, devops-master19 Created container container-disk-binary
Normal Started 2m29s kubelet, devops-master19 Started container container-disk-binary
Normal Pulled 2m28s kubelet, devops-master19 Container image "index.docker.io/kubevirt/virt-launcher@sha256:c82e420fb4220c1f945a51dbf459813e86301784f71eb8cd797faf23e9dca295" already present on machine
Normal Created 2m28s kubelet, devops-master19 Created container compute
Normal Started 2m28s kubelet, devops-master19 Started container compute
Normal Pulling 2m28s kubelet, devops-master19 Pulling image "XXX/centos7-2003-pre-fill-1-0:latest"
apiVersion: "k8s.cni.cncf.io/v1"
kind: NetworkAttachmentDefinition
metadata:
name: a-bridge-network
spec:
config: '{
"cniVersion": "0.3.0",
"name": "a-bridge-network",
"type": "bridge",
"bridge": "br0",
"isGateway": true,
"ipam": {
"type": "static"
}
}'
Name: virt-launcher-centos7-master-99-qdxxf
Namespace: default
Priority: 0
Node: devops-master19/10.128.17.19
Start Time: Mon, 16 Nov 2020 18:05:05 +0000
Labels: kubevirt.io=virt-launcher
kubevirt.io/created-by=ced1c317-9057-4b7e-a1a3-8dafc1168108
Annotations: k8s.v1.cni.cncf.io/networks: [{"interface":"net1","name":"a-bridge-network","namespace":"default"}]
kubevirt.io/domain: centos7-master-99
Status: Pending
IP:
IPs: <none>
Controlled By: VirtualMachineInstance/centos7-master-99
Init Containers:
container-disk-binary:
Container ID:
Image: index.docker.io/kubevirt/virt-launcher@sha256:c82e420fb4220c1f945a51dbf459813e86301784f71eb8cd797faf23e9dca295
Image ID:
Port: <none>
Host Port: <none>
Command:
/usr/bin/cp
/usr/bin/container-disk
/init/usr/bin/container-disk
State: Waiting
Reason: PodInitializing
Ready: False
Restart Count: 0
Limits:
cpu: 10m
memory: 40M
Requests:
cpu: 10m
memory: 40M
Environment: <none>
Mounts:
/init/usr/bin from virt-bin-share-dir (rw)
Containers:
compute:
Container ID:
Image: index.docker.io/kubevirt/virt-launcher@sha256:c82e420fb4220c1f945a51dbf459813e86301784f71eb8cd797faf23e9dca295
Image ID:
Port: <none>
Host Port: <none>
Command:
/usr/bin/virt-launcher
--qemu-timeout
5m
--name
centos7-master-99
--uid
ced1c317-9057-4b7e-a1a3-8dafc1168108
--namespace
default
--kubevirt-share-dir
/var/run/kubevirt
--ephemeral-disk-dir
/var/run/kubevirt-ephemeral-disks
--container-disk-dir
/var/run/kubevirt/container-disks
--grace-period-seconds
45
--hook-sidecars
0
--less-pvc-space-toleration
10
--ovmf-path
/usr/share/OVMF
State: Waiting
Reason: PodInitializing
Ready: False
Restart Count: 0
Limits:
cpu: 6
devices.kubevirt.io/kvm: 1
devices.kubevirt.io/tun: 1
devices.kubevirt.io/vhost-net: 1
memory: 12765256Ki
Requests:
cpu: 6
devices.kubevirt.io/kvm: 1
devices.kubevirt.io/tun: 1
devices.kubevirt.io/vhost-net: 1
memory: 12765256Ki
Environment:
KUBEVIRT_RESOURCE_NAME_test:
Mounts:
/var/run/kubevirt-ephemeral-disks from ephemeral-disks (rw)
/var/run/kubevirt-private/secret/cloudinitdisk/userdata from cloudinitdisk-udata (ro,path="userdata")
/var/run/kubevirt-private/vmi-disks/docker from docker (rw)
/var/run/kubevirt-private/vmi-disks/etcd from etcd (rw)
/var/run/kubevirt-private/vmi-disks/kubelet from kubelet (rw)
/var/run/kubevirt-private/vmi-disks/rook from rook (rw)
/var/run/kubevirt/container-disks from container-disks (rw)
/var/run/kubevirt/sockets from sockets (rw)
/var/run/libvirt from libvirt-runtime (rw)
volumedisk0:
Container ID:
Image: XXXX/centos7-2003-pre-fill-1-0:latest
Image ID:
Port: <none>
Host Port: <none>
Command:
/usr/bin/container-disk
Args:
--copy-path
/var/run/kubevirt-ephemeral-disks/container-disk-data/ced1c317-9057-4b7e-a1a3-8dafc1168108/disk_0
State: Waiting
Reason: PodInitializing
Ready: False
Restart Count: 0
Limits:
cpu: 10m
memory: 40M
Requests:
cpu: 10m
memory: 40M
Environment: <none>
Mounts:
/usr/bin from virt-bin-share-dir (rw)
/var/run/kubevirt-ephemeral-disks/container-disk-data/ced1c317-9057-4b7e-a1a3-8dafc1168108 from container-disks (rw)
Conditions:
Type Status
Initialized False
Ready False
ContainersReady False
PodScheduled True
Volumes:
sockets:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
etcd:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
ClaimName: etcd-centos7-master-99
ReadOnly: false
kubelet:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
ClaimName: kubelet-centos7-master-99
ReadOnly: false
rook:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
ClaimName: rook-centos7-master-99
ReadOnly: false
docker:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
ClaimName: docker-centos7-master-99
ReadOnly: false
cloudinitdisk-udata:
Type: Secret (a volume populated by a Secret)
SecretName: centos7-init
Optional: false
virt-bin-share-dir:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
libvirt-runtime:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
ephemeral-disks:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
container-disks:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
QoS Class: Guaranteed
Node-Selectors: kubevirt.io/schedulable=true
Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s
node.kubernetes.io/unreachable:NoExecute for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling <unknown> default-scheduler running "VolumeBinding" filter plugin for pod "virt-launcher-centos7-master-99-qdxxf": pod has unbound immediate PersistentVolumeClaims
Warning FailedScheduling <unknown> default-scheduler running "VolumeBinding" filter plugin for pod "virt-launcher-centos7-master-99-qdxxf": pod has unbound immediate PersistentVolumeClaims
Normal Scheduled <unknown> default-scheduler Successfully assigned default/virt-launcher-centos7-master-99-qdxxf to devops-master19
Normal SuccessfulAttachVolume 48s attachdetach-controller AttachVolume.Attach succeeded for volume "pvc-a435ccf1-b4f0-4a52-9fc8-fff087eea227"
Normal SuccessfulAttachVolume 48s attachdetach-controller AttachVolume.Attach succeeded for volume "pvc-1be1a13b-822a-48ed-9893-9224128feb1f"
Normal SuccessfulAttachVolume 48s attachdetach-controller AttachVolume.Attach succeeded for volume "pvc-aeb7c859-5930-4d29-b79b-86b709785b84"
Normal SuccessfulAttachVolume 48s attachdetach-controller AttachVolume.Attach succeeded for volume "pvc-8bd1f29e-d136-4d4c-bb49-e75ed7a77f7a"
Warning FailedCreatePodSandBox 42s kubelet, devops-master19 Failed to create pod sandbox: rpc error: code = Unknown desc = failed to set up sandbox container "200c5c26cc0f0f3b9c0f7fa3c7321a730347948f8a6ef813190ba7af2d05202f" network for pod "virt-launcher-centos7-master-99-qdxxf": networkPlugin cni failed to set up pod "virt-launcher-centos7-master-99-qdxxf_default" network: Multus: [default/virt-launcher-centos7-master-99-qdxxf]: error adding container to network "a-bridge-network": delegateAdd: error invoking DelegateAdd - "bridge": error in getting result from AddNetwork: IPAM plugin returned missing IP config
Warning FailedCreatePodSandBox 40s kubelet, devops-master19 Failed to create pod sandbox: rpc error: code = Unknown desc = failed to set up sandbox container "4bd440fce9339b2b4d3c2319ceafc0fc8c542330632735b126c97c196e73dacf" network for pod "virt-launcher-centos7-master-99-qdxxf": networkPlugin cni failed to set up pod "virt-launcher-centos7-master-99-qdxxf_default" network: Multus: [default/virt-launcher-centos7-master-99-qdxxf]: error adding container to network "a-bridge-network": delegateAdd: error invoking DelegateAdd - "bridge": error in getting result from AddNetwork: IPAM plugin returned missing IP config
Warning FailedCreatePodSandBox 37s kubelet, devops-master19 Failed to create pod sandbox: rpc error: code = Unknown desc = failed to set up sandbox container "384b5bf63af8f24cb057fe150ebbe3f3d17b88a25fa4478b0395b32788da4ec1" network for pod "virt-launcher-centos7-master-99-qdxxf": networkPlugin cni failed to set up pod "virt-launcher-centos7-master-99-qdxxf_default" network: Multus: [default/virt-launcher-centos7-master-99-qdxxf]: error adding container to network "a-bridge-network": delegateAdd: error invoking DelegateAdd - "bridge": error in getting result from AddNetwork: IPAM plugin returned missing IP config
Warning FailedCreatePodSandBox 35s kubelet, devops-master19 Failed to create pod sandbox: rpc error: code = Unknown desc = failed to set up sandbox container "b4b973b65475d2e8d5aac301b877bee26da4ad3319c520f7abf89be18f959701" network for pod "virt-launcher-centos7-master-99-qdxxf": networkPlugin cni failed to set up pod "virt-launcher-centos7-master-99-qdxxf_default" network: Multus: [default/virt-launcher-centos7-master-99-qdxxf]: error adding container to network "a-bridge-network": delegateAdd: error invoking DelegateAdd - "bridge": error in getting result from AddNetwork: IPAM plugin returned missing IP config
Warning FailedCreatePodSandBox 33s kubelet, devops-master19 Failed to create pod sandbox: rpc error: code = Unknown desc = failed to set up sandbox container "4e1a5b2f7f7892985e95d1c31e52226a8cf1a6c35c16d9dcf4941f32ff9e5749" network for pod "virt-launcher-centos7-master-99-qdxxf": networkPlugin cni failed to set up pod "virt-launcher-centos7-master-99-qdxxf_default" network: Multus: [default/virt-launcher-centos7-master-99-qdxxf]: error adding container to network "a-bridge-network": delegateAdd: error invoking DelegateAdd - "bridge": error in getting result from AddNetwork: IPAM plugin returned missing IP config
Warning FailedCreatePodSandBox 31s kubelet, devops-master19 Failed to create pod sandbox: rpc error: code = Unknown desc = failed to set up sandbox container "d7a9a8d19919a4a40ec44693b8a4528294ac88ca4d7eb164172e8802c79fe085" network for pod "virt-launcher-centos7-master-99-qdxxf": networkPlugin cni failed to set up pod "virt-launcher-centos7-master-99-qdxxf_default" network: Multus: [default/virt-launcher-centos7-master-99-qdxxf]: error adding container to network "a-bridge-network": delegateAdd: error invoking DelegateAdd - "bridge": error in getting result from AddNetwork: IPAM plugin returned missing IP config
Warning FailedCreatePodSandBox 29s kubelet, devops-master19 Failed to create pod sandbox: rpc error: code = Unknown desc = failed to set up sandbox container "e6ae625d61d6dd2a1376164975db54863c938848d5fdadfb015710a127eae304" network for pod "virt-launcher-centos7-master-99-qdxxf": networkPlugin cni failed to set up pod "virt-launcher-centos7-master-99-qdxxf_default" network: Multus: [default/virt-launcher-centos7-master-99-qdxxf]: error adding container to network "a-bridge-network": delegateAdd: error invoking DelegateAdd - "bridge": error in getting result from AddNetwork: IPAM plugin returned missing IP config
Warning FailedCreatePodSandBox 26s kubelet, devops-master19 Failed to create pod sandbox: rpc error: code = Unknown desc = failed to set up sandbox container "d7c91a1879a7e29219821ceca9e0b084bfed52fee489a3d32ac9278aa20c18b9" network for pod "virt-launcher-centos7-master-99-qdxxf": networkPlugin cni failed to set up pod "virt-launcher-centos7-master-99-qdxxf_default" network: Multus: [default/virt-launcher-centos7-master-99-qdxxf]: error adding container to network "a-bridge-network": delegateAdd: error invoking DelegateAdd - "bridge": error in getting result from AddNetwork: IPAM plugin returned missing IP config
Warning FailedCreatePodSandBox 24s kubelet, devops-master19 Failed to create pod sandbox: rpc error: code = Unknown desc = failed to set up sandbox container "82191a126b87fa3c470da253c131b4373aeb0f0bd2476efc8d0460dfbce49a33" network for pod "virt-launcher-centos7-master-99-qdxxf": networkPlugin cni failed to set up pod "virt-launcher-centos7-master-99-qdxxf_default" network: Multus: [default/virt-launcher-centos7-master-99-qdxxf]: error adding container to network "a-bridge-network": delegateAdd: error invoking DelegateAdd - "bridge": error in getting result from AddNetwork: IPAM plugin returned missing IP config
Normal SandboxChanged 17s (x12 over 41s) kubelet, devops-master19 Pod sandbox changed, it will be killed and re-created.
Warning FailedCreatePodSandBox 16s (x4 over 22s) kubelet, devops-master19 (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to set up sandbox container "5dae78199e25fadd59332ca2ee6cf469eb34af0ae81a05b489c53a4bb78227a5" network for pod "virt-launcher-centos7-master-99-qdxxf": networkPlugin cni failed to set up pod "virt-launcher-centos7-master-99-qdxxf_default" network: Multus: [default/virt-launcher-centos7-master-99-qdxxf]: error adding container to network "a-bridge-network": delegateAdd: error invoking DelegateAdd - "bridge": error in getting result from AddNetwork: IPAM plugin returned missing IP config
# Manual edit
apiVersion: v1
kind: Pod
metadata:
annotations:
k8s.v1.cni.cncf.io/networks: '[{"interface":"net1","name":"a-bridge-network","namespace":"default"}]'
=>
k8s.v1.cni.cncf.io/networks: '[{"interface":"net1","name":"a-bridge-network","namespace":"default",
"ips": ["192.168.5.6/24"] }]'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment