Skip to content

Instantly share code, notes, and snippets.

@krsna1729

krsna1729/pod-networking.md

Last active December 3, 2019 03:56
Show Gist options
  • Save krsna1729/4185186fcc08037e49b68bf582cdcbc7 to your computer and use it in GitHub Desktop.
Save krsna1729/4185186fcc08037e49b68bf582cdcbc7 to your computer and use it in GitHub Desktop.
Download ZIP
canal calico cilium
Raw
pod-networking.md

Pods

stack@s2rf6n5:~/kind-clusters/cni-test$ for i in calico canal cilium; do echo $i; kubectl --context kind-$i get pods -owide; done
calico
NAME      READY   STATUS    RESTARTS   AGE     IP             NODE            NOMINATED NODE   READINESS GATES
busybox   1/1     Running   0          3m40s   10.244.9.131   calico-worker   <none>           <none>
canal
NAME      READY   STATUS    RESTARTS   AGE     IP           NODE            NOMINATED NODE   READINESS GATES
busybox   1/1     Running   0          3m40s   10.244.1.3   canal-worker2   <none>           <none>
cilium
NAME      READY   STATUS    RESTARTS   AGE     IP             NODE             NOMINATED NODE   READINESS GATES
busybox   1/1     Running   0          3m39s   10.244.2.182   cilium-worker2   <none>           <none>

Calico

Pod

stack@s2rf6n5:~/kind-clusters/cni-test$ kubectl --context kind-calico exec busybox -- sh -c "ip a; echo; ip route; echo; ip neigh"
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: tunl0@NONE: <NOARP> mtu 1480 qdisc noop qlen 1000
    link/ipip 0.0.0.0 brd 0.0.0.0
4: eth0@if6: <BROADCAST,MULTICAST,UP,LOWER_UP,M-DOWN> mtu 1440 qdisc noqueue
    link/ether 02:a6:c7:c0:f0:b0 brd ff:ff:ff:ff:ff:ff
    inet 10.244.9.131/32 scope global eth0
       valid_lft forever preferred_lft forever
    inet6 fe80::a6:c7ff:fec0:f0b0/64 scope link
       valid_lft forever preferred_lft forever

default via 169.254.1.1 dev eth0
169.254.1.1 dev eth0 scope link

Host

stack@s2rf6n5:~/kind-clusters/cni-test$ docker exec calico-worker sh -c "ip a; echo; ip route; echo; ip neigh"
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
2: tunl0@NONE: <NOARP,UP,LOWER_UP> mtu 1440 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ipip 0.0.0.0 brd 0.0.0.0
    inet 10.244.9.128/32 brd 10.244.9.128 scope global tunl0
       valid_lft forever preferred_lft forever
3: cali63763105010@if4: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netns cni-e1e669ee-fa09-382a-a54f-dfcff14dc684
5: calia9dcbeea99d@if4: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netns cni-ce309516-6435-ac9d-287c-8849d2d18f2d
6: cali12d4a061371@if4: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netns cni-33674786-c22b-0114-8f2c-ab4fe48bd03d
12057: eth0@if12058: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default
    link/ether 02:42:ac:11:00:04 brd ff:ff:ff:ff:ff:ff link-netnsid 0
    inet 172.17.0.4/16 brd 172.17.255.255 scope global eth0
       valid_lft forever preferred_lft forever

default via 172.17.0.1 dev eth0
blackhole 10.244.9.128/26 proto bird
10.244.9.129 dev cali63763105010 scope link
10.244.9.130 dev calia9dcbeea99d scope link
10.244.9.131 dev cali12d4a061371 scope link
10.244.71.0/26 via 172.17.0.2 dev tunl0 proto bird onlink
10.244.88.0/26 via 172.17.0.3 dev tunl0 proto bird onlink
172.17.0.0/16 dev eth0 proto kernel scope link src 172.17.0.4

10.244.9.129 dev cali63763105010 lladdr 72:fb:a5:b9:64:9d REACHABLE
10.244.9.130 dev calia9dcbeea99d lladdr 1a:02:c1:51:2a:e4 REACHABLE
172.17.0.1 dev eth0 lladdr 02:42:ee:12:aa:fc STALE
172.17.0.2 dev eth0 lladdr 02:42:ac:11:00:02 REACHABLE
172.17.0.3 dev eth0 lladdr 02:42:ac:11:00:03 REACHABLE

Canal

Pod

stack@s2rf6n5:~/kind-clusters/cni-test$ kubectl --context kind-canal exec busybox -- sh -c "ip a; echo; ip route; echo; ip neigh"
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: tunl0@NONE: <NOARP> mtu 1480 qdisc noop qlen 1000
    link/ipip 0.0.0.0 brd 0.0.0.0
4: eth0@if3: <BROADCAST,MULTICAST,UP,LOWER_UP,M-DOWN> mtu 1500 qdisc noqueue
    link/ether ae:9f:b5:8e:17:dd brd ff:ff:ff:ff:ff:ff
    inet 10.244.1.3/32 scope global eth0
       valid_lft forever preferred_lft forever
    inet6 fe80::ac9f:b5ff:fe8e:17dd/64 scope link
       valid_lft forever preferred_lft forever

default via 169.254.1.1 dev eth0
169.254.1.1 dev eth0 scope link

Host

stack@s2rf6n5:~/kind-clusters/cni-test$ docker exec canal-worker2 sh -c "ip a; echo; ip route; echo; ip neigh"
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
2: tunl0@NONE: <NOARP> mtu 1480 qdisc noop state DOWN group default qlen 1000
    link/ipip 0.0.0.0 brd 0.0.0.0
3: cali12d4a061371@if4: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netns cni-5b2b9b22-c627-0fcc-ad79-aee3ba38a7eb
5: flannel.1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc noqueue state UNKNOWN group default
    link/ether 8a:c9:47:05:76:cf brd ff:ff:ff:ff:ff:ff
    inet 10.244.1.0/32 scope global flannel.1
       valid_lft forever preferred_lft forever
12065: eth0@if12066: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default
    link/ether 02:42:ac:11:00:07 brd ff:ff:ff:ff:ff:ff link-netnsid 0
    inet 172.17.0.7/16 brd 172.17.255.255 scope global eth0
       valid_lft forever preferred_lft forever

default via 172.17.0.1 dev eth0
10.244.0.0/24 via 10.244.0.0 dev flannel.1 onlink
10.244.1.3 dev cali12d4a061371 scope link
10.244.2.0/24 via 10.244.2.0 dev flannel.1 onlink
172.17.0.0/16 dev eth0 proto kernel scope link src 172.17.0.7

10.244.0.0 dev flannel.1 lladdr f2:9d:86:56:0f:8a PERMANENT
172.17.0.1 dev eth0 lladdr 02:42:ee:12:aa:fc STALE
172.17.0.6 dev eth0 lladdr 02:42:ac:11:00:06 REACHABLE
10.244.2.0 dev flannel.1 lladdr 8a:ad:e0:68:74:6e PERMANENT

Cilium

Pod

stack@s2rf6n5:~/kind-clusters/cni-test$ kubectl --context kind-cilium exec busybox -- sh -c "ip a; echo; ip route; echo; ip neigh"
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: tunl0@NONE: <NOARP> mtu 1480 qdisc noop qlen 1000
    link/ipip 0.0.0.0 brd 0.0.0.0
12: eth0@if13: <BROADCAST,MULTICAST,UP,LOWER_UP,M-DOWN> mtu 1500 qdisc noqueue
    link/ether ca:47:90:dd:a3:b2 brd ff:ff:ff:ff:ff:ff
    inet 10.244.2.182/32 brd 10.244.2.182 scope global eth0
       valid_lft forever preferred_lft forever
    inet6 fe80::c847:90ff:fedd:a3b2/64 scope link
       valid_lft forever preferred_lft forever

default via 10.244.2.208 dev eth0
10.244.2.208 dev eth0 scope link

Host

stack@s2rf6n5:~/kind-clusters/cni-test$ docker exec cilium-worker2 sh -c "ip a; echo; ip route; echo; ip neigh"
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
2: tunl0@NONE: <NOARP> mtu 1480 qdisc noop state DOWN group default qlen 1000
    link/ipip 0.0.0.0 brd 0.0.0.0
3: cilium_net@cilium_host: <BROADCAST,MULTICAST,NOARP,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 6a:3a:36:9b:0a:06 brd ff:ff:ff:ff:ff:ff
4: cilium_host@cilium_net: <BROADCAST,MULTICAST,NOARP,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 7a:11:21:c0:1b:cf brd ff:ff:ff:ff:ff:ff
    inet 10.244.2.208/32 scope link cilium_host
       valid_lft forever preferred_lft forever
5: cilium_vxlan: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether 9a:ea:fd:2c:cb:12 brd ff:ff:ff:ff:ff:ff
7: lxc_health@if6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether fa:65:71:38:71:ed brd ff:ff:ff:ff:ff:ff link-netnsid 1
9: lxcd33e03202dc6@if8: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 66:70:11:e3:c4:c6 brd ff:ff:ff:ff:ff:ff link-netns cni-8403503f-25e9-bd5e-89c7-d216e7b135b2
11: lxc012dd33a331d@if10: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether de:03:e9:b8:67:37 brd ff:ff:ff:ff:ff:ff link-netns cni-21833277-483d-3235-b51c-819073476ac4
13: lxc4aea3e39103d@if12: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether ae:40:6e:7b:a8:21 brd ff:ff:ff:ff:ff:ff link-netns cni-27c1ed74-55c2-839c-556d-a0a5f3118cca
12071: eth0@if12072: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default
    link/ether 02:42:ac:11:00:08 brd ff:ff:ff:ff:ff:ff link-netnsid 0
    inet 172.17.0.8/16 brd 172.17.255.255 scope global eth0
       valid_lft forever preferred_lft forever

default via 172.17.0.1 dev eth0
10.244.0.0/24 via 10.244.2.208 dev cilium_host src 10.244.2.208 mtu 1450
10.244.1.0/24 via 10.244.2.208 dev cilium_host src 10.244.2.208 mtu 1450
10.244.2.0/24 via 10.244.2.208 dev cilium_host src 10.244.2.208 mtu 1450
10.244.2.208 dev cilium_host scope link
172.17.0.0/16 dev eth0 proto kernel scope link src 172.17.0.8

172.17.0.9 dev eth0 lladdr 02:42:ac:11:00:09 REACHABLE
172.17.0.10 dev eth0 lladdr 02:42:ac:11:00:0a DELAY
172.17.0.1 dev eth0 lladdr 02:42:ee:12:aa:fc STALE
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment