core-n2 -> core-n1 via 802.1q tagging over VLAN 30 (inside cab)
[root@core-n2 ~]# iperf3 -c 10.30.3.1 -i 60 -t 240
Connecting to host 10.30.3.1, port 5201
[ 4] local 10.30.3.2 port 38904 connected to 10.30.3.1 port 5201
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-60.00 sec 69.1 GBytes 9.90 Gbits/sec 0
[ 4] 60.00-120.00 sec 69.1 GBytes 9.90 Gbits/sec 0
[ 4] 120.00-180.00 sec 69.1 GBytes 9.90 Gbits/sec 0
[ 4] 180.00-240.00 sec 69.1 GBytes 9.90 Gbits/sec 0
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-240.00 sec 276 GBytes 9.90 Gbits/sec 0 sender
[ 4] 0.00-240.00 sec 276 GBytes 9.90 Gbits/sec receiver
iperf Done.
[root@core-n2 ~]#
9.90 Gbits/sec, 0 Retr
core-n6 -> core-n1 via 802.1q tagging over VLAN 30 (cross-cab)
[root@core-n6 ~]# iperf3 -c 10.30.3.1 -i 60 -t 240
Connecting to host 10.30.3.1, port 5201
[ 4] local 10.30.3.6 port 56116 connected to 10.30.3.1 port 5201
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-60.00 sec 69.1 GBytes 9.90 Gbits/sec 0
[ 4] 60.00-120.00 sec 69.1 GBytes 9.90 Gbits/sec 0
[ 4] 120.00-180.00 sec 69.1 GBytes 9.90 Gbits/sec 0
[ 4] 180.00-240.00 sec 69.1 GBytes 9.90 Gbits/sec 0
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-240.00 sec 276 GBytes 9.90 Gbits/sec 0 sender
[ 4] 0.00-240.00 sec 276 GBytes 9.90 Gbits/sec receiver
iperf Done.
[root@core-n6 ~]#
9.90 Gbits/sec, 0 Retr
core-n6 -> core-n3 via 802.1q tagging over VLAN 30 (cross-cab)
(WHILE)
core-n6 -> core-n3 via 802.1q tagging over VLAN 30 (cross-cab)
[root@core-n6 ~]# iperf3 -c 10.30.3.3 -i 60 -t 240 -p 20030
Connecting to host 10.30.3.3, port 20030
[ 4] local 10.30.3.6 port 46385 connected to 10.30.3.3 port 20030
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-60.00 sec 34.3 GBytes 4.91 Gbits/sec 19
[ 4] 60.00-120.00 sec 33.8 GBytes 4.84 Gbits/sec 7
[ 4] 120.00-180.00 sec 34.1 GBytes 4.88 Gbits/sec 1
[ 4] 180.00-240.00 sec 34.4 GBytes 4.92 Gbits/sec 0
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-240.00 sec 137 GBytes 4.89 Gbits/sec 27 sender
[ 4] 0.00-240.00 sec 137 GBytes 4.89 Gbits/sec receiver
iperf Done.
[root@core-n6 ~]#
(WHILE)
[root@core-n6 ~]# iperf3 -c 10.30.3.3 -i 60 -t 240 -p 20040
Connecting to host 10.30.3.3, port 20040
[ 4] local 10.30.3.6 port 45891 connected to 10.30.3.3 port 20040
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-60.00 sec 34.8 GBytes 4.99 Gbits/sec 14
[ 4] 60.00-120.00 sec 35.3 GBytes 5.06 Gbits/sec 0
[ 4] 120.00-180.00 sec 35.0 GBytes 5.01 Gbits/sec 0
[ 4] 180.00-240.00 sec 34.7 GBytes 4.97 Gbits/sec 3
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-240.00 sec 140 GBytes 5.01 Gbits/sec 17 sender
[ 4] 0.00-240.00 sec 140 GBytes 5.01 Gbits/sec receiver
iperf Done.
[root@core-n6 ~]#
4.89 Gbits/sec + 5.01 Gbits/sec = 9.90 Gbits/sec, 40 Retr
core-n6 -> core-n3 via 802.1q tagging over VLAN 30 (cross-cab)
(WHILE)
core-n6 -> core-n3 via 802.1q tagging over VLAN 40 (cross-cab)
[root@core-n6 ~]# iperf3 -c 10.30.3.5 -i 60 -t 240 -p 20030
Connecting to host 10.30.3.5, port 20030
[ 4] local 10.30.3.6 port 58023 connected to 10.30.3.5 port 20030
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-60.00 sec 34.1 GBytes 4.89 Gbits/sec 21
[ 4] 60.00-120.00 sec 34.6 GBytes 4.95 Gbits/sec 0
[ 4] 120.00-180.00 sec 34.6 GBytes 4.95 Gbits/sec 0
[ 4] 180.00-240.00 sec 34.7 GBytes 4.97 Gbits/sec 0
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-240.00 sec 138 GBytes 4.94 Gbits/sec 21 sender
[ 4] 0.00-240.00 sec 138 GBytes 4.94 Gbits/sec receiver
iperf Done.
[root@core-n6 ~]#
(WHILE)
[root@core-n6 ~]# iperf3 -c 10.40.3.5 -i 60 -t 240 -p 20040
Connecting to host 10.40.3.5, port 20040
[ 4] local 10.40.3.6 port 35338 connected to 10.40.3.5 port 20040
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-60.00 sec 35.0 GBytes 5.01 Gbits/sec 7
[ 4] 60.00-120.00 sec 34.6 GBytes 4.95 Gbits/sec 0
[ 4] 120.00-180.00 sec 34.5 GBytes 4.95 Gbits/sec 0
[ 4] 180.00-240.00 sec 34.4 GBytes 4.92 Gbits/sec 9
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-240.00 sec 138 GBytes 4.96 Gbits/sec 16 sender
[ 4] 0.00-240.00 sec 138 GBytes 4.96 Gbits/sec receiver
iperf Done.
[root@core-n6 ~]#
4.94 Gbits/sec + 4.96 Gbits/sec = 9.90 Gbits/sec, 37 Retr
[root@core-n5 ~]# sar 1 240
CPU %user %nice %system %iowait %steal %idle
(shortened output)
Average: all 0.03 0.00 0.97 0.00 0.00 99.00
[root@core-n5 ~]#
(WHILE)
[root@core-n6 ~]# sar 1 240
CPU %user %nice %system %iowait %steal %idle
(shortened output)
Average: all 0.01 0.00 0.89 0.00 0.00 99.10
[root@core-n6 ~]#
core-n6 -> core-n5 via pre-VLAN-tagged SR-IOV virtual function over VLAN 30 (inside cab)
- normal CentOS 6.5 kernel
[root@core-n6 network-scripts]# iperf3 -c 10.30.3.105 -i 60 -t 240
Connecting to host 10.30.3.105, port 5201
[ 4] local 10.30.3.106 port 42986 connected to 10.30.3.105 port 5201
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-60.00 sec 69.1 GBytes 9.90 Gbits/sec 0
[ 4] 60.00-120.00 sec 69.1 GBytes 9.90 Gbits/sec 0
[ 4] 120.00-180.00 sec 69.1 GBytes 9.90 Gbits/sec 0
[ 4] 180.00-240.00 sec 69.1 GBytes 9.90 Gbits/sec 0
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-240.00 sec 276 GBytes 9.90 Gbits/sec 0 sender
[ 4] 0.00-240.00 sec 276 GBytes 9.90 Gbits/sec receiver
iperf Done.
[root@core-n6 network-scripts]#
9.90 Gbits/sec, 0 Retr
core-n6 -> core-n5 via pre-VLAN-tagged SR-IOV virtual function over VLAN 30 (inside cab), rate limited to 4000Mbits/sec
(WHILE)
core-n6 -> core-n5 via pre-VLAN-tagged SR-IOV virtual function over VLAN 40 (inside cab), rate limited to 6000Mbits/sec
- normal CentOS 6.5 kernel
[root@core-n6 ~]# iperf3 -c 10.30.3.105 -i 60 -t 240 -p 20030
Connecting to host 10.30.3.105, port 20030
[ 4] local 10.30.3.106 port 57041 connected to 10.30.3.105 port 20030
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-60.00 sec 27.7 GBytes 3.97 Gbits/sec 0
[ 4] 60.00-120.00 sec 27.7 GBytes 3.97 Gbits/sec 0
[ 4] 120.00-180.00 sec 27.7 GBytes 3.97 Gbits/sec 0
[ 4] 180.00-240.00 sec 27.7 GBytes 3.97 Gbits/sec 0
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-240.00 sec 111 GBytes 3.97 Gbits/sec 0 sender
[ 4] 0.00-240.00 sec 111 GBytes 3.97 Gbits/sec receiver
iperf Done.
[root@core-n6 ~]#
(WHILE)
[root@core-n6 ~]# iperf3 -c 10.40.3.105 -i 60 -t 240 -p 20040
Connecting to host 10.40.3.105, port 20040
[ 4] local 10.40.3.106 port 41657 connected to 10.40.3.105 port 20040
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-60.00 sec 41.4 GBytes 5.93 Gbits/sec 0
[ 4] 60.00-120.00 sec 41.4 GBytes 5.93 Gbits/sec 0
[ 4] 120.00-180.00 sec 41.4 GBytes 5.93 Gbits/sec 0
[ 4] 180.00-240.00 sec 41.4 GBytes 5.93 Gbits/sec 0
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-240.00 sec 166 GBytes 5.93 Gbits/sec 0 sender
[ 4] 0.00-240.00 sec 166 GBytes 5.93 Gbits/sec receiver
iperf Done.
[root@core-n6 ~]#
3.97 Gbits/sec + 5.93 Gbits/sec = 9.90 Gbits/sec, 0 Retr
core-n6 -> core-n5 via pre-VLAN-tagged SR-IOV virtual function over VLAN 30 (inside cab), rate limited to 5000Mbits/sec
(WHILE)
core-n6 -> core-n5 via pre-VLAN-tagged SR-IOV virtual function over VLAN 40 (inside cab), rate limited to 5000Mbits/sec
- normal CentOS 6.5 kernel
[root@core-n6 ~]# iperf3 -c 10.30.3.105 -i 60 -t 240 -p 20030
Connecting to host 10.30.3.105, port 20030
[ 4] local 10.30.3.106 port 57044 connected to 10.30.3.105 port 20030
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-60.00 sec 34.6 GBytes 4.95 Gbits/sec 0
[ 4] 60.00-120.00 sec 34.6 GBytes 4.95 Gbits/sec 0
[ 4] 120.00-180.00 sec 34.6 GBytes 4.95 Gbits/sec 0
[ 4] 180.00-240.00 sec 34.6 GBytes 4.95 Gbits/sec 0
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-240.00 sec 138 GBytes 4.95 Gbits/sec 0 sender
[ 4] 0.00-240.00 sec 138 GBytes 4.95 Gbits/sec receiver
iperf Done.
[root@core-n6 ~]#
(WHILE)
[root@core-n6 ~]# iperf3 -c 10.40.3.105 -i 60 -t 240 -p 20040
Connecting to host 10.40.3.105, port 20040
[ 4] local 10.40.3.106 port 41662 connected to 10.40.3.105 port 20040
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-60.00 sec 34.6 GBytes 4.95 Gbits/sec 0
[ 4] 60.00-120.00 sec 34.6 GBytes 4.95 Gbits/sec 0
[ 4] 120.00-180.00 sec 34.6 GBytes 4.95 Gbits/sec 0
[ 4] 180.00-240.00 sec 34.6 GBytes 4.95 Gbits/sec 0
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-240.00 sec 138 GBytes 4.95 Gbits/sec 0 sender
[ 4] 0.00-240.00 sec 138 GBytes 4.95 Gbits/sec receiver
iperf Done.
[root@core-n6 ~]#
4.95 Gbits/sec + 4.95 Gbits/sec = 9.90 Gbits/sec, 0 Retr
core-n6 -> core-n5 via pre-VLAN-tagged SR-IOV virtual function over VLAN 30 (inside cab), no manual rate limiting
(WHILE)
core-n6 -> core-n5 via pre-VLAN-tagged SR-IOV virtual function over VLAN 40 (inside cab), no manual rate limiting
- normal CentOS 6.5 kernel
[root@core-n6 ~]# iperf3 -c 10.30.3.105 -i 60 -t 240 -p 20030
Connecting to host 10.30.3.105, port 20030
[ 4] local 10.30.3.106 port 57049 connected to 10.30.3.105 port 20030
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-60.00 sec 34.6 GBytes 4.95 Gbits/sec 0
[ 4] 60.00-120.00 sec 34.6 GBytes 4.95 Gbits/sec 0
[ 4] 120.00-180.00 sec 34.6 GBytes 4.95 Gbits/sec 0
[ 4] 180.00-240.00 sec 34.6 GBytes 4.95 Gbits/sec 0
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-240.00 sec 138 GBytes 4.95 Gbits/sec 0 sender
[ 4] 0.00-240.00 sec 138 GBytes 4.95 Gbits/sec receiver
iperf Done.
[root@core-n6 ~]#
(WHILE)
[root@core-n6 ~]# iperf3 -c 10.40.3.105 -i 60 -t 240 -p 20040
Connecting to host 10.40.3.105, port 20040
[ 4] local 10.40.3.106 port 41665 connected to 10.40.3.105 port 20040
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-60.00 sec 34.6 GBytes 4.95 Gbits/sec 0
[ 4] 60.00-120.00 sec 34.6 GBytes 4.95 Gbits/sec 0
[ 4] 120.00-180.00 sec 34.6 GBytes 4.95 Gbits/sec 0
[ 4] 180.00-240.00 sec 34.6 GBytes 4.95 Gbits/sec 0
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-240.00 sec 138 GBytes 4.95 Gbits/sec 0 sender
[ 4] 0.00-240.00 sec 138 GBytes 4.95 Gbits/sec receiver
iperf Done.
[root@core-n6 ~]#
4.95 Gbits/sec + 4.95 Gbits/sec = 9.90 Gbits/sec, 0 Retr
[root@core-n5 ~]# sar 1 240
CPU %user %nice %system %iowait %steal %idle
(shortened output)
Average: all 0.04 0.00 1.20 0.00 0.00 98.75
[root@core-n5 ~]#
(WHILE)
[root@core-n6 ~]# sar 1 240
CPU %user %nice %system %iowait %steal %idle
(shortened output)
Average: all 0.01 0.00 0.92 0.00 0.00 99.07
[root@core-n6 ~]#