Skip to content

Instantly share code, notes, and snippets.

@josh-wrale
Last active August 29, 2015 13:56
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save josh-wrale/9101038 to your computer and use it in GitHub Desktop.
Save josh-wrale/9101038 to your computer and use it in GitHub Desktop.
(2014-02-19) Seldon Tests (published)

Test 1

core-n2 -> core-n1 via 802.1q tagging over VLAN 30 (inside cab)

Result

[root@core-n2 ~]# iperf3 -c 10.30.3.1 -i 60 -t 240 
Connecting to host 10.30.3.1, port 5201
[  4] local 10.30.3.2 port 38904 connected to 10.30.3.1 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-60.00  sec  69.1 GBytes  9.90 Gbits/sec    0         
[  4]  60.00-120.00 sec  69.1 GBytes  9.90 Gbits/sec    0         
[  4] 120.00-180.00 sec  69.1 GBytes  9.90 Gbits/sec    0         
[  4] 180.00-240.00 sec  69.1 GBytes  9.90 Gbits/sec    0         
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-240.00 sec   276 GBytes  9.90 Gbits/sec    0         sender
[  4]   0.00-240.00 sec   276 GBytes  9.90 Gbits/sec              receiver

iperf Done.
[root@core-n2 ~]#

9.90 Gbits/sec, 0 Retr

Test 2

core-n6 -> core-n1 via 802.1q tagging over VLAN 30 (cross-cab)

Result

[root@core-n6 ~]# iperf3 -c 10.30.3.1 -i 60 -t 240
Connecting to host 10.30.3.1, port 5201
[  4] local 10.30.3.6 port 56116 connected to 10.30.3.1 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-60.00  sec  69.1 GBytes  9.90 Gbits/sec    0         
[  4]  60.00-120.00 sec  69.1 GBytes  9.90 Gbits/sec    0         
[  4] 120.00-180.00 sec  69.1 GBytes  9.90 Gbits/sec    0         
[  4] 180.00-240.00 sec  69.1 GBytes  9.90 Gbits/sec    0         
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-240.00 sec   276 GBytes  9.90 Gbits/sec    0         sender
[  4]   0.00-240.00 sec   276 GBytes  9.90 Gbits/sec              receiver

iperf Done.
[root@core-n6 ~]# 

9.90 Gbits/sec, 0 Retr

Test 3

core-n6 -> core-n3 via 802.1q tagging over VLAN 30 (cross-cab)

(WHILE)

core-n6 -> core-n3 via 802.1q tagging over VLAN 30 (cross-cab)

Result

[root@core-n6 ~]# iperf3 -c 10.30.3.3 -i 60 -t 240 -p 20030
Connecting to host 10.30.3.3, port 20030
[  4] local 10.30.3.6 port 46385 connected to 10.30.3.3 port 20030
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-60.00  sec  34.3 GBytes  4.91 Gbits/sec   19         
[  4]  60.00-120.00 sec  33.8 GBytes  4.84 Gbits/sec    7         
[  4] 120.00-180.00 sec  34.1 GBytes  4.88 Gbits/sec    1         
[  4] 180.00-240.00 sec  34.4 GBytes  4.92 Gbits/sec    0         
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-240.00 sec   137 GBytes  4.89 Gbits/sec   27         sender
[  4]   0.00-240.00 sec   137 GBytes  4.89 Gbits/sec              receiver

iperf Done.
[root@core-n6 ~]# 

(WHILE)

[root@core-n6 ~]# iperf3 -c 10.30.3.3 -i 60 -t 240 -p 20040
Connecting to host 10.30.3.3, port 20040
[  4] local 10.30.3.6 port 45891 connected to 10.30.3.3 port 20040
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-60.00  sec  34.8 GBytes  4.99 Gbits/sec   14         
[  4]  60.00-120.00 sec  35.3 GBytes  5.06 Gbits/sec    0         
[  4] 120.00-180.00 sec  35.0 GBytes  5.01 Gbits/sec    0         
[  4] 180.00-240.00 sec  34.7 GBytes  4.97 Gbits/sec    3         
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-240.00 sec   140 GBytes  5.01 Gbits/sec   17         sender
[  4]   0.00-240.00 sec   140 GBytes  5.01 Gbits/sec              receiver

iperf Done.
[root@core-n6 ~]# 

4.89 Gbits/sec + 5.01 Gbits/sec = 9.90 Gbits/sec, 40 Retr

Test 4

core-n6 -> core-n3 via 802.1q tagging over VLAN 30 (cross-cab)

(WHILE)

core-n6 -> core-n3 via 802.1q tagging over VLAN 40 (cross-cab)

Result

[root@core-n6 ~]# iperf3 -c 10.30.3.5 -i 60 -t 240 -p 20030
Connecting to host 10.30.3.5, port 20030
[  4] local 10.30.3.6 port 58023 connected to 10.30.3.5 port 20030
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-60.00  sec  34.1 GBytes  4.89 Gbits/sec   21         
[  4]  60.00-120.00 sec  34.6 GBytes  4.95 Gbits/sec    0         
[  4] 120.00-180.00 sec  34.6 GBytes  4.95 Gbits/sec    0         
[  4] 180.00-240.00 sec  34.7 GBytes  4.97 Gbits/sec    0         
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-240.00 sec   138 GBytes  4.94 Gbits/sec   21         sender
[  4]   0.00-240.00 sec   138 GBytes  4.94 Gbits/sec              receiver

iperf Done.
[root@core-n6 ~]# 

(WHILE)

[root@core-n6 ~]# iperf3 -c 10.40.3.5 -i 60 -t 240 -p 20040
Connecting to host 10.40.3.5, port 20040
[  4] local 10.40.3.6 port 35338 connected to 10.40.3.5 port 20040
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-60.00  sec  35.0 GBytes  5.01 Gbits/sec    7         
[  4]  60.00-120.00 sec  34.6 GBytes  4.95 Gbits/sec    0         
[  4] 120.00-180.00 sec  34.5 GBytes  4.95 Gbits/sec    0         
[  4] 180.00-240.00 sec  34.4 GBytes  4.92 Gbits/sec    9         
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-240.00 sec   138 GBytes  4.96 Gbits/sec   16         sender
[  4]   0.00-240.00 sec   138 GBytes  4.96 Gbits/sec              receiver

iperf Done.
[root@core-n6 ~]#

4.94 Gbits/sec + 4.96 Gbits/sec = 9.90 Gbits/sec, 37 Retr

[root@core-n5 ~]# sar 1 240

                CPU     %user     %nice   %system   %iowait    %steal     %idle
(shortened output)
Average:        all      0.03      0.00      0.97      0.00      0.00     99.00
[root@core-n5 ~]# 

(WHILE)

[root@core-n6 ~]# sar 1 240
                CPU     %user     %nice   %system   %iowait    %steal     %idle
(shortened output)
Average:        all      0.01      0.00      0.89      0.00      0.00     99.10
[root@core-n6 ~]#

Test 5

core-n6 -> core-n5 via pre-VLAN-tagged SR-IOV virtual function over VLAN 30 (inside cab)

  • normal CentOS 6.5 kernel

Result

[root@core-n6 network-scripts]# iperf3 -c 10.30.3.105 -i 60 -t 240
Connecting to host 10.30.3.105, port 5201
[  4] local 10.30.3.106 port 42986 connected to 10.30.3.105 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-60.00  sec  69.1 GBytes  9.90 Gbits/sec    0         
[  4]  60.00-120.00 sec  69.1 GBytes  9.90 Gbits/sec    0         
[  4] 120.00-180.00 sec  69.1 GBytes  9.90 Gbits/sec    0         
[  4] 180.00-240.00 sec  69.1 GBytes  9.90 Gbits/sec    0         
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-240.00 sec   276 GBytes  9.90 Gbits/sec    0         sender
[  4]   0.00-240.00 sec   276 GBytes  9.90 Gbits/sec              receiver

iperf Done.
[root@core-n6 network-scripts]# 

9.90 Gbits/sec, 0 Retr

Test 6

core-n6 -> core-n5 via pre-VLAN-tagged SR-IOV virtual function over VLAN 30 (inside cab), rate limited to 4000Mbits/sec

(WHILE)

core-n6 -> core-n5 via pre-VLAN-tagged SR-IOV virtual function over VLAN 40 (inside cab), rate limited to 6000Mbits/sec

  • normal CentOS 6.5 kernel

Result

[root@core-n6 ~]# iperf3 -c 10.30.3.105 -i 60 -t 240 -p 20030
Connecting to host 10.30.3.105, port 20030
[  4] local 10.30.3.106 port 57041 connected to 10.30.3.105 port 20030
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-60.00  sec  27.7 GBytes  3.97 Gbits/sec    0         
[  4]  60.00-120.00 sec  27.7 GBytes  3.97 Gbits/sec    0         
[  4] 120.00-180.00 sec  27.7 GBytes  3.97 Gbits/sec    0         
[  4] 180.00-240.00 sec  27.7 GBytes  3.97 Gbits/sec    0         
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-240.00 sec   111 GBytes  3.97 Gbits/sec    0         sender
[  4]   0.00-240.00 sec   111 GBytes  3.97 Gbits/sec              receiver

iperf Done.
[root@core-n6 ~]# 

(WHILE)

[root@core-n6 ~]# iperf3 -c 10.40.3.105 -i 60 -t 240 -p 20040
Connecting to host 10.40.3.105, port 20040
[  4] local 10.40.3.106 port 41657 connected to 10.40.3.105 port 20040
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-60.00  sec  41.4 GBytes  5.93 Gbits/sec    0         
[  4]  60.00-120.00 sec  41.4 GBytes  5.93 Gbits/sec    0         
[  4] 120.00-180.00 sec  41.4 GBytes  5.93 Gbits/sec    0         
[  4] 180.00-240.00 sec  41.4 GBytes  5.93 Gbits/sec    0         
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-240.00 sec   166 GBytes  5.93 Gbits/sec    0         sender
[  4]   0.00-240.00 sec   166 GBytes  5.93 Gbits/sec              receiver

iperf Done.
[root@core-n6 ~]# 

3.97 Gbits/sec + 5.93 Gbits/sec = 9.90 Gbits/sec, 0 Retr

Test 7

core-n6 -> core-n5 via pre-VLAN-tagged SR-IOV virtual function over VLAN 30 (inside cab), rate limited to 5000Mbits/sec

(WHILE)

core-n6 -> core-n5 via pre-VLAN-tagged SR-IOV virtual function over VLAN 40 (inside cab), rate limited to 5000Mbits/sec

  • normal CentOS 6.5 kernel

Result

[root@core-n6 ~]# iperf3 -c 10.30.3.105 -i 60 -t 240 -p 20030
Connecting to host 10.30.3.105, port 20030
[  4] local 10.30.3.106 port 57044 connected to 10.30.3.105 port 20030
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-60.00  sec  34.6 GBytes  4.95 Gbits/sec    0         
[  4]  60.00-120.00 sec  34.6 GBytes  4.95 Gbits/sec    0         
[  4] 120.00-180.00 sec  34.6 GBytes  4.95 Gbits/sec    0         
[  4] 180.00-240.00 sec  34.6 GBytes  4.95 Gbits/sec    0         
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-240.00 sec   138 GBytes  4.95 Gbits/sec    0         sender
[  4]   0.00-240.00 sec   138 GBytes  4.95 Gbits/sec              receiver

iperf Done.
[root@core-n6 ~]# 

(WHILE)

[root@core-n6 ~]# iperf3 -c 10.40.3.105 -i 60 -t 240 -p 20040
Connecting to host 10.40.3.105, port 20040
[  4] local 10.40.3.106 port 41662 connected to 10.40.3.105 port 20040
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-60.00  sec  34.6 GBytes  4.95 Gbits/sec    0         
[  4]  60.00-120.00 sec  34.6 GBytes  4.95 Gbits/sec    0         
[  4] 120.00-180.00 sec  34.6 GBytes  4.95 Gbits/sec    0         
[  4] 180.00-240.00 sec  34.6 GBytes  4.95 Gbits/sec    0         
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-240.00 sec   138 GBytes  4.95 Gbits/sec    0         sender
[  4]   0.00-240.00 sec   138 GBytes  4.95 Gbits/sec              receiver

iperf Done.
[root@core-n6 ~]#

4.95 Gbits/sec + 4.95 Gbits/sec = 9.90 Gbits/sec, 0 Retr

Test 8

core-n6 -> core-n5 via pre-VLAN-tagged SR-IOV virtual function over VLAN 30 (inside cab), no manual rate limiting

(WHILE)

core-n6 -> core-n5 via pre-VLAN-tagged SR-IOV virtual function over VLAN 40 (inside cab), no manual rate limiting

  • normal CentOS 6.5 kernel

Result

[root@core-n6 ~]# iperf3 -c 10.30.3.105 -i 60 -t 240 -p 20030
Connecting to host 10.30.3.105, port 20030
[  4] local 10.30.3.106 port 57049 connected to 10.30.3.105 port 20030
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-60.00  sec  34.6 GBytes  4.95 Gbits/sec    0         
[  4]  60.00-120.00 sec  34.6 GBytes  4.95 Gbits/sec    0         
[  4] 120.00-180.00 sec  34.6 GBytes  4.95 Gbits/sec    0         
[  4] 180.00-240.00 sec  34.6 GBytes  4.95 Gbits/sec    0         
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-240.00 sec   138 GBytes  4.95 Gbits/sec    0         sender
[  4]   0.00-240.00 sec   138 GBytes  4.95 Gbits/sec              receiver

iperf Done.
[root@core-n6 ~]# 

(WHILE)

[root@core-n6 ~]# iperf3 -c 10.40.3.105 -i 60 -t 240 -p 20040
Connecting to host 10.40.3.105, port 20040
[  4] local 10.40.3.106 port 41665 connected to 10.40.3.105 port 20040
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-60.00  sec  34.6 GBytes  4.95 Gbits/sec    0         
[  4]  60.00-120.00 sec  34.6 GBytes  4.95 Gbits/sec    0         
[  4] 120.00-180.00 sec  34.6 GBytes  4.95 Gbits/sec    0         
[  4] 180.00-240.00 sec  34.6 GBytes  4.95 Gbits/sec    0         
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-240.00 sec   138 GBytes  4.95 Gbits/sec    0         sender
[  4]   0.00-240.00 sec   138 GBytes  4.95 Gbits/sec              receiver

iperf Done.
[root@core-n6 ~]# 

4.95 Gbits/sec + 4.95 Gbits/sec = 9.90 Gbits/sec, 0 Retr

[root@core-n5 ~]# sar 1 240

                CPU     %user     %nice   %system   %iowait    %steal     %idle
(shortened output)
Average:        all      0.04      0.00      1.20      0.00      0.00     98.75
[root@core-n5 ~]# 

(WHILE)

[root@core-n6 ~]# sar 1 240
                CPU     %user     %nice   %system   %iowait    %steal     %idle
(shortened output)
Average:        all      0.01      0.00      0.92      0.00      0.00     99.07
[root@core-n6 ~]#

Links

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment