Skip to content

Instantly share code, notes, and snippets.

@hiroyuki-sato
Last active August 29, 2015 13:57
Show Gist options
  • Save hiroyuki-sato/9442541 to your computer and use it in GitHub Desktop.
Save hiroyuki-sato/9442541 to your computer and use it in GitHub Desktop.
ib_read_bw result with pib 0.3.4 on CentOS6.5

Client

# ib_read_bw -d pib_1 -a server_ip
---------------------------------------------------------------------------------------
Device not recognized to implement inline feature. Disabling it
---------------------------------------------------------------------------------------
                    RDMA_Read BW Test
 Dual-port       : OFF		Device         : pib_1
 Number of qps   : 1		Transport type : IB
 Connection type : RC
 TX depth        : 128
 CQ Moderation   : 100
 Mtu             : 4096[B]
 Link type       : IB
 Outstand reads  : 16
 rdma_cm QPs	 : OFF
 Data ex. method : Ethernet
---------------------------------------------------------------------------------------
 local address: LID 0x03 QPN 0x27d938 PSN 0x80671c OUT 0x10 RKey 0xf1b43000 VAddr 0x007f72f2935000
 remote address: LID 0x01 QPN 0xfcdfda PSN 0x694272 OUT 0x10 RKey 0x81d21000 VAddr 0x007fcef9707000
---------------------------------------------------------------------------------------
 #bytes     #iterations    BW peak[MB/sec]    BW average[MB/sec]   MsgRate[Mpps]
 2          1000           0.07               0.06   		   0.030463
 4          1000           0.18               0.12   		   0.032299
 8          1000           0.33               0.25   		   0.032113
 16         1000           0.69               0.51   		   0.033102
 32         1000           1.40               0.98   		   0.032262
 64         1000           2.40               1.95   		   0.031914
 128        1000           5.65               3.98   		   0.032604
 256        1000           11.29              7.63   		   0.031240
 512        1000           21.77              15.69  		   0.032123
 1024       1000           43.67              30.38  		   0.031105
 2048       1000           86.45              59.55  		   0.030489
 4096       1000           139.54             110.92 		   0.028395
 8192       1000           218.50             136.54 		   0.017477
 16384      1000           151.37             141.67 		   0.009067
 32768      1000           145.81             144.80 		   0.004634
 65536      1000           148.90             148.90 		   0.002382
 131072     1000           1.65               1.64   		   0.000013
 262144     1000           1.65               1.64   		   0.000007
 524288     1000           1.64               1.64   		   0.000003
 1048576    1000           142.42             142.42 		   0.000142
 2097152    1000           134.81             134.06 		   0.000067
 4194304    1000           121.37             121.37 		   0.000030
Problems with warm up

Server

# ib_read_bw -d pib_0 -a 
---------------------------------------------------------------------------------------
Device not recognized to implement inline feature. Disabling it
---------------------------------------------------------------------------------------
                    RDMA_Read BW Test
 Dual-port       : OFF		Device         : pib_0
 Number of qps   : 1		Transport type : IB
 Connection type : RC
 CQ Moderation   : 100
 Mtu             : 4096[B]
 Link type       : IB
 Outstand reads  : 16
 rdma_cm QPs	 : OFF
 Data ex. method : Ethernet
---------------------------------------------------------------------------------------
 local address: LID 0x01 QPN 0xfcdfda PSN 0x694272 OUT 0x10 RKey 0x81d21000 VAddr 0x007fcef9707000
 remote address: LID 0x03 QPN 0x27d938 PSN 0x80671c OUT 0x10 RKey 0xf1b43000 VAddr 0x007f72f2935000
---------------------------------------------------------------------------------------
 #bytes     #iterations    BW peak[MB/sec]    BW average[MB/sec]   MsgRate[Mpps]
pp_read_keys: Success
Couldn't read remote address
 Unable to read to socket/rdam_cm
Failed to close connection between server and client
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment