Skip to content

Instantly share code, notes, and snippets.

@hppritcha

hppritcha/issue_1831_psm2_results

Last active November 3, 2016 15:21
Show Gist options
  • Save hppritcha/8da4436a216c9d96bf10ad9d403da03f to your computer and use it in GitHub Desktop.
Save hppritcha/8da4436a216c9d96bf10ad9d403da03f to your computer and use it in GitHub Desktop.
Download ZIP
Raw
issue_1831_psm2_results
Using this configure option for OMPI:
./configure --prefix=/users/hpp/ompi_install_dir --with-pmi --with-slurm
I ran osu_mbw_mr multiple times on a LANL omnipath system (Intel(R) Xeon(R) CPU E5-2695 v4 @ 2.10GHz processors)
1.10.x:
srun -n 2 -N 2 --label ./osu_mbw_mr_1.10.x
0: # OSU MPI Multiple Bandwidth / Message Rate Test v5.3
0: # [ pairs: 1 ] [ window size: 64 ]
0: # Size MB/s Messages/s
0: 1 2.88 2877697.85
0: 2 6.18 3088803.08
0: 4 13.13 3282051.27
0: 8 25.69 3211239.32
0: 16 46.40 2899864.05
0: 32 94.90 2965709.01
0: 64 193.85 3028868.91
0: 128 386.23 3017444.60
0: 256 731.43 2857142.86
0: 512 1381.45 2698145.04
0: 1024 2562.00 2501954.64
0: 2048 4128.25 2015748.04
0: 4096 6104.89 1490451.79
0: 8192 7755.74 946745.56
0: 16384 9374.84 572194.90
0: 32768 11535.49 352035.20
0: 65536 11689.81 178372.35
0: 131072 11960.66 91252.58
0: 262144 12193.63 46515.01
0: 524288 12306.78 23473.32
0: 1048576 12352.99 11780.73
0: 2097152 12370.98 5898.94
0: 4194304 12380.57 2951.76
v2.0.x
srun -n 2 -N 2 --label ./osu_mbw_mr_2.0.x
0: # OSU MPI Multiple Bandwidth / Message Rate Test v5.3
0: # [ pairs: 1 ] [ window size: 64 ]
0: # Size MB/s Messages/s
0: 1 1.86 1862925.92
0: 2 3.81 1907243.03
0: 4 8.01 2002651.63
0: 8 16.21 2026836.60
0: 16 29.90 1869043.70
0: 32 59.10 1847005.60
0: 64 120.78 1887134.05
0: 128 237.00 1851558.26
0: 256 458.57 1791296.09
0: 512 872.10 1703327.69
0: 1024 1561.81 1525204.36
0: 2048 2615.25 1276979.43
0: 4096 3773.81 921339.22
0: 8192 4989.32 609047.77
0: 16384 4674.23 285292.33
0: 32768 8280.77 252708.97
0: 65536 10171.22 155200.45
0: 131072 10956.62 83592.39
0: 262144 11454.35 43694.87
0: 524288 11836.62 22576.55
0: 1048576 11920.46 11368.24
0: 2097152 11954.77 5700.48
0: 4194304 11973.70 2854.75
v2.X
srun -n 2 -N 2 --label ./osu_mbw_mr_2x
0: # OSU MPI Multiple Bandwidth / Message Rate Test v5.3
0: # [ pairs: 1 ] [ window size: 64 ]
0: # Size MB/s Messages/s
0: 1 2.44 2437941.07
0: 2 5.15 2572565.44
0: 4 10.74 2684713.55
0: 8 22.23 2778740.21
0: 16 41.79 2612015.69
0: 32 84.09 2627668.80
0: 64 167.52 2617461.67
0: 128 335.40 2620305.80
0: 256 635.97 2484271.45
0: 512 1237.53 2417041.64
0: 1024 2247.26 2194590.95
0: 2048 3717.55 1815211.98
0: 4096 5750.67 1403973.07
0: 8192 7445.36 908856.98
0: 16384 9408.06 574222.52
0: 32768 11331.64 345814.26
0: 65536 11747.59 179253.98
0: 131072 12025.16 91744.66
0: 262144 12204.81 46557.65
0: 524288 12308.00 23475.65
0: 1048576 12349.60 11777.49
0: 2097152 12365.42 5896.29
0: 4194304 12381.95 2952.09
master (0cd200da)
srun -n 2 -N 2 --label ./osu_mbw_mr_master
0: # OSU MPI Multiple Bandwidth / Message Rate Test v5.3
0: # [ pairs: 1 ] [ window size: 64 ]
0: # Size MB/s Messages/s
0: 1 2.45 2446010.08
0: 2 5.24 2617686.48
0: 4 10.69 2673123.36
0: 8 22.30 2787446.70
0: 16 41.89 2617910.29
0: 32 77.62 2425616.01
0: 64 168.53 2633331.95
0: 128 330.91 2585266.31
0: 256 651.82 2546188.47
0: 512 1258.77 2458543.77
0: 1024 2271.25 2218015.70
0: 2048 3753.46 1832746.43
0: 4096 5783.99 1412107.76
0: 8192 7565.03 923465.36
0: 16384 9169.61 559668.54
0: 32768 10795.90 329464.70
0: 65536 11727.17 178942.44
0: 131072 12049.28 91928.74
0: 262144 12212.50 46587.00
0: 524288 12310.26 23479.95
0: 1048576 12346.88 11774.91
0: 2097152 12374.46 5900.60
0: 4194304 12383.10 2952.36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment