Benchmarks of Datastores Used by My Skull Canyon NUC ESXi Host

esxi_datastore_benchmarks.md

Intro

• Ubuntu 14.04 512MB RAM
• time bonnie++ -m "Freenas" -r 1024 -s 2048 -d /tmp/ -f -b -n 1 >> ~/bonnie.txt

FreeNAS iSCSI over 1GBe

102 MiB/s write, 121 MiB/s read, 87 seconds to complete.

Version  1.97       ------Sequential Output------ --Sequential Input- --Random-
Concurrency   1     -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
Freenas          2G           104974   4 60821   3           125202   3  4799  70
Latency                         103ms     370ms             36921us    9747us
Version  1.97       ------Sequential Create------ --------Random Create--------
Freenas             -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                  1   231  27 +++++ +++   399  31   642   7 +++++ +++   377  36
Latency             62263us      52us   26571us   26175us      21us   14450us
1.97,1.97,Freenas,1,1490927715,2G,,,,104974,4,60821,3,,,125202,3,4799,70,1,,,,,231,27,+++++,+++,399,31,642,7,+++++,+++,377,36,,103ms,370ms,,36921us,9747us,62263us,52us,26571us,26175us,21us,14450us

SSD

493 MiB/s write, 544 MiB/s read, 23 seconds to complete.

Concurrency   1     -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
SSD              2G           505152  19 246807  15           557387  17 12549 153
Latency                       20032us   98711us             14155us    1996us
Version  1.97       ------Sequential Create------ --------Random Create--------
SSD                 -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                  1 +++++ +++ +++++ +++  1181  72 +++++ +++ +++++ +++   973  77
Latency               993us      51us    1910us     485us      14us    2621us
1.97,1.97,SSD,1,1490935692,2G,,,,505152,19,246807,15,,,557387,17,12549,153,1,,,,,+++++,+++,+++++,+++,1181,72,+++++,+++,+++++,+++,973,77,,20032us,98711us,,14155us,1996us,993us,51us,1910us,485us,14us,2621us

We're running about 1.05 MiB/s copying to the SSD:

du -sH ../SSD; sleep 60; du -sH ../SSD
2627712	../SSD
2756736	../SSD

Tried this suggestion:

esxcli system module set --enabled=false --module=vmw_ahci

Rebooted, and saw 7.58 MiB/s copying to the SSD: (much better, but still crappy)

du -sH ../SSD; sleep 60; du -sH ../SSD/
2164864	../SSD
3096704	../SSD/