benchmarking storage types on aws ec2 ebs-optimized instance c3.xlarge

bonnie.log

# ephemeral = instance
[root@ip-172-31-28-224 ec2-user]# bonnie++ -d /media/ephemeral0/ -n0 -s4G -r512M -f -b -u root
Using uid:0, gid:0.
Writing intelligently...

done
Rewriting...done
Reading intelligently...done
start 'em...done...done...done...done...done...
Version  1.96       ------Sequential Output------ --Sequential Input- --Random-
Concurrency   1     -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
ip-172-31-28-224 4G           65510   6 141837   6           5993275  99 10888 116
Latency                         677ms     251ms                34us   12240us

1.96,1.96,ip-172-31-28-224,1,1513817957,4G,,,,65510,6,141837,6,,,5993275,99,10888,116,,,,,,,,,,,,,,,,,,,677ms,251ms,,34us,12240us,,,,,,

# ebs mounted ext2fs
[root@ip-172-31-28-224 ec2-user]# bonnie++ -d /mnt/ebs/ -n0 -s4G -r512M -f -b -u root
Using uid:0, gid:0.
Writing intelligently...done
Rewriting...done
Reading intelligently...done
start 'em...done...done...done...done...done...
Version  1.96       ------Sequential Output------ --Sequential Input- --Random-
Concurrency   1     -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
ip-172-31-28-224 4G           120916   7 121052   4           5199490 100 11702 126
Latency                         166ms   15511us                34us    3707us

1.96,1.96,ip-172-31-28-224,1,1513817752,4G,,,,120916,7,121052,4,,,5199490,100,11702,126,,,,,,,,,,,,,,,,,,,166ms,15511us,,34us,3707us,,,,,,

conclusions.md

conclusions

• no diff between ebs encrypted and not
• instance store faster by: 10 for writes, 5 for buffered reads (same as ebs for cached)
• bonnie++ tests would take with grain of salt because of small volume:mem size (bonnie++ warns that mem should be half of test file size to be usable) ... they show EBS having 2 x faster read (output), and comparable write (input)

dd-hdparm.log

# dd

## ebs
[root@ip-172-31-20-156 ec2-user]# dd if=/dev/zero bs=1M count=256 of=/mnt/ebs/test
256+0 records in
256+0 records out
268435456 bytes (268 MB) copied, 0.179459 s, 1.5 GB/s
[root@ip-172-31-20-156 ec2-user]# dd if=/dev/zero bs=1M count=256 of=/mnt/ebs/test
256+0 records in
256+0 records out
268435456 bytes (268 MB) copied, 2.03951 s, 132 MB/s

## ebs enc
[root@ip-172-31-20-156 ec2-user]# dd if=/dev/zero bs=1M count=256 of=/mnt/ebs-enc/test
256+0 records in
256+0 records out
268435456 bytes (268 MB) copied, 0.183731 s, 1.5 GB/s
[root@ip-172-31-20-156 ec2-user]# dd if=/dev/zero bs=1M count=256 of=/mnt/ebs-enc/test
256+0 records in
256+0 records out
268435456 bytes (268 MB) copied, 2.04299 s, 131 MB/s


## instance
[root@ip-172-31-20-156 ec2-user]# dd if=/dev/zero bs=1M count=256 of=/media/ephemeral0/test
256+0 records in
256+0 records out
268435456 bytes (268 MB) copied, 0.272333 s, 986 MB/s
[root@ip-172-31-20-156 ec2-user]# dd if=/dev/zero bs=1M count=256 of=/media/ephemeral0/test
256+0 records in
256+0 records out
268435456 bytes (268 MB) copied, 0.402829 s, 666 MB/s
[root@ip-172-31-20-156 ec2-user]# dd if=/dev/zero bs=1M count=256 of=/media/ephemeral0/test
256+0 records in
256+0 records out
268435456 bytes (268 MB) copied, 0.267825 s, 1.0 GB/s
[root@ip-172-31-20-156 ec2-user]# dd if=/dev/zero bs=1M count=256 of=/media/ephemeral0/test
256+0 records in
256+0 records out
268435456 bytes (268 MB) copied, 0.266745 s, 1.0 GB/s


# hdparm - buffered

## ebs
 Timing buffered disk reads: 372 MB in  3.06 seconds = 121.60 MB/sec

## ebs-enc
 Timing buffered disk reads: 366 MB in  3.00 seconds = 121.95 MB/sec

## instance
 Timing buffered disk reads: 1752 MB in  3.01 seconds = 581.84 MB/sec



# hdparm - cached

## ebs
 Timing cached reads:   20384 MB in  2.00 seconds = 10204.01 MB/sec

## ebs-enc
 Timing cached reads:   20042 MB in  2.00 seconds = 10031.94 MB/sec

## instance
 Timing cached reads:   19950 MB in  2.00 seconds = 9987.19 MB/sec