Skip to content

Instantly share code, notes, and snippets.

View phstudy's full-sized avatar

Yuan-Kuei Hsueh phstudy

48 followers · 75 following
View GitHub Profile
@phstudy
phstudy / Bighadoop_read_TestDFSIO_results.log
Created May 16, 2014 03:43
Bighadoop Single Node - 32GB NN, SNN, DN (without Hive & HBase)
----- TestDFSIO ----- : read
Date & time: Fri May 16 11:33:04 CST 2014
Number of files: 10
Total MBytes processed: 10000.0
Throughput mb/sec: 291.97932786358723
Average IO rate mb/sec: 328.28546142578125
IO rate std deviation: 105.94441144516256
Test exec time sec: 49.525
----- TestDFSIO ----- : read
@phstudy
phstudy / HA_read_TestDFSIO_results.log
Created May 16, 2014 05:43
HA 4 Nodes - 8GB/Node 2NN, 3DN, 3NM
----- TestDFSIO ----- : read
Date & time: Fri May 16 13:21:58 CST 2014
Number of files: 10
Total MBytes processed: 10000.0
Throughput mb/sec: 15.751603513237647
Average IO rate mb/sec: 26.165821075439453
IO rate std deviation: 16.41244162412394
Test exec time sec: 177.314
----- TestDFSIO ----- : read
@phstudy
phstudy / HA_1DN_3NM_read_TestDFSIO_results.log
Created May 16, 2014 10:43
HA 4 Nodes - 8GB/Node 2NN, 1DN, 3NM
----- TestDFSIO ----- : read
Date & time: Fri May 16 14:33:46 CST 2014
Number of files: 10
Total MBytes processed: 10000.0
Throughput mb/sec: 15.215165259517466
Average IO rate mb/sec: 15.31158447265625
IO rate std deviation: 1.1998894009063248
Test exec time sec: 176.768
----- TestDFSIO ----- : read
@phstudy
phstudy / HA_1DN_1NM_read_TestDFSIO_results.log
Created May 16, 2014 10:43
HA 4 Nodes - 8GB/Node 2NN, 1DN, 1NM
----- TestDFSIO ----- : read
Date & time: Fri May 16 17:43:43 CST 2014
Number of files: 10
Total MBytes processed: 10000.0
Throughput mb/sec: 80.46800189904485
Average IO rate mb/sec: 81.07865905761719
IO rate std deviation: 7.228150704445114
Test exec time sec: 187.542
----- TestDFSIO ----- : read
@phstudy
phstudy / TestDFSIO_results.log
Created May 17, 2014 23:55
HA 4 Nodes - 8GB/Node 2NN, 3DN, 3NM (VMs deployed on 4 different HDD)
----- TestDFSIO ----- : read
Date & time: Sun May 18 07:24:03 CST 2014
Number of files: 10
Total MBytes processed: 10000.0
Throughput mb/sec: 51.92404550623348
Average IO rate mb/sec: 65.51341247558594
IO rate std deviation: 30.326697909865505
Test exec time sec: 84.001
----- TestDFSIO ----- : read
@phstudy
phstudy / TestDFSIO_results.log
Last active August 29, 2015 14:01
HA 4 Nodes - 8GB/Node 2NN, 3DN, 3NM (VMs deployed on 4 different HDD and tuned JVM parameters)
----- TestDFSIO ----- : write
Date & time: Sun May 18 08:15:05 CST 2014
Number of files: 10
Total MBytes processed: 10000.0
Throughput mb/sec: 9.214067669955782
Average IO rate mb/sec: 9.27421760559082
IO rate std deviation: 0.7552383706698728
Test exec time sec: 261.614
----- TestDFSIO ----- : write
@phstudy
phstudy / TestDFSIO_results.log
Created May 19, 2014 08:57
HA 4 Nodes - 8GB/Node 2NN, 2DN, 2NM (VMs deployed on 4 different HDD and tuned JVM parameters)
----- TestDFSIO ----- : write
Date & time: Mon May 19 11:11:17 CST 2014
Number of files: 10
Total MBytes processed: 10000.0
Throughput mb/sec: 15.226401361849337
Average IO rate mb/sec: 15.8214111328125
IO rate std deviation: 3.6683988613521583
Test exec time sec: 295.618
----- TestDFSIO ----- : write
@phstudy
phstudy / TestDFSIO_results.log
Created May 19, 2014 10:31
JPS_HA 4 Nodes - 8GB/Node 2NN, 2DN, 2NM (VMs deployed on 4 different HDD and tuned JVM parameters)
----- TestDFSIO ----- : write
Date & time: Mon May 19 17:14:20 CST 2014
Number of files: 10
Total MBytes processed: 10000.0
Throughput mb/sec: 13.56559439686689
Average IO rate mb/sec: 13.863067626953125
IO rate std deviation: 2.1142203063369194
Test exec time sec: 321.241
----- TestDFSIO ----- : write
@phstudy
phstudy / resize.md
Created May 25, 2014 05:34
resize vagrant box vmdk

cd ~/.vagrant.d/boxes/puppetlab-centos-64-nocm/0/virtualbox/ VBoxManage clonehd "box-disk1.vmdk" "cloned-box-disk1.vdi" --format vdi VBoxManage modifyhd "cloned-box-disk1.vdi" --resize 81920 VBoxManage clonehd "cloned-box-disk1.vdi" "cloned-box-disk1.vmdk" --format vmdk # write down uuid

modify box.ovf

start an new vm and attach cloned-box-disk1.vmdk

fdisk /dev/sdX

@phstudy
phstudy / README.md
Created July 1, 2014 05:49 — forked from magnetikonline/README.md