Skip to content

Instantly share code, notes, and snippets.

@dstuebe

dstuebe/Test Notes

Last active October 5, 2018 01:58
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save dstuebe/9ae04ce3ba2036940941131c3d6d1582 to your computer and use it in GitHub Desktop.
Save dstuebe/9ae04ce3ba2036940941131c3d6d1582 to your computer and use it in GitHub Desktop.
Download ZIP
Log file from uppend benchmark on I3.metal
Raw
Test Notes
Created two instance:
i3.8xl 10.10.17.185
i3.metal 10.10.17.180
SSH Connection:
ssh-add .ssh/p_ecs_cluster
ssh ubuntu@10.10.17.180
ssh ubuntu@10.10.17.185
Followed Raid instructions from:
https://blog.devopscomplete.com/configuring-software-raid-on-amazon-linux-422055072814
sudo mkdir -p /data
sudo mdadm --create --verbose --level=0 /dev/md0 --name=DATA --raid-devices=4 /dev/nvme0n1 /dev/nvme1n1 /dev/nvme2n1 /dev/nvme3n1
sudo mdadm --create --verbose --level=0 /dev/md0 --name=DATA --raid-devices=8 /dev/nvme0n1 /dev/nvme1n1 /dev/nvme2n1 /dev/nvme3n1 /dev/nvme4n1 /dev/nvme5n1 /dev/nvme6n1 /dev/nvme7n1
sudo mdadm --wait /dev/md0
sudo mkfs.ext4 /dev/md0
sudo cp /etc/mdadm/mdadm.conf /etc/mdadm/mdadm.conf_orig
sudo mdadm --detail --scan | sudo tee -a /etc/mdadm/mdadm.conf
sudo update-initramfs -u
sudo echo /dev/md0 /data ext4 defaults,nofail,noatime,discard 0 2 >> /etc/fstab
sudo mount -a
sudo chown ubuntu /data
sudo chgrp ubuntu /data
Install Java 10.0.2:
curl -v -j -k -L -H "Cookie: oraclelicense=accept-securebackup-cookie" -O http://download.oracle.com/otn-pub/java/jdk/10.0.2+13/19aef61b38124481863b1413dce1855f/jdk-10.0.2_linux-x64_bin.tar.gz
mkdir -p ~/opt/jdk
tar -xzvf jdk-*.tar.gz -C ~/opt/jdk
rm jdk-*.tar.gz
opt/jdk/jdk-10.0.2/bin/java --version
Install IOStat
sudo apt-get install sysstat
To look at sparseness
ls -ltrh /data/rbwf/1/partitions/0000/
du -sh /data/rbwf/1/partitions/0000/*
## Run tests
Branches: read_buffer_write_file => rbwf
scp build/libs/uppend-all-0.0.2-135-gabccd96.dirty.jar ubuntu@10.10.17.180:test/rbwf.jar
scp build/libs/uppend-all-0.0.2-135-gabccd96.dirty.jar ubuntu@10.10.17.185:test/rbwf.jar
opt/jdk/jdk-10.0.2/bin/java -Xmx64g -jar test/rbwf.jar benchmark -c wide -m write -s large -i '-c -d 5 -p md0 -x' /data/rbwf/1
opt/jdk/jdk-10.0.2/bin/java -Xmx64g -jar test/test.jar benchmark -c wide -m write -s large -i '-c -d 5 -p md0 -x' /data/rbwf/1
opt/jdk/jdk-10.0.2/bin/java -Xmx64g -jar test/test.jar benchmark -c wide -m write -s large -i '-c -d 5 -p md0 -x' /data/rbwf/1
I3.metal results:
225s Large Baseline rbwf
245s 256 partitions
203s 512 partitions - cheet - doesn't need to flush
## Test with partition key removed...
opt/jdk/jdk-10.0.2/bin/java -Xmx64g -jar test/npk.jar benchmark -c wide -m write -s large -i '-c -d 5 -p md0 -x' /data/npk/1
Raw
uppend.log
2018-10-05 01:39:37,396 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 317.55mb/s 651129.48a/s; Mem 23446.80mb free 65536.00mb total
2018-10-05 01:39:37,396 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:39:37,396 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=1966797, flushedLookups=7654}
2018-10-05 01:39:37,401 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=2267647, hitCount=1157959, meanSize=2541, meanFindTimer=39us}
2018-10-05 01:39:37,402 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=108959184, appendCount=3483439, allocCount=2269983}
avg-cpu: %user %nice %system %iowait %steal %idle
62.82 0.00 16.19 0.00 0.00 20.99
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 18473.20 0.00 660309.60 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 35.74 0.00 0.00
2018-10-05 01:39:42,650 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 322.88mb/s 661867.72a/s; Mem 22219.49mb free 65536.00mb total
2018-10-05 01:39:42,650 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:39:42,650 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=2010197, flushedLookups=7823}
2018-10-05 01:39:42,656 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=2254705, hitCount=1163441, meanSize=2556, meanFindTimer=41us}
2018-10-05 01:39:42,657 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=108363696, appendCount=3477346, allocCount=2257577}
avg-cpu: %user %nice %system %iowait %steal %idle
58.80 0.00 20.49 0.00 0.00 20.71
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 8297.40 0.00 519475.20 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 62.61 0.00 0.00
2018-10-05 01:39:47,649 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 291.17mb/s 596881.40a/s; Mem 21023.23mb free 65536.00mb total
2018-10-05 01:39:47,649 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:39:47,649 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=1812889, flushedLookups=7055}
2018-10-05 01:39:47,657 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=1932807, hitCount=1001030, meanSize=2570, meanFindTimer=44us}
2018-10-05 01:39:47,657 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=92954400, appendCount=2987208, allocCount=1936550}
avg-cpu: %user %nice %system %iowait %steal %idle
59.56 0.00 20.92 0.00 0.00 19.52
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 5516.97 0.00 442158.08 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 80.15 0.00 0.00
2018-10-05 01:39:52,650 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 290.92mb/s 596651.60a/s; Mem 19739.16mb free 65536.00mb total
2018-10-05 01:39:52,650 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:39:52,650 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=1872045, flushedLookups=7285}
2018-10-05 01:39:52,655 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=1923781, hitCount=1007477, meanSize=2584, meanFindTimer=36us}
2018-10-05 01:39:52,656 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=92433552, appendCount=2981889, allocCount=1925699}
avg-cpu: %user %nice %system %iowait %steal %idle
59.16 0.00 20.37 0.00 0.00 20.47
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 5427.20 0.00 372034.40 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 68.55 0.00 0.00
2018-10-05 01:39:57,649 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 289.57mb/s 594146.00a/s; Mem 18487.07mb free 65536.00mb total
2018-10-05 01:39:57,649 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:39:57,649 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=1921614, flushedLookups=7478}
2018-10-05 01:39:57,655 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=1909700, hitCount=1010133, meanSize=2599, meanFindTimer=34us}
2018-10-05 01:39:57,656 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=238, size=91782240, appendCount=2971212, allocCount=1912130}
avg-cpu: %user %nice %system %iowait %steal %idle
58.89 0.00 23.22 0.00 0.00 17.89
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 11615.20 0.00 426579.20 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 36.73 0.00 0.00
2018-10-05 01:40:02,649 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 288.71mb/s 591899.20a/s; Mem 17168.15mb free 65536.00mb total
2018-10-05 01:40:02,649 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:40:02,649 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=2044708, flushedLookups=7957}
2018-10-05 01:40:02,655 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=1896467, hitCount=1010743, meanSize=2615, meanFindTimer=37us}
2018-10-05 01:40:02,656 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=18, size=91157808, appendCount=2958255, allocCount=1899121}
avg-cpu: %user %nice %system %iowait %steal %idle
58.25 0.00 22.71 0.00 0.00 19.04
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 7013.40 0.00 492403.20 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 70.21 0.00 0.00
2018-10-05 01:40:07,649 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 290.67mb/s 596134.60a/s; Mem 15647.04mb free 65536.00mb total
2018-10-05 01:40:07,649 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:40:07,650 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=2065036, flushedLookups=8036}
2018-10-05 01:40:07,656 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=1904105, hitCount=1026486, meanSize=2630, meanFindTimer=32us}
2018-10-05 01:40:07,657 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=91547472, appendCount=2982259, allocCount=1907240}
avg-cpu: %user %nice %system %iowait %steal %idle
57.95 0.00 23.56 0.00 0.00 18.48
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 8857.20 0.00 454806.40 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 51.35 0.00 0.00
2018-10-05 01:40:12,649 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 287.55mb/s 589326.80a/s; Mem 14259.15mb free 65536.00mb total
2018-10-05 01:40:12,649 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:40:12,649 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=2110534, flushedLookups=8213}
2018-10-05 01:40:12,654 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=1876954, hitCount=1017372, meanSize=2647, meanFindTimer=37us}
2018-10-05 01:40:12,655 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=90180768, appendCount=2943225, allocCount=1878765}
avg-cpu: %user %nice %system %iowait %steal %idle
58.20 0.00 22.60 0.01 0.00 19.19
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 15161.40 0.00 1198769.60 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 79.07 0.00 0.00
2018-10-05 01:40:17,649 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 299.73mb/s 614377.40a/s; Mem 12001.48mb free 65536.00mb total
2018-10-05 01:40:17,650 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:40:17,650 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=2283454, flushedLookups=8886}
2018-10-05 01:40:17,656 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=1951047, hitCount=1070639, meanSize=2664, meanFindTimer=41us}
2018-10-05 01:40:17,961 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=93866928, appendCount=3075051, allocCount=1955561}
avg-cpu: %user %nice %system %iowait %steal %idle
63.54 0.00 17.23 0.00 0.00 19.23
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 11586.80 0.00 1033318.40 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 89.18 0.00 0.00
2018-10-05 01:40:22,863 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 270.57mb/s 555034.91a/s; Mem 13561.46mb free 65536.00mb total
2018-10-05 01:40:22,863 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:40:22,863 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=2106056, flushedLookups=8196}
2018-10-05 01:40:22,873 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=1834472, hitCount=1013951, meanSize=2680, meanFindTimer=41us}
2018-10-05 01:40:22,876 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=88206096, appendCount=2896640, allocCount=1837627}
avg-cpu: %user %nice %system %iowait %steal %idle
63.92 0.00 15.12 0.00 0.00 20.96
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 9546.60 0.00 781752.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 81.89 0.00 0.00
2018-10-05 01:40:28,003 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 227.73mb/s 467074.51a/s; Mem 17933.23mb free 65536.00mb total
2018-10-05 01:40:28,003 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:40:28,003 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=1708777, flushedLookups=6650}
2018-10-05 01:40:28,028 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=1514935, hitCount=845684, meanSize=2693, meanFindTimer=52us}
2018-10-05 01:40:28,028 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=73317648, appendCount=2415271, allocCount=1527451}
avg-cpu: %user %nice %system %iowait %steal %idle
62.82 0.00 8.33 0.00 0.00 28.85
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 12304.60 0.00 1061381.60 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 86.26 0.00 0.00
2018-10-05 01:40:34,269 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 74.23mb/s 152338.01a/s; Mem 24548.84mb free 65536.00mb total
2018-10-05 01:40:34,269 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:40:34,269 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=695353, flushedLookups=2706}
2018-10-05 01:40:34,284 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=605559, hitCount=339189, meanSize=2698, meanFindTimer=99us}
2018-10-05 01:40:34,284 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=28620480, appendCount=943716, allocCount=596260}
avg-cpu: %user %nice %system %iowait %steal %idle
66.67 0.00 3.10 0.00 0.00 30.23
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 25043.20 0.00 1007870.40 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 40.25 0.00 0.00
2018-10-05 01:40:39,270 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 63.58mb/s 130444.80a/s; Mem 27747.46mb free 65536.00mb total
2018-10-05 01:40:39,270 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:40:39,270 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=447067, flushedLookups=1740}
2018-10-05 01:40:39,312 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=408399, hitCount=229237, meanSize=2702, meanFindTimer=314us}
2018-10-05 01:40:39,313 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=20320128, appendCount=670671, allocCount=423336}
avg-cpu: %user %nice %system %iowait %steal %idle
66.85 0.00 2.90 0.00 0.00 30.25
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 11409.60 0.00 782228.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 68.56 0.00 0.00
2018-10-05 01:40:44,648 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 28.22mb/s 57890.31a/s; Mem 33225.38mb free 65536.00mb total
2018-10-05 01:40:44,649 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:40:44,649 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=206824, flushedLookups=805}
2018-10-05 01:40:44,658 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=194741, hitCount=109092, meanSize=2703, meanFindTimer=232us}
2018-10-05 01:40:44,658 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=8703408, appendCount=287201, allocCount=181321}
avg-cpu: %user %nice %system %iowait %steal %idle
66.30 0.00 3.33 0.00 0.00 30.36
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 10768.60 0.00 713017.60 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 66.21 0.00 0.00
2018-10-05 01:40:50,063 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 43.03mb/s 88139.06a/s; Mem 37555.17mb free 65536.00mb total
2018-10-05 01:40:50,063 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:40:50,063 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=346099, flushedLookups=1347}
2018-10-05 01:40:50,070 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=300568, hitCount=169327, meanSize=2706, meanFindTimer=274us}
2018-10-05 01:40:50,071 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=14381136, appendCount=475078, allocCount=299607}
avg-cpu: %user %nice %system %iowait %steal %idle
66.21 0.00 3.18 0.00 0.00 30.60
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 17963.20 0.00 638599.20 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 35.55 0.00 0.00
2018-10-05 01:40:57,038 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 33.60mb/s 68851.04a/s; Mem 41292.51mb free 65536.00mb total
2018-10-05 01:40:57,039 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:40:57,039 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=331449, flushedLookups=1290}
2018-10-05 01:40:57,060 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=310280, hitCount=174899, meanSize=2709, meanFindTimer=327us}
2018-10-05 01:40:57,061 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=15092928, appendCount=498812, allocCount=314436}
avg-cpu: %user %nice %system %iowait %steal %idle
66.73 0.00 2.16 0.00 0.00 31.11
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 12155.60 0.00 483736.80 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 39.80 0.00 0.00
avg-cpu: %user %nice %system %iowait %steal %idle
66.77 0.00 2.57 0.00 0.00 30.66
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 15343.60 0.00 393245.60 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 25.63 0.00 0.00
2018-10-05 01:41:03,042 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 39.17mb/s 80322.62a/s; Mem 42525.73mb free 65536.00mb total
2018-10-05 01:41:03,042 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:41:03,042 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=321182, flushedLookups=1250}
2018-10-05 01:41:03,051 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=296716, hitCount=167813, meanSize=2711, meanFindTimer=178us}
2018-10-05 01:41:03,052 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=14131152, appendCount=467597, allocCount=294399}
avg-cpu: %user %nice %system %iowait %steal %idle
64.29 0.00 16.77 0.00 0.00 18.94
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 18402.60 0.00 369570.40 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20.08 0.00 0.00
2018-10-05 01:41:08,042 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 325.31mb/s 666682.40a/s; Mem 38770.73mb free 65536.00mb total
2018-10-05 01:41:08,042 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:41:08,042 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=2164935, flushedLookups=8425}
2018-10-05 01:41:08,062 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=2093987, hitCount=1187349, meanSize=2727, meanFindTimer=47us}
2018-10-05 01:41:08,067 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=101008896, appendCount=3344754, allocCount=2104353}
avg-cpu: %user %nice %system %iowait %steal %idle
60.80 0.00 18.78 0.00 0.00 20.41
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 18403.60 0.00 399209.60 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 21.69 0.00 0.00
2018-10-05 01:41:13,044 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 313.53mb/s 642736.11a/s; Mem 38701.48mb free 65536.00mb total
2018-10-05 01:41:13,044 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:41:13,044 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=1919816, flushedLookups=7471}
2018-10-05 01:41:13,051 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=2010940, hitCount=1152379, meanSize=2742, meanFindTimer=36us}
2018-10-05 01:41:13,052 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=96348624, appendCount=3202742, allocCount=2007262}
avg-cpu: %user %nice %system %iowait %steal %idle
62.92 0.00 16.25 0.00 0.00 20.82
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 16795.60 0.00 542483.20 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 32.30 0.00 0.00
2018-10-05 01:41:18,044 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 343.32mb/s 703769.80a/s; Mem 37103.98mb free 65536.00mb total
2018-10-05 01:41:18,044 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:41:18,044 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=1946009, flushedLookups=7573}
2018-10-05 01:41:18,053 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=2194883, hitCount=1268636, meanSize=2757, meanFindTimer=37us}
2018-10-05 01:41:18,053 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=105573840, appendCount=3521056, allocCount=2199457}
avg-cpu: %user %nice %system %iowait %steal %idle
63.01 0.00 16.15 0.00 0.00 20.85
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 1808.20 0.00 55958.40 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 30.95 0.00 0.00
2018-10-05 01:41:23,044 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 338.41mb/s 693820.80a/s; Mem 35927.71mb free 65536.00mb total
2018-10-05 01:41:23,044 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:41:23,044 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=1855535, flushedLookups=7221}
2018-10-05 01:41:23,051 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=2154252, hitCount=1255088, meanSize=2771, meanFindTimer=37us}
2018-10-05 01:41:23,051 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=39, size=103586976, appendCount=3464909, allocCount=2158060}
avg-cpu: %user %nice %system %iowait %steal %idle
63.04 0.00 15.03 0.00 0.00 21.93
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.20 15556.20 0.80 482498.40 0.00 0.00 0.00 0.00 0.00 0.00 0.00 4.00 31.02 0.00 0.00
2018-10-05 01:41:28,252 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 300.08mb/s 615398.04a/s; Mem 36388.34mb free 65536.00mb total
2018-10-05 01:41:28,253 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:41:28,253 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=1691749, flushedLookups=6584}
2018-10-05 01:41:28,262 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=0, missCount=1987217, hitCount=1167901, meanSize=2784, meanFindTimer=37us}
2018-10-05 01:41:28,265 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=217, size=95638512, appendCount=3210179, allocCount=1992469}
avg-cpu: %user %nice %system %iowait %steal %idle
62.84 0.00 15.66 0.00 0.00 21.50
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 14629.00 0.00 565804.80 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 38.68 0.00 0.00
2018-10-05 01:41:33,362 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 331.62mb/s 679690.22a/s; Mem 35306.75mb free 65536.00mb total
2018-10-05 01:41:33,363 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:41:33,363 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=1871195, flushedLookups=7282}
2018-10-05 01:41:33,429 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=1, missCount=2143345, hitCount=1269455, meanSize=2798, meanFindTimer=40us}
2018-10-05 01:41:33,429 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=105359472, appendCount=3547159, allocCount=2194990}
avg-cpu: %user %nice %system %iowait %steal %idle
62.29 0.00 15.12 0.00 0.00 22.59
Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
md0 0.00 17932.20 0.00 563747.20 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 31.44 0.00 0.00
2018-10-05 01:41:38,564 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Read: 0.00mb/s 0.00r/s; Write 325.99mb/s 668427.53a/s; Mem 34122.48mb free 65536.00mb total
2018-10-05 01:41:38,564 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Lookup Key Cache: CacheStats{hitCount=0, missCount=0, loadSuccessCount=0, loadFailureCount=0, totalLoadTime=0, evictionCount=0, evictionWeight=0}
2018-10-05 01:41:38,564 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Flush Stats: FlushStats{flushedKeys=1919985, flushedLookups=7472}
2018-10-05 01:41:38,579 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark PartitionStats{newMDPages=0, newKeyPages=0, newBlobPages=5, missCount=2140670, hitCount=1279838, meanSize=2813, meanFindTimer=38us}
2018-10-05 01:41:38,587 INFO [Timer-0:{}] com.upserve.uppend.cli.benchmark.Benchmark Block Stats: BlockStats{pagesLoaded=0, size=100797888, appendCount=3407018, allocCount=2099955}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment