Skip to content

Instantly share code, notes, and snippets.

@janisz
Last active February 23, 2017 04:39
Show Gist options
  • Save janisz/5d2585376fc8ffb6d0fa9bb25afc7b92 to your computer and use it in GitHub Desktop.
Save janisz/5d2585376fc8ffb6d0fa9bb25afc7b92 to your computer and use it in GitHub Desktop.
Mesos replicated log benchmark
-------------------------------------------------------
Input: 10B x 1000
Total number of appends: 1000
Total time used: 4.590994792secs
-------------------------------------------------------
-------------------------------------------------------
Input: 100B x 1000
Total number of appends: 1000
Total time used: 6.654305136secs
-------------------------------------------------------
-------------------------------------------------------
Input: 1KB x 1000
Total number of appends: 1000
Total time used: 5.097612306secs
-------------------------------------------------------
-------------------------------------------------------
Input: 10KB x 1000
Total number of appends: 1000
Total time used: 3.408779712secs
-------------------------------------------------------
-------------------------------------------------------
Input: 50KB x 1000
Total number of appends: 1000
Total time used: 4.073168134secs
-------------------------------------------------------
-------------------------------------------------------
Input: 100KB x 1000
Total number of appends: 1000
Total time used: 5.080969813secs
-------------------------------------------------------
-------------------------------------------------------
Input: 200KB x 1000
Total number of appends: 1000
Total time used: 6.614818841secs
-------------------------------------------------------
-------------------------------------------------------
Input: 500KB x 1000
Total number of appends: 1000
Total time used: 16.105379176secs
-------------------------------------------------------
-------------------------------------------------------
Input: 700KB x 1000
Total number of appends: 1000
Total time used: 19.056302476secs
-------------------------------------------------------
-------------------------------------------------------
Input: 1MB x 1000
Total number of appends: 1000
Total time used: 30.582605872secs
-------------------------------------------------------
-------------------------------------------------------
Input: 10B x 1000
Total number of appends: 1000
Total time used: 5.044743835secs
-------------------------------------------------------
-------------------------------------------------------
Input: 100B x 1000
Total number of appends: 1000
Total time used: 3.867464506secs
-------------------------------------------------------
-------------------------------------------------------
Input: 1KB x 1000
Total number of appends: 1000
Total time used: 3.133526852secs
-------------------------------------------------------
-------------------------------------------------------
Input: 10KB x 1000
Total number of appends: 1000
Total time used: 3.459165443secs
-------------------------------------------------------
-------------------------------------------------------
Input: 50KB x 1000
Total number of appends: 1000
Total time used: 6.453992178secs
-------------------------------------------------------
-------------------------------------------------------
Input: 100KB x 1000
Total number of appends: 1000
Total time used: 9.685341707secs
-------------------------------------------------------
-------------------------------------------------------
Input: 200KB x 1000
Total number of appends: 1000
Total time used: 13.895342292secs
-------------------------------------------------------
-------------------------------------------------------
Input: 500KB x 1000
Total number of appends: 1000
Total time used: 20.793043358secs
-------------------------------------------------------
-------------------------------------------------------
Input: 700KB x 1000
Total number of appends: 1000
Total time used: 17.916384027secs
-------------------------------------------------------
-------------------------------------------------------
Input: 1MB x 1000
Total number of appends: 1000
Total time used: 21.602218003secs
-------------------------------------------------------
#!/bin/bash
sizes=( 10B 100B 1KB 10KB 100KB 500KB 1MB )
times=1000
for size in "${sizes[@]}"
do
perl -e "print \"$size\n\" x$times" > input.txt
MESOS_LOG_PATH=$(mktemp -d /tmp/mesos-log-benchmark.XXXXXX)
MESOS_LOG_OUTPUT=$(mktemp $MESOS_LOG_PATH/output.XXXXXX)
echo "-------------------------------------------------------"
echo "Input: $size x $times"
./src/mesos-log benchmark \
--quorum=1 \
--type=random \
--path=$MESOS_LOG_PATH \
--servers=localhost:2181 \
--znode=/mesos-log-benchmark-small \
--input=input.txt \
--output=$MESOS_LOG_OUTPUT \
--quiet 2> /dev/null
echo "-------------------------------------------------------"
done
@haosdent
Copy link

Thanks a lot for the nice result. May you mind check

Input: 1MB x 1000

again? Is 1.19 worst on this because of deviation?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment