Skip to content

Instantly share code, notes, and snippets.

@szpak
Created July 6, 2019 21:48
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save szpak/14c28b91b0ce66918e1b8651339d8722 to your computer and use it in GitHub Desktop.
Save szpak/14c28b91b0ce66918e1b8651339d8722 to your computer and use it in GitHub Desktop.
Results for JMH execution for BlockHound - approach 2 - https://github.com/reactor/BlockHound/pull/35
# JMH version: 1.21
# VM version: JDK 11.0.3, OpenJDK 64-Bit Server VM, 11.0.3+7
# VM invoker: /usr/lib/jvm/java-11-openjdk-11.0.3.7-5.fc30.x86_64/bin/java
# VM options: <none>
# Warmup: 3 iterations, 10 s each
# Measurement: 5 iterations, 10 s each
# Timeout: 10 min per iteration
# Threads: 1 thread, will synchronize iterations
# Benchmark mode: Average time, time/op
# Benchmark: reactor.blockhound.BlockHoundBlockingAllowedThreadBenchmark.baselineBlockingCall
# Run progress: 0.00% complete, ETA 00:28:00
# Fork: 1 of 3
# Warmup Iteration 1: 5.297 us/op
# Warmup Iteration 2: 5.188 us/op
# Warmup Iteration 3: 5.208 us/op
Iteration 1: 5.173 us/op
Iteration 2: 5.180 us/op
Iteration 3: 5.105 us/op
Iteration 4: 5.118 us/op
Iteration 5: 5.155 us/op
# Run progress: 4.76% complete, ETA 00:26:48
# Fork: 2 of 3
# Warmup Iteration 1: 5.252 us/op
# Warmup Iteration 2: 5.081 us/op
# Warmup Iteration 3: 5.120 us/op
Iteration 1: 5.110 us/op
Iteration 2: 5.160 us/op
Iteration 3: 5.092 us/op
Iteration 4: 5.139 us/op
Iteration 5: 5.049 us/op
# Run progress: 9.52% complete, ETA 00:25:27
# Fork: 3 of 3
# Warmup Iteration 1: 5.192 us/op
# Warmup Iteration 2: 5.116 us/op
# Warmup Iteration 3: 5.144 us/op
Iteration 1: 5.121 us/op
Iteration 2: 5.077 us/op
Iteration 3: 5.128 us/op
Iteration 4: 5.109 us/op
Iteration 5: 5.149 us/op
Result "reactor.blockhound.BlockHoundBlockingAllowedThreadBenchmark.baselineBlockingCall":
5.124 ±(99.9%) 0.039 us/op [Average]
(min, avg, max) = (5.049, 5.124, 5.180), stdev = 0.036
CI (99.9%): [5.086, 5.163] (assumes normal distribution)
# JMH version: 1.21
# VM version: JDK 11.0.3, OpenJDK 64-Bit Server VM, 11.0.3+7
# VM invoker: /usr/lib/jvm/java-11-openjdk-11.0.3.7-5.fc30.x86_64/bin/java
# VM options: <none>
# Warmup: 3 iterations, 10 s each
# Measurement: 5 iterations, 10 s each
# Timeout: 10 min per iteration
# Threads: 1 thread, will synchronize iterations
# Benchmark mode: Average time, time/op
# Benchmark: reactor.blockhound.BlockHoundBlockingAllowedThreadBenchmark.baselineNonBlockingCall
# Run progress: 14.29% complete, ETA 00:24:07
# Fork: 1 of 3
# Warmup Iteration 1: 5.143 us/op
# Warmup Iteration 2: 5.081 us/op
# Warmup Iteration 3: 5.074 us/op
Iteration 1: 5.067 us/op
Iteration 2: 5.091 us/op
Iteration 3: 5.065 us/op
Iteration 4: 5.094 us/op
Iteration 5: 5.155 us/op
# Run progress: 19.05% complete, ETA 00:22:47
# Fork: 2 of 3
# Warmup Iteration 1: 5.300 us/op
# Warmup Iteration 2: 5.040 us/op
# Warmup Iteration 3: 5.017 us/op
Iteration 1: 5.065 us/op
Iteration 2: 5.032 us/op
Iteration 3: 4.989 us/op
Iteration 4: 4.998 us/op
Iteration 5: 5.064 us/op
# Run progress: 23.81% complete, ETA 00:21:26
# Fork: 3 of 3
# Warmup Iteration 1: 5.137 us/op
# Warmup Iteration 2: 5.099 us/op
# Warmup Iteration 3: 5.054 us/op
Iteration 1: 5.111 us/op
Iteration 2: 5.095 us/op
Iteration 3: 5.100 us/op
Iteration 4: 5.053 us/op
Iteration 5: 5.064 us/op
Result "reactor.blockhound.BlockHoundBlockingAllowedThreadBenchmark.baselineNonBlockingCall":
5.070 ±(99.9%) 0.045 us/op [Average]
(min, avg, max) = (4.989, 5.070, 5.155), stdev = 0.042
CI (99.9%): [5.024, 5.115] (assumes normal distribution)
# JMH version: 1.21
# VM version: JDK 11.0.3, OpenJDK 64-Bit Server VM, 11.0.3+7
# VM invoker: /usr/lib/jvm/java-11-openjdk-11.0.3.7-5.fc30.x86_64/bin/java
# VM options: <none>
# Warmup: 3 iterations, 10 s each
# Measurement: 5 iterations, 10 s each
# Timeout: 10 min per iteration
# Threads: 1 thread, will synchronize iterations
# Benchmark mode: Average time, time/op
# Benchmark: reactor.blockhound.BlockHoundBlockingAllowedThreadBenchmark.measureBlockingCall
# Run progress: 28.57% complete, ETA 00:20:06
# Fork: 1 of 3
# Warmup Iteration 1: OpenJDK 64-Bit Server VM warning: Sharing is only supported for boot loader classes because bootstrap classpath has been appended
5.216 us/op
# Warmup Iteration 2: 5.199 us/op
# Warmup Iteration 3: 5.153 us/op
Iteration 1: 5.154 us/op
Iteration 2: 5.211 us/op
Iteration 3: 5.146 us/op
Iteration 4: 5.108 us/op
Iteration 5: 5.225 us/op
# Run progress: 33.33% complete, ETA 00:18:46
# Fork: 2 of 3
# Warmup Iteration 1: OpenJDK 64-Bit Server VM warning: Sharing is only supported for boot loader classes because bootstrap classpath has been appended
5.335 us/op
# Warmup Iteration 2: 5.151 us/op
# Warmup Iteration 3: 5.136 us/op
Iteration 1: 5.162 us/op
Iteration 2: 5.154 us/op
Iteration 3: 5.189 us/op
Iteration 4: 5.263 us/op
Iteration 5: 5.187 us/op
# Run progress: 38.10% complete, ETA 00:17:27
# Fork: 3 of 3
# Warmup Iteration 1: OpenJDK 64-Bit Server VM warning: Sharing is only supported for boot loader classes because bootstrap classpath has been appended
5.396 us/op
# Warmup Iteration 2: 5.404 us/op
# Warmup Iteration 3: 5.308 us/op
Iteration 1: 5.358 us/op
Iteration 2: 5.313 us/op
Iteration 3: 5.273 us/op
Iteration 4: 5.284 us/op
Iteration 5: 5.302 us/op
Result "reactor.blockhound.BlockHoundBlockingAllowedThreadBenchmark.measureBlockingCall":
5.222 ±(99.9%) 0.078 us/op [Average]
(min, avg, max) = (5.108, 5.222, 5.358), stdev = 0.073
CI (99.9%): [5.144, 5.300] (assumes normal distribution)
# JMH version: 1.21
# VM version: JDK 11.0.3, OpenJDK 64-Bit Server VM, 11.0.3+7
# VM invoker: /usr/lib/jvm/java-11-openjdk-11.0.3.7-5.fc30.x86_64/bin/java
# VM options: <none>
# Warmup: 3 iterations, 10 s each
# Measurement: 5 iterations, 10 s each
# Timeout: 10 min per iteration
# Threads: 1 thread, will synchronize iterations
# Benchmark mode: Average time, time/op
# Benchmark: reactor.blockhound.BlockHoundBlockingAllowedThreadBenchmark.measureNonBlockingCall
# Run progress: 42.86% complete, ETA 00:16:06
# Fork: 1 of 3
# Warmup Iteration 1: OpenJDK 64-Bit Server VM warning: Sharing is only supported for boot loader classes because bootstrap classpath has been appended
5.324 us/op
# Warmup Iteration 2: 5.231 us/op
# Warmup Iteration 3: 5.193 us/op
Iteration 1: 5.242 us/op
Iteration 2: 5.144 us/op
Iteration 3: 5.288 us/op
Iteration 4: 5.159 us/op
Iteration 5: 5.263 us/op
# Run progress: 47.62% complete, ETA 00:14:46
# Fork: 2 of 3
# Warmup Iteration 1: OpenJDK 64-Bit Server VM warning: Sharing is only supported for boot loader classes because bootstrap classpath has been appended
5.198 us/op
# Warmup Iteration 2: 5.083 us/op
# Warmup Iteration 3: 4.996 us/op
Iteration 1: 5.109 us/op
Iteration 2: 5.159 us/op
Iteration 3: 5.078 us/op
Iteration 4: 5.130 us/op
Iteration 5: 5.081 us/op
# Run progress: 52.38% complete, ETA 00:13:26
# Fork: 3 of 3
# Warmup Iteration 1: OpenJDK 64-Bit Server VM warning: Sharing is only supported for boot loader classes because bootstrap classpath has been appended
5.174 us/op
# Warmup Iteration 2: 5.049 us/op
# Warmup Iteration 3: 5.091 us/op
Iteration 1: 5.081 us/op
Iteration 2: 5.048 us/op
Iteration 3: 5.107 us/op
Iteration 4: 5.097 us/op
Iteration 5: 5.137 us/op
Result "reactor.blockhound.BlockHoundBlockingAllowedThreadBenchmark.measureNonBlockingCall":
5.142 ±(99.9%) 0.076 us/op [Average]
(min, avg, max) = (5.048, 5.142, 5.288), stdev = 0.071
CI (99.9%): [5.065, 5.218] (assumes normal distribution)
# JMH version: 1.21
# VM version: JDK 11.0.3, OpenJDK 64-Bit Server VM, 11.0.3+7
# VM invoker: /usr/lib/jvm/java-11-openjdk-11.0.3.7-5.fc30.x86_64/bin/java
# VM options: <none>
# Warmup: 3 iterations, 10 s each
# Measurement: 5 iterations, 10 s each
# Timeout: 10 min per iteration
# Threads: 1 thread, will synchronize iterations
# Benchmark mode: Average time, time/op
# Benchmark: reactor.blockhound.BlockHoundBlockingNotAllowedThreadBenchmark.baselineBlockingCall
# Run progress: 57.14% complete, ETA 00:12:05
# Fork: 1 of 3
# Warmup Iteration 1: 5.169 us/op
# Warmup Iteration 2: 5.100 us/op
# Warmup Iteration 3: 5.087 us/op
Iteration 1: 5.094 us/op
Iteration 2: 5.096 us/op
Iteration 3: 5.153 us/op
Iteration 4: 5.056 us/op
Iteration 5: 5.090 us/op
# Run progress: 61.90% complete, ETA 00:10:45
# Fork: 2 of 3
# Warmup Iteration 1: 5.194 us/op
# Warmup Iteration 2: 5.143 us/op
# Warmup Iteration 3: 5.156 us/op
Iteration 1: 5.122 us/op
Iteration 2: 5.114 us/op
Iteration 3: 5.205 us/op
Iteration 4: 5.222 us/op
Iteration 5: 5.162 us/op
# Run progress: 66.67% complete, ETA 00:09:24
# Fork: 3 of 3
# Warmup Iteration 1: 5.152 us/op
# Warmup Iteration 2: 5.164 us/op
# Warmup Iteration 3: 5.239 us/op
Iteration 1: 5.019 us/op
Iteration 2: 5.079 us/op
Iteration 3: 5.036 us/op
Iteration 4: 5.061 us/op
Iteration 5: 5.018 us/op
Result "reactor.blockhound.BlockHoundBlockingNotAllowedThreadBenchmark.baselineBlockingCall":
5.102 ±(99.9%) 0.067 us/op [Average]
(min, avg, max) = (5.018, 5.102, 5.222), stdev = 0.063
CI (99.9%): [5.035, 5.169] (assumes normal distribution)
# JMH version: 1.21
# VM version: JDK 11.0.3, OpenJDK 64-Bit Server VM, 11.0.3+7
# VM invoker: /usr/lib/jvm/java-11-openjdk-11.0.3.7-5.fc30.x86_64/bin/java
# VM options: <none>
# Warmup: 3 iterations, 10 s each
# Measurement: 5 iterations, 10 s each
# Timeout: 10 min per iteration
# Threads: 1 thread, will synchronize iterations
# Benchmark mode: Average time, time/op
# Benchmark: reactor.blockhound.BlockHoundBlockingNotAllowedThreadBenchmark.measureAllowedBlockingCall
# Run progress: 71.43% complete, ETA 00:08:03
# Fork: 1 of 3
# Warmup Iteration 1: OpenJDK 64-Bit Server VM warning: Sharing is only supported for boot loader classes because bootstrap classpath has been appended
5.980 us/op
# Warmup Iteration 2: 5.835 us/op
# Warmup Iteration 3: 5.805 us/op
Iteration 1: 5.718 us/op
Iteration 2: 5.846 us/op
Iteration 3: 5.791 us/op
Iteration 4: 5.799 us/op
Iteration 5: 5.822 us/op
# Run progress: 76.19% complete, ETA 00:06:43
# Fork: 2 of 3
# Warmup Iteration 1: OpenJDK 64-Bit Server VM warning: Sharing is only supported for boot loader classes because bootstrap classpath has been appended
6.255 us/op
# Warmup Iteration 2: 6.142 us/op
# Warmup Iteration 3: 6.072 us/op
Iteration 1: 6.050 us/op
Iteration 2: 6.007 us/op
Iteration 3: 6.131 us/op
Iteration 4: 6.113 us/op
Iteration 5: 6.069 us/op
# Run progress: 80.95% complete, ETA 00:05:22
# Fork: 3 of 3
# Warmup Iteration 1: OpenJDK 64-Bit Server VM warning: Sharing is only supported for boot loader classes because bootstrap classpath has been appended
5.769 us/op
# Warmup Iteration 2: 5.711 us/op
# Warmup Iteration 3: 5.698 us/op
Iteration 1: 5.672 us/op
Iteration 2: 5.694 us/op
Iteration 3: 5.677 us/op
Iteration 4: 5.680 us/op
Iteration 5: 5.720 us/op
Result "reactor.blockhound.BlockHoundBlockingNotAllowedThreadBenchmark.measureAllowedBlockingCall":
5.853 ±(99.9%) 0.184 us/op [Average]
(min, avg, max) = (5.672, 5.853, 6.131), stdev = 0.173
CI (99.9%): [5.668, 6.037] (assumes normal distribution)
# JMH version: 1.21
# VM version: JDK 11.0.3, OpenJDK 64-Bit Server VM, 11.0.3+7
# VM invoker: /usr/lib/jvm/java-11-openjdk-11.0.3.7-5.fc30.x86_64/bin/java
# VM options: <none>
# Warmup: 3 iterations, 10 s each
# Measurement: 5 iterations, 10 s each
# Timeout: 10 min per iteration
# Threads: 1 thread, will synchronize iterations
# Benchmark mode: Average time, time/op
# Benchmark: reactor.blockhound.BlockHoundBlockingNotAllowedThreadBenchmark.measureDisallowedBlockingCall
# Run progress: 85.71% complete, ETA 00:04:01
# Fork: 1 of 3
# Warmup Iteration 1: OpenJDK 64-Bit Server VM warning: Sharing is only supported for boot loader classes because bootstrap classpath has been appended
5.828 us/op
# Warmup Iteration 2: 5.907 us/op
# Warmup Iteration 3: 5.972 us/op
Iteration 1: 5.970 us/op
Iteration 2: 5.904 us/op
Iteration 3: 5.914 us/op
Iteration 4: 5.897 us/op
Iteration 5: 5.966 us/op
# Run progress: 90.48% complete, ETA 00:02:41
# Fork: 2 of 3
# Warmup Iteration 1: OpenJDK 64-Bit Server VM warning: Sharing is only supported for boot loader classes because bootstrap classpath has been appended
6.549 us/op
# Warmup Iteration 2: 6.454 us/op
# Warmup Iteration 3: 6.451 us/op
Iteration 1: 6.462 us/op
Iteration 2: 6.408 us/op
Iteration 3: 6.477 us/op
Iteration 4: 6.363 us/op
Iteration 5: 6.335 us/op
# Run progress: 95.24% complete, ETA 00:01:20
# Fork: 3 of 3
# Warmup Iteration 1: OpenJDK 64-Bit Server VM warning: Sharing is only supported for boot loader classes because bootstrap classpath has been appended
6.479 us/op
# Warmup Iteration 2: 6.675 us/op
# Warmup Iteration 3: 6.552 us/op
Iteration 1: 6.738 us/op
Iteration 2: 6.653 us/op
Iteration 3: 6.660 us/op
Iteration 4: 6.687 us/op
Iteration 5: 6.573 us/op
Result "reactor.blockhound.BlockHoundBlockingNotAllowedThreadBenchmark.measureDisallowedBlockingCall":
6.334 ±(99.9%) 0.340 us/op [Average]
(min, avg, max) = (5.897, 6.334, 6.738), stdev = 0.318
CI (99.9%): [5.994, 6.674] (assumes normal distribution)
# Run complete. Total time: 00:28:14
REMEMBER: The numbers below are just data. To gain reusable insights, you need to follow up on
why the numbers are the way they are. Use profilers (see -prof, -lprof), design factorial
experiments, perform baseline and negative tests that provide experimental control, make sure
the benchmarking environment is safe on JVM/OS/HW level, ask for reviews from the domain experts.
Do not assume the numbers tell you what you want them to tell.
Benchmark Mode Cnt Score Error Units
BlockHoundBlockingAllowedThreadBenchmark.baselineBlockingCall avgt 15 5.124 ± 0.039 us/op
BlockHoundBlockingAllowedThreadBenchmark.baselineNonBlockingCall avgt 15 5.070 ± 0.045 us/op
BlockHoundBlockingAllowedThreadBenchmark.measureBlockingCall avgt 15 5.222 ± 0.078 us/op
BlockHoundBlockingAllowedThreadBenchmark.measureNonBlockingCall avgt 15 5.142 ± 0.076 us/op
BlockHoundBlockingNotAllowedThreadBenchmark.baselineBlockingCall avgt 15 5.102 ± 0.067 us/op
BlockHoundBlockingNotAllowedThreadBenchmark.measureAllowedBlockingCall avgt 15 5.853 ± 0.184 us/op
BlockHoundBlockingNotAllowedThreadBenchmark.measureDisallowedBlockingCall avgt 15 6.334 ± 0.340 us/op
Benchmark result is saved to /home/foobar/Code/BlockHound/example/build/reports/jmh/results1562425147999.txt
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment