Skip to content

Instantly share code, notes, and snippets.

@jvican

jvican/benchmarks-zinc-7d4bf285

Created February 16, 2017 12:44
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save jvican/14a5df268cc7125571b3e68a0de3a80b to your computer and use it in GitHub Desktop.
Save jvican/14a5df268cc7125571b3e68a0de3a80b to your computer and use it in GitHub Desktop.
Download ZIP
Benchmarks for commit 7d4bf285 in Zinc.
Raw
benchmarks-zinc-7d4bf285
l/zinc-benchmarks/target/scala-2.12/src_managed/jmh and resources to /data/rw/code/scala/zinc/internal/zinc-benchmarks/target/scala-2.12/resource_managed/jmh
[info] Compiling 15 Java sources to /data/rw/code/scala/zinc/internal/zinc-benchmarks/target/scala-2.12/classes...
[info] Running org.openjdk.jmh.Main -p _tempDir=/tmp/sbt_67b913f6
[info] # JMH 1.17.4 (released 29 days ago)
[info] # VM version: JDK 1.8.0_92, VM 25.92-b14
[info] # VM invoker: /usr/lib/jvm/java-8-openjdk/jre/bin/java
[info] # VM options: <none>
[info] # Warmup: 6 iterations, 10 s each
[info] # Measurement: 6 iterations, 10 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Sampling time
[info] # Benchmark: xsbt.HotShapelessBenchmark.compile
[info] # Parameters: (_tempDir = /tmp/sbt_67b913f6)
[info]
[info] # Run progress: 0.00% complete, ETA 00:07:30
[info] # Fork: 1 of 3
[info] # Warmup Iteration 1: C
[info] 45499.810 ms/op
[info] # Warmup Iteration 2: C
[info] 23420.994 ms/op
[info] # Warmup Iteration 3: C
[info] 17414.750 ms/op
[info] # Warmup Iteration 4: C
[info] 15904.801 ms/op
[info] # Warmup Iteration 5: C
[info] 14327.742 ms/op
[info] # Warmup Iteration 6: C
[info] 14831.059 ms/op
[info] Iteration 1: C
[info] 13371.441 ms/op
[info] compile·p0.00: 13371.441 ms/op
[info] compile·p0.50: 13371.441 ms/op
[info] compile·p0.90: 13371.441 ms/op
[info] compile·p0.95: 13371.441 ms/op
[info] compile·p0.99: 13371.441 ms/op
[info] compile·p0.999: 13371.441 ms/op
[info] compile·p0.9999: 13371.441 ms/op
[info] compile·p1.00: 13371.441 ms/op
[info]
[info] Iteration 2: C
[info] 13774.094 ms/op
[info] compile·p0.00: 13774.094 ms/op
[info] compile·p0.50: 13774.094 ms/op
[info] compile·p0.90: 13774.094 ms/op
[info] compile·p0.95: 13774.094 ms/op
[info] compile·p0.99: 13774.094 ms/op
[info] compile·p0.999: 13774.094 ms/op
[info] compile·p0.9999: 13774.094 ms/op
[info] compile·p1.00: 13774.094 ms/op
[info]
[info] Iteration 3: C
[info] 13270.778 ms/op
[info] compile·p0.00: 13270.778 ms/op
[info] compile·p0.50: 13270.778 ms/op
[info] compile·p0.90: 13270.778 ms/op
[info] compile·p0.95: 13270.778 ms/op
[info] compile·p0.99: 13270.778 ms/op
[info] compile·p0.999: 13270.778 ms/op
[info] compile·p0.9999: 13270.778 ms/op
[info] compile·p1.00: 13270.778 ms/op
[info]
[info] Iteration 4: C
[info] 14143.193 ms/op
[info] compile·p0.00: 14143.193 ms/op
[info] compile·p0.50: 14143.193 ms/op
[info] compile·p0.90: 14143.193 ms/op
[info] compile·p0.95: 14143.193 ms/op
[info] compile·p0.99: 14143.193 ms/op
[info] compile·p0.999: 14143.193 ms/op
[info] compile·p0.9999: 14143.193 ms/op
[info] compile·p1.00: 14143.193 ms/op
[info]
[info] Iteration 5: C
[info] 13186.892 ms/op
[info] compile·p0.00: 13186.892 ms/op
[info] compile·p0.50: 13186.892 ms/op
[info] compile·p0.90: 13186.892 ms/op
[info] compile·p0.95: 13186.892 ms/op
[info] compile·p0.99: 13186.892 ms/op
[info] compile·p0.999: 13186.892 ms/op
[info] compile·p0.9999: 13186.892 ms/op
[info] compile·p1.00: 13186.892 ms/op
[info]
[info] Iteration 6: C
[info] 12985.565 ms/op
[info] compile·p0.00: 12985.565 ms/op
[info] compile·p0.50: 12985.565 ms/op
[info] compile·p0.90: 12985.565 ms/op
[info] compile·p0.95: 12985.565 ms/op
[info] compile·p0.99: 12985.565 ms/op
[info] compile·p0.999: 12985.565 ms/op
[info] compile·p0.9999: 12985.565 ms/op
[info] compile·p1.00: 12985.565 ms/op
[info]
[info]
[info] # Run progress: 26.67% complete, ETA 00:09:45
[info] # Fork: 2 of 3
[info] # Warmup Iteration 1: C
[info] 43553.653 ms/op
[info] # Warmup Iteration 2: C
[info] 24863.834 ms/op
[info] # Warmup Iteration 3: C
[info] 18253.611 ms/op
[info] # Warmup Iteration 4: C
[info] 15099.494 ms/op
[info] # Warmup Iteration 5: C
[info] 14680.064 ms/op
[info] # Warmup Iteration 6: C
[info] 13287.555 ms/op
[info] Iteration 1: C
[info] 13891.535 ms/op
[info] compile·p0.00: 13891.535 ms/op
[info] compile·p0.50: 13891.535 ms/op
[info] compile·p0.90: 13891.535 ms/op
[info] compile·p0.95: 13891.535 ms/op
[info] compile·p0.99: 13891.535 ms/op
[info] compile·p0.999: 13891.535 ms/op
[info] compile·p0.9999: 13891.535 ms/op
[info] compile·p1.00: 13891.535 ms/op
[info]
[info] Iteration 2: C
[info] 12851.347 ms/op
[info] compile·p0.00: 12851.347 ms/op
[info] compile·p0.50: 12851.347 ms/op
[info] compile·p0.90: 12851.347 ms/op
[info] compile·p0.95: 12851.347 ms/op
[info] compile·p0.99: 12851.347 ms/op
[info] compile·p0.999: 12851.347 ms/op
[info] compile·p0.9999: 12851.347 ms/op
[info] compile·p1.00: 12851.347 ms/op
[info]
[info] Iteration 3: C
[info] 12717.130 ms/op
[info] compile·p0.00: 12717.130 ms/op
[info] compile·p0.50: 12717.130 ms/op
[info] compile·p0.90: 12717.130 ms/op
[info] compile·p0.95: 12717.130 ms/op
[info] compile·p0.99: 12717.130 ms/op
[info] compile·p0.999: 12717.130 ms/op
[info] compile·p0.9999: 12717.130 ms/op
[info] compile·p1.00: 12717.130 ms/op
[info]
[info] Iteration 4: C
[info] 12935.234 ms/op
[info] compile·p0.00: 12935.234 ms/op
[info] compile·p0.50: 12935.234 ms/op
[info] compile·p0.90: 12935.234 ms/op
[info] compile·p0.95: 12935.234 ms/op
[info] compile·p0.99: 12935.234 ms/op
[info] compile·p0.999: 12935.234 ms/op
[info] compile·p0.9999: 12935.234 ms/op
[info] compile·p1.00: 12935.234 ms/op
[info]
[info] Iteration 5: C
[info] 12582.912 ms/op
[info] compile·p0.00: 12582.912 ms/op
[info] compile·p0.50: 12582.912 ms/op
[info] compile·p0.90: 12582.912 ms/op
[info] compile·p0.95: 12582.912 ms/op
[info] compile·p0.99: 12582.912 ms/op
[info] compile·p0.999: 12582.912 ms/op
[info] compile·p0.9999: 12582.912 ms/op
[info] compile·p1.00: 12582.912 ms/op
[info]
[info] Iteration 6: C
[info] 13455.327 ms/op
[info] compile·p0.00: 13455.327 ms/op
[info] compile·p0.50: 13455.327 ms/op
[info] compile·p0.90: 13455.327 ms/op
[info] compile·p0.95: 13455.327 ms/op
[info] compile·p0.99: 13455.327 ms/op
[info] compile·p0.999: 13455.327 ms/op
[info] compile·p0.9999: 13455.327 ms/op
[info] compile·p1.00: 13455.327 ms/op
[info]
[info]
[info] # Run progress: 53.33% complete, ETA 00:06:09
[info] # Fork: 3 of 3
[info] # Warmup Iteration 1: C
[info] 42278.584 ms/op
[info] # Warmup Iteration 2: C
[info] 25736.249 ms/op
[info] # Warmup Iteration 3: C
[info] 19528.679 ms/op
[info] # Warmup Iteration 4: C
[info] 15569.256 ms/op
[info] # Warmup Iteration 5: C
[info] 15099.494 ms/op
[info] # Warmup Iteration 6: C
[info] 13555.991 ms/op
[info] Iteration 1: C
[info] 13958.644 ms/op
[info] compile·p0.00: 13958.644 ms/op
[info] compile·p0.50: 13958.644 ms/op
[info] compile·p0.90: 13958.644 ms/op
[info] compile·p0.95: 13958.644 ms/op
[info] compile·p0.99: 13958.644 ms/op
[info] compile·p0.999: 13958.644 ms/op
[info] compile·p0.9999: 13958.644 ms/op
[info] compile·p1.00: 13958.644 ms/op
[info]
[info] Iteration 2: C
[info] 12884.902 ms/op
[info] compile·p0.00: 12884.902 ms/op
[info] compile·p0.50: 12884.902 ms/op
[info] compile·p0.90: 12884.902 ms/op
[info] compile·p0.95: 12884.902 ms/op
[info] compile·p0.99: 12884.902 ms/op
[info] compile·p0.999: 12884.902 ms/op
[info] compile·p0.9999: 12884.902 ms/op
[info] compile·p1.00: 12884.902 ms/op
[info]
[info] Iteration 3: C
[info] 14025.753 ms/op
[info] compile·p0.00: 14025.753 ms/op
[info] compile·p0.50: 14025.753 ms/op
[info] compile·p0.90: 14025.753 ms/op
[info] compile·p0.95: 14025.753 ms/op
[info] compile·p0.99: 14025.753 ms/op
[info] compile·p0.999: 14025.753 ms/op
[info] compile·p0.9999: 14025.753 ms/op
[info] compile·p1.00: 14025.753 ms/op
[info]
[info] Iteration 4: C
[info] 13421.773 ms/op
[info] compile·p0.00: 13421.773 ms/op
[info] compile·p0.50: 13421.773 ms/op
[info] compile·p0.90: 13421.773 ms/op
[info] compile·p0.95: 13421.773 ms/op
[info] compile·p0.99: 13421.773 ms/op
[info] compile·p0.999: 13421.773 ms/op
[info] compile·p0.9999: 13421.773 ms/op
[info] compile·p1.00: 13421.773 ms/op
[info]
[info] Iteration 5: C
[info] 14864.613 ms/op
[info] compile·p0.00: 14864.613 ms/op
[info] compile·p0.50: 14864.613 ms/op
[info] compile·p0.90: 14864.613 ms/op
[info] compile·p0.95: 14864.613 ms/op
[info] compile·p0.99: 14864.613 ms/op
[info] compile·p0.999: 14864.613 ms/op
[info] compile·p0.9999: 14864.613 ms/op
[info] compile·p1.00: 14864.613 ms/op
[info]
[info] Iteration 6: C
[info] 12717.130 ms/op
[info] compile·p0.00: 12717.130 ms/op
[info] compile·p0.50: 12717.130 ms/op
[info] compile·p0.90: 12717.130 ms/op
[info] compile·p0.95: 12717.130 ms/op
[info] compile·p0.99: 12717.130 ms/op
[info] compile·p0.999: 12717.130 ms/op
[info] compile·p0.9999: 12717.130 ms/op
[info] compile·p1.00: 12717.130 ms/op
[info]
[info]
[info]
[info] Result "xsbt.HotShapelessBenchmark.compile":
[info] N = 18
[info] mean = 13391.015 ±(99.9%) 573.528 ms/op
[info]
[info] Histogram, ms/op:
[info] [12000.000, 12250.000) = 0
[info] [12250.000, 12500.000) = 0
[info] [12500.000, 12750.000) = 3
[info] [12750.000, 13000.000) = 4
[info] [13000.000, 13250.000) = 1
[info] [13250.000, 13500.000) = 4
[info] [13500.000, 13750.000) = 0
[info] [13750.000, 14000.000) = 3
[info] [14000.000, 14250.000) = 2
[info] [14250.000, 14500.000) = 0
[info] [14500.000, 14750.000) = 0
[info]
[info] Percentiles, ms/op:
[info] p(0.0000) = 12582.912 ms/op
[info] p(50.0000) = 13321.110 ms/op
[info] p(90.0000) = 14215.335 ms/op
[info] p(95.0000) = 14864.613 ms/op
[info] p(99.0000) = 14864.613 ms/op
[info] p(99.9000) = 14864.613 ms/op
[info] p(99.9900) = 14864.613 ms/op
[info] p(99.9990) = 14864.613 ms/op
[info] p(99.9999) = 14864.613 ms/op
[info] p(100.0000) = 14864.613 ms/op
[info]
[info]
[info] # JMH 1.17.4 (released 29 days ago)
[info] # VM version: JDK 1.8.0_92, VM 25.92-b14
[info] # VM invoker: /usr/lib/jvm/java-8-openjdk/jre/bin/java
[info] # VM options: <none>
[info] # Warmup: <none>
[info] # Measurement: 1 iterations, 30 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Sampling time
[info] # Benchmark: xsbt.WarmShapelessBenchmark.compile
[info] # Parameters: (_tempDir = /tmp/sbt_67b913f6)
[info]
[info] # Run progress: 80.00% complete, ETA 00:02:39
[info] # Fork: 1 of 3
[info] Iteration 1: C
[info] 49392.124 ms/op
[info] compile·p0.00: 49392.124 ms/op
[info] compile·p0.50: 49392.124 ms/op
[info] compile·p0.90: 49392.124 ms/op
[info] compile·p0.95: 49392.124 ms/op
[info] compile·p0.99: 49392.124 ms/op
[info] compile·p0.999: 49392.124 ms/op
[info] compile·p0.9999: 49392.124 ms/op
[info] compile·p1.00: 49392.124 ms/op
[info]
[info]
[info] # Run progress: 86.66% complete, ETA 00:01:45
[info] # Fork: 2 of 3
[info] Iteration 1: C
[info] 45298.483 ms/op
[info] compile·p0.00: 45298.483 ms/op
[info] compile·p0.50: 45298.483 ms/op
[info] compile·p0.90: 45298.483 ms/op
[info] compile·p0.95: 45298.483 ms/op
[info] compile·p0.99: 45298.483 ms/op
[info] compile·p0.999: 45298.483 ms/op
[info] compile·p0.9999: 45298.483 ms/op
[info] compile·p1.00: 45298.483 ms/op
[info]
[info]
[info] # Run progress: 93.33% complete, ETA 00:00:52
[info] # Fork: 3 of 3
[info] Iteration 1: C
[info] 48251.273 ms/op
[info] compile·p0.00: 48251.273 ms/op
[info] compile·p0.50: 48251.273 ms/op
[info] compile·p0.90: 48251.273 ms/op
[info] compile·p0.95: 48251.273 ms/op
[info] compile·p0.99: 48251.273 ms/op
[info] compile·p0.999: 48251.273 ms/op
[info] compile·p0.9999: 48251.273 ms/op
[info] compile·p1.00: 48251.273 ms/op
[info]
[info]
[info]
[info] Result "xsbt.WarmShapelessBenchmark.compile":
[info] N = 3
[info] mean = 47647.293 ±(99.9%) 38541.639 ms/op
[info]
[info] Histogram, ms/op:
[info] [45000.000, 45500.000) = 1
[info] [45500.000, 46000.000) = 0
[info] [46000.000, 46500.000) = 0
[info] [46500.000, 47000.000) = 0
[info] [47000.000, 47500.000) = 0
[info] [47500.000, 48000.000) = 0
[info] [48000.000, 48500.000) = 1
[info] [48500.000, 49000.000) = 0
[info] [49000.000, 49500.000) = 1
[info]
[info] Percentiles, ms/op:
[info] p(0.0000) = 45298.483 ms/op
[info] p(50.0000) = 48251.273 ms/op
[info] p(90.0000) = 49392.124 ms/op
[info] p(95.0000) = 49392.124 ms/op
[info] p(99.0000) = 49392.124 ms/op
[info] p(99.9000) = 49392.124 ms/op
[info] p(99.9900) = 49392.124 ms/op
[info] p(99.9990) = 49392.124 ms/op
[info] p(99.9999) = 49392.124 ms/op
[info] p(100.0000) = 49392.124 ms/op
[info]
[info]
[info] # JMH 1.17.4 (released 29 days ago)
[info] # VM version: JDK 1.8.0_92, VM 25.92-b14
[info] # VM invoker: /usr/lib/jvm/java-8-openjdk/jre/bin/java
[info] # VM options: -XX:CICompilerCount=2
[info] # Warmup: <none>
[info] # Measurement: 1 iterations, single-shot each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread
[info] # Benchmark mode: Single shot invocation time
[info] # Benchmark: xsbt.ColdShapelessBenchmark.compile
[info] # Parameters: (_tempDir = /tmp/sbt_67b913f6)
[info]
[info] # Run progress: 100.00% complete, ETA 00:00:00
[info] # Fork: 1 of 10
[info] Iteration 1: C
[info] 36976.910 ms/op
[info]
[info] # Run progress: 100.00% complete, ETA 00:00:00
[info] # Fork: 2 of 10
[info] Iteration 1: C
[info] 36021.420 ms/op
[info]
[info] # Run progress: 100.00% complete, ETA 00:00:00
[info] # Fork: 3 of 10
[info] Iteration 1: C
[info] 40060.946 ms/op
[info]
[info] # Run progress: 100.00% complete, ETA 00:00:00
[info] # Fork: 4 of 10
[info] Iteration 1: C
[info] 38672.270 ms/op
[info]
[info] # Run progress: 100.00% complete, ETA 00:00:00
[info] # Fork: 5 of 10
[info] Iteration 1: C
[info] 39429.528 ms/op
[info]
[info] # Run progress: 100.00% complete, ETA 00:00:00
[info] # Fork: 6 of 10
[info] Iteration 1: C
[info] 37144.523 ms/op
[info]
[info] # Run progress: 100.00% complete, ETA 00:00:00
[info] # Fork: 7 of 10
[info] Iteration 1: C
[info] 33067.391 ms/op
[info]
[info] # Run progress: 100.00% complete, ETA 00:00:00
[info] # Fork: 8 of 10
[info] Iteration 1: C
[info] 34962.063 ms/op
[info]
[info] # Run progress: 100.00% complete, ETA 00:00:00
[info] # Fork: 9 of 10
[info] Iteration 1: C
[info] 43265.421 ms/op
[info]
[info] # Run progress: 100.00% complete, ETA 00:00:00
[info] # Fork: 10 of 10
[info] Iteration 1: C
[info] 52092.405 ms/op
[info]
[info]
[info] Result "xsbt.ColdShapelessBenchmark.compile":
[info] N = 10
[info] mean = 39169.288 ±(99.9%) 8104.775 ms/op
[info]
[info] Histogram, ms/op:
[info] [30000.000, 32500.000) = 0
[info] [32500.000, 35000.000) = 2
[info] [35000.000, 37500.000) = 3
[info] [37500.000, 40000.000) = 2
[info] [40000.000, 42500.000) = 1
[info] [42500.000, 45000.000) = 1
[info] [45000.000, 47500.000) = 0
[info] [47500.000, 50000.000) = 0
[info] [50000.000, 52500.000) = 1
[info] [52500.000, 55000.000) = 0
[info] [55000.000, 57500.000) = 0
[info]
[info] Percentiles, ms/op:
[info] p(0.0000) = 33067.391 ms/op
[info] p(50.0000) = 37908.396 ms/op
[info] p(90.0000) = 51209.707 ms/op
[info] p(95.0000) = 52092.405 ms/op
[info] p(99.0000) = 52092.405 ms/op
[info] p(99.9000) = 52092.405 ms/op
[info] p(99.9900) = 52092.405 ms/op
[info] p(99.9990) = 52092.405 ms/op
[info] p(99.9999) = 52092.405 ms/op
[info] p(100.0000) = 52092.405 ms/op
[info]
[info]
[info] # Run complete. Total time: 00:19:41
[info]
[info] Benchmark (_tempDir) Mode Cnt Score Error Units
[info] HotShapelessBenchmark.compile /tmp/sbt_67b913f6 sample 18 13391.015 ± 573.528 ms/op
[info] HotShapelessBenchmark.compile:compile·p0.00 /tmp/sbt_67b913f6 sample 12582.912 ms/op
[info] HotShapelessBenchmark.compile:compile·p0.50 /tmp/sbt_67b913f6 sample 13321.110 ms/op
[info] HotShapelessBenchmark.compile:compile·p0.90 /tmp/sbt_67b913f6 sample 14215.335 ms/op
[info] HotShapelessBenchmark.compile:compile·p0.95 /tmp/sbt_67b913f6 sample 14864.613 ms/op
[info] HotShapelessBenchmark.compile:compile·p0.99 /tmp/sbt_67b913f6 sample 14864.613 ms/op
[info] HotShapelessBenchmark.compile:compile·p0.999 /tmp/sbt_67b913f6 sample 14864.613 ms/op
[info] HotShapelessBenchmark.compile:compile·p0.9999 /tmp/sbt_67b913f6 sample 14864.613 ms/op
[info] HotShapelessBenchmark.compile:compile·p1.00 /tmp/sbt_67b913f6 sample 14864.613 ms/op
[info] WarmShapelessBenchmark.compile /tmp/sbt_67b913f6 sample 3 47647.293 ± 38541.639 ms/op
[info] WarmShapelessBenchmark.compile:compile·p0.00 /tmp/sbt_67b913f6 sample 45298.483 ms/op
[info] WarmShapelessBenchmark.compile:compile·p0.50 /tmp/sbt_67b913f6 sample 48251.273 ms/op
[info] WarmShapelessBenchmark.compile:compile·p0.90 /tmp/sbt_67b913f6 sample 49392.124 ms/op
[info] WarmShapelessBenchmark.compile:compile·p0.95 /tmp/sbt_67b913f6 sample 49392.124 ms/op
[info] WarmShapelessBenchmark.compile:compile·p0.99 /tmp/sbt_67b913f6 sample 49392.124 ms/op
[info] WarmShapelessBenchmark.compile:compile·p0.999 /tmp/sbt_67b913f6 sample 49392.124 ms/op
[info] WarmShapelessBenchmark.compile:compile·p0.9999 /tmp/sbt_67b913f6 sample 49392.124 ms/op
[info] WarmShapelessBenchmark.compile:compile·p1.00 /tmp/sbt_67b913f6 sample 49392.124 ms/op
[info] ColdShapelessBenchmark.compile /tmp/sbt_67b913f6 ss 10 39169.288 ± 8104.775 ms/op
[success] Total time: 1184 s, completed Feb 16, 2017 1:40:29 PM
[success] Total time: 0 s, completed Feb 16, 2017 1:40:29 PM
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment