Skip to content

Instantly share code, notes, and snippets.

@jvican

jvican/upicklet-js-compiler-plugins-classloading-benchmark.sh

Created February 7, 2018 22:30
Show Gist options
  • Save jvican/aa7d0d5be9ff1e1d72a03a5c0560e217 to your computer and use it in GitHub Desktop.
Save jvican/aa7d0d5be9ff1e1d72a03a5c0560e217 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
upicklet-js-compiler-plugins-classloading-benchmark.sh
> $ for i in 2.12.5--bin-dbd90495c2-SNAPSHOT 2.12.5-bin-f18e3c59fd-SNAPSHOT; do \ [±84a3854 ●]
sbt "set scalaVersion in compilation := \"$i\"" 'hot -f1 -wi 10 -i 8 -p source=@/data/rw/code/scala/upickle/upickle/js/target/test.args' || break; \
done
Starting sbt with output filtering enabled.
[info] Loading global plugins from /home/jvican/.sbt/0.13/plugins
[info] Loading project definition from /data/rw/code/scala/compiler-benchmark/project
[info] Set current project to compiler-benchmark (in build file:/data/rw/code/scala/compiler-benchmark/)
[info] Defining compilation/*:scalaVersion
[info] The new value will be used by compilation/*:allDependencies, compilation/*:crossScalaVersions and 32 others.
[info] Run `last` for details.
[info] Reapplying settings...
[info] Set current project to compiler-benchmark (in build file:/data/rw/code/scala/compiler-benchmark/)
Processing 37 classes from /data/rw/code/scala/compiler-benchmark/compilation/target/scala-2.12.5--bin-dbd90495c2-SNAPSHOT/classes with "reflection" generator
Writing out Java source to /data/rw/code/scala/compiler-benchmark/compilation/target/scala-2.12.5--bin-dbd90495c2-SNAPSHOT/src_managed/jmh and resources to /data/rw/code/scala/compiler-benchmark/compilation/target/scala-2.12.5--bin-dbd90495c2-SNAPSHOT/resource_managed/jmh
[info] Running scala.bench.ScalacBenchmarkRunner HotScalacBenchmark -foe true -f1 -wi 10 -i 8 -p source=@/data/rw/code/scala/upickle/upickle/js/target/test.args
[info] # JMH version: 1.19
[info] # VM version: JDK 1.8.0_144, VM 25.144-b01
[info] # VM invoker: /usr/lib/jvm/java-8-openjdk/jre/bin/java
[info] # VM options: -Xms2G -Xmx2G
[info] # Warmup: 10 iterations, 10 s each
[info] # Measurement: 8 iterations, 10 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Sampling time
[info] # Benchmark: scala.tools.nsc.HotScalacBenchmark.compile
[info] # Parameters: (corpusVersion = latest, extraArgs = , source = @/data/rw/code/scala/upickle/upickle/js/target/test.args)
[info]
[info] # Run progress: 0.00% complete, ETA 00:03:00
[info] # Fork: 1 of 1
[info] # Warmup Iteration 1: 27917.287 ms/op
[info] # Warmup Iteration 2: 18186.502 ms/op
[info] # Warmup Iteration 3: 16710.107 ms/op
[info] # Warmup Iteration 4: 14864.613 ms/op
[info] # Warmup Iteration 5: 13992.198 ms/op
[info] # Warmup Iteration 6: 13958.644 ms/op
[info] # Warmup Iteration 7: 13086.228 ms/op
[info] # Warmup Iteration 8: 13254.001 ms/op
[info] # Warmup Iteration 9: 13321.110 ms/op
[info] # Warmup Iteration 10: 12784.239 ms/op
[info] Iteration 1: 12633.244 ms/op
[info] compile·p0.00: 12633.244 ms/op
[info] compile·p0.50: 12633.244 ms/op
[info] compile·p0.90: 12633.244 ms/op
[info] compile·p0.95: 12633.244 ms/op
[info] compile·p0.99: 12633.244 ms/op
[info] compile·p0.999: 12633.244 ms/op
[info] compile·p0.9999: 12633.244 ms/op
[info] compile·p1.00: 12633.244 ms/op
[info]
[info] Iteration 2: 12431.917 ms/op
[info] compile·p0.00: 12431.917 ms/op
[info] compile·p0.50: 12431.917 ms/op
[info] compile·p0.90: 12431.917 ms/op
[info] compile·p0.95: 12431.917 ms/op
[info] compile·p0.99: 12431.917 ms/op
[info] compile·p0.999: 12431.917 ms/op
[info] compile·p0.9999: 12431.917 ms/op
[info] compile·p1.00: 12431.917 ms/op
[info]
[info] Iteration 3: 12532.580 ms/op
[info] compile·p0.00: 12532.580 ms/op
[info] compile·p0.50: 12532.580 ms/op
[info] compile·p0.90: 12532.580 ms/op
[info] compile·p0.95: 12532.580 ms/op
[info] compile·p0.99: 12532.580 ms/op
[info] compile·p0.999: 12532.580 ms/op
[info] compile·p0.9999: 12532.580 ms/op
[info] compile·p1.00: 12532.580 ms/op
[info]
[info] Iteration 4: 12482.249 ms/op
[info] compile·p0.00: 12482.249 ms/op
[info] compile·p0.50: 12482.249 ms/op
[info] compile·p0.90: 12482.249 ms/op
[info] compile·p0.95: 12482.249 ms/op
[info] compile·p0.99: 12482.249 ms/op
[info] compile·p0.999: 12482.249 ms/op
[info] compile·p0.9999: 12482.249 ms/op
[info] compile·p1.00: 12482.249 ms/op
[info]
[info] Iteration 5: 12180.259 ms/op
[info] compile·p0.00: 12180.259 ms/op
[info] compile·p0.50: 12180.259 ms/op
[info] compile·p0.90: 12180.259 ms/op
[info] compile·p0.95: 12180.259 ms/op
[info] compile·p0.99: 12180.259 ms/op
[info] compile·p0.999: 12180.259 ms/op
[info] compile·p0.9999: 12180.259 ms/op
[info] compile·p1.00: 12180.259 ms/op
[info]
[info] Iteration 6: 12515.803 ms/op
[info] compile·p0.00: 12515.803 ms/op
[info] compile·p0.50: 12515.803 ms/op
[info] compile·p0.90: 12515.803 ms/op
[info] compile·p0.95: 12515.803 ms/op
[info] compile·p0.99: 12515.803 ms/op
[info] compile·p0.999: 12515.803 ms/op
[info] compile·p0.9999: 12515.803 ms/op
[info] compile·p1.00: 12515.803 ms/op
[info]
[info] Iteration 7: 12163.482 ms/op
[info] compile·p0.00: 12163.482 ms/op
[info] compile·p0.50: 12163.482 ms/op
[info] compile·p0.90: 12163.482 ms/op
[info] compile·p0.95: 12163.482 ms/op
[info] compile·p0.99: 12163.482 ms/op
[info] compile·p0.999: 12163.482 ms/op
[info] compile·p0.9999: 12163.482 ms/op
[info] compile·p1.00: 12163.482 ms/op
[info]
[info] Iteration 8: 12113.150 ms/op
[info] compile·p0.00: 12113.150 ms/op
[info] compile·p0.50: 12113.150 ms/op
[info] compile·p0.90: 12113.150 ms/op
[info] compile·p0.95: 12113.150 ms/op
[info] compile·p0.99: 12113.150 ms/op
[info] compile·p0.999: 12113.150 ms/op
[info] compile·p0.9999: 12113.150 ms/op
[info] compile·p1.00: 12113.150 ms/op
[info]
[info]
[info]
[info] Result "scala.tools.nsc.HotScalacBenchmark.compile":
[info] N = 8
[info] mean = 12381.585 ±(99.9%) 380.321 ms/op
[info]
[info] Histogram, ms/op:
[info] [12100.000, 12150.000) = 1
[info] [12150.000, 12200.000) = 2
[info] [12200.000, 12250.000) = 0
[info] [12250.000, 12300.000) = 0
[info] [12300.000, 12350.000) = 0
[info] [12350.000, 12400.000) = 0
[info] [12400.000, 12450.000) = 1
[info] [12450.000, 12500.000) = 1
[info] [12500.000, 12550.000) = 2
[info] [12550.000, 12600.000) = 0
[info] [12600.000, 12650.000) = 1
[info]
[info] Percentiles, ms/op:
[info] p(0.0000) = 12113.150 ms/op
[info] p(50.0000) = 12457.083 ms/op
[info] p(90.0000) = 12633.244 ms/op
[info] p(95.0000) = 12633.244 ms/op
[info] p(99.0000) = 12633.244 ms/op
[info] p(99.9000) = 12633.244 ms/op
[info] p(99.9900) = 12633.244 ms/op
[info] p(99.9990) = 12633.244 ms/op
[info] p(99.9999) = 12633.244 ms/op
[info] p(100.0000) = 12633.244 ms/op
[info]
[info]
[info] # Run complete. Total time: 00:04:18
[info]
[info] Benchmark (corpusVersion) (extraArgs) (source) Mode Cnt Score Error Units
[info] HotScalacBenchmark.compile latest @/data/rw/code/scala/upickle/upickle/js/target/test.args sample 8 12381.585 ± 380.321 ms/op
[info] HotScalacBenchmark.compile:compile·p0.00 latest @/data/rw/code/scala/upickle/upickle/js/target/test.args sample 12113.150 ms/op
[info] HotScalacBenchmark.compile:compile·p0.50 latest @/data/rw/code/scala/upickle/upickle/js/target/test.args sample 12457.083 ms/op
[info] HotScalacBenchmark.compile:compile·p0.90 latest @/data/rw/code/scala/upickle/upickle/js/target/test.args sample 12633.244 ms/op
[info] HotScalacBenchmark.compile:compile·p0.95 latest @/data/rw/code/scala/upickle/upickle/js/target/test.args sample 12633.244 ms/op
[info] HotScalacBenchmark.compile:compile·p0.99 latest @/data/rw/code/scala/upickle/upickle/js/target/test.args sample 12633.244 ms/op
[info] HotScalacBenchmark.compile:compile·p0.999 latest @/data/rw/code/scala/upickle/upickle/js/target/test.args sample 12633.244 ms/op
[info] HotScalacBenchmark.compile:compile·p0.9999 latest @/data/rw/code/scala/upickle/upickle/js/target/test.args sample 12633.244 ms/op
[info] HotScalacBenchmark.compile:compile·p1.00 latest @/data/rw/code/scala/upickle/upickle/js/target/test.args sample 12633.244 ms/op
[success] Total time: 260 s, completed Jan 30, 2018 12:47:08 AM
Starting sbt with output filtering enabled.
[info] Loading global plugins from /home/jvican/.sbt/0.13/plugins
[info] Loading project definition from /data/rw/code/scala/compiler-benchmark/project
[info] Set current project to compiler-benchmark (in build file:/data/rw/code/scala/compiler-benchmark/)
[info] Defining compilation/*:scalaVersion
[info] The new value will be used by compilation/*:allDependencies, compilation/*:crossScalaVersions and 32 others.
[info] Run `last` for details.
[info] Reapplying settings...
[info] Set current project to compiler-benchmark (in build file:/data/rw/code/scala/compiler-benchmark/)
Processing 37 classes from /data/rw/code/scala/compiler-benchmark/compilation/target/scala-2.12/classes with "reflection" generator
Writing out Java source to /data/rw/code/scala/compiler-benchmark/compilation/target/scala-2.12/src_managed/jmh and resources to /data/rw/code/scala/compiler-benchmark/compilation/target/scala-2.12/resource_managed/jmh
[info] Running scala.bench.ScalacBenchmarkRunner HotScalacBenchmark -foe true -f1 -wi 10 -i 8 -p source=@/data/rw/code/scala/upickle/upickle/js/target/test.args
[info] # JMH version: 1.19
[info] # VM version: JDK 1.8.0_144, VM 25.144-b01
[info] # VM invoker: /usr/lib/jvm/java-8-openjdk/jre/bin/java
[info] # VM options: -Xms2G -Xmx2G
[info] # Warmup: 10 iterations, 10 s each
[info] # Measurement: 8 iterations, 10 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Sampling time
[info] # Benchmark: scala.tools.nsc.HotScalacBenchmark.compile
[info] # Parameters: (corpusVersion = latest, extraArgs = , source = @/data/rw/code/scala/upickle/upickle/js/target/test.args)
[info]
[info] # Run progress: 0.00% complete, ETA 00:03:00
[info] # Fork: 1 of 1
[info] # Warmup Iteration 1: 31474.057 ms/op
[info] # Warmup Iteration 2: 16559.112 ms/op
[info] # Warmup Iteration 3: 14361.297 ms/op
[info] # Warmup Iteration 4: 13522.436 ms/op
[info] # Warmup Iteration 5: 12314.477 ms/op
[info] # Warmup Iteration 6: 11744.051 ms/op
[info] # Warmup Iteration 7: 11509.170 ms/op
[info] # Warmup Iteration 8: 11425.284 ms/op
[info] # Warmup Iteration 9: 11089.740 ms/op
[info] # Warmup Iteration 10: 11660.165 ms/op
[info] Iteration 1: 11056.185 ms/op
[info] compile·p0.00: 11056.185 ms/op
[info] compile·p0.50: 11056.185 ms/op
[info] compile·p0.90: 11056.185 ms/op
[info] compile·p0.95: 11056.185 ms/op
[info] compile·p0.99: 11056.185 ms/op
[info] compile·p0.999: 11056.185 ms/op
[info] compile·p0.9999: 11056.185 ms/op
[info] compile·p1.00: 11056.185 ms/op
[info]
[info] Iteration 2: 10770.973 ms/op
[info] compile·p0.00: 10770.973 ms/op
[info] compile·p0.50: 10770.973 ms/op
[info] compile·p0.90: 10770.973 ms/op
[info] compile·p0.95: 10770.973 ms/op
[info] compile·p0.99: 10770.973 ms/op
[info] compile·p0.999: 10770.973 ms/op
[info] compile·p0.9999: 10770.973 ms/op
[info] compile·p1.00: 10770.973 ms/op
[info]
[info] Iteration 3: 10770.973 ms/op
[info] compile·p0.00: 10770.973 ms/op
[info] compile·p0.50: 10770.973 ms/op
[info] compile·p0.90: 10770.973 ms/op
[info] compile·p0.95: 10770.973 ms/op
[info] compile·p0.99: 10770.973 ms/op
[info] compile·p0.999: 10770.973 ms/op
[info] compile·p0.9999: 10770.973 ms/op
[info] compile·p1.00: 10770.973 ms/op
[info]
[info] Iteration 4: 10838.082 ms/op
[info] compile·p0.00: 10838.082 ms/op
[info] compile·p0.50: 10838.082 ms/op
[info] compile·p0.90: 10838.082 ms/op
[info] compile·p0.95: 10838.082 ms/op
[info] compile·p0.99: 10838.082 ms/op
[info] compile·p0.999: 10838.082 ms/op
[info] compile·p0.9999: 10838.082 ms/op
[info] compile·p1.00: 10838.082 ms/op
[info]
[info] Iteration 5: 10653.532 ms/op
[info] compile·p0.00: 10653.532 ms/op
[info] compile·p0.50: 10653.532 ms/op
[info] compile·p0.90: 10653.532 ms/op
[info] compile·p0.95: 10653.532 ms/op
[info] compile·p0.99: 10653.532 ms/op
[info] compile·p0.999: 10653.532 ms/op
[info] compile·p0.9999: 10653.532 ms/op
[info] compile·p1.00: 10653.532 ms/op
[info]
[info] Iteration 6: 10619.978 ms/op
[info] compile·p0.00: 10619.978 ms/op
[info] compile·p0.50: 10619.978 ms/op
[info] compile·p0.90: 10619.978 ms/op
[info] compile·p0.95: 10619.978 ms/op
[info] compile·p0.99: 10619.978 ms/op
[info] compile·p0.999: 10619.978 ms/op
[info] compile·p0.9999: 10619.978 ms/op
[info] compile·p1.00: 10619.978 ms/op
[info]
[info] Iteration 7: 10519.314 ms/op
[info] compile·p0.00: 10519.314 ms/op
[info] compile·p0.50: 10519.314 ms/op
[info] compile·p0.90: 10519.314 ms/op
[info] compile·p0.95: 10519.314 ms/op
[info] compile·p0.99: 10519.314 ms/op
[info] compile·p0.999: 10519.314 ms/op
[info] compile·p0.9999: 10519.314 ms/op
[info] compile·p1.00: 10519.314 ms/op
[info]
[info] Iteration 8: 10485.760 ms/op
[info] compile·p0.00: 10485.760 ms/op
[info] compile·p0.50: 10485.760 ms/op
[info] compile·p0.90: 10485.760 ms/op
[info] compile·p0.95: 10485.760 ms/op
[info] compile·p0.99: 10485.760 ms/op
[info] compile·p0.999: 10485.760 ms/op
[info] compile·p0.9999: 10485.760 ms/op
[info] compile·p1.00: 10485.760 ms/op
[info]
[info]
[info]
[info] Result "scala.tools.nsc.HotScalacBenchmark.compile":
[info] N = 8
[info] mean = 10714.350 ±(99.9%) 355.112 ms/op
[info]
[info] Histogram, ms/op:
[info] [10400.000, 10450.000) = 0
[info] [10450.000, 10500.000) = 1
[info] [10500.000, 10550.000) = 1
[info] [10550.000, 10600.000) = 0
[info] [10600.000, 10650.000) = 1
[info] [10650.000, 10700.000) = 1
[info] [10700.000, 10750.000) = 0
[info] [10750.000, 10800.000) = 2
[info] [10800.000, 10850.000) = 1
[info] [10850.000, 10900.000) = 0
[info] [10900.000, 10950.000) = 0
[info] [10950.000, 11000.000) = 0
[info] [11000.000, 11050.000) = 0
[info]
[info] Percentiles, ms/op:
[info] p(0.0000) = 10485.760 ms/op
[info] p(50.0000) = 10712.252 ms/op
[info] p(90.0000) = 11056.185 ms/op
[info] p(95.0000) = 11056.185 ms/op
[info] p(99.0000) = 11056.185 ms/op
[info] p(99.9000) = 11056.185 ms/op
[info] p(99.9900) = 11056.185 ms/op
[info] p(99.9990) = 11056.185 ms/op
[info] p(99.9999) = 11056.185 ms/op
[info] p(100.0000) = 11056.185 ms/op
[info]
[info]
[info] # Run complete. Total time: 00:03:52
[info]
[info] Benchmark (corpusVersion) (extraArgs) (source) Mode Cnt Score Error Units
[info] HotScalacBenchmark.compile latest @/data/rw/code/scala/upickle/upickle/js/target/test.args sample 8 10714.350 ± 355.112 ms/op
[info] HotScalacBenchmark.compile:compile·p0.00 latest @/data/rw/code/scala/upickle/upickle/js/target/test.args sample 10485.760 ms/op
[info] HotScalacBenchmark.compile:compile·p0.50 latest @/data/rw/code/scala/upickle/upickle/js/target/test.args sample 10712.252 ms/op
[info] HotScalacBenchmark.compile:compile·p0.90 latest @/data/rw/code/scala/upickle/upickle/js/target/test.args sample 11056.185 ms/op
[info] HotScalacBenchmark.compile:compile·p0.95 latest @/data/rw/code/scala/upickle/upickle/js/target/test.args sample 11056.185 ms/op
[info] HotScalacBenchmark.compile:compile·p0.99 latest @/data/rw/code/scala/upickle/upickle/js/target/test.args sample 11056.185 ms/op
[info] HotScalacBenchmark.compile:compile·p0.999 latest @/data/rw/code/scala/upickle/upickle/js/target/test.args sample 11056.185 ms/op
[info] HotScalacBenchmark.compile:compile·p0.9999 latest @/data/rw/code/scala/upickle/upickle/js/target/test.args sample 11056.185 ms/op
[info] HotScalacBenchmark.compile:compile·p1.00 latest @/data/rw/code/scala/upickle/upickle/js/target/test.args sample 11056.185 ms/op
[success] Total time: 235 s, completed Jan 30, 2018 12:51:12 AM
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment