Skip to content

Instantly share code, notes, and snippets.

@saschatimme

saschatimme/benchmark.md

Last active April 29, 2018 08:05
Show Gist options
  • Save saschatimme/0ff7aedc084d81866be9cf7d92f94e37 to your computer and use it in GitHub Desktop.
Save saschatimme/0ff7aedc084d81866be9cf7d92f94e37 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
benchmark.md

Benchmark Report for StaticPolynomials

Job Properties

  • Time of benchmarks:
    • Target: 28 Apr 2018 - 20:27
    • Baseline: 28 Apr 2018 - 20:31
  • Package commits:
    • Target: 35310a
    • Baseline: fe936e
  • Julia commits:
    • Target: 0d7248
    • Baseline: 0d7248
  • Julia command flags:
    • Target: -O3
    • Baseline: -O3
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["evaluate", "Complex{Float64}", "chandra4"] 0.79 (5%) ✅ 1.00 (1%)
["evaluate", "Complex{Float64}", "chandra5"] 0.88 (5%) ✅ 1.00 (1%)
["evaluate", "Complex{Float64}", "cyclic5"] 0.80 (5%) ✅ 1.00 (1%)
["evaluate", "Complex{Float64}", "cyclic6"] 0.89 (5%) ✅ 1.00 (1%)
["evaluate", "Complex{Float64}", "fourbar"] 0.94 (5%) ✅ 1.00 (1%)
["evaluate", "Complex{Float64}", "katsura10"] 1.11 (5%) ❌ 1.00 (1%)
["evaluate", "Complex{Float64}", "katsura5"] 1.07 (5%) ❌ 1.00 (1%)
["evaluate", "Complex{Float64}", "katsura7"] 0.93 (5%) ✅ 1.00 (1%)
["evaluate", "Complex{Float64}", "katsura8"] 1.08 (5%) ❌ 1.00 (1%)
["evaluate", "Complex{Float64}", "katsura9"] 1.13 (5%) ❌ 1.00 (1%)
["evaluate", "Complex{Float64}", "rps10"] 1.20 (5%) ❌ 1.00 (1%)
["evaluate", "Float64", "chandra4"] 0.62 (5%) ✅ 1.00 (1%)
["evaluate", "Float64", "chandra5"] 0.80 (5%) ✅ 1.00 (1%)
["evaluate", "Float64", "cyclic5"] 0.65 (5%) ✅ 1.00 (1%)
["evaluate", "Float64", "cyclic6"] 0.90 (5%) ✅ 1.00 (1%)
["evaluate", "Float64", "cyclic7"] 0.76 (5%) ✅ 1.00 (1%)
["evaluate", "Float64", "katsura10"] 1.23 (5%) ❌ 1.00 (1%)
["evaluate", "Float64", "katsura5"] 0.84 (5%) ✅ 1.00 (1%)
["evaluate", "Float64", "katsura6"] 0.85 (5%) ✅ 1.00 (1%)
["evaluate", "Float64", "katsura8"] 1.07 (5%) ❌ 1.00 (1%)
["evaluate", "Float64", "katsura9"] 1.10 (5%) ❌ 1.00 (1%)
["evaluate", "Float64", "rps10"] 1.52 (5%) ❌ 1.00 (1%)
["jacobian", "Complex{Float64}", "chandra4"] 0.52 (5%) ✅ 1.00 (1%)
["jacobian", "Complex{Float64}", "chandra5"] 0.64 (5%) ✅ 1.00 (1%)
["jacobian", "Complex{Float64}", "cyclic5"] 0.79 (5%) ✅ 1.00 (1%)
["jacobian", "Complex{Float64}", "cyclic6"] 0.87 (5%) ✅ 1.00 (1%)
["jacobian", "Complex{Float64}", "cyclic7"] 0.87 (5%) ✅ 1.00 (1%)
["jacobian", "Complex{Float64}", "cyclic8"] 0.86 (5%) ✅ 1.00 (1%)
["jacobian", "Complex{Float64}", "fourbar"] 1.12 (5%) ❌ 1.00 (1%)
["jacobian", "Complex{Float64}", "katsura10"] 0.72 (5%) ✅ 1.00 (1%)
["jacobian", "Complex{Float64}", "katsura5"] 0.69 (5%) ✅ 1.00 (1%)
["jacobian", "Complex{Float64}", "katsura6"] 0.66 (5%) ✅ 1.00 (1%)
["jacobian", "Complex{Float64}", "katsura7"] 0.67 (5%) ✅ 1.00 (1%)
["jacobian", "Complex{Float64}", "katsura8"] 0.71 (5%) ✅ 1.00 (1%)
["jacobian", "Complex{Float64}", "katsura9"] 0.64 (5%) ✅ 1.00 (1%)
["jacobian", "Complex{Float64}", "rps10"] 0.92 (5%) ✅ 1.00 (1%)
["jacobian", "Float64", "chandra4"] 0.57 (5%) ✅ 1.00 (1%)
["jacobian", "Float64", "chandra5"] 0.66 (5%) ✅ 1.00 (1%)
["jacobian", "Float64", "cyclic5"] 0.77 (5%) ✅ 1.00 (1%)
["jacobian", "Float64", "cyclic6"] 0.76 (5%) ✅ 1.00 (1%)
["jacobian", "Float64", "cyclic7"] 0.82 (5%) ✅ 1.00 (1%)
["jacobian", "Float64", "fourbar"] 1.27 (5%) ❌ 1.00 (1%)
["jacobian", "Float64", "katsura5"] 0.80 (5%) ✅ 1.00 (1%)
["jacobian", "Float64", "katsura6"] 0.79 (5%) ✅ 1.00 (1%)
["jacobian", "Float64", "katsura7"] 0.88 (5%) ✅ 1.00 (1%)
["jacobian", "Float64", "katsura8"] 0.91 (5%) ✅ 1.00 (1%)
["jacobian", "Float64", "katsura9"] 0.85 (5%) ✅ 1.00 (1%)
["jacobian", "Float64", "rps10"] 1.55 (5%) ❌ 1.00 (1%)
["static jacobian", "Complex{Float64}", "chandra4"] 0.66 (5%) ✅ 1.00 (1%)
["static jacobian", "Complex{Float64}", "chandra5"] 0.75 (5%) ✅ 1.00 (1%)
["static jacobian", "Complex{Float64}", "cyclic5"] 0.85 (5%) ✅ 1.00 (1%)
["static jacobian", "Complex{Float64}", "cyclic6"] 0.81 (5%) ✅ 1.00 (1%)
["static jacobian", "Complex{Float64}", "cyclic7"] 0.87 (5%) ✅ 1.00 (1%)
["static jacobian", "Complex{Float64}", "cyclic8"] 0.81 (5%) ✅ 1.00 (1%)
["static jacobian", "Complex{Float64}", "fourbar"] 0.88 (5%) ✅ 1.00 (1%)
["static jacobian", "Complex{Float64}", "katsura10"] 0.65 (5%) ✅ 1.00 (1%)
["static jacobian", "Complex{Float64}", "katsura5"] 0.67 (5%) ✅ 1.00 (1%)
["static jacobian", "Complex{Float64}", "katsura6"] 0.64 (5%) ✅ 1.00 (1%)
["static jacobian", "Complex{Float64}", "katsura7"] 0.62 (5%) ✅ 1.00 (1%)
["static jacobian", "Complex{Float64}", "katsura8"] 0.67 (5%) ✅ 1.00 (1%)
["static jacobian", "Complex{Float64}", "katsura9"] 0.67 (5%) ✅ 1.00 (1%)
["static jacobian", "Complex{Float64}", "rps10"] 0.92 (5%) ✅ 1.00 (1%)
["static jacobian", "Float64", "chandra4"] 0.68 (5%) ✅ 1.00 (1%)
["static jacobian", "Float64", "chandra5"] 0.63 (5%) ✅ 1.00 (1%)
["static jacobian", "Float64", "cyclic5"] 0.69 (5%) ✅ 1.00 (1%)
["static jacobian", "Float64", "cyclic6"] 0.82 (5%) ✅ 1.00 (1%)
["static jacobian", "Float64", "cyclic7"] 0.76 (5%) ✅ 1.00 (1%)
["static jacobian", "Float64", "cyclic8"] 0.89 (5%) ✅ 1.00 (1%)
["static jacobian", "Float64", "fourbar"] 0.82 (5%) ✅ 1.00 (1%)
["static jacobian", "Float64", "katsura10"] 0.79 (5%) ✅ 1.00 (1%)
["static jacobian", "Float64", "katsura5"] 0.73 (5%) ✅ 1.00 (1%)
["static jacobian", "Float64", "katsura6"] 0.69 (5%) ✅ 1.00 (1%)
["static jacobian", "Float64", "katsura7"] 0.74 (5%) ✅ 1.00 (1%)
["static jacobian", "Float64", "katsura8"] 0.78 (5%) ✅ 1.00 (1%)
["static jacobian", "Float64", "katsura9"] 0.81 (5%) ✅ 1.00 (1%)
["static jacobian", "Float64", "rps10"] 0.77 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["evaluate", "Complex{Float64}"]
  • ["evaluate", "Float64"]
  • ["jacobian", "Complex{Float64}"]
  • ["jacobian", "Float64"]
  • ["static jacobian", "Complex{Float64}"]
  • ["static jacobian", "Float64"]

Julia versioninfo

Target

Julia Version 0.6.1
Commit 0d7248e2ff (2017-10-24 22:15 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
  CPU: Intel(R) Core(TM) i5-4590 CPU @ 3.30GHz
  WORD_SIZE: 64
           "openSUSE Leap 42.3"
  uname: Linux 4.4.120-45-default #1 SMP Wed Mar 14 20:51:49 UTC 2018 (623211f) x86_64 x86_64
Memory: 15.560203552246094 GB (272.09375 MB free)
Uptime: 2.461412e6 sec
Load Avg:  1.26953125  1.21435546875  1.013671875
Intel(R) Core(TM) i5-4590 CPU @ 3.30GHz: 
       speed         user         nice          sys         idle          irq
#1  3699 MHz    3096778 s       4891 s     559185 s  241401447 s          0 s
#2  3600 MHz    2873938 s       3190 s     450243 s  242358693 s          0 s
#3  3548 MHz    2904471 s       6818 s     460786 s  242307697 s          0 s
#4  3699 MHz    2872777 s       6766 s     450438 s  242405630 s          0 s

  BLAS: libopenblas (USE64BITINT DYNAMIC_ARCH NO_AFFINITY Haswell)
  LAPACK: libopenblas64_
  LIBM: libopenlibm
  LLVM: libLLVM-3.9.1 (ORCJIT, haswell)

Baseline

Julia Version 0.6.1
Commit 0d7248e2ff (2017-10-24 22:15 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
  CPU: Intel(R) Core(TM) i5-4590 CPU @ 3.30GHz
  WORD_SIZE: 64
           "openSUSE Leap 42.3"
  uname: Linux 4.4.120-45-default #1 SMP Wed Mar 14 20:51:49 UTC 2018 (623211f) x86_64 x86_64
Memory: 15.560203552246094 GB (278.06640625 MB free)
Uptime: 2.461648e6 sec
Load Avg:  1.3603515625  1.32958984375  1.1083984375
Intel(R) Core(TM) i5-4590 CPU @ 3.30GHz: 
       speed         user         nice          sys         idle          irq
#1  3600 MHz    3097012 s       4891 s     559242 s  241424574 s          0 s
#2  3647 MHz    2885408 s       3190 s     450287 s  242370723 s          0 s
#3  3699 MHz    2913439 s       6818 s     460843 s  242322243 s          0 s
#4  3601 MHz    2873232 s       6766 s     450584 s  242428640 s          0 s

  BLAS: libopenblas (USE64BITINT DYNAMIC_ARCH NO_AFFINITY Haswell)
  LAPACK: libopenblas64_
  LIBM: libopenlibm
  LLVM: libLLVM-3.9.1 (ORCJIT, haswell)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment