Skip to content

Instantly share code, notes, and snippets.

@dpo
Created September 19, 2020 14:33
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save dpo/724ff08aab7da1654d72daa55508701e to your computer and use it in GitHub Desktop.
Save dpo/724ff08aab7da1654d72daa55508701e to your computer and use it in GitHub Desktop.
LDLFactorization repository benchmark
Display the source blob
Display the rendered blob
Raw
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

Benchmark Report for LDLFactorizations

Job Properties

  • Time of benchmarks:
    • Target: 19 Sep 2020 - 10:00
    • Baseline: 19 Sep 2020 - 10:01
  • Package commits:
    • Target: 3d8eb8
    • Baseline: f962c4
  • Julia commits:
    • Target: 96786e
    • Baseline: 96786e
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["fact", "hs21_2x2_0"] 1.07 (5%) ❌ 1.00 (1%)
["fact", "hs53_2x2_0"] 0.95 (5%) ✅ 1.00 (1%)
["fact", "s268_2x2_0"] 1.06 (5%) ❌ 1.00 (1%)
["solve1", "genhs28_2x2_0"] 1.05 (5%) ❌ 1.00 (1%)
["solve1", "hs21_2x2_0"] 1.06 (5%) ❌ 1.00 (1%)
["solve1", "hs35_2x2_0"] 1.05 (5%) ❌ 1.00 (1%)
["solve1", "hs35mod_2x2_0"] 1.07 (5%) ❌ 1.00 (1%)
["solve1", "hs76_2x2_0"] 0.94 (5%) ✅ 1.00 (1%)
["solve1", "lotschd_2x2_0"] 1.12 (5%) ❌ 1.00 (1%)
["solve1", "zecevic2_2x2_0"] 1.07 (5%) ❌ 1.00 (1%)
["solve5", "hs21_2x2_0"] 0.95 (5%) ✅ 1.00 (1%)
["solve5", "lotschd_2x2_0"] 1.09 (5%) ❌ 1.00 (1%)
["solve5", "s268_2x2_0"] 1.05 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["fact"]
  • ["solve1"]
  • ["solve5"]

Julia versioninfo

Target

Julia Version 1.5.0
Commit 96786e22cc (2020-08-01 23:44 UTC)
Platform Info:
  OS: macOS (x86_64-apple-darwin18.7.0)
  uname: Darwin 19.6.0 Darwin Kernel Version 19.6.0: Thu Jun 18 20:49:00 PDT 2020; root:xnu-6153.141.1~1/RELEASE_X86_64 x86_64 i386
  CPU: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz: 
              speed         user         nice          sys         idle          irq
       #1  3100 MHz       5197 s          0 s       6962 s       4153 s          0 s
       #2  3100 MHz       1620 s          0 s       1326 s      13362 s          0 s
       #3  3100 MHz       5181 s          0 s       6555 s       4573 s          0 s
       #4  3100 MHz       1680 s          0 s       1313 s      13316 s          0 s
       #5  3100 MHz       5027 s          0 s       6047 s       5235 s          0 s
       #6  3100 MHz       1784 s          0 s       1325 s      13199 s          0 s
       #7  3100 MHz       4816 s          0 s       4547 s       6945 s          0 s
       #8  3100 MHz       1930 s          0 s       1324 s      13054 s          0 s
       
  Memory: 16.0 GB (2363.93359375 MB free)
  Uptime: 1631.0 sec
  Load Avg:  4.9482421875  4.6103515625  8.9482421875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-9.0.1 (ORCJIT, skylake)

Baseline

Julia Version 1.5.0
Commit 96786e22cc (2020-08-01 23:44 UTC)
Platform Info:
  OS: macOS (x86_64-apple-darwin18.7.0)
  uname: Darwin 19.6.0 Darwin Kernel Version 19.6.0: Thu Jun 18 20:49:00 PDT 2020; root:xnu-6153.141.1~1/RELEASE_X86_64 x86_64 i386
  CPU: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz: 
              speed         user         nice          sys         idle          irq
       #1  3100 MHz       5506 s          0 s       7098 s       4401 s          0 s
       #2  3100 MHz       1667 s          0 s       1363 s      13970 s          0 s
       #3  3100 MHz       5472 s          0 s       6654 s       4874 s          0 s
       #4  3100 MHz       1729 s          0 s       1346 s      13925 s          0 s
       #5  3100 MHz       5315 s          0 s       6137 s       5548 s          0 s
       #6  3100 MHz       1836 s          0 s       1357 s      13807 s          0 s
       #7  3100 MHz       5095 s          0 s       4628 s       7277 s          0 s
       #8  3100 MHz       1986 s          0 s       1355 s      13659 s          0 s
       
  Memory: 16.0 GB (2227.39453125 MB free)
  Uptime: 1700.0 sec
  Load Avg:  3.85888671875  4.33349609375  8.498046875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-9.0.1 (ORCJIT, skylake)

Benchmark Report for LDLFactorizations

Job Properties

  • Time of benchmark: 19 Sep 2020 - 10:1
  • Package commit: f962c4
  • Julia commit: 96786e
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["fact", "genhs28_2x2_0"] 3.027 μs (5%) 6.12 KiB (1%) 20
["fact", "hs21_2x2_0"] 1.790 μs (5%) 4.00 KiB (1%) 20
["fact", "hs21mod_2x2_0"] 2.614 μs (5%) 6.50 KiB (1%) 20
["fact", "hs268_2x2_0"] 2.539 μs (5%) 6.09 KiB (1%) 20
["fact", "hs35_2x2_0"] 1.902 μs (5%) 3.91 KiB (1%) 20
["fact", "hs35mod_2x2_0"] 1.700 μs (5%) 3.52 KiB (1%) 20
["fact", "hs51_2x2_0"] 1.612 μs (5%) 3.29 KiB (1%) 20
["fact", "hs52_2x2_0"] 1.583 μs (5%) 3.29 KiB (1%) 20
["fact", "hs53_2x2_0"] 3.421 μs (5%) 7.49 KiB (1%) 20
["fact", "hs76_2x2_0"] 2.499 μs (5%) 5.59 KiB (1%) 20
["fact", "lotschd_2x2_0"] 5.537 μs (5%) 12.88 KiB (1%) 20
["fact", "s268_2x2_0"] 2.346 μs (5%) 6.09 KiB (1%) 20
["fact", "tame_2x2_0"] 1.534 μs (5%) 3.05 KiB (1%) 20
["fact", "zecevic2_2x2_0"] 2.057 μs (5%) 4.49 KiB (1%) 20
["solve1", "genhs28_2x2_0"] 170.029 ns (5%)
["solve1", "hs21_2x2_0"] 95.454 ns (5%)
["solve1", "hs21mod_2x2_0"] 151.341 ns (5%)
["solve1", "hs268_2x2_0"] 174.581 ns (5%)
["solve1", "hs35_2x2_0"] 94.125 ns (5%)
["solve1", "hs35mod_2x2_0"] 81.705 ns (5%)
["solve1", "hs51_2x2_0"] 87.330 ns (5%)
["solve1", "hs52_2x2_0"] 88.894 ns (5%)
["solve1", "hs53_2x2_0"] 185.294 ns (5%)
["solve1", "hs76_2x2_0"] 135.519 ns (5%)
["solve1", "lotschd_2x2_0"] 336.796 ns (5%)
["solve1", "s268_2x2_0"] 183.759 ns (5%)
["solve1", "tame_2x2_0"] 75.589 ns (5%)
["solve1", "zecevic2_2x2_0"] 108.895 ns (5%)
["solve5", "genhs28_2x2_0"] 577.776 ns (5%)
["solve5", "hs21_2x2_0"] 271.881 ns (5%)
["solve5", "hs21mod_2x2_0"] 455.264 ns (5%)
["solve5", "hs268_2x2_0"] 702.552 ns (5%)
["solve5", "hs35_2x2_0"] 272.333 ns (5%)
["solve5", "hs35mod_2x2_0"] 236.631 ns (5%)
["solve5", "hs51_2x2_0"] 236.254 ns (5%)
["solve5", "hs52_2x2_0"] 229.726 ns (5%)
["solve5", "hs53_2x2_0"] 620.287 ns (5%)
["solve5", "hs76_2x2_0"] 467.357 ns (5%)
["solve5", "lotschd_2x2_0"] 1.468 μs (5%)
["solve5", "s268_2x2_0"] 664.455 ns (5%)
["solve5", "tame_2x2_0"] 187.300 ns (5%)
["solve5", "zecevic2_2x2_0"] 336.128 ns (5%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["fact"]
  • ["solve1"]
  • ["solve5"]

Julia versioninfo

Julia Version 1.5.0
Commit 96786e22cc (2020-08-01 23:44 UTC)
Platform Info:
  OS: macOS (x86_64-apple-darwin18.7.0)
  uname: Darwin 19.6.0 Darwin Kernel Version 19.6.0: Thu Jun 18 20:49:00 PDT 2020; root:xnu-6153.141.1~1/RELEASE_X86_64 x86_64 i386
  CPU: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz: 
              speed         user         nice          sys         idle          irq
       #1  3100 MHz       5506 s          0 s       7098 s       4401 s          0 s
       #2  3100 MHz       1667 s          0 s       1363 s      13970 s          0 s
       #3  3100 MHz       5472 s          0 s       6654 s       4874 s          0 s
       #4  3100 MHz       1729 s          0 s       1346 s      13925 s          0 s
       #5  3100 MHz       5315 s          0 s       6137 s       5548 s          0 s
       #6  3100 MHz       1836 s          0 s       1357 s      13807 s          0 s
       #7  3100 MHz       5095 s          0 s       4628 s       7277 s          0 s
       #8  3100 MHz       1986 s          0 s       1355 s      13659 s          0 s
       
  Memory: 16.0 GB (2227.39453125 MB free)
  Uptime: 1700.0 sec
  Load Avg:  3.85888671875  4.33349609375  8.498046875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-9.0.1 (ORCJIT, skylake)

Benchmark Report for LDLFactorizations

Job Properties

  • Time of benchmark: 19 Sep 2020 - 10:0
  • Package commit: 3d8eb8
  • Julia commit: 96786e
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["fact", "genhs28_2x2_0"] 3.039 μs (5%) 6.12 KiB (1%) 20
["fact", "hs21_2x2_0"] 1.923 μs (5%) 4.00 KiB (1%) 20
["fact", "hs21mod_2x2_0"] 2.687 μs (5%) 6.50 KiB (1%) 20
["fact", "hs268_2x2_0"] 2.478 μs (5%) 6.09 KiB (1%) 20
["fact", "hs35_2x2_0"] 1.842 μs (5%) 3.91 KiB (1%) 20
["fact", "hs35mod_2x2_0"] 1.672 μs (5%) 3.52 KiB (1%) 20
["fact", "hs51_2x2_0"] 1.597 μs (5%) 3.29 KiB (1%) 20
["fact", "hs52_2x2_0"] 1.592 μs (5%) 3.29 KiB (1%) 20
["fact", "hs53_2x2_0"] 3.241 μs (5%) 7.49 KiB (1%) 20
["fact", "hs76_2x2_0"] 2.524 μs (5%) 5.59 KiB (1%) 20
["fact", "lotschd_2x2_0"] 5.700 μs (5%) 12.88 KiB (1%) 20
["fact", "s268_2x2_0"] 2.486 μs (5%) 6.09 KiB (1%) 20
["fact", "tame_2x2_0"] 1.504 μs (5%) 3.05 KiB (1%) 20
["fact", "zecevic2_2x2_0"] 2.042 μs (5%) 4.49 KiB (1%) 20
["solve1", "genhs28_2x2_0"] 178.808 ns (5%)
["solve1", "hs21_2x2_0"] 101.288 ns (5%)
["solve1", "hs21mod_2x2_0"] 144.061 ns (5%)
["solve1", "hs268_2x2_0"] 174.749 ns (5%)
["solve1", "hs35_2x2_0"] 98.852 ns (5%)
["solve1", "hs35mod_2x2_0"] 87.799 ns (5%)
["solve1", "hs51_2x2_0"] 87.706 ns (5%)
["solve1", "hs52_2x2_0"] 89.056 ns (5%)
["solve1", "hs53_2x2_0"] 185.023 ns (5%)
["solve1", "hs76_2x2_0"] 127.309 ns (5%)
["solve1", "lotschd_2x2_0"] 377.786 ns (5%)
["solve1", "s268_2x2_0"] 184.180 ns (5%)
["solve1", "tame_2x2_0"] 78.853 ns (5%)
["solve1", "zecevic2_2x2_0"] 116.478 ns (5%)
["solve5", "genhs28_2x2_0"] 573.650 ns (5%)
["solve5", "hs21_2x2_0"] 257.069 ns (5%)
["solve5", "hs21mod_2x2_0"] 451.832 ns (5%)
["solve5", "hs268_2x2_0"] 669.958 ns (5%)
["solve5", "hs35_2x2_0"] 274.691 ns (5%)
["solve5", "hs35mod_2x2_0"] 237.578 ns (5%)
["solve5", "hs51_2x2_0"] 226.907 ns (5%)
["solve5", "hs52_2x2_0"] 240.145 ns (5%)
["solve5", "hs53_2x2_0"] 631.444 ns (5%)
["solve5", "hs76_2x2_0"] 466.944 ns (5%)
["solve5", "lotschd_2x2_0"] 1.594 μs (5%)
["solve5", "s268_2x2_0"] 697.683 ns (5%)
["solve5", "tame_2x2_0"] 185.611 ns (5%)
["solve5", "zecevic2_2x2_0"] 334.195 ns (5%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["fact"]
  • ["solve1"]
  • ["solve5"]

Julia versioninfo

Julia Version 1.5.0
Commit 96786e22cc (2020-08-01 23:44 UTC)
Platform Info:
  OS: macOS (x86_64-apple-darwin18.7.0)
  uname: Darwin 19.6.0 Darwin Kernel Version 19.6.0: Thu Jun 18 20:49:00 PDT 2020; root:xnu-6153.141.1~1/RELEASE_X86_64 x86_64 i386
  CPU: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz: 
              speed         user         nice          sys         idle          irq
       #1  3100 MHz       5197 s          0 s       6962 s       4153 s          0 s
       #2  3100 MHz       1620 s          0 s       1326 s      13362 s          0 s
       #3  3100 MHz       5181 s          0 s       6555 s       4573 s          0 s
       #4  3100 MHz       1680 s          0 s       1313 s      13316 s          0 s
       #5  3100 MHz       5027 s          0 s       6047 s       5235 s          0 s
       #6  3100 MHz       1784 s          0 s       1325 s      13199 s          0 s
       #7  3100 MHz       4816 s          0 s       4547 s       6945 s          0 s
       #8  3100 MHz       1930 s          0 s       1324 s      13054 s          0 s
       
  Memory: 16.0 GB (2363.93359375 MB free)
  Uptime: 1631.0 sec
  Load Avg:  4.9482421875  4.6103515625  8.9482421875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-9.0.1 (ORCJIT, skylake)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment