Skip to content

Instantly share code, notes, and snippets.

@MonssafToukal
Created July 27, 2020 18:06
Show Gist options
  • Save MonssafToukal/f7e5bf30c98b36e8e70c8ca73d359d55 to your computer and use it in GitHub Desktop.
Save MonssafToukal/f7e5bf30c98b36e8e70c8ca73d359d55 to your computer and use it in GitHub Desktop.
A benchmark for Krylov repository

Benchmark Report for Krylov

Job Properties

  • Time of benchmark: 27 Jul 2020 - 14:4
  • Package commit: 888c48
  • Julia commit: 44fa15
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["CG", "DivGrad N=128", "Krylov"] 8.916 s (5%) 48.01 MiB (1%) 18
["CG", "DivGrad N=32", "Krylov"] 19.527 ms (5%) 770.61 KiB (1%) 16
["CG", "DivGrad N=64", "Krylov"] 632.881 ms (5%) 6.00 MiB (1%) 17
["CG", "UFL", "LF10", "Krylov"] 3.519 μs (5%) 1.44 KiB (1%) 11
["CG", "UFL", "LFAT5", "Krylov"] 2.660 μs (5%) 1.08 KiB (1%) 10
["CG", "UFL", "bcsstk01", "Krylov"] 21.790 μs (5%) 2.77 KiB (1%) 12
["CG", "UFL", "bcsstk02", "Krylov"] 126.338 μs (5%) 3.14 KiB (1%) 12
["CG", "UFL", "bcsstm02", "Krylov"] 3.536 μs (5%) 2.34 KiB (1%) 10
["CG", "UFL", "ex5", "Krylov"] 9.573 μs (5%) 1.67 KiB (1%) 11
["CG", "UFL", "mesh1e1", "Krylov"] 6.037 μs (5%) 1.97 KiB (1%) 10
["CG", "UFL", "mesh1em1", "Krylov"] 10.192 μs (5%) 2.23 KiB (1%) 11
["CG", "UFL", "mesh1em6", "Krylov"] 6.086 μs (5%) 1.97 KiB (1%) 10
["CG", "UFL", "nos4", "Krylov"] 52.370 μs (5%) 5.00 KiB (1%) 13

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["CG", "DivGrad N=128"]
  • ["CG", "DivGrad N=32"]
  • ["CG", "DivGrad N=64"]
  • ["CG", "UFL", "LF10"]
  • ["CG", "UFL", "LFAT5"]
  • ["CG", "UFL", "bcsstk01"]
  • ["CG", "UFL", "bcsstk02"]
  • ["CG", "UFL", "bcsstm02"]
  • ["CG", "UFL", "ex5"]
  • ["CG", "UFL", "mesh1e1"]
  • ["CG", "UFL", "mesh1em1"]
  • ["CG", "UFL", "mesh1em6"]
  • ["CG", "UFL", "nos4"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.4.0-42-generic #46~18.04.1-Ubuntu SMP Fri Jul 10 07:21:24 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz: 
              speed         user         nice          sys         idle          irq
       #1  3286 MHz     115176 s        509 s      34822 s    1189316 s          0 s
       #2  3274 MHz     107620 s        760 s      32341 s    1198597 s          0 s
       #3  3197 MHz     124521 s       2830 s      31969 s    1179145 s          0 s
       #4  3235 MHz     100931 s         35 s      34464 s    1204257 s          0 s
       
  Memory: 15.600475311279297 GB (3347.4375 MB free)
  Uptime: 13528.0 sec
  Load Avg:  2.287109375  1.07275390625  0.7060546875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Benchmark Report for Krylov

Job Properties

  • Time of benchmarks:
    • Target: 27 Jul 2020 - 14:04
    • Baseline: 27 Jul 2020 - 14:05
  • Package commits:
    • Target: 888c48
    • Baseline: aeba3e
  • Julia commits:
    • Target: 44fa15
    • Baseline: 44fa15
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["CG", "DivGrad N=128", "Krylov"] 0.87 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["CG", "DivGrad N=128"]
  • ["CG", "DivGrad N=32"]
  • ["CG", "DivGrad N=64"]
  • ["CG", "UFL", "LF10"]
  • ["CG", "UFL", "LFAT5"]
  • ["CG", "UFL", "bcsstk01"]
  • ["CG", "UFL", "bcsstk02"]
  • ["CG", "UFL", "bcsstm02"]
  • ["CG", "UFL", "ex5"]
  • ["CG", "UFL", "mesh1e1"]
  • ["CG", "UFL", "mesh1em1"]
  • ["CG", "UFL", "mesh1em6"]
  • ["CG", "UFL", "nos4"]

Julia versioninfo

Target

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.4.0-42-generic #46~18.04.1-Ubuntu SMP Fri Jul 10 07:21:24 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz: 
              speed         user         nice          sys         idle          irq
       #1  3286 MHz     115176 s        509 s      34822 s    1189316 s          0 s
       #2  3274 MHz     107620 s        760 s      32341 s    1198597 s          0 s
       #3  3197 MHz     124521 s       2830 s      31969 s    1179145 s          0 s
       #4  3235 MHz     100931 s         35 s      34464 s    1204257 s          0 s
       
  Memory: 15.600475311279297 GB (3347.4375 MB free)
  Uptime: 13528.0 sec
  Load Avg:  2.287109375  1.07275390625  0.7060546875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Baseline

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.4.0-42-generic #46~18.04.1-Ubuntu SMP Fri Jul 10 07:21:24 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz: 
              speed         user         nice          sys         idle          irq
       #1  3325 MHz     118516 s        509 s      35840 s    1193366 s          0 s
       #2  3327 MHz     110480 s        760 s      33233 s    1203227 s          0 s
       #3  3308 MHz     127174 s       2831 s      32972 s    1183882 s          0 s
       #4  3306 MHz     107438 s         35 s      35214 s    1205483 s          0 s
       
  Memory: 15.600475311279297 GB (3331.328125 MB free)
  Uptime: 13613.0 sec
  Load Avg:  3.09619140625  1.55908203125  0.9091796875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Benchmark Report for Krylov

Job Properties

  • Time of benchmark: 27 Jul 2020 - 14:5
  • Package commit: aeba3e
  • Julia commit: 44fa15
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["CG", "DivGrad N=128", "Krylov"] 10.198 s (5%) 48.01 MiB (1%) 18
["CG", "DivGrad N=32", "Krylov"] 19.666 ms (5%) 770.61 KiB (1%) 16
["CG", "DivGrad N=64", "Krylov"] 629.761 ms (5%) 6.00 MiB (1%) 17
["CG", "UFL", "LF10", "Krylov"] 3.411 μs (5%) 1.44 KiB (1%) 11
["CG", "UFL", "LFAT5", "Krylov"] 2.636 μs (5%) 1.08 KiB (1%) 10
["CG", "UFL", "bcsstk01", "Krylov"] 21.645 μs (5%) 2.77 KiB (1%) 12
["CG", "UFL", "bcsstk02", "Krylov"] 125.353 μs (5%) 3.14 KiB (1%) 12
["CG", "UFL", "bcsstm02", "Krylov"] 3.531 μs (5%) 2.34 KiB (1%) 10
["CG", "UFL", "ex5", "Krylov"] 9.675 μs (5%) 1.67 KiB (1%) 11
["CG", "UFL", "mesh1e1", "Krylov"] 6.104 μs (5%) 1.97 KiB (1%) 10
["CG", "UFL", "mesh1em1", "Krylov"] 10.170 μs (5%) 2.23 KiB (1%) 11
["CG", "UFL", "mesh1em6", "Krylov"] 6.071 μs (5%) 1.97 KiB (1%) 10
["CG", "UFL", "nos4", "Krylov"] 52.199 μs (5%) 5.00 KiB (1%) 13

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["CG", "DivGrad N=128"]
  • ["CG", "DivGrad N=32"]
  • ["CG", "DivGrad N=64"]
  • ["CG", "UFL", "LF10"]
  • ["CG", "UFL", "LFAT5"]
  • ["CG", "UFL", "bcsstk01"]
  • ["CG", "UFL", "bcsstk02"]
  • ["CG", "UFL", "bcsstm02"]
  • ["CG", "UFL", "ex5"]
  • ["CG", "UFL", "mesh1e1"]
  • ["CG", "UFL", "mesh1em1"]
  • ["CG", "UFL", "mesh1em6"]
  • ["CG", "UFL", "nos4"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.4.0-42-generic #46~18.04.1-Ubuntu SMP Fri Jul 10 07:21:24 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz: 
              speed         user         nice          sys         idle          irq
       #1  3325 MHz     118516 s        509 s      35840 s    1193366 s          0 s
       #2  3327 MHz     110480 s        760 s      33233 s    1203227 s          0 s
       #3  3308 MHz     127174 s       2831 s      32972 s    1183882 s          0 s
       #4  3306 MHz     107438 s         35 s      35214 s    1205483 s          0 s
       
  Memory: 15.600475311279297 GB (3331.328125 MB free)
  Uptime: 13613.0 sec
  Load Avg:  3.09619140625  1.55908203125  0.9091796875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment