Skip to content

Instantly share code, notes, and snippets.

@MonssafToukal
Created July 22, 2020 14:33
Show Gist options
  • Save MonssafToukal/0112634cfd731c9633fa9559631f3004 to your computer and use it in GitHub Desktop.
Save MonssafToukal/0112634cfd731c9633fa9559631f3004 to your computer and use it in GitHub Desktop.
A benchmark for Krylov repository

Benchmark Report for Krylov

Job Properties

  • Time of benchmark: 22 Jul 2020 - 10:33
  • Package commit: 07286a
  • Julia commit: 44fa15
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["CG", "DivGrad N=128", "Krylov"] 11.068 s (5%) 48.01 MiB (1%) 18
["CG", "DivGrad N=32", "Krylov"] 22.341 ms (5%) 770.61 KiB (1%) 16
["CG", "DivGrad N=64", "Krylov"] 513.295 ms (5%) 6.00 MiB (1%) 17
["CG", "UFL", "LF10", "Krylov"] 3.657 μs (5%) 1.44 KiB (1%) 11
["CG", "UFL", "LFAT5", "Krylov"] 2.758 μs (5%) 1.08 KiB (1%) 10
["CG", "UFL", "bcsstk01", "Krylov"] 22.381 μs (5%) 2.77 KiB (1%) 12
["CG", "UFL", "bcsstk02", "Krylov"] 128.941 μs (5%) 3.14 KiB (1%) 12
["CG", "UFL", "bcsstm02", "Krylov"] 3.825 μs (5%) 2.34 KiB (1%) 10
["CG", "UFL", "ex5", "Krylov"] 9.979 μs (5%) 1.67 KiB (1%) 11
["CG", "UFL", "mesh1e1", "Krylov"] 6.440 μs (5%) 1.97 KiB (1%) 10
["CG", "UFL", "mesh1em1", "Krylov"] 10.466 μs (5%) 2.23 KiB (1%) 11
["CG", "UFL", "mesh1em6", "Krylov"] 6.220 μs (5%) 1.97 KiB (1%) 10
["CG", "UFL", "nos4", "Krylov"] 53.655 μs (5%) 5.00 KiB (1%) 13

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["CG", "DivGrad N=128"]
  • ["CG", "DivGrad N=32"]
  • ["CG", "DivGrad N=64"]
  • ["CG", "UFL", "LF10"]
  • ["CG", "UFL", "LFAT5"]
  • ["CG", "UFL", "bcsstk01"]
  • ["CG", "UFL", "bcsstk02"]
  • ["CG", "UFL", "bcsstm02"]
  • ["CG", "UFL", "ex5"]
  • ["CG", "UFL", "mesh1e1"]
  • ["CG", "UFL", "mesh1em1"]
  • ["CG", "UFL", "mesh1em6"]
  • ["CG", "UFL", "nos4"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-62-generic #56~18.04.1-Ubuntu SMP Wed Jun 24 16:17:03 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz: 
              speed         user         nice          sys         idle          irq
       #1  3300 MHz      58729 s         24 s      20478 s     158436 s          0 s
       #2  3300 MHz      59760 s         33 s      19625 s     158524 s          0 s
       #3  3300 MHz      67575 s         49 s      19043 s     149860 s          0 s
       #4  3300 MHz      75974 s         36 s      16482 s     145077 s          0 s
       
  Memory: 15.600471496582031 GB (6021.63671875 MB free)
  Uptime: 2469.0 sec
  Load Avg:  3.57470703125  2.69580078125  2.21728515625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Benchmark Report for Krylov

Job Properties

  • Time of benchmarks:
    • Target: 22 Jul 2020 - 10:33
    • Baseline: 22 Jul 2020 - 10:32
  • Package commits:
    • Target: 07286a
    • Baseline: a886ea
  • Julia commits:
    • Target: 44fa15
    • Baseline: 44fa15
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["CG", "DivGrad N=128", "Krylov"] 0.91 (5%) ✅ 1.00 (1%)
["CG", "DivGrad N=64", "Krylov"] 0.93 (5%) ✅ 1.00 (1%)
["CG", "UFL", "LFAT5", "Krylov"] 1.05 (5%) ❌ 1.00 (1%)
["CG", "UFL", "bcsstk02", "Krylov"] 0.92 (5%) ✅ 1.00 (1%)
["CG", "UFL", "mesh1em1", "Krylov"] 0.91 (5%) ✅ 1.00 (1%)
["CG", "UFL", "mesh1em6", "Krylov"] 0.93 (5%) ✅ 1.00 (1%)
["CG", "UFL", "nos4", "Krylov"] 0.86 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["CG", "DivGrad N=128"]
  • ["CG", "DivGrad N=32"]
  • ["CG", "DivGrad N=64"]
  • ["CG", "UFL", "LF10"]
  • ["CG", "UFL", "LFAT5"]
  • ["CG", "UFL", "bcsstk01"]
  • ["CG", "UFL", "bcsstk02"]
  • ["CG", "UFL", "bcsstm02"]
  • ["CG", "UFL", "ex5"]
  • ["CG", "UFL", "mesh1e1"]
  • ["CG", "UFL", "mesh1em1"]
  • ["CG", "UFL", "mesh1em6"]
  • ["CG", "UFL", "nos4"]

Julia versioninfo

Target

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-62-generic #56~18.04.1-Ubuntu SMP Wed Jun 24 16:17:03 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz: 
              speed         user         nice          sys         idle          irq
       #1  3300 MHz      58729 s         24 s      20478 s     158436 s          0 s
       #2  3300 MHz      59760 s         33 s      19625 s     158524 s          0 s
       #3  3300 MHz      67575 s         49 s      19043 s     149860 s          0 s
       #4  3300 MHz      75974 s         36 s      16482 s     145077 s          0 s
       
  Memory: 15.600471496582031 GB (6021.63671875 MB free)
  Uptime: 2469.0 sec
  Load Avg:  3.57470703125  2.69580078125  2.21728515625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Baseline

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-62-generic #56~18.04.1-Ubuntu SMP Wed Jun 24 16:17:03 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz: 
              speed         user         nice          sys         idle          irq
       #1  1673 MHz      54864 s         23 s      19174 s     154566 s          0 s
       #2  1292 MHz      55598 s         33 s      18451 s     154758 s          0 s
       #3  2011 MHz      60282 s         49 s      18074 s     148946 s          0 s
       #4  1750 MHz      72048 s         36 s      15259 s     141147 s          0 s
       
  Memory: 15.600471496582031 GB (6040.47265625 MB free)
  Uptime: 2377.0 sec
  Load Avg:  2.6826171875  2.27392578125  2.044921875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Benchmark Report for Krylov

Job Properties

  • Time of benchmark: 22 Jul 2020 - 10:32
  • Package commit: a886ea
  • Julia commit: 44fa15
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["CG", "DivGrad N=128", "Krylov"] 12.111 s (5%) 48.01 MiB (1%) 18
["CG", "DivGrad N=32", "Krylov"] 23.463 ms (5%) 770.61 KiB (1%) 16
["CG", "DivGrad N=64", "Krylov"] 551.483 ms (5%) 6.00 MiB (1%) 17
["CG", "UFL", "LF10", "Krylov"] 3.550 μs (5%) 1.44 KiB (1%) 11
["CG", "UFL", "LFAT5", "Krylov"] 2.621 μs (5%) 1.08 KiB (1%) 10
["CG", "UFL", "bcsstk01", "Krylov"] 22.741 μs (5%) 2.77 KiB (1%) 12
["CG", "UFL", "bcsstk02", "Krylov"] 140.787 μs (5%) 3.14 KiB (1%) 12
["CG", "UFL", "bcsstm02", "Krylov"] 3.654 μs (5%) 2.34 KiB (1%) 10
["CG", "UFL", "ex5", "Krylov"] 9.809 μs (5%) 1.67 KiB (1%) 11
["CG", "UFL", "mesh1e1", "Krylov"] 6.638 μs (5%) 1.97 KiB (1%) 10
["CG", "UFL", "mesh1em1", "Krylov"] 11.512 μs (5%) 2.23 KiB (1%) 11
["CG", "UFL", "mesh1em6", "Krylov"] 6.681 μs (5%) 1.97 KiB (1%) 10
["CG", "UFL", "nos4", "Krylov"] 62.348 μs (5%) 5.00 KiB (1%) 13

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["CG", "DivGrad N=128"]
  • ["CG", "DivGrad N=32"]
  • ["CG", "DivGrad N=64"]
  • ["CG", "UFL", "LF10"]
  • ["CG", "UFL", "LFAT5"]
  • ["CG", "UFL", "bcsstk01"]
  • ["CG", "UFL", "bcsstk02"]
  • ["CG", "UFL", "bcsstm02"]
  • ["CG", "UFL", "ex5"]
  • ["CG", "UFL", "mesh1e1"]
  • ["CG", "UFL", "mesh1em1"]
  • ["CG", "UFL", "mesh1em6"]
  • ["CG", "UFL", "nos4"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-62-generic #56~18.04.1-Ubuntu SMP Wed Jun 24 16:17:03 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz: 
              speed         user         nice          sys         idle          irq
       #1  1673 MHz      54864 s         23 s      19174 s     154566 s          0 s
       #2  1292 MHz      55598 s         33 s      18451 s     154758 s          0 s
       #3  2011 MHz      60282 s         49 s      18074 s     148946 s          0 s
       #4  1750 MHz      72048 s         36 s      15259 s     141147 s          0 s
       
  Memory: 15.600471496582031 GB (6040.47265625 MB free)
  Uptime: 2377.0 sec
  Load Avg:  2.6826171875  2.27392578125  2.044921875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment