Skip to content

Instantly share code, notes, and snippets.

@MonssafToukal
Created August 13, 2020 19:34
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save MonssafToukal/db5f6dca256a340167f22489c32095b2 to your computer and use it in GitHub Desktop.
Save MonssafToukal/db5f6dca256a340167f22489c32095b2 to your computer and use it in GitHub Desktop.
A benchmark for Krylov repository

Benchmark Report for Krylov

Job Properties

  • Time of benchmark: 13 Aug 2020 - 15:32
  • Package commit: 32ae78
  • Julia commit: 44fa15
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["CG", "DivGrad N=128", "Krylov"] 7.869 s (5%) 48.01 MiB (1%) 18
["CG", "DivGrad N=32", "Krylov"] 18.187 ms (5%) 770.61 KiB (1%) 16
["CG", "DivGrad N=64", "Krylov"] 413.109 ms (5%) 6.00 MiB (1%) 17
["CG", "UFL", "LF10", "Krylov"] 3.411 μs (5%) 1.44 KiB (1%) 11
["CG", "UFL", "LFAT5", "Krylov"] 2.545 μs (5%) 1.08 KiB (1%) 10
["CG", "UFL", "bcsstk01", "Krylov"] 21.873 μs (5%) 2.77 KiB (1%) 12
["CG", "UFL", "bcsstk02", "Krylov"] 136.738 μs (5%) 3.14 KiB (1%) 12
["CG", "UFL", "bcsstm02", "Krylov"] 3.439 μs (5%) 2.34 KiB (1%) 10
["CG", "UFL", "ex5", "Krylov"] 9.552 μs (5%) 1.67 KiB (1%) 11
["CG", "UFL", "mesh1e1", "Krylov"] 6.632 μs (5%) 1.97 KiB (1%) 10
["CG", "UFL", "mesh1em1", "Krylov"] 11.229 μs (5%) 2.23 KiB (1%) 11
["CG", "UFL", "mesh1em6", "Krylov"] 6.481 μs (5%) 1.97 KiB (1%) 10
["CG", "UFL", "nos4", "Krylov"] 56.502 μs (5%) 5.00 KiB (1%) 13

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["CG", "DivGrad N=128"]
  • ["CG", "DivGrad N=32"]
  • ["CG", "DivGrad N=64"]
  • ["CG", "UFL", "LF10"]
  • ["CG", "UFL", "LFAT5"]
  • ["CG", "UFL", "bcsstk01"]
  • ["CG", "UFL", "bcsstk02"]
  • ["CG", "UFL", "bcsstm02"]
  • ["CG", "UFL", "ex5"]
  • ["CG", "UFL", "mesh1e1"]
  • ["CG", "UFL", "mesh1em1"]
  • ["CG", "UFL", "mesh1em6"]
  • ["CG", "UFL", "nos4"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.4.0-42-generic #46~18.04.1-Ubuntu SMP Fri Jul 10 07:21:24 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz: 
              speed         user         nice          sys         idle          irq
       #1  2158 MHz     208847 s       1848 s      56405 s    1049699 s          0 s
       #2  2284 MHz     194446 s         40 s      57242 s    1065163 s          0 s
       #3  1702 MHz     211899 s        846 s      52955 s    1049998 s          0 s
       #4  3051 MHz     203559 s        262 s      54431 s    1057351 s          0 s
       
  Memory: 15.600475311279297 GB (2881.67578125 MB free)
  Uptime: 13403.0 sec
  Load Avg:  1.55615234375  1.72705078125  1.7197265625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Benchmark Report for Krylov

Job Properties

  • Time of benchmarks:
    • Target: 13 Aug 2020 - 15:32
    • Baseline: 13 Aug 2020 - 15:33
  • Package commits:
    • Target: 32ae78
    • Baseline: 60c166
  • Julia commits:
    • Target: 44fa15
    • Baseline: 44fa15
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["CG", "DivGrad N=128", "Krylov"] 0.81 (5%) ✅ 1.00 (1%)
["CG", "UFL", "LF10", "Krylov"] 0.81 (5%) ✅ 1.00 (1%)
["CG", "UFL", "LFAT5", "Krylov"] 0.77 (5%) ✅ 1.00 (1%)
["CG", "UFL", "bcsstk01", "Krylov"] 0.94 (5%) ✅ 1.00 (1%)
["CG", "UFL", "bcsstk02", "Krylov"] 1.08 (5%) ❌ 1.00 (1%)
["CG", "UFL", "bcsstm02", "Krylov"] 0.89 (5%) ✅ 1.00 (1%)
["CG", "UFL", "ex5", "Krylov"] 0.90 (5%) ✅ 1.00 (1%)
["CG", "UFL", "nos4", "Krylov"] 1.05 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["CG", "DivGrad N=128"]
  • ["CG", "DivGrad N=32"]
  • ["CG", "DivGrad N=64"]
  • ["CG", "UFL", "LF10"]
  • ["CG", "UFL", "LFAT5"]
  • ["CG", "UFL", "bcsstk01"]
  • ["CG", "UFL", "bcsstk02"]
  • ["CG", "UFL", "bcsstm02"]
  • ["CG", "UFL", "ex5"]
  • ["CG", "UFL", "mesh1e1"]
  • ["CG", "UFL", "mesh1em1"]
  • ["CG", "UFL", "mesh1em6"]
  • ["CG", "UFL", "nos4"]

Julia versioninfo

Target

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.4.0-42-generic #46~18.04.1-Ubuntu SMP Fri Jul 10 07:21:24 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz: 
              speed         user         nice          sys         idle          irq
       #1  2158 MHz     208847 s       1848 s      56405 s    1049699 s          0 s
       #2  2284 MHz     194446 s         40 s      57242 s    1065163 s          0 s
       #3  1702 MHz     211899 s        846 s      52955 s    1049998 s          0 s
       #4  3051 MHz     203559 s        262 s      54431 s    1057351 s          0 s
       
  Memory: 15.600475311279297 GB (2881.67578125 MB free)
  Uptime: 13403.0 sec
  Load Avg:  1.55615234375  1.72705078125  1.7197265625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Baseline

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.4.0-42-generic #46~18.04.1-Ubuntu SMP Fri Jul 10 07:21:24 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz: 
              speed         user         nice          sys         idle          irq
       #1  3514 MHz     210843 s       1848 s      57197 s    1055211 s          0 s
       #2  3454 MHz     196874 s         40 s      57930 s    1070363 s          0 s
       #3  3416 MHz     214250 s        846 s      53781 s    1055128 s          0 s
       #4  3427 MHz     211002 s        262 s      54932 s    1057975 s          0 s
       
  Memory: 15.600475311279297 GB (3067.53515625 MB free)
  Uptime: 13489.0 sec
  Load Avg:  2.18310546875  1.849609375  1.76171875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Benchmark Report for Krylov

Job Properties

  • Time of benchmark: 13 Aug 2020 - 15:33
  • Package commit: 60c166
  • Julia commit: 44fa15
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["CG", "DivGrad N=128", "Krylov"] 9.696 s (5%) 48.01 MiB (1%) 18
["CG", "DivGrad N=32", "Krylov"] 19.121 ms (5%) 770.61 KiB (1%) 16
["CG", "DivGrad N=64", "Krylov"] 417.040 ms (5%) 6.00 MiB (1%) 17
["CG", "UFL", "LF10", "Krylov"] 4.225 μs (5%) 1.44 KiB (1%) 11
["CG", "UFL", "LFAT5", "Krylov"] 3.284 μs (5%) 1.08 KiB (1%) 10
["CG", "UFL", "bcsstk01", "Krylov"] 23.390 μs (5%) 2.77 KiB (1%) 12
["CG", "UFL", "bcsstk02", "Krylov"] 126.331 μs (5%) 3.14 KiB (1%) 12
["CG", "UFL", "bcsstm02", "Krylov"] 3.873 μs (5%) 2.34 KiB (1%) 10
["CG", "UFL", "ex5", "Krylov"] 10.571 μs (5%) 1.67 KiB (1%) 11
["CG", "UFL", "mesh1e1", "Krylov"] 6.399 μs (5%) 1.97 KiB (1%) 10
["CG", "UFL", "mesh1em1", "Krylov"] 11.221 μs (5%) 2.23 KiB (1%) 11
["CG", "UFL", "mesh1em6", "Krylov"] 6.376 μs (5%) 1.97 KiB (1%) 10
["CG", "UFL", "nos4", "Krylov"] 53.605 μs (5%) 5.00 KiB (1%) 13

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["CG", "DivGrad N=128"]
  • ["CG", "DivGrad N=32"]
  • ["CG", "DivGrad N=64"]
  • ["CG", "UFL", "LF10"]
  • ["CG", "UFL", "LFAT5"]
  • ["CG", "UFL", "bcsstk01"]
  • ["CG", "UFL", "bcsstk02"]
  • ["CG", "UFL", "bcsstm02"]
  • ["CG", "UFL", "ex5"]
  • ["CG", "UFL", "mesh1e1"]
  • ["CG", "UFL", "mesh1em1"]
  • ["CG", "UFL", "mesh1em6"]
  • ["CG", "UFL", "nos4"]

Julia versioninfo

Julia Version 1.4.2
Commit 44fa15b150* (2020-05-23 18:35 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.4.0-42-generic #46~18.04.1-Ubuntu SMP Fri Jul 10 07:21:24 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz: 
              speed         user         nice          sys         idle          irq
       #1  3514 MHz     210843 s       1848 s      57197 s    1055211 s          0 s
       #2  3454 MHz     196874 s         40 s      57930 s    1070363 s          0 s
       #3  3416 MHz     214250 s        846 s      53781 s    1055128 s          0 s
       #4  3427 MHz     211002 s        262 s      54932 s    1057975 s          0 s
       
  Memory: 15.600475311279297 GB (3067.53515625 MB free)
  Uptime: 13489.0 sec
  Load Avg:  2.18310546875  1.849609375  1.76171875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment