Skip to content

Instantly share code, notes, and snippets.

@amontoison
Created December 1, 2019 03:15
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save amontoison/0b008620c4ad78525aa257dcd4f45081 to your computer and use it in GitHub Desktop.
Save amontoison/0b008620c4ad78525aa257dcd4f45081 to your computer and use it in GitHub Desktop.
A benchmark for Krylov repository

Benchmark Report for Krylov

Job Properties

  • Time of benchmark: 30 Nov 2019 - 22:14
  • Package commit: 7e298a
  • Julia commit: 46ce4d
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["CG", "DivGrad N=128", "Krylov"] 17.918 s (5%) 48.01 MiB (1%) 18
["CG", "DivGrad N=32", "Krylov"] 61.275 ms (5%) 770.61 KiB (1%) 16
["CG", "DivGrad N=64", "Krylov"] 1.090 s (5%) 6.00 MiB (1%) 17
["CG", "UFL", "LF10", "Krylov"] 4.425 μs (5%) 1.44 KiB (1%) 11
["CG", "UFL", "LFAT5", "Krylov"] 3.341 μs (5%) 1.08 KiB (1%) 10
["CG", "UFL", "bcsstk01", "Krylov"] 28.365 μs (5%) 2.77 KiB (1%) 12
["CG", "UFL", "bcsstk02", "Krylov"] 172.178 μs (5%) 3.14 KiB (1%) 12
["CG", "UFL", "bcsstm02", "Krylov"] 4.827 μs (5%) 2.34 KiB (1%) 10
["CG", "UFL", "ex5", "Krylov"] 12.012 μs (5%) 1.67 KiB (1%) 11
["CG", "UFL", "mesh1e1", "Krylov"] 7.643 μs (5%) 1.97 KiB (1%) 10
["CG", "UFL", "mesh1em1", "Krylov"] 12.809 μs (5%) 2.23 KiB (1%) 11
["CG", "UFL", "mesh1em6", "Krylov"] 8.516 μs (5%) 1.97 KiB (1%) 10
["CG", "UFL", "nos4", "Krylov"] 66.174 μs (5%) 5.00 KiB (1%) 13

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["CG", "DivGrad N=128"]
  • ["CG", "DivGrad N=32"]
  • ["CG", "DivGrad N=64"]
  • ["CG", "UFL", "LF10"]
  • ["CG", "UFL", "LFAT5"]
  • ["CG", "UFL", "bcsstk01"]
  • ["CG", "UFL", "bcsstk02"]
  • ["CG", "UFL", "bcsstm02"]
  • ["CG", "UFL", "ex5"]
  • ["CG", "UFL", "mesh1e1"]
  • ["CG", "UFL", "mesh1em1"]
  • ["CG", "UFL", "mesh1em6"]
  • ["CG", "UFL", "nos4"]

Julia versioninfo

Julia Version 1.3.0
Commit 46ce4d7933 (2019-11-26 06:09 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-36-generic #39~18.04.1-Ubuntu SMP Tue Nov 12 11:09:50 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Core(TM) i5-6200U CPU @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2594 MHz     473517 s        142 s     137971 s    2259577 s          0 s
       #2  2692 MHz     466112 s         85 s     143888 s    2269742 s          0 s
       #3  2570 MHz     492217 s         56 s     167287 s    2211205 s          0 s
       #4  2690 MHz     451430 s         53 s     153532 s    2276123 s          0 s
       
  Memory: 7.666389465332031 GB (2058.84375 MB free)
  Uptime: 29237.0 sec
  Load Avg:  2.40869140625  1.8984375  1.57763671875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Benchmark Report for Krylov

Job Properties

  • Time of benchmarks:
    • Target: 30 Nov 2019 - 22:14
    • Baseline: 30 Nov 2019 - 22:15
  • Package commits:
    • Target: 7e298a
    • Baseline: 7e298a
  • Julia commits:
    • Target: 46ce4d
    • Baseline: 46ce4d
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["CG", "DivGrad N=128", "Krylov"] 0.88 (5%) ✅ 1.00 (1%)
["CG", "DivGrad N=64", "Krylov"] 0.86 (5%) ✅ 1.00 (1%)
["CG", "UFL", "mesh1e1", "Krylov"] 0.93 (5%) ✅ 1.00 (1%)
["CG", "UFL", "mesh1em1", "Krylov"] 0.92 (5%) ✅ 1.00 (1%)
["CG", "UFL", "nos4", "Krylov"] 0.91 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["CG", "DivGrad N=128"]
  • ["CG", "DivGrad N=32"]
  • ["CG", "DivGrad N=64"]
  • ["CG", "UFL", "LF10"]
  • ["CG", "UFL", "LFAT5"]
  • ["CG", "UFL", "bcsstk01"]
  • ["CG", "UFL", "bcsstk02"]
  • ["CG", "UFL", "bcsstm02"]
  • ["CG", "UFL", "ex5"]
  • ["CG", "UFL", "mesh1e1"]
  • ["CG", "UFL", "mesh1em1"]
  • ["CG", "UFL", "mesh1em6"]
  • ["CG", "UFL", "nos4"]

Julia versioninfo

Target

Julia Version 1.3.0
Commit 46ce4d7933 (2019-11-26 06:09 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-36-generic #39~18.04.1-Ubuntu SMP Tue Nov 12 11:09:50 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Core(TM) i5-6200U CPU @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2594 MHz     473517 s        142 s     137971 s    2259577 s          0 s
       #2  2692 MHz     466112 s         85 s     143888 s    2269742 s          0 s
       #3  2570 MHz     492217 s         56 s     167287 s    2211205 s          0 s
       #4  2690 MHz     451430 s         53 s     153532 s    2276123 s          0 s
       
  Memory: 7.666389465332031 GB (2058.84375 MB free)
  Uptime: 29237.0 sec
  Load Avg:  2.40869140625  1.8984375  1.57763671875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Baseline

Julia Version 1.3.0
Commit 46ce4d7933 (2019-11-26 06:09 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-36-generic #39~18.04.1-Ubuntu SMP Tue Nov 12 11:09:50 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Core(TM) i5-6200U CPU @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2558 MHz     476427 s        142 s     138693 s    2265648 s          0 s
       #2  2636 MHz     468286 s         85 s     145438 s    2275713 s          0 s
       #3  2642 MHz     496342 s         56 s     168618 s    2215498 s          0 s
       #4  2635 MHz     457711 s         53 s     154907 s    2278232 s          0 s
       
  Memory: 7.666389465332031 GB (1917.99609375 MB free)
  Uptime: 29334.0 sec
  Load Avg:  2.39501953125  2.0087890625  1.6455078125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Benchmark Report for Krylov

Job Properties

  • Time of benchmark: 30 Nov 2019 - 22:15
  • Package commit: 7e298a
  • Julia commit: 46ce4d
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["CG", "DivGrad N=128", "Krylov"] 20.436 s (5%) 48.01 MiB (1%) 18
["CG", "DivGrad N=32", "Krylov"] 62.948 ms (5%) 770.61 KiB (1%) 16
["CG", "DivGrad N=64", "Krylov"] 1.271 s (5%) 6.00 MiB (1%) 17
["CG", "UFL", "LF10", "Krylov"] 4.391 μs (5%) 1.44 KiB (1%) 11
["CG", "UFL", "LFAT5", "Krylov"] 3.436 μs (5%) 1.08 KiB (1%) 10
["CG", "UFL", "bcsstk01", "Krylov"] 28.019 μs (5%) 2.77 KiB (1%) 12
["CG", "UFL", "bcsstk02", "Krylov"] 178.634 μs (5%) 3.14 KiB (1%) 12
["CG", "UFL", "bcsstm02", "Krylov"] 4.796 μs (5%) 2.34 KiB (1%) 10
["CG", "UFL", "ex5", "Krylov"] 11.995 μs (5%) 1.67 KiB (1%) 11
["CG", "UFL", "mesh1e1", "Krylov"] 8.258 μs (5%) 1.97 KiB (1%) 10
["CG", "UFL", "mesh1em1", "Krylov"] 13.883 μs (5%) 2.23 KiB (1%) 11
["CG", "UFL", "mesh1em6", "Krylov"] 8.413 μs (5%) 1.97 KiB (1%) 10
["CG", "UFL", "nos4", "Krylov"] 72.718 μs (5%) 5.00 KiB (1%) 13

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["CG", "DivGrad N=128"]
  • ["CG", "DivGrad N=32"]
  • ["CG", "DivGrad N=64"]
  • ["CG", "UFL", "LF10"]
  • ["CG", "UFL", "LFAT5"]
  • ["CG", "UFL", "bcsstk01"]
  • ["CG", "UFL", "bcsstk02"]
  • ["CG", "UFL", "bcsstm02"]
  • ["CG", "UFL", "ex5"]
  • ["CG", "UFL", "mesh1e1"]
  • ["CG", "UFL", "mesh1em1"]
  • ["CG", "UFL", "mesh1em6"]
  • ["CG", "UFL", "nos4"]

Julia versioninfo

Julia Version 1.3.0
Commit 46ce4d7933 (2019-11-26 06:09 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-36-generic #39~18.04.1-Ubuntu SMP Tue Nov 12 11:09:50 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Core(TM) i5-6200U CPU @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2558 MHz     476427 s        142 s     138693 s    2265648 s          0 s
       #2  2636 MHz     468286 s         85 s     145438 s    2275713 s          0 s
       #3  2642 MHz     496342 s         56 s     168618 s    2215498 s          0 s
       #4  2635 MHz     457711 s         53 s     154907 s    2278232 s          0 s
       
  Memory: 7.666389465332031 GB (1917.99609375 MB free)
  Uptime: 29334.0 sec
  Load Avg:  2.39501953125  2.0087890625  1.6455078125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment