Skip to content

Instantly share code, notes, and snippets.

@ranocha

ranocha/trixi_benchmark_example_comparison.md

Created April 12, 2021 07:27
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save ranocha/bf98d19e288e759d3a36ca0643448efb to your computer and use it in GitHub Desktop.
Save ranocha/bf98d19e288e759d3a36ca0643448efb to your computer and use it in GitHub Desktop.
Download ZIP
Example benchmark results for Trixi
Raw
trixi_benchmark_example_comparison.md

Benchmark Report for /home/runner/work/Trixi.jl/Trixi.jl

Job Properties

  • Time of benchmarks:
    • Target: 11 Apr 2021 - 18:51
    • Baseline: 11 Apr 2021 - 19:12
  • Package commits:
    • Target: 8c5844
    • Baseline: f4a7c5
  • Julia commits:
    • Target: f9720d
    • Baseline: f9720d
  • Julia command flags:
    • Target: -Cnative,-J/opt/hostedtoolcache/julia/1.6.0/x64/lib/julia/sys.so,-g1,--color=yes,--check-bounds=no,--threads=2
    • Baseline: -Cnative,-J/opt/hostedtoolcache/julia/1.6.0/x64/lib/julia/sys.so,-g1,--color=yes,--check-bounds=no,--threads=2
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["2d", "elixir_advection_amr_nonperiodic.jl", "p3_analysis"] 0.95 (5%) 0.34 (1%) ✅
["2d", "elixir_advection_amr_nonperiodic.jl", "p3_rhs!"] 1.13 (5%) ❌ 0.43 (1%) ✅
["2d", "elixir_advection_amr_nonperiodic.jl", "p7_analysis"] 0.94 (5%) ✅ 0.15 (1%) ✅
["2d", "elixir_advection_amr_nonperiodic.jl", "p7_rhs!"] 1.10 (5%) ❌ 0.18 (1%) ✅
["2d", "elixir_advection_extended.jl", "p3_analysis"] 1.02 (5%) 0.34 (1%) ✅
["2d", "elixir_advection_extended.jl", "p3_rhs!"] 0.88 (5%) ✅ 0.44 (1%) ✅
["2d", "elixir_advection_extended.jl", "p7_analysis"] 1.08 (5%) ❌ 0.15 (1%) ✅
["2d", "elixir_advection_extended.jl", "p7_rhs!"] 0.70 (5%) ✅ 0.17 (1%) ✅
["2d", "elixir_euler_ec.jl", "p3_analysis"] 0.97 (5%) 0.34 (1%) ✅
["2d", "elixir_euler_ec.jl", "p3_rhs!"] 0.98 (5%) 0.42 (1%) ✅
["2d", "elixir_euler_ec.jl", "p7_analysis"] 1.01 (5%) 0.16 (1%) ✅
["2d", "elixir_euler_ec.jl", "p7_rhs!"] 1.01 (5%) 0.17 (1%) ✅
["2d", "elixir_euler_vortex_mortar.jl", "p3_analysis"] 1.06 (5%) ❌ 0.34 (1%) ✅
["2d", "elixir_euler_vortex_mortar.jl", "p3_rhs!"] 0.97 (5%) 0.42 (1%) ✅
["2d", "elixir_euler_vortex_mortar.jl", "p7_analysis"] 1.01 (5%) 0.16 (1%) ✅
["2d", "elixir_euler_vortex_mortar.jl", "p7_rhs!"] 0.94 (5%) ✅ 0.17 (1%) ✅
["2d", "elixir_euler_vortex_mortar_shockcapturing.jl", "p3_analysis"] 0.92 (5%) ✅ 0.38 (1%) ✅
["2d", "elixir_euler_vortex_mortar_shockcapturing.jl", "p3_rhs!"] 0.98 (5%) 0.46 (1%) ✅
["2d", "elixir_euler_vortex_mortar_shockcapturing.jl", "p7_analysis"] 0.99 (5%) 0.18 (1%) ✅
["2d", "elixir_euler_vortex_mortar_shockcapturing.jl", "p7_rhs!"] 1.07 (5%) ❌ 0.19 (1%) ✅
["3d", "elixir_advection_extended.jl", "p3_analysis"] 1.04 (5%) 0.36 (1%) ✅
["3d", "elixir_advection_extended.jl", "p3_rhs!"] 1.02 (5%) 0.44 (1%) ✅
["3d", "elixir_advection_extended.jl", "p7_analysis"] 1.03 (5%) 0.16 (1%) ✅
["3d", "elixir_advection_extended.jl", "p7_rhs!"] 1.00 (5%) 0.17 (1%) ✅
["3d", "elixir_euler_ec.jl", "p3_analysis"] 0.99 (5%) 0.36 (1%) ✅
["3d", "elixir_euler_ec.jl", "p3_rhs!"] 1.05 (5%) 0.42 (1%) ✅
["3d", "elixir_euler_ec.jl", "p7_analysis"] 1.00 (5%) 0.17 (1%) ✅
["3d", "elixir_euler_ec.jl", "p7_rhs!"] 1.00 (5%) 0.17 (1%) ✅
["3d", "elixir_euler_mortar.jl", "p3_analysis"] 0.93 (5%) ✅ 0.36 (1%) ✅
["3d", "elixir_euler_mortar.jl", "p3_rhs!"] 0.92 (5%) ✅ 0.42 (1%) ✅
["3d", "elixir_euler_mortar.jl", "p7_analysis"] 1.03 (5%) 0.17 (1%) ✅
["3d", "elixir_euler_mortar.jl", "p7_rhs!"] 0.86 (5%) ✅ 0.17 (1%) ✅
["latency", "polydeg_7"] 0.68 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["2d", "elixir_advection_amr_nonperiodic.jl"]
  • ["2d", "elixir_advection_extended.jl"]
  • ["2d", "elixir_euler_ec.jl"]
  • ["2d", "elixir_euler_vortex_mortar.jl"]
  • ["2d", "elixir_euler_vortex_mortar_shockcapturing.jl"]
  • ["3d", "elixir_advection_extended.jl"]
  • ["3d", "elixir_euler_ec.jl"]
  • ["3d", "elixir_euler_mortar.jl"]
  • ["latency"]

Julia versioninfo

Target

Julia Version 1.6.0
Commit f9720dc2eb (2021-03-24 12:55 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 20.04.2 LTS
  uname: Linux 5.4.0-1043-azure #45-Ubuntu SMP Fri Mar 19 17:33:38 UTC 2021 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      15027 s          2 s        295 s      20623 s          0 s
       #2  2294 MHz      21454 s          0 s        444 s      14022 s          0 s
       
  Memory: 6.791343688964844 GB (2483.83203125 MB free)
  Uptime: 3616.0 sec
  Load Avg:  1.36  1.21  1.08
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-11.0.1 (ORCJIT, broadwell)

Baseline

Julia Version 1.6.0
Commit f9720dc2eb (2021-03-24 12:55 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 20.04.2 LTS
  uname: Linux 5.4.0-1043-azure #45-Ubuntu SMP Fri Mar 19 17:33:38 UTC 2021 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      20382 s          2 s        363 s      27970 s          0 s
       #2  2294 MHz      29653 s          0 s        524 s      18503 s          0 s
       
  Memory: 6.791343688964844 GB (2198.91015625 MB free)
  Uptime: 4899.0 sec
  Load Avg:  1.28  1.15  1.08
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-11.0.1 (ORCJIT, broadwell)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment