- Time of benchmarks:
- Target: 16 Nov 2020 - 00:33
- Baseline: 16 Nov 2020 - 02:19
- Package commits:
- Target: b4e854
- Baseline: b4e854
- Julia commits:
- Target: 697e78
- Baseline: 697e78
- Julia command flags:
- Target: None
- Baseline: None
- Environment variables:
- Target: None
- Baseline: None
A ratio greater than 1.0
denotes a possible regression (marked with ❌), while a ratio less
than 1.0
denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).
ID | time ratio | memory ratio |
---|---|---|
["analyze", "cvxqp3_s_2x2_10"] |
1.06 (5%) ❌ | 1.00 (1%) |
["analyze", "cvxqp3_s_2x2_5"] |
1.05 (5%) ❌ | 1.00 (1%) |
["analyze", "dual4_2x2_0"] |
1.07 (5%) ❌ | 1.00 (1%) |
["analyze", "dual4_2x2_5"] |
1.07 (5%) ❌ | 1.00 (1%) |
["analyze", "dual4_3x3_0"] |
1.08 (5%) ❌ | 1.00 (1%) |
["analyze", "dual4_3x3_5"] |
1.07 (5%) ❌ | 1.00 (1%) |
["analyze", "dualc2_2x2_0"] |
1.07 (5%) ❌ | 1.00 (1%) |
["analyze", "dualc2_2x2_10"] |
1.10 (5%) ❌ | 1.00 (1%) |
["analyze", "dualc2_2x2_5"] |
1.11 (5%) ❌ | 1.00 (1%) |
["analyze", "dualc5_2x2_0"] |
1.06 (5%) ❌ | 1.00 (1%) |
["analyze", "dualc5_3x3_0"] |
1.06 (5%) ❌ | 1.00 (1%) |
["analyze", "genhs28_2x2_0"] |
0.94 (5%) ✅ | 1.00 (1%) |
["analyze", "hs21_2x2_5"] |
0.95 (5%) ✅ | 1.00 (1%) |
["analyze", "hs21_3x3_5"] |
0.94 (5%) ✅ | 1.00 (1%) |
["analyze", "hs21mod_3x3_5"] |
0.93 (5%) ✅ | 1.00 (1%) |
["analyze", "hs268_2x2_0"] |
1.07 (5%) ❌ | 1.00 (1%) |
["analyze", "lotschd_3x3_0"] |
0.90 (5%) ✅ | 1.00 (1%) |
["analyze", "primalc5_2x2_10"] |
1.05 (5%) ❌ | 1.00 (1%) |
["analyze", "primalc8_2x2_10"] |
1.05 (5%) ❌ | 1.00 (1%) |
["factorize", "aug2dqp_3x3_10"] |
0.91 (5%) ✅ | 1.00 (1%) |
["factorize", "aug2dqp_3x3_5"] |
0.94 (5%) ✅ | 1.00 (1%) |
["factorize", "cvxqp2_s_3x3_0"] |
1.06 (5%) ❌ | 1.00 (1%) |
["factorize", "cvxqp2_s_3x3_10"] |
1.07 (5%) ❌ | 1.00 (1%) |
["factorize", "cvxqp2_s_3x3_5"] |
1.05 (5%) ❌ | 1.00 (1%) |
["factorize", "cvxqp3_l_3x3_5"] |
1.05 (5%) ❌ | 1.00 (1%) |
["factorize", "cvxqp3_s_2x2_10"] |
1.05 (5%) ❌ | 1.00 (1%) |
["factorize", "cvxqp3_s_3x3_10"] |
1.06 (5%) ❌ | 1.00 (1%) |
["factorize", "dualc1_3x3_0"] |
1.08 (5%) ❌ | 1.00 (1%) |
["factorize", "dualc1_3x3_10"] |
1.08 (5%) ❌ | 1.00 (1%) |
["factorize", "dualc1_3x3_5"] |
1.06 (5%) ❌ | 1.00 (1%) |
["factorize", "dualc2_2x2_10"] |
0.95 (5%) ✅ | 1.00 (1%) |
["factorize", "gouldqp3_2x2_0"] |
1.05 (5%) ❌ | 1.00 (1%) |
["factorize", "gouldqp3_2x2_10"] |
1.07 (5%) ❌ | 1.00 (1%) |
["factorize", "gouldqp3_2x2_5"] |
1.06 (5%) ❌ | 1.00 (1%) |
["factorize", "hs118_2x2_0"] |
0.95 (5%) ✅ | 1.00 (1%) |
["factorize", "hs118_3x3_10"] |
0.90 (5%) ✅ | 1.00 (1%) |
["factorize", "hs118_3x3_5"] |
0.92 (5%) ✅ | 1.00 (1%) |
["factorize", "hs268_2x2_0"] |
0.94 (5%) ✅ | 1.00 (1%) |
["factorize", "liswet6_3x3_10"] |
0.93 (5%) ✅ | 1.00 (1%) |
["factorize", "liswet9_3x3_0"] |
0.93 (5%) ✅ | 1.00 (1%) |
["factorize", "liswet9_3x3_5"] |
0.92 (5%) ✅ | 1.00 (1%) |
["factorize", "lotschd_2x2_0"] |
0.94 (5%) ✅ | 1.00 (1%) |
["factorize", "lotschd_2x2_5"] |
0.92 (5%) ✅ | 1.00 (1%) |
["factorize", "lotschd_3x3_0"] |
0.84 (5%) ✅ | 1.00 (1%) |
["factorize", "lotschd_3x3_5"] |
0.86 (5%) ✅ | 1.00 (1%) |
["factorize", "primalc2_3x3_0"] |
1.07 (5%) ❌ | 1.00 (1%) |
["factorize", "primalc2_3x3_10"] |
1.07 (5%) ❌ | 1.00 (1%) |
["factorize", "primalc2_3x3_5"] |
1.06 (5%) ❌ | 1.00 (1%) |
["factorize", "qpcboei2_2x2_10"] |
0.91 (5%) ✅ | 1.00 (1%) |
["factorize", "s268_3x3_0"] |
0.95 (5%) ✅ | 1.00 (1%) |
["factorize", "yao_2x2_0"] |
1.05 (5%) ❌ | 1.00 (1%) |
["factorize", "yao_3x3_0"] |
1.15 (5%) ❌ | 1.00 (1%) |
["solve1", "cvxqp3_s_2x2_10"] |
1.05 (5%) ❌ | 1.00 (1%) |
["solve1", "dualc8_2x2_0"] |
0.95 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet10_2x2_5"] |
1.06 (5%) ❌ | 1.00 (1%) |
["solve1", "liswet10_3x3_0"] |
0.92 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet10_3x3_5"] |
0.90 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet11_2x2_10"] |
1.06 (5%) ❌ | 1.00 (1%) |
["solve1", "liswet11_3x3_0"] |
0.94 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet11_3x3_10"] |
1.13 (5%) ❌ | 1.00 (1%) |
["solve1", "liswet11_3x3_5"] |
0.93 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet12_2x2_0"] |
0.92 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet12_3x3_5"] |
1.05 (5%) ❌ | 1.00 (1%) |
["solve1", "liswet1_2x2_0"] |
0.92 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet1_2x2_10"] |
0.92 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet1_3x3_10"] |
0.92 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet1_3x3_5"] |
0.91 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet2_2x2_5"] |
0.92 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet2_3x3_0"] |
0.95 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet2_3x3_10"] |
0.93 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet3_2x2_0"] |
0.86 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet3_2x2_5"] |
0.95 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet3_3x3_0"] |
1.08 (5%) ❌ | 1.00 (1%) |
["solve1", "liswet3_3x3_10"] |
0.94 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet3_3x3_5"] |
0.92 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet4_2x2_10"] |
0.93 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet4_2x2_5"] |
0.92 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet4_3x3_10"] |
1.08 (5%) ❌ | 1.00 (1%) |
["solve1", "liswet5_2x2_10"] |
0.88 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet5_3x3_5"] |
1.08 (5%) ❌ | 1.00 (1%) |
["solve1", "liswet6_2x2_10"] |
0.93 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet6_3x3_0"] |
0.90 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet6_3x3_10"] |
0.90 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet6_3x3_5"] |
0.93 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet7_2x2_0"] |
1.06 (5%) ❌ | 1.00 (1%) |
["solve1", "liswet7_2x2_10"] |
0.92 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet7_3x3_10"] |
0.94 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet7_3x3_5"] |
0.89 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet8_2x2_0"] |
0.91 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet8_3x3_0"] |
0.88 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet8_3x3_5"] |
0.94 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet9_2x2_0"] |
0.95 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet9_2x2_5"] |
0.93 (5%) ✅ | 1.00 (1%) |
["solve1", "liswet9_3x3_0"] |
0.93 (5%) ✅ | 1.00 (1%) |
["solve1", "powell20_2x2_5"] |
0.93 (5%) ✅ | 1.00 (1%) |
["solve1", "powell20_3x3_5"] |
0.93 (5%) ✅ | 1.00 (1%) |
["solve1", "primal4_2x2_5"] |
0.92 (5%) ✅ | 1.00 (1%) |
["solve1", "primalc1_3x3_5"] |
1.07 (5%) ❌ | 1.00 (1%) |
["solve1", "primalc8_3x3_5"] |
0.94 (5%) ✅ | 1.00 (1%) |
["solve1", "yao_3x3_0"] |
0.95 (5%) ✅ | 1.00 (1%) |
["solve1", "zecevic2_3x3_0"] |
0.89 (5%) ✅ | 1.00 (1%) |
["solve5", "cvxqp3_l_2x2_10"] |
1.08 (5%) ❌ | 1.00 (1%) |
["solve5", "genhs28_3x3_0"] |
0.91 (5%) ✅ | 1.00 (1%) |
["solve5", "hs21mod_2x2_0"] |
0.93 (5%) ✅ | 1.00 (1%) |
["solve5", "hs268_3x3_0"] |
0.94 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet11_2x2_0"] |
0.93 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet11_2x2_10"] |
0.94 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet11_3x3_0"] |
0.94 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet11_3x3_5"] |
0.91 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet12_3x3_10"] |
0.92 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet12_3x3_5"] |
0.93 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet1_2x2_0"] |
0.95 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet1_2x2_10"] |
0.95 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet1_2x2_5"] |
0.95 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet1_3x3_0"] |
0.91 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet2_3x3_0"] |
0.95 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet2_3x3_10"] |
0.91 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet2_3x3_5"] |
0.93 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet3_3x3_0"] |
0.91 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet3_3x3_10"] |
0.94 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet4_3x3_0"] |
0.92 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet4_3x3_5"] |
0.93 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet5_3x3_0"] |
0.95 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet5_3x3_10"] |
0.93 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet6_2x2_0"] |
0.95 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet6_3x3_5"] |
0.92 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet7_3x3_10"] |
0.94 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet7_3x3_5"] |
0.95 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet8_2x2_0"] |
0.95 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet8_3x3_0"] |
0.93 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet8_3x3_10"] |
0.94 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet8_3x3_5"] |
0.91 (5%) ✅ | 1.00 (1%) |
["solve5", "liswet9_3x3_10"] |
0.91 (5%) ✅ | 1.00 (1%) |
["solve5", "powell20_3x3_0"] |
0.95 (5%) ✅ | 1.00 (1%) |
["solve5", "primal4_2x2_5"] |
0.78 (5%) ✅ | 1.00 (1%) |
["solve5", "tame_3x3_0"] |
0.91 (5%) ✅ | 1.00 (1%) |
Here's a list of all the benchmark groups executed by this job:
["analyze"]
["factorize"]
["solve1"]
["solve5"]
Julia Version 1.5.1
Commit 697e782ab8 (2020-08-25 20:08 UTC)
Platform Info:
OS: Linux (x86_64-pc-linux-gnu)
uname: Linux 3.10.0-957.5.1.el7.x86_64 #1 SMP Fri Feb 1 14:54:57 UTC 2019 x86_64 x86_64
CPU: Intel(R) Xeon(R) CPU E5530 @ 2.40GHz:
speed user nice sys idle irq
#1-16 1596 MHz 29355320 s 3445 s 2153783 s 59605208779 s 0 s
Memory: 46.99784851074219 GB (29720.86328125 MB free)
Uptime: 3.7280708e7 sec
Load Avg: 1.32958984375 1.21875 1.1240234375
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-9.0.1 (ORCJIT, nehalem)
Julia Version 1.5.1
Commit 697e782ab8 (2020-08-25 20:08 UTC)
Platform Info:
OS: Linux (x86_64-pc-linux-gnu)
uname: Linux 3.10.0-957.5.1.el7.x86_64 #1 SMP Fri Feb 1 14:54:57 UTC 2019 x86_64 x86_64
CPU: Intel(R) Xeon(R) CPU E5530 @ 2.40GHz:
speed user nice sys idle irq
#1-16 2128 MHz 29985582 s 3445 s 2164177 s 59614801703 s 0 s
Memory: 46.99784851074219 GB (30184.40625 MB free)
Uptime: 3.7287105e7 sec
Load Avg: 1.0029296875 1.0146484375 1.04541015625
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-9.0.1 (ORCJIT, nehalem)