LDLFactorization repository benchmark

1_solve1.svg

2_solve5.svg

3_fact.svg

4_judgement.md

Benchmark Report for LDLFactorizations\n\n## Job Properties\n* Time of benchmarks:\n - Target: 19 Sep 2020 - 10:00\n - Baseline: 19 Sep 2020 - 10:01\n* Package commits:\n - Target: 3d8eb8\n - Baseline: f962c4\n* Julia commits:\n - Target: 96786e\n - Baseline: 96786e\n* Julia command flags:\n - Target: None\n - Baseline: None\n* Environment variables:\n - Target: None\n - Baseline: None\n\n## Results\nA ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less\nthan 1.0 denotes a possible improvement (marked with ✅). Only significant results - results\nthat indicate possible regressions or improvements - are shown below (thus, an empty table means that all\nbenchmark results remained invariant between builds).\n\n| ID | time ratio | memory ratio |\n|--------------------------------|------------------------------|--------------|\n| [\"fact\", \"hs21_2x2_0\"] | 1.07 (5%) ❌ | 1.00 (1%) |\n| [\"fact\", \"hs53_2x2_0\"] | 0.95 (5%) ✅ | 1.00 (1%) |\n| [\"fact\", \"s268_2x2_0\"] | 1.06 (5%) ❌ | 1.00 (1%) |\n| [\"solve1\", \"genhs28_2x2_0\"] | 1.05 (5%) ❌ | 1.00 (1%) |\n| [\"solve1\", \"hs21_2x2_0\"] | 1.06 (5%) ❌ | 1.00 (1%) |\n| [\"solve1\", \"hs35_2x2_0\"] | 1.05 (5%) ❌ | 1.00 (1%) |\n| [\"solve1\", \"hs35mod_2x2_0\"] | 1.07 (5%) ❌ | 1.00 (1%) |\n| [\"solve1\", \"hs76_2x2_0\"] | 0.94 (5%) ✅ | 1.00 (1%) |\n| [\"solve1\", \"lotschd_2x2_0\"] | 1.12 (5%) ❌ | 1.00 (1%) |\n| [\"solve1\", \"zecevic2_2x2_0\"] | 1.07 (5%) ❌ | 1.00 (1%) |\n| [\"solve5\", \"hs21_2x2_0\"] | 0.95 (5%) ✅ | 1.00 (1%) |\n| [\"solve5\", \"lotschd_2x2_0\"] | 1.09 (5%) ❌ | 1.00 (1%) |\n| [\"solve5\", \"s268_2x2_0\"] | 1.05 (5%) ❌ | 1.00 (1%) |\n\n## Benchmark Group List\nHere's a list of all the benchmark groups executed by this job:\n\n- [\"fact\"]\n- [\"solve1\"]\n- [\"solve5\"]\n\n## Julia versioninfo\n\n### Target\n\nJulia Version 1.5.0\nCommit 96786e22cc (2020-08-01 23:44 UTC)\nPlatform Info:\n OS: macOS (x86_64-apple-darwin18.7.0)\n uname: Darwin 19.6.0 Darwin Kernel Version 19.6.0: Thu Jun 18 20:49:00 PDT 2020; root:xnu-6153.141.1~1/RELEASE_X86_64 x86_64 i386\n CPU: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz: \n speed user nice sys idle irq\n #1 3100 MHz 5197 s 0 s 6962 s 4153 s 0 s\n #2 3100 MHz 1620 s 0 s 1326 s 13362 s 0 s\n #3 3100 MHz 5181 s 0 s 6555 s 4573 s 0 s\n #4 3100 MHz 1680 s 0 s 1313 s 13316 s 0 s\n #5 3100 MHz 5027 s 0 s 6047 s 5235 s 0 s\n #6 3100 MHz 1784 s 0 s 1325 s 13199 s 0 s\n #7 3100 MHz 4816 s 0 s 4547 s 6945 s 0 s\n #8 3100 MHz 1930 s 0 s 1324 s 13054 s 0 s\n \n Memory: 16.0 GB (2363.93359375 MB free)\n Uptime: 1631.0 sec\n Load Avg: 4.9482421875 4.6103515625 8.9482421875\n WORD_SIZE: 64\n LIBM: libopenlibm\n LLVM: libLLVM-9.0.1 (ORCJIT, skylake)\n\n\n### Baseline\n\nJulia Version 1.5.0\nCommit 96786e22cc (2020-08-01 23:44 UTC)\nPlatform Info:\n OS: macOS (x86_64-apple-darwin18.7.0)\n uname: Darwin 19.6.0 Darwin Kernel Version 19.6.0: Thu Jun 18 20:49:00 PDT 2020; root:xnu-6153.141.1~1/RELEASE_X86_64 x86_64 i386\n CPU: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz: \n speed user nice sys idle irq\n #1 3100 MHz 5506 s 0 s 7098 s 4401 s 0 s\n #2 3100 MHz 1667 s 0 s 1363 s 13970 s 0 s\n #3 3100 MHz 5472 s 0 s 6654 s 4874 s 0 s\n #4 3100 MHz 1729 s 0 s 1346 s 13925 s 0 s\n #5 3100 MHz 5315 s 0 s 6137 s 5548 s 0 s\n #6 3100 MHz 1836 s 0 s 1357 s 13807 s 0 s\n #7 3100 MHz 5095 s 0 s 4628 s 7277 s 0 s\n #8 3100 MHz 1986 s 0 s 1355 s 13659 s 0 s\n \n Memory: 16.0 GB (2227.39453125 MB free)\n Uptime: 1700.0 sec\n Load Avg: 3.85888671875 4.33349609375 8.498046875\n WORD_SIZE: 64\n LIBM: libopenlibm\n LLVM: libLLVM-9.0.1 (ORCJIT, skylake)\n

5_master.md

Benchmark Report for LDLFactorizations\n\n## Job Properties\n* Time of benchmark: 19 Sep 2020 - 10:1\n* Package commit: f962c4\n* Julia commit: 96786e\n* Julia command flags: None\n* Environment variables: None\n\n## Results\nBelow is a table of this job's results, obtained by running the benchmarks.\nThe values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to\nindex into the BaseBenchmarks suite to retrieve the corresponding benchmarks.\nThe percentages accompanying time and memory values in the below table are noise tolerances. The "true"\ntime/memory value for a given benchmark is expected to fall within this percentage of the reported value.\nAn empty cell means that the value was zero.\n\n| ID | time | GC time | memory | allocations |\n|--------------------------------|----------------:|--------:|---------------:|------------:|\n| [\"fact\", \"genhs28_2x2_0\"] | 3.027 μs (5%) | | 6.12 KiB (1%) | 20 |\n| [\"fact\", \"hs21_2x2_0\"] | 1.790 μs (5%) | | 4.00 KiB (1%) | 20 |\n| [\"fact\", \"hs21mod_2x2_0\"] | 2.614 μs (5%) | | 6.50 KiB (1%) | 20 |\n| [\"fact\", \"hs268_2x2_0\"] | 2.539 μs (5%) | | 6.09 KiB (1%) | 20 |\n| [\"fact\", \"hs35_2x2_0\"] | 1.902 μs (5%) | | 3.91 KiB (1%) | 20 |\n| [\"fact\", \"hs35mod_2x2_0\"] | 1.700 μs (5%) | | 3.52 KiB (1%) | 20 |\n| [\"fact\", \"hs51_2x2_0\"] | 1.612 μs (5%) | | 3.29 KiB (1%) | 20 |\n| [\"fact\", \"hs52_2x2_0\"] | 1.583 μs (5%) | | 3.29 KiB (1%) | 20 |\n| [\"fact\", \"hs53_2x2_0\"] | 3.421 μs (5%) | | 7.49 KiB (1%) | 20 |\n| [\"fact\", \"hs76_2x2_0\"] | 2.499 μs (5%) | | 5.59 KiB (1%) | 20 |\n| [\"fact\", \"lotschd_2x2_0\"] | 5.537 μs (5%) | | 12.88 KiB (1%) | 20 |\n| [\"fact\", \"s268_2x2_0\"] | 2.346 μs (5%) | | 6.09 KiB (1%) | 20 |\n| [\"fact\", \"tame_2x2_0\"] | 1.534 μs (5%) | | 3.05 KiB (1%) | 20 |\n| [\"fact\", \"zecevic2_2x2_0\"] | 2.057 μs (5%) | | 4.49 KiB (1%) | 20 |\n| [\"solve1\", \"genhs28_2x2_0\"] | 170.029 ns (5%) | | | |\n| [\"solve1\", \"hs21_2x2_0\"] | 95.454 ns (5%) | | | |\n| [\"solve1\", \"hs21mod_2x2_0\"] | 151.341 ns (5%) | | | |\n| [\"solve1\", \"hs268_2x2_0\"] | 174.581 ns (5%) | | | |\n| [\"solve1\", \"hs35_2x2_0\"] | 94.125 ns (5%) | | | |\n| [\"solve1\", \"hs35mod_2x2_0\"] | 81.705 ns (5%) | | | |\n| [\"solve1\", \"hs51_2x2_0\"] | 87.330 ns (5%) | | | |\n| [\"solve1\", \"hs52_2x2_0\"] | 88.894 ns (5%) | | | |\n| [\"solve1\", \"hs53_2x2_0\"] | 185.294 ns (5%) | | | |\n| [\"solve1\", \"hs76_2x2_0\"] | 135.519 ns (5%) | | | |\n| [\"solve1\", \"lotschd_2x2_0\"] | 336.796 ns (5%) | | | |\n| [\"solve1\", \"s268_2x2_0\"] | 183.759 ns (5%) | | | |\n| [\"solve1\", \"tame_2x2_0\"] | 75.589 ns (5%) | | | |\n| [\"solve1\", \"zecevic2_2x2_0\"] | 108.895 ns (5%) | | | |\n| [\"solve5\", \"genhs28_2x2_0\"] | 577.776 ns (5%) | | | |\n| [\"solve5\", \"hs21_2x2_0\"] | 271.881 ns (5%) | | | |\n| [\"solve5\", \"hs21mod_2x2_0\"] | 455.264 ns (5%) | | | |\n| [\"solve5\", \"hs268_2x2_0\"] | 702.552 ns (5%) | | | |\n| [\"solve5\", \"hs35_2x2_0\"] | 272.333 ns (5%) | | | |\n| [\"solve5\", \"hs35mod_2x2_0\"] | 236.631 ns (5%) | | | |\n| [\"solve5\", \"hs51_2x2_0\"] | 236.254 ns (5%) | | | |\n| [\"solve5\", \"hs52_2x2_0\"] | 229.726 ns (5%) | | | |\n| [\"solve5\", \"hs53_2x2_0\"] | 620.287 ns (5%) | | | |\n| [\"solve5\", \"hs76_2x2_0\"] | 467.357 ns (5%) | | | |\n| [\"solve5\", \"lotschd_2x2_0\"] | 1.468 μs (5%) | | | |\n| [\"solve5\", \"s268_2x2_0\"] | 664.455 ns (5%) | | | |\n| [\"solve5\", \"tame_2x2_0\"] | 187.300 ns (5%) | | | |\n| [\"solve5\", \"zecevic2_2x2_0\"] | 336.128 ns (5%) | | | |\n\n## Benchmark Group List\nHere's a list of all the benchmark groups executed by this job:\n\n- [\"fact\"]\n- [\"solve1\"]\n- [\"solve5\"]\n\n## Julia versioninfo\n\nJulia Version 1.5.0\nCommit 96786e22cc (2020-08-01 23:44 UTC)\nPlatform Info:\n OS: macOS (x86_64-apple-darwin18.7.0)\n uname: Darwin 19.6.0 Darwin Kernel Version 19.6.0: Thu Jun 18 20:49:00 PDT 2020; root:xnu-6153.141.1~1/RELEASE_X86_64 x86_64 i386\n CPU: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz: \n speed user nice sys idle irq\n #1 3100 MHz 5506 s 0 s 7098 s 4401 s 0 s\n #2 3100 MHz 1667 s 0 s 1363 s 13970 s 0 s\n #3 3100 MHz 5472 s 0 s 6654 s 4874 s 0 s\n #4 3100 MHz 1729 s 0 s 1346 s 13925 s 0 s\n #5 3100 MHz 5315 s 0 s 6137 s 5548 s 0 s\n #6 3100 MHz 1836 s 0 s 1357 s 13807 s 0 s\n #7 3100 MHz 5095 s 0 s 4628 s 7277 s 0 s\n #8 3100 MHz 1986 s 0 s 1355 s 13659 s 0 s\n \n Memory: 16.0 GB (2227.39453125 MB free)\n Uptime: 1700.0 sec\n Load Avg: 3.85888671875 4.33349609375 8.498046875\n WORD_SIZE: 64\n LIBM: libopenlibm\n LLVM: libLLVM-9.0.1 (ORCJIT, skylake)\n

6_commit.md

Benchmark Report for LDLFactorizations\n\n## Job Properties\n* Time of benchmark: 19 Sep 2020 - 10:0\n* Package commit: 3d8eb8\n* Julia commit: 96786e\n* Julia command flags: None\n* Environment variables: None\n\n## Results\nBelow is a table of this job's results, obtained by running the benchmarks.\nThe values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to\nindex into the BaseBenchmarks suite to retrieve the corresponding benchmarks.\nThe percentages accompanying time and memory values in the below table are noise tolerances. The "true"\ntime/memory value for a given benchmark is expected to fall within this percentage of the reported value.\nAn empty cell means that the value was zero.\n\n| ID | time | GC time | memory | allocations |\n|--------------------------------|----------------:|--------:|---------------:|------------:|\n| [\"fact\", \"genhs28_2x2_0\"] | 3.039 μs (5%) | | 6.12 KiB (1%) | 20 |\n| [\"fact\", \"hs21_2x2_0\"] | 1.923 μs (5%) | | 4.00 KiB (1%) | 20 |\n| [\"fact\", \"hs21mod_2x2_0\"] | 2.687 μs (5%) | | 6.50 KiB (1%) | 20 |\n| [\"fact\", \"hs268_2x2_0\"] | 2.478 μs (5%) | | 6.09 KiB (1%) | 20 |\n| [\"fact\", \"hs35_2x2_0\"] | 1.842 μs (5%) | | 3.91 KiB (1%) | 20 |\n| [\"fact\", \"hs35mod_2x2_0\"] | 1.672 μs (5%) | | 3.52 KiB (1%) | 20 |\n| [\"fact\", \"hs51_2x2_0\"] | 1.597 μs (5%) | | 3.29 KiB (1%) | 20 |\n| [\"fact\", \"hs52_2x2_0\"] | 1.592 μs (5%) | | 3.29 KiB (1%) | 20 |\n| [\"fact\", \"hs53_2x2_0\"] | 3.241 μs (5%) | | 7.49 KiB (1%) | 20 |\n| [\"fact\", \"hs76_2x2_0\"] | 2.524 μs (5%) | | 5.59 KiB (1%) | 20 |\n| [\"fact\", \"lotschd_2x2_0\"] | 5.700 μs (5%) | | 12.88 KiB (1%) | 20 |\n| [\"fact\", \"s268_2x2_0\"] | 2.486 μs (5%) | | 6.09 KiB (1%) | 20 |\n| [\"fact\", \"tame_2x2_0\"] | 1.504 μs (5%) | | 3.05 KiB (1%) | 20 |\n| [\"fact\", \"zecevic2_2x2_0\"] | 2.042 μs (5%) | | 4.49 KiB (1%) | 20 |\n| [\"solve1\", \"genhs28_2x2_0\"] | 178.808 ns (5%) | | | |\n| [\"solve1\", \"hs21_2x2_0\"] | 101.288 ns (5%) | | | |\n| [\"solve1\", \"hs21mod_2x2_0\"] | 144.061 ns (5%) | | | |\n| [\"solve1\", \"hs268_2x2_0\"] | 174.749 ns (5%) | | | |\n| [\"solve1\", \"hs35_2x2_0\"] | 98.852 ns (5%) | | | |\n| [\"solve1\", \"hs35mod_2x2_0\"] | 87.799 ns (5%) | | | |\n| [\"solve1\", \"hs51_2x2_0\"] | 87.706 ns (5%) | | | |\n| [\"solve1\", \"hs52_2x2_0\"] | 89.056 ns (5%) | | | |\n| [\"solve1\", \"hs53_2x2_0\"] | 185.023 ns (5%) | | | |\n| [\"solve1\", \"hs76_2x2_0\"] | 127.309 ns (5%) | | | |\n| [\"solve1\", \"lotschd_2x2_0\"] | 377.786 ns (5%) | | | |\n| [\"solve1\", \"s268_2x2_0\"] | 184.180 ns (5%) | | | |\n| [\"solve1\", \"tame_2x2_0\"] | 78.853 ns (5%) | | | |\n| [\"solve1\", \"zecevic2_2x2_0\"] | 116.478 ns (5%) | | | |\n| [\"solve5\", \"genhs28_2x2_0\"] | 573.650 ns (5%) | | | |\n| [\"solve5\", \"hs21_2x2_0\"] | 257.069 ns (5%) | | | |\n| [\"solve5\", \"hs21mod_2x2_0\"] | 451.832 ns (5%) | | | |\n| [\"solve5\", \"hs268_2x2_0\"] | 669.958 ns (5%) | | | |\n| [\"solve5\", \"hs35_2x2_0\"] | 274.691 ns (5%) | | | |\n| [\"solve5\", \"hs35mod_2x2_0\"] | 237.578 ns (5%) | | | |\n| [\"solve5\", \"hs51_2x2_0\"] | 226.907 ns (5%) | | | |\n| [\"solve5\", \"hs52_2x2_0\"] | 240.145 ns (5%) | | | |\n| [\"solve5\", \"hs53_2x2_0\"] | 631.444 ns (5%) | | | |\n| [\"solve5\", \"hs76_2x2_0\"] | 466.944 ns (5%) | | | |\n| [\"solve5\", \"lotschd_2x2_0\"] | 1.594 μs (5%) | | | |\n| [\"solve5\", \"s268_2x2_0\"] | 697.683 ns (5%) | | | |\n| [\"solve5\", \"tame_2x2_0\"] | 185.611 ns (5%) | | | |\n| [\"solve5\", \"zecevic2_2x2_0\"] | 334.195 ns (5%) | | | |\n\n## Benchmark Group List\nHere's a list of all the benchmark groups executed by this job:\n\n- [\"fact\"]\n- [\"solve1\"]\n- [\"solve5\"]\n\n## Julia versioninfo\n\nJulia Version 1.5.0\nCommit 96786e22cc (2020-08-01 23:44 UTC)\nPlatform Info:\n OS: macOS (x86_64-apple-darwin18.7.0)\n uname: Darwin 19.6.0 Darwin Kernel Version 19.6.0: Thu Jun 18 20:49:00 PDT 2020; root:xnu-6153.141.1~1/RELEASE_X86_64 x86_64 i386\n CPU: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz: \n speed user nice sys idle irq\n #1 3100 MHz 5197 s 0 s 6962 s 4153 s 0 s\n #2 3100 MHz 1620 s 0 s 1326 s 13362 s 0 s\n #3 3100 MHz 5181 s 0 s 6555 s 4573 s 0 s\n #4 3100 MHz 1680 s 0 s 1313 s 13316 s 0 s\n #5 3100 MHz 5027 s 0 s 6047 s 5235 s 0 s\n #6 3100 MHz 1784 s 0 s 1325 s 13199 s 0 s\n #7 3100 MHz 4816 s 0 s 4547 s 6945 s 0 s\n #8 3100 MHz 1930 s 0 s 1324 s 13054 s 0 s\n \n Memory: 16.0 GB (2363.93359375 MB free)\n Uptime: 1631.0 sec\n Load Avg: 4.9482421875 4.6103515625 8.9482421875\n WORD_SIZE: 64\n LIBM: libopenlibm\n LLVM: libLLVM-9.0.1 (ORCJIT, skylake)\n