amontoison/benchmark.md

## benchmark.md

      
    Raw
  

              benchmark.md
            
          
    Benchmark Report for Krylov

Job Properties


Time of benchmark: 24 Jul 2018 - 0:6
Package commit: c73fef
Julia commit: 9d11f6
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.


ID
time
GC time
memory
allocations


["big matrix", "obstclae.mtx", "IterativeSolvers"]
25.204 ms (5%)

1.22 MiB (1%)
46


["big matrix", "obstclae.mtx", "Krylov"]
24.116 ms (5%)

942.02 KiB (1%)
193


["big matrix", "obstclae.mtx", "KrylovMethods"]
26.315 ms (5%)

1.83 MiB (1%)
116


["big matrix", "sts4098.mtx", "IterativeSolvers"]
968.489 ms (5%)

130.66 KiB (1%)
46


["big matrix", "sts4098.mtx", "Krylov"]
963.864 ms (5%)

865.89 KiB (1%)
32821


["big matrix", "sts4098.mtx", "KrylovMethods"]
958.645 ms (5%)

514.34 KiB (1%)
16437


["big matrix", "torsion1.mtx", "IterativeSolvers"]
32.103 ms (5%)

1.22 MiB (1%)
46


["big matrix", "torsion1.mtx", "Krylov"]
27.122 ms (5%)

942.02 KiB (1%)
193


["big matrix", "torsion1.mtx", "KrylovMethods"]
31.170 ms (5%)

1.83 MiB (1%)
116


["div_grad", "dimension: 128", "IterativeSolvers"]
16.099 s (5%)
1.303 ms
64.00 MiB (1%)
46


["div_grad", "dimension: 128", "Krylov"]
16.976 s (5%)
680.496 μs
48.03 MiB (1%)
1432


["div_grad", "dimension: 128", "KrylovMethods"]
18.622 s (5%)
1.895 ms
96.01 MiB (1%)
734


["div_grad", "dimension: 32", "IterativeSolvers"]
56.220 ms (5%)

1.00 MiB (1%)
46


["div_grad", "dimension: 32", "Krylov"]
52.798 ms (5%)

776.52 KiB (1%)
382


["div_grad", "dimension: 32", "KrylovMethods"]
55.041 ms (5%)

1.50 MiB (1%)
210


["div_grad", "dimension: 64", "IterativeSolvers"]
1.057 s (5%)

8.00 MiB (1%)
46


["div_grad", "dimension: 64", "Krylov"]
1.061 s (5%)

6.02 MiB (1%)
759


["div_grad", "dimension: 64", "KrylovMethods"]
1.075 s (5%)

12.01 MiB (1%)
398


["medium matrix", "Chem97ZtZ.mtx", "IterativeSolvers"]
1.590 ms (5%)

81.91 KiB (1%)
46


["medium matrix", "Chem97ZtZ.mtx", "Krylov"]
1.501 ms (5%)

67.95 KiB (1%)
370


["medium matrix", "Chem97ZtZ.mtx", "KrylovMethods"]
1.633 ms (5%)

123.94 KiB (1%)
204


["medium matrix", "bcsstk09.mtx", "IterativeSolvers"]
5.927 ms (5%)

36.59 KiB (1%)
42


["medium matrix", "bcsstk09.mtx", "Krylov"]
5.829 ms (5%)

51.16 KiB (1%)
1077


["medium matrix", "bcsstk09.mtx", "KrylovMethods"]
5.935 ms (5%)

62.73 KiB (1%)
554


["medium matrix", "nasa1824.mtx", "IterativeSolvers"]
186.645 ms (5%)

59.59 KiB (1%)
42


["medium matrix", "nasa1824.mtx", "Krylov"]
184.065 ms (5%)

336.22 KiB (1%)
14624


["medium matrix", "nasa1824.mtx", "KrylovMethods"]
208.390 ms (5%)

230.03 KiB (1%)
7337


["medium matrix", "plat1919.mtx", "IterativeSolvers"]
173.190 ms (5%)

62.59 KiB (1%)
42


["medium matrix", "plat1919.mtx", "Krylov"]
173.403 ms (5%)

350.34 KiB (1%)
15384


["medium matrix", "plat1919.mtx", "KrylovMethods"]
170.857 ms (5%)

241.97 KiB (1%)
7717


["medium matrix", "t3dl_e.mtx", "IterativeSolvers"]
67.337 ms (5%)

638.66 KiB (1%)
46


["medium matrix", "t3dl_e.mtx", "Krylov"]
55.522 ms (5%)

502.64 KiB (1%)
1076


["medium matrix", "t3dl_e.mtx", "KrylovMethods"]
74.820 ms (5%)

965.95 KiB (1%)
556


["small matrix", "494_bus.mtx", "IterativeSolvers"]
3.678 ms (5%)

18.09 KiB (1%)
42


["small matrix", "494_bus.mtx", "Krylov"]
3.601 ms (5%)

59.81 KiB (1%)
2004


["small matrix", "494_bus.mtx", "KrylovMethods"]
3.998 ms (5%)

48.66 KiB (1%)
1028


["small matrix", "bcsstk01.mtx", "IterativeSolvers"]
70.468 μs (5%)

4.13 KiB (1%)
36


["small matrix", "bcsstk01.mtx", "Krylov"]
76.910 μs (5%)

7.31 KiB (1%)
215


["small matrix", "bcsstk01.mtx", "KrylovMethods"]
81.713 μs (5%)

6.77 KiB (1%)
131


["small matrix", "ex5.mtx", "IterativeSolvers"]
34.515 μs (5%)

3.31 KiB (1%)
36


["small matrix", "ex5.mtx", "Krylov"]
35.076 μs (5%)

4.33 KiB (1%)
130


["small matrix", "ex5.mtx", "KrylovMethods"]
51.119 μs (5%)

4.61 KiB (1%)
89


["small matrix", "nos4.mtx", "IterativeSolvers"]
82.152 μs (5%)

5.50 KiB (1%)
36


["small matrix", "nos4.mtx", "Krylov"]
86.713 μs (5%)

7.69 KiB (1%)
173


["small matrix", "nos4.mtx", "KrylovMethods"]
81.716 μs (5%)

7.92 KiB (1%)
99


["small matrix", "plat362.mtx", "IterativeSolvers"]
5.513 ms (5%)

14.09 KiB (1%)
42


["small matrix", "plat362.mtx", "Krylov"]
5.795 ms (5%)

48.56 KiB (1%)
1476


["small matrix", "plat362.mtx", "KrylovMethods"]
5.580 ms (5%)

36.41 KiB (1%)
764


Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["big matrix", "obstclae.mtx"]
["big matrix", "sts4098.mtx"]
["big matrix", "torsion1.mtx"]
["div_grad", "dimension: 128"]
["div_grad", "dimension: 32"]
["div_grad", "dimension: 64"]
["medium matrix", "Chem97ZtZ.mtx"]
["medium matrix", "bcsstk09.mtx"]
["medium matrix", "nasa1824.mtx"]
["medium matrix", "plat1919.mtx"]
["medium matrix", "t3dl_e.mtx"]
["small matrix", "494_bus.mtx"]
["small matrix", "bcsstk01.mtx"]
["small matrix", "ex5.mtx"]
["small matrix", "nos4.mtx"]
["small matrix", "plat362.mtx"]

Julia versioninfo

Julia Version 0.6.4
Commit 9d11f62bcb (2018-07-09 19:09 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
  CPU: Intel(R) Core(TM) i5-6200U CPU @ 2.30GHz
  WORD_SIZE: 64
           Ubuntu 16.04.4 LTS
  uname: Linux 4.13.0-45-generic #50~16.04.1-Ubuntu SMP Wed May 30 11:18:27 UTC 2018 x86_64 x86_64
Memory: 7.669498443603516 GB (930.30859375 MB free)
Uptime: 14674.0 sec
Load Avg:  3.103515625  2.70947265625  2.09228515625
Intel(R) Core(TM) i5-6200U CPU @ 2.30GHz: 
       speed         user         nice          sys         idle          irq
#1  2701 MHz     220972 s        745 s     104789 s    1126501 s          0 s
#2  2706 MHz     212924 s        700 s      98766 s    1137319 s          0 s
#3  2708 MHz     215508 s        548 s     100903 s    1125492 s          0 s
#4  2700 MHz     209826 s        512 s      93722 s    1146002 s          0 s

  BLAS: libopenblas (USE64BITINT DYNAMIC_ARCH NO_AFFINITY Haswell MAX_THREADS=16)
  LAPACK: libopenblas64_
  LIBM: libopenlibm
  LLVM: libLLVM-3.9.1 (ORCJIT, skylake)
ID	time	GC time	memory	allocations
`["big matrix", "obstclae.mtx", "IterativeSolvers"]`	25.204 ms (5%)		1.22 MiB (1%)	46
`["big matrix", "obstclae.mtx", "Krylov"]`	24.116 ms (5%)		942.02 KiB (1%)	193
`["big matrix", "obstclae.mtx", "KrylovMethods"]`	26.315 ms (5%)		1.83 MiB (1%)	116
`["big matrix", "sts4098.mtx", "IterativeSolvers"]`	968.489 ms (5%)		130.66 KiB (1%)	46
`["big matrix", "sts4098.mtx", "Krylov"]`	963.864 ms (5%)		865.89 KiB (1%)	32821
`["big matrix", "sts4098.mtx", "KrylovMethods"]`	958.645 ms (5%)		514.34 KiB (1%)	16437
`["big matrix", "torsion1.mtx", "IterativeSolvers"]`	32.103 ms (5%)		1.22 MiB (1%)	46
`["big matrix", "torsion1.mtx", "Krylov"]`	27.122 ms (5%)		942.02 KiB (1%)	193
`["big matrix", "torsion1.mtx", "KrylovMethods"]`	31.170 ms (5%)		1.83 MiB (1%)	116
`["div_grad", "dimension: 128", "IterativeSolvers"]`	16.099 s (5%)	1.303 ms	64.00 MiB (1%)	46
`["div_grad", "dimension: 128", "Krylov"]`	16.976 s (5%)	680.496 μs	48.03 MiB (1%)	1432
`["div_grad", "dimension: 128", "KrylovMethods"]`	18.622 s (5%)	1.895 ms	96.01 MiB (1%)	734
`["div_grad", "dimension: 32", "IterativeSolvers"]`	56.220 ms (5%)		1.00 MiB (1%)	46
`["div_grad", "dimension: 32", "Krylov"]`	52.798 ms (5%)		776.52 KiB (1%)	382
`["div_grad", "dimension: 32", "KrylovMethods"]`	55.041 ms (5%)		1.50 MiB (1%)	210
`["div_grad", "dimension: 64", "IterativeSolvers"]`	1.057 s (5%)		8.00 MiB (1%)	46
`["div_grad", "dimension: 64", "Krylov"]`	1.061 s (5%)		6.02 MiB (1%)	759
`["div_grad", "dimension: 64", "KrylovMethods"]`	1.075 s (5%)		12.01 MiB (1%)	398
`["medium matrix", "Chem97ZtZ.mtx", "IterativeSolvers"]`	1.590 ms (5%)		81.91 KiB (1%)	46
`["medium matrix", "Chem97ZtZ.mtx", "Krylov"]`	1.501 ms (5%)		67.95 KiB (1%)	370
`["medium matrix", "Chem97ZtZ.mtx", "KrylovMethods"]`	1.633 ms (5%)		123.94 KiB (1%)	204
`["medium matrix", "bcsstk09.mtx", "IterativeSolvers"]`	5.927 ms (5%)		36.59 KiB (1%)	42
`["medium matrix", "bcsstk09.mtx", "Krylov"]`	5.829 ms (5%)		51.16 KiB (1%)	1077
`["medium matrix", "bcsstk09.mtx", "KrylovMethods"]`	5.935 ms (5%)		62.73 KiB (1%)	554
`["medium matrix", "nasa1824.mtx", "IterativeSolvers"]`	186.645 ms (5%)		59.59 KiB (1%)	42
`["medium matrix", "nasa1824.mtx", "Krylov"]`	184.065 ms (5%)		336.22 KiB (1%)	14624
`["medium matrix", "nasa1824.mtx", "KrylovMethods"]`	208.390 ms (5%)		230.03 KiB (1%)	7337
`["medium matrix", "plat1919.mtx", "IterativeSolvers"]`	173.190 ms (5%)		62.59 KiB (1%)	42
`["medium matrix", "plat1919.mtx", "Krylov"]`	173.403 ms (5%)		350.34 KiB (1%)	15384
`["medium matrix", "plat1919.mtx", "KrylovMethods"]`	170.857 ms (5%)		241.97 KiB (1%)	7717
`["medium matrix", "t3dl_e.mtx", "IterativeSolvers"]`	67.337 ms (5%)		638.66 KiB (1%)	46
`["medium matrix", "t3dl_e.mtx", "Krylov"]`	55.522 ms (5%)		502.64 KiB (1%)	1076
`["medium matrix", "t3dl_e.mtx", "KrylovMethods"]`	74.820 ms (5%)		965.95 KiB (1%)	556
`["small matrix", "494_bus.mtx", "IterativeSolvers"]`	3.678 ms (5%)		18.09 KiB (1%)	42
`["small matrix", "494_bus.mtx", "Krylov"]`	3.601 ms (5%)		59.81 KiB (1%)	2004
`["small matrix", "494_bus.mtx", "KrylovMethods"]`	3.998 ms (5%)		48.66 KiB (1%)	1028
`["small matrix", "bcsstk01.mtx", "IterativeSolvers"]`	70.468 μs (5%)		4.13 KiB (1%)	36
`["small matrix", "bcsstk01.mtx", "Krylov"]`	76.910 μs (5%)		7.31 KiB (1%)	215
`["small matrix", "bcsstk01.mtx", "KrylovMethods"]`	81.713 μs (5%)		6.77 KiB (1%)	131
`["small matrix", "ex5.mtx", "IterativeSolvers"]`	34.515 μs (5%)		3.31 KiB (1%)	36
`["small matrix", "ex5.mtx", "Krylov"]`	35.076 μs (5%)		4.33 KiB (1%)	130
`["small matrix", "ex5.mtx", "KrylovMethods"]`	51.119 μs (5%)		4.61 KiB (1%)	89
`["small matrix", "nos4.mtx", "IterativeSolvers"]`	82.152 μs (5%)		5.50 KiB (1%)	36
`["small matrix", "nos4.mtx", "Krylov"]`	86.713 μs (5%)		7.69 KiB (1%)	173
`["small matrix", "nos4.mtx", "KrylovMethods"]`	81.716 μs (5%)		7.92 KiB (1%)	99
`["small matrix", "plat362.mtx", "IterativeSolvers"]`	5.513 ms (5%)		14.09 KiB (1%)	42
`["small matrix", "plat362.mtx", "Krylov"]`	5.795 ms (5%)		48.56 KiB (1%)	1476
`["small matrix", "plat362.mtx", "KrylovMethods"]`	5.580 ms (5%)		36.41 KiB (1%)	764