GC-opt branch improvement

00 summary

gc-opt branch

mark + reindex (times in seconds)
220
239
292
95
150

mark + reindex (times in seconds)
54
50
50
41
42

===================
total time for five runs:
996s vs 237s
76% reduction in runtime for GC phase

01 original

original
00:00:00.968347 Task: Parsing heapdump-73gb.hprof
00:00:00.006846 [Task: Parsing /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:00:00.000126 [
00:00:00.000020 Subtask: Scanning /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:01:46.273662 [....................
00:00:00.000053 [INFO] Wrote threads call stacks to /home/jkoch/Downloads/heapdump/heapdump-73gb.threads
00:00:00.000017 [....................
00:00:00.000012 [INFO] Heap /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof contains 979,239,706 objects
00:00:00.000012 [....................
00:00:00.000010 Subtask: Extracting objects from /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:05:12.163156 [................................................................................Task: Removing unreachable objects
00:00:00.000047 [
00:00:00.000008 Subtask: Searching for unreachable objects
00:00:00.038670 [
00:00:00.000045 Subtask: Marking reachable objects
00:03:16.391378 [.
00:00:00.000042 Subtask: Re-indexing objects
00:00:24.991458 [.
00:00:00.000038 [INFO] Removed 905,276,064 unreachable objects using 59,438,816,832 bytes
00:00:00.000008 [..
00:00:00.000005 Subtask: Re-indexing classes
00:00:00.018646 [...
00:00:00.000030 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.idx.index
00:00:01.130358 [....
00:00:00.000035 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2c.index
00:00:03.639778 [.....
00:00:00.000034 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.a2s.index
00:00:02.342460 [......
00:00:00.000037 Subtask: Re-indexing outbound index
00:00:38.510041 [.......
00:00:00.000034 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.inbound.index
00:00:19.351030 [........
00:00:00.000038 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.outbound.index
00:00:00.585354 [.........
00:00:00.000035 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2hprof.index
00:00:11.660113 [.........Task: Calculating Dominator Tree
00:00:00.000037 [
00:00:00.000008 Subtask: Dominator Tree calculation
00:00:00.000005 [
00:00:00.000005 Subtask: Depth-first search
00:00:09.448208 [....................
00:00:00.000038 Subtask: Computing dominators
00:00:13.811709 [..............................................
00:00:00.000038 Subtask: Calculate retained sizes
00:00:30.087002 [............................................................
00:00:00.000034 Subtask: Create dominators index file
00:00:09.115578 [................................................................................]

real	13m1.760s
user	70m22.130s
sys	2m56.889s
original
00:00:00.950579 Task: Parsing heapdump-73gb.hprof
00:00:00.006158 [Task: Parsing /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:00:00.000136 [
00:00:00.000026 Subtask: Scanning /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:01:46.773615 [....................
00:00:00.000036 [INFO] Wrote threads call stacks to /home/jkoch/Downloads/heapdump/heapdump-73gb.threads
00:00:00.000008 [....................
00:00:00.000005 [INFO] Heap /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof contains 979,239,706 objects
00:00:00.000005 [....................
00:00:00.000005 Subtask: Extracting objects from /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:05:14.362844 [................................................................................Task: Removing unreachable objects
00:00:00.000044 [
00:00:00.000009 Subtask: Searching for unreachable objects
00:00:00.038827 [
00:00:00.000044 Subtask: Marking reachable objects
00:03:35.271765 [.
00:00:00.000034 Subtask: Re-indexing objects
00:00:24.837018 [.
00:00:00.000038 [INFO] Removed 905,276,064 unreachable objects using 59,438,816,832 bytes
00:00:00.000015 [..
00:00:00.000010 Subtask: Re-indexing classes
00:00:00.021441 [...
00:00:00.000030 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.idx.index
00:00:01.131888 [....
00:00:00.000035 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2c.index
00:00:03.432493 [.....
00:00:00.000032 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.a2s.index
00:00:03.003124 [......
00:00:00.000038 Subtask: Re-indexing outbound index
00:00:37.836467 [.......
00:00:00.000037 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.inbound.index
00:00:19.026105 [........
00:00:00.000037 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.outbound.index
00:00:00.600194 [.........
00:00:00.000035 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2hprof.index
00:00:11.652036 [.........Task: Calculating Dominator Tree
00:00:00.000050 [
00:00:00.000013 Subtask: Dominator Tree calculation
00:00:00.000010 [
00:00:00.000010 Subtask: Depth-first search
00:00:08.837763 [....................
00:00:00.000037 Subtask: Computing dominators
00:00:13.974507 [..............................................
00:00:00.000037 Subtask: Calculate retained sizes
00:00:30.150196 [............................................................
00:00:00.000037 Subtask: Create dominators index file
00:00:09.685742 [................................................................................]

real	13m22.807s
user	73m43.469s
sys	2m56.795s
original
00:00:00.835585 Task: Parsing heapdump-73gb.hprof
00:00:00.006163 [Task: Parsing /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:00:00.000117 [
00:00:00.000018 Subtask: Scanning /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:01:45.600170 [....................
00:00:00.000037 [INFO] Wrote threads call stacks to /home/jkoch/Downloads/heapdump/heapdump-73gb.threads
00:00:00.000010 [....................
00:00:00.000006 [INFO] Heap /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof contains 979,239,706 objects
00:00:00.000007 [....................
00:00:00.000005 Subtask: Extracting objects from /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:05:15.146310 [................................................................................Task: Removing unreachable objects
00:00:00.000041 [
00:00:00.000008 Subtask: Searching for unreachable objects
00:00:00.040532 [
00:00:00.000049 Subtask: Marking reachable objects
00:04:27.870131 [.
00:00:00.000040 Subtask: Re-indexing objects
00:00:25.106739 [.
00:00:00.000035 [INFO] Removed 905,276,064 unreachable objects using 59,438,816,832 bytes
00:00:00.000008 [..
00:00:00.000005 Subtask: Re-indexing classes
00:00:00.018568 [...
00:00:00.000031 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.idx.index
00:00:01.092611 [....
00:00:00.000033 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2c.index
00:00:02.743387 [.....
00:00:00.000035 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.a2s.index
00:00:02.343755 [......
00:00:00.000038 Subtask: Re-indexing outbound index
00:00:38.594576 [.......
00:00:00.000035 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.inbound.index
00:00:18.709409 [........
00:00:00.000044 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.outbound.index
00:00:00.600237 [.........
00:00:00.000034 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2hprof.index
00:00:11.774411 [.........Task: Calculating Dominator Tree
00:00:00.000037 [
00:00:00.000008 Subtask: Dominator Tree calculation
00:00:00.000005 [
00:00:00.000005 Subtask: Depth-first search
00:00:09.530486 [....................
00:00:00.000035 Subtask: Computing dominators
00:00:13.558607 [..............................................
00:00:00.000038 Subtask: Calculate retained sizes
00:00:30.391179 [............................................................
00:00:00.000035 Subtask: Create dominators index file
00:00:09.555030 [................................................................................]

real	14m14.732s
user	77m58.264s
sys	2m58.533s
original
00:00:00.953083 Task: Parsing heapdump-73gb.hprof
00:00:00.007534 [Task: Parsing /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:00:00.000127 [
00:00:00.000019 Subtask: Scanning /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:01:47.581872 [....................
00:00:00.000045 [INFO] Wrote threads call stacks to /home/jkoch/Downloads/heapdump/heapdump-73gb.threads
00:00:00.000016 [....................
00:00:00.000013 [INFO] Heap /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof contains 979,239,706 objects
00:00:00.000013 [....................
00:00:00.000010 Subtask: Extracting objects from /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:05:13.302654 [................................................................................Task: Removing unreachable objects
00:00:00.000053 [
00:00:00.000016 Subtask: Searching for unreachable objects
00:00:00.041250 [
00:00:00.000035 Subtask: Marking reachable objects
00:01:10.161414 [.
00:00:00.000032 Subtask: Re-indexing objects
00:00:25.781033 [.
00:00:00.000035 [INFO] Removed 905,276,064 unreachable objects using 59,438,816,832 bytes
00:00:00.000007 [..
00:00:00.000005 Subtask: Re-indexing classes
00:00:00.026019 [...
00:00:00.000030 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.idx.index
00:00:01.036914 [....
00:00:00.000035 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2c.index
00:00:02.746473 [.....
00:00:00.000035 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.a2s.index
00:00:02.439511 [......
00:00:00.000037 Subtask: Re-indexing outbound index
00:00:38.699830 [.......
00:00:00.000032 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.inbound.index
00:00:18.313487 [........
00:00:00.000047 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.outbound.index
00:00:00.620510 [.........
00:00:00.000044 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2hprof.index
00:00:11.319995 [.........Task: Calculating Dominator Tree
00:00:00.000038 [
00:00:00.000007 Subtask: Dominator Tree calculation
00:00:00.000006 [
00:00:00.000004 Subtask: Depth-first search
00:00:09.245061 [....................
00:00:00.000034 Subtask: Computing dominators
00:00:13.134439 [..............................................
00:00:00.000037 Subtask: Calculate retained sizes
00:00:30.069664 [............................................................
00:00:00.000035 Subtask: Create dominators index file
00:00:09.242165 [................................................................................]

real	10m55.940s
user	57m13.506s
sys	2m56.819s
original
00:00:00.843649 Task: Parsing heapdump-73gb.hprof
00:00:00.007546 [Task: Parsing /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:00:00.000123 [
00:00:00.000019 Subtask: Scanning /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:01:46.476114 [....................
00:00:00.000038 [INFO] Wrote threads call stacks to /home/jkoch/Downloads/heapdump/heapdump-73gb.threads
00:00:00.000008 [....................
00:00:00.000005 [INFO] Heap /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof contains 979,239,706 objects
00:00:00.000005 [....................
00:00:00.000004 Subtask: Extracting objects from /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:05:15.197063 [................................................................................Task: Removing unreachable objects
00:00:00.000041 [
00:00:00.000008 Subtask: Searching for unreachable objects
00:00:00.039077 [
00:00:00.000036 Subtask: Marking reachable objects
00:02:05.620320 [.
00:00:00.000035 Subtask: Re-indexing objects
00:00:25.438049 [.
00:00:00.000037 [INFO] Removed 905,276,064 unreachable objects using 59,438,816,832 bytes
00:00:00.000009 [..
00:00:00.000006 Subtask: Re-indexing classes
00:00:00.028983 [...
00:00:00.000031 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.idx.index
00:00:01.028753 [....
00:00:00.000035 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2c.index
00:00:02.957048 [.....
00:00:00.000033 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.a2s.index
00:00:02.451271 [......
00:00:00.000037 Subtask: Re-indexing outbound index
00:00:38.942555 [.......
00:00:00.000046 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.inbound.index
00:00:17.953563 [........
00:00:00.000044 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.outbound.index
00:00:00.576450 [.........
00:00:00.000034 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2hprof.index
00:00:11.388609 [.........Task: Calculating Dominator Tree
00:00:00.000036 [
00:00:00.000007 Subtask: Dominator Tree calculation
00:00:00.000006 [
00:00:00.000004 Subtask: Depth-first search
00:00:08.979724 [....................
00:00:00.000038 Subtask: Computing dominators
00:00:13.107727 [..............................................
00:00:00.000037 Subtask: Calculate retained sizes
00:00:30.157818 [............................................................
00:00:00.000036 Subtask: Create dominators index file
00:00:09.102382 [................................................................................]

real	11m51.521s
user	64m46.587s
sys	2m58.936s

02 new

new
00:00:00.917287 Task: Parsing heapdump-73gb.hprof
00:00:00.006893 [Task: Parsing /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:00:00.000134 [
00:00:00.000018 Subtask: Scanning /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:01:45.184263 [....................
00:00:00.000034 [INFO] Wrote threads call stacks to /home/jkoch/Downloads/heapdump/heapdump-73gb.threads
00:00:00.000011 [....................
00:00:00.000007 [INFO] Heap /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof contains 979,239,706 objects
00:00:00.000005 [....................
00:00:00.000006 Subtask: Extracting objects from /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:05:15.539770 [................................................................................Task: Removing unreachable objects
00:00:00.000052 [
00:00:00.000014 Subtask: Searching for unreachable objects
00:00:00.037581 [
00:00:00.000036 Subtask: Marking reachable objects
00:00:48.573485 [.
00:00:00.001378 Subtask: Re-indexing objects
00:00:06.716832 [.
00:00:00.000035 [INFO] Removed 905,276,064 unreachable objects using 59,438,816,832 bytes
00:00:00.000011 [..
00:00:00.000006 Subtask: Re-indexing classes
00:00:00.011091 [...
00:00:00.000029 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.idx.index
00:00:01.030859 [....
00:00:00.000037 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2c.index
00:00:02.105247 [.....
00:00:00.000034 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.a2s.index
00:00:03.407037 [......
00:00:00.000036 Subtask: Re-indexing outbound index
00:00:32.037838 [.......
00:00:00.000039 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.inbound.index
00:00:18.943810 [........
00:00:00.000051 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.outbound.index
00:00:00.614470 [.........
00:00:00.000044 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2hprof.index
00:00:11.661792 [.........Task: Calculating Dominator Tree
00:00:00.000042 [
00:00:00.000007 Subtask: Dominator Tree calculation
00:00:00.000005 [
00:00:00.000005 Subtask: Depth-first search
00:00:10.110108 [....................
00:00:00.000036 Subtask: Computing dominators
00:00:13.658970 [..............................................
00:00:00.000037 Subtask: Calculate retained sizes
00:00:15.407354 [............................................................
00:00:00.000035 Subtask: Create dominators index file
00:00:09.707780 [................................................................................]

real	9m56.692s
user	54m2.091s
sys	4m38.826s
new
00:00:00.971857 Task: Parsing heapdump-73gb.hprof
00:00:00.006589 [Task: Parsing /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:00:00.000125 [
00:00:00.000019 Subtask: Scanning /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:01:45.293110 [....................
00:00:00.000036 [INFO] Wrote threads call stacks to /home/jkoch/Downloads/heapdump/heapdump-73gb.threads
00:00:00.000013 [....................
00:00:00.000010 [INFO] Heap /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof contains 979,239,706 objects
00:00:00.000009 [....................
00:00:00.000009 Subtask: Extracting objects from /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:05:20.186050 [................................................................................Task: Removing unreachable objects
00:00:00.000055 [
00:00:00.000015 Subtask: Searching for unreachable objects
00:00:00.038109 [
00:00:00.000044 Subtask: Marking reachable objects
00:00:44.674061 [.
00:00:00.001519 Subtask: Re-indexing objects
00:00:06.605234 [.
00:00:00.000048 [INFO] Removed 905,276,064 unreachable objects using 59,438,816,832 bytes
00:00:00.000015 [..
00:00:00.000009 Subtask: Re-indexing classes
00:00:00.011357 [...
00:00:00.000039 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.idx.index
00:00:01.085836 [....
00:00:00.000043 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2c.index
00:00:02.212375 [.....
00:00:00.000043 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.a2s.index
00:00:03.625925 [......
00:00:00.000045 Subtask: Re-indexing outbound index
00:00:31.361984 [.......
00:00:00.000730 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.inbound.index
00:00:18.739361 [........
00:00:00.000039 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.outbound.index
00:00:00.602427 [.........
00:00:00.000034 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2hprof.index
00:00:11.460384 [.........Task: Calculating Dominator Tree
00:00:00.000042 [
00:00:00.000007 Subtask: Dominator Tree calculation
00:00:00.000005 [
00:00:00.000005 Subtask: Depth-first search
00:00:10.136955 [....................
00:00:00.000038 Subtask: Computing dominators
00:00:13.613985 [..............................................
00:00:00.000038 Subtask: Calculate retained sizes
00:00:14.239447 [............................................................
00:00:00.000036 Subtask: Create dominators index file
00:00:10.252943 [................................................................................]

real	9m56.167s
user	53m34.271s
sys	4m32.855s
new
00:00:00.962931 Task: Parsing heapdump-73gb.hprof
00:00:00.006612 [Task: Parsing /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:00:00.000125 [
00:00:00.000019 Subtask: Scanning /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:01:44.997988 [....................
00:00:00.000047 [INFO] Wrote threads call stacks to /home/jkoch/Downloads/heapdump/heapdump-73gb.threads
00:00:00.000013 [....................
00:00:00.000010 [INFO] Heap /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof contains 979,239,706 objects
00:00:00.000010 [....................
00:00:00.000010 Subtask: Extracting objects from /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:05:16.149932 [................................................................................Task: Removing unreachable objects
00:00:00.000053 [
00:00:00.000015 Subtask: Searching for unreachable objects
00:00:00.040050 [
00:00:00.000046 Subtask: Marking reachable objects
00:00:44.942846 [.
00:00:00.001682 Subtask: Re-indexing objects
00:00:06.713986 [.
00:00:00.000035 [INFO] Removed 905,276,064 unreachable objects using 59,438,816,832 bytes
00:00:00.000007 [..
00:00:00.000006 Subtask: Re-indexing classes
00:00:00.010577 [...
00:00:00.000028 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.idx.index
00:00:01.182107 [....
00:00:00.000035 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2c.index
00:00:02.037471 [.....
00:00:00.000034 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.a2s.index
00:00:02.514696 [......
00:00:00.000036 Subtask: Re-indexing outbound index
00:00:31.548900 [.......
00:00:00.000043 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.inbound.index
00:00:18.831516 [........
00:00:00.000041 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.outbound.index
00:00:00.659442 [.........
00:00:00.000034 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2hprof.index
00:00:11.379501 [.........Task: Calculating Dominator Tree
00:00:00.000043 [
00:00:00.000007 Subtask: Dominator Tree calculation
00:00:00.000005 [
00:00:00.000005 Subtask: Depth-first search
00:00:10.444610 [....................
00:00:00.000038 Subtask: Computing dominators
00:00:13.222969 [..............................................
00:00:00.000038 Subtask: Calculate retained sizes
00:00:14.041066 [............................................................
00:00:00.000037 Subtask: Create dominators index file
00:00:09.698249 [................................................................................]

real	9m50.405s
user	53m4.674s
sys	4m24.075s
new
00:00:00.989681 Task: Parsing heapdump-73gb.hprof
00:00:00.008376 [Task: Parsing /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:00:00.000120 [
00:00:00.000020 Subtask: Scanning /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:01:45.175678 [....................
00:00:00.000035 [INFO] Wrote threads call stacks to /home/jkoch/Downloads/heapdump/heapdump-73gb.threads
00:00:00.000009 [....................
00:00:00.000005 [INFO] Heap /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof contains 979,239,706 objects
00:00:00.000005 [....................
00:00:00.000005 Subtask: Extracting objects from /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:05:15.380343 [................................................................................Task: Removing unreachable objects
00:00:00.000041 [
00:00:00.000008 Subtask: Searching for unreachable objects
00:00:00.039880 [
00:00:00.000040 Subtask: Marking reachable objects
00:00:34.019918 [.
00:00:00.001667 Subtask: Re-indexing objects
00:00:07.920334 [.
00:00:00.000034 [INFO] Removed 905,276,064 unreachable objects using 59,438,816,832 bytes
00:00:00.000008 [..
00:00:00.000005 Subtask: Re-indexing classes
00:00:00.011405 [...
00:00:00.000031 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.idx.index
00:00:01.129383 [....
00:00:00.000034 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2c.index
00:00:02.675803 [.....
00:00:00.000034 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.a2s.index
00:00:03.605035 [......
00:00:00.000038 Subtask: Re-indexing outbound index
00:00:31.294824 [.......
00:00:00.001611 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.inbound.index
00:00:19.044721 [........
00:00:00.000046 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.outbound.index
00:00:00.559926 [.........
00:00:00.000043 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2hprof.index
00:00:11.317616 [.........Task: Calculating Dominator Tree
00:00:00.000043 [
00:00:00.000008 Subtask: Dominator Tree calculation
00:00:00.000005 [
00:00:00.000005 Subtask: Depth-first search
00:00:10.443222 [....................
00:00:00.000043 Subtask: Computing dominators
00:00:13.536699 [..............................................
00:00:00.000037 Subtask: Calculate retained sizes
00:00:14.849722 [............................................................
00:00:00.000037 Subtask: Create dominators index file
00:00:09.719181 [................................................................................]

real	9m42.769s
user	51m28.118s
sys	4m10.143s
new
00:00:00.944640 Task: Parsing heapdump-73gb.hprof
00:00:00.006551 [Task: Parsing /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:00:00.000118 [
00:00:00.000010 Subtask: Scanning /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:01:45.237030 [....................
00:00:00.000040 [INFO] Wrote threads call stacks to /home/jkoch/Downloads/heapdump/heapdump-73gb.threads
00:00:00.000008 [....................
00:00:00.000005 [INFO] Heap /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof contains 979,239,706 objects
00:00:00.000005 [....................
00:00:00.000005 Subtask: Extracting objects from /home/jkoch/Downloads/heapdump/heapdump-73gb.hprof
00:05:15.589595 [................................................................................Task: Removing unreachable objects
00:00:00.000057 [
00:00:00.000018 Subtask: Searching for unreachable objects
00:00:00.038728 [
00:00:00.000045 Subtask: Marking reachable objects
00:00:36.607538 [.
00:00:00.001717 Subtask: Re-indexing objects
00:00:06.832920 [.
00:00:00.000034 [INFO] Removed 905,276,064 unreachable objects using 59,438,816,832 bytes
00:00:00.000008 [..
00:00:00.000005 Subtask: Re-indexing classes
00:00:00.011507 [...
00:00:00.000031 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.idx.index
00:00:01.091769 [....
00:00:00.000034 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2c.index
00:00:02.038924 [.....
00:00:00.000034 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.a2s.index
00:00:02.896567 [......
00:00:00.000035 Subtask: Re-indexing outbound index
00:00:33.360151 [.......
00:00:00.000055 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.inbound.index
00:00:18.990679 [........
00:00:00.000040 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.outbound.index
00:00:00.594820 [.........
00:00:00.000035 Subtask: Writing /home/jkoch/Downloads/heapdump/heapdump-73gb.o2hprof.index
00:00:11.291532 [.........Task: Calculating Dominator Tree
00:00:00.000044 [
00:00:00.000007 Subtask: Dominator Tree calculation
00:00:00.000006 [
00:00:00.000004 Subtask: Depth-first search
00:00:10.489186 [....................
00:00:00.000037 Subtask: Computing dominators
00:00:13.345958 [..............................................
00:00:00.000037 Subtask: Calculate retained sizes
00:00:13.701357 [............................................................
00:00:00.000036 Subtask: Create dominators index file
00:00:09.667491 [................................................................................]

real	9m43.790s
user	51m24.613s
sys	4m35.294s

03 machine

intel i9-9900k

==============

Machine (47GB total)
  Package L#0
    NUMANode L#0 (P#0 47GB)
    L3 L#0 (16MB)
      L2 L#0 (256KB) + L1d L#0 (32KB) + L1i L#0 (32KB) + Core L#0
        PU L#0 (P#0)
        PU L#1 (P#8)
      L2 L#1 (256KB) + L1d L#1 (32KB) + L1i L#1 (32KB) + Core L#1
        PU L#2 (P#1)
        PU L#3 (P#9)
      L2 L#2 (256KB) + L1d L#2 (32KB) + L1i L#2 (32KB) + Core L#2
        PU L#4 (P#2)
        PU L#5 (P#10)
      L2 L#3 (256KB) + L1d L#3 (32KB) + L1i L#3 (32KB) + Core L#3
        PU L#6 (P#3)
        PU L#7 (P#11)
      L2 L#4 (256KB) + L1d L#4 (32KB) + L1i L#4 (32KB) + Core L#4
        PU L#8 (P#4)
        PU L#9 (P#12)
      L2 L#5 (256KB) + L1d L#5 (32KB) + L1i L#5 (32KB) + Core L#5
        PU L#10 (P#5)
        PU L#11 (P#13)
      L2 L#6 (256KB) + L1d L#6 (32KB) + L1i L#6 (32KB) + Core L#6
        PU L#12 (P#6)
        PU L#13 (P#14)
      L2 L#7 (256KB) + L1d L#7 (32KB) + L1i L#7 (32KB) + Core L#7
        PU L#14 (P#7)
        PU L#15 (P#15)
  HostBridge
    PCIBridge
      PCI 01:00.0 (VGA)
        GPU ":1.0"
        CoProc(OpenCL) "opencl0d0"
    PCI 00:17.0 (SATA)
    PCIBridge
      PCI 02:00.0 (NVMExp)
        Block(Disk) "nvme0n1"
    PCIBridge
      PCI 05:00.0 (NVMExp)
        Block(Disk) "nvme1n1"
    PCI 00:1f.6 (Ethernet)
      Net "eno1"
      
=======

# enable perf event capture
echo -1 | sudo tee /proc/sys/kernel/perf_event_paranoid

# disable nmi watchdog
echo 0 | sudo tee /proc/sys/kernel/nmi_watchdog

# disable turbo
echo 1 | sudo tee /sys/devices/system/cpu/intel_pstate/no_turbo

# set performance governor
for i in /sys/devices/system/cpu/cpu*/cpufreq/scaling_governor
do
  echo performance | sudo tee $i
done

# enable kernel symbols for normal users
echo 0 | sudo tee /proc/sys/kernel/kptr_restrict