Skip to content

Instantly share code, notes, and snippets.

@kuskmen

kuskmen/aerospike-node-1.log

Created April 3, 2023 08:31
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save kuskmen/adb870ed8341bfe66f86dac1ae022e59 to your computer and use it in GitHub Desktop.
Save kuskmen/adb870ed8341bfe66f86dac1ae022e59 to your computer and use it in GitHub Desktop.
Download ZIP
Aerospike Cluster Logs
Raw
aerospike-node-1.log
This file has been truncated, but you can view the full file.
Mar 27 2023 11:20:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:20:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:20:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 171 user-cpu-pct 130 kernel-cpu-pct 41 free-mem-kbytes 10650548 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:20:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 177 threads (11,64,39,30) heap-kbytes (13126452,13202936,14510592) heap-efficiency-pct 99.4
Mar 27 2023 11:20:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:20:03 GMT: INFO (info): (ticker.c:319) fds: proto (118,126710,126592) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:20:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6885044
Mar 27 2023 11:20:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14745726,21686587) ctrl (49,46) meta (0,0) rw (278240,246097)
Mar 27 2023 11:20:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53209738 master 15771008 prole 34411759 non-replica 3026968
Mar 27 2023 11:20:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (144,581,216) active (2,4,0) complete-pct 66.07
Mar 27 2023 11:20:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11906694872 index-bytes 3405423232 set-index-bytes 0 sindex-bytes 8501271640 used-pct 69.31
Mar 27 2023 11:20:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196712890464 avail-pct 46 cache-read-pct 2.83
Mar 27 2023 11:20:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2649332,0,0,231269,0) write (2103169,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:20:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:20:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605048,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:20:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12308 respond (0,111651)
Mar 27 2023 11:20:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2880601 total) msec
Mar 27 2023 11:20:03 GMT: INFO (info): (hist.c:331) (00: 0002879088) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:20:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:20:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2103170 total) msec
Mar 27 2023 11:20:03 GMT: INFO (info): (hist.c:331) (00: 0001673086) (01: 0000403450) (02: 0000023980) (03: 0000002414)
Mar 27 2023 11:20:03 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:20:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:20:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:20:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:20:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 169 user-cpu-pct 136 kernel-cpu-pct 33 free-mem-kbytes 10651128 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:20:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 175 threads (11,64,39,30) heap-kbytes (13125573,13201544,14510592) heap-efficiency-pct 99.4
Mar 27 2023 11:20:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:20:13 GMT: INFO (info): (ticker.c:319) fds: proto (118,126710,126592) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:20:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6885311
Mar 27 2023 11:20:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14796481,15270529) ctrl (49,45) meta (0,0) rw (855,3056)
Mar 27 2023 11:20:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53210070 master 15771330 prole 34411769 non-replica 3026966
Mar 27 2023 11:20:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (142,578,213) active (2,2,0) complete-pct 66.31
Mar 27 2023 11:20:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11906743456 index-bytes 3405444480 set-index-bytes 0 sindex-bytes 8501298976 used-pct 69.31
Mar 27 2023 11:20:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196713235168 avail-pct 46 cache-read-pct 0.02
Mar 27 2023 11:20:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2649332,0,0,231269,0) write (2103170,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:20:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:20:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605057,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:20:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12308 respond (0,111651)
Mar 27 2023 11:20:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2880601 total) msec
Mar 27 2023 11:20:13 GMT: INFO (info): (hist.c:331) (00: 0002879088) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:20:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:20:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2103171 total) msec
Mar 27 2023 11:20:13 GMT: INFO (info): (hist.c:331) (00: 0001673087) (01: 0000403450) (02: 0000023980) (03: 0000002414)
Mar 27 2023 11:20:13 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:20:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:20:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 196713414208 free-wblocks 960466 write-q 0 write (429900,1.1) defrag-q 0 defrag-read (366246,0.7) defrag-write (124513,0.3)
Mar 27 2023 11:20:20 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (29885318,20) total-ms 26876
Mar 27 2023 11:20:21 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:20:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:20:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:20:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 148 user-cpu-pct 121 kernel-cpu-pct 27 free-mem-kbytes 10651040 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:20:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 155 threads (13,64,39,30) heap-kbytes (13128300,13204360,14510592) heap-efficiency-pct 99.4
Mar 27 2023 11:20:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:20:23 GMT: INFO (info): (ticker.c:319) fds: proto (118,126711,126593) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:20:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6885578
Mar 27 2023 11:20:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (13544351,9983985) ctrl (28,35) meta (0,0) rw (5425,3113)
Mar 27 2023 11:20:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53210361 master 15771617 prole 34411776 non-replica 3026964
Mar 27 2023 11:20:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (142,576,213) active (4,2,0) complete-pct 66.40
Mar 27 2023 11:20:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11906781264 index-bytes 3405463104 set-index-bytes 0 sindex-bytes 8501318160 used-pct 69.31
Mar 27 2023 11:20:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196713528176 avail-pct 46 cache-read-pct 0.03
Mar 27 2023 11:20:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2649332,0,0,231269,0) write (2103175,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:20:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:20:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605069,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:20:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12308 respond (0,111651)
Mar 27 2023 11:20:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2880601 total) msec
Mar 27 2023 11:20:23 GMT: INFO (info): (hist.c:331) (00: 0002879088) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:20:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:20:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2103176 total) msec
Mar 27 2023 11:20:23 GMT: INFO (info): (hist.c:331) (00: 0001673092) (01: 0000403450) (02: 0000023980) (03: 0000002414)
Mar 27 2023 11:20:23 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:20:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:20:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:20:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:20:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 166 user-cpu-pct 134 kernel-cpu-pct 32 free-mem-kbytes 10650700 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:20:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 172 threads (13,64,39,30) heap-kbytes (13127404,13201528,14510592) heap-efficiency-pct 99.4
Mar 27 2023 11:20:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:20:33 GMT: INFO (info): (ticker.c:319) fds: proto (118,126711,126593) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:20:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6885844
Mar 27 2023 11:20:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14167014,13667163) ctrl (44,37) meta (0,0) rw (304555,341159)
Mar 27 2023 11:20:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53210689 master 15771921 prole 34411800 non-replica 3007029
Mar 27 2023 11:20:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (140,575,210) active (4,3,0) complete-pct 66.54
Mar 27 2023 11:20:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11906548236 index-bytes 3405484096 set-index-bytes 0 sindex-bytes 8501064140 used-pct 69.31
Mar 27 2023 11:20:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196713882608 avail-pct 46 cache-read-pct 2.37
Mar 27 2023 11:20:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2649653,0,0,231273,0) write (2103444,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:20:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:20:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605109,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:20:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12336 respond (0,111651)
Mar 27 2023 11:20:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2880926 total) msec
Mar 27 2023 11:20:33 GMT: INFO (info): (hist.c:331) (00: 0002879413) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:20:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:20:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2103445 total) msec
Mar 27 2023 11:20:33 GMT: INFO (info): (hist.c:331) (00: 0001673309) (01: 0000403500) (02: 0000023982) (03: 0000002414)
Mar 27 2023 11:20:33 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:20:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:20:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 196714121760 free-wblocks 960465 write-q 0 write (429932,1.6) defrag-q 0 defrag-read (366273,1.4) defrag-write (124525,0.6)
Mar 27 2023 11:20:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:20:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:20:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 166 user-cpu-pct 134 kernel-cpu-pct 32 free-mem-kbytes 10650948 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:20:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 170 threads (13,64,39,30) heap-kbytes (13126737,13202004,14510592) heap-efficiency-pct 99.4
Mar 27 2023 11:20:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:20:43 GMT: INFO (info): (ticker.c:319) fds: proto (118,126711,126593) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:20:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6886110
Mar 27 2023 11:20:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (13811861,13878484) ctrl (47,39) meta (0,0) rw (900,1715)
Mar 27 2023 11:20:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53210989 master 15772211 prole 34411810 non-replica 3007029
Mar 27 2023 11:20:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (138,572,207) active (4,1,0) complete-pct 66.78
Mar 27 2023 11:20:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11905624244 index-bytes 3405503296 set-index-bytes 0 sindex-bytes 8500120948 used-pct 69.30
Mar 27 2023 11:20:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196714244192 avail-pct 46 cache-read-pct 0.01
Mar 27 2023 11:20:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2649653,0,0,231273,0) write (2103445,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:20:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:20:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605119,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:20:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12336 respond (0,111651)
Mar 27 2023 11:20:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2880926 total) msec
Mar 27 2023 11:20:43 GMT: INFO (info): (hist.c:331) (00: 0002879413) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:20:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:20:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2103446 total) msec
Mar 27 2023 11:20:43 GMT: INFO (info): (hist.c:331) (00: 0001673310) (01: 0000403500) (02: 0000023982) (03: 0000002414)
Mar 27 2023 11:20:43 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:20:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:20:48 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (29969572,84254) total-ms 26841
Mar 27 2023 11:20:49 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:20:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:20:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:20:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 147 user-cpu-pct 118 kernel-cpu-pct 29 free-mem-kbytes 10650316 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:20:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 154 threads (13,64,39,30) heap-kbytes (13126264,13202400,14510592) heap-efficiency-pct 99.4
Mar 27 2023 11:20:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:20:53 GMT: INFO (info): (ticker.c:319) fds: proto (119,126713,126594) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:20:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6886378
Mar 27 2023 11:20:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14680334,9007829) ctrl (42,32) meta (0,0) rw (2912,5239)
Mar 27 2023 11:20:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53211305 master 15772523 prole 34411818 non-replica 3007029
Mar 27 2023 11:20:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (136,571,204) active (4,2,0) complete-pct 66.92
Mar 27 2023 11:20:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11904332672 index-bytes 3405523520 set-index-bytes 0 sindex-bytes 8498809152 used-pct 69.29
Mar 27 2023 11:20:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196714587712 avail-pct 46 cache-read-pct 0.02
Mar 27 2023 11:20:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2649656,0,0,231274,0) write (2103450,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:20:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:20:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605133,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:20:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12339 respond (0,111651)
Mar 27 2023 11:20:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2880930 total) msec
Mar 27 2023 11:20:53 GMT: INFO (info): (hist.c:331) (00: 0002879417) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:20:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:20:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2103451 total) msec
Mar 27 2023 11:20:53 GMT: INFO (info): (hist.c:331) (00: 0001673315) (01: 0000403500) (02: 0000023982) (03: 0000002414)
Mar 27 2023 11:20:53 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:20:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:20:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 196714758512 free-wblocks 960463 write-q 0 write (429934,0.1) defrag-q 0 defrag-read (366273,0.0) defrag-write (124525,0.0)
Mar 27 2023 11:21:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:21:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:21:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 170 user-cpu-pct 137 kernel-cpu-pct 33 free-mem-kbytes 10649900 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:21:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 176 threads (13,64,39,30) heap-kbytes (13124193,13199472,14510592) heap-efficiency-pct 99.4
Mar 27 2023 11:21:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:21:03 GMT: INFO (info): (ticker.c:319) fds: proto (170,126830,126660) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:21:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6886644
Mar 27 2023 11:21:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14015618,13516090) ctrl (44,37) meta (0,0) rw (748280,788411)
Mar 27 2023 11:21:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53211650 master 15772815 prole 34411871 non-replica 2987144
Mar 27 2023 11:21:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (134,570,201) active (4,3,0) complete-pct 67.06
Mar 27 2023 11:21:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11902698920 index-bytes 3405545600 set-index-bytes 0 sindex-bytes 8497153320 used-pct 69.28
Mar 27 2023 11:21:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196715261968 avail-pct 46 cache-read-pct 5.41
Mar 27 2023 11:21:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2650733,0,0,231287,0) write (2104089,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:21:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:21:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605241,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:21:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12399 respond (0,111651)
Mar 27 2023 11:21:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2882020 total) msec
Mar 27 2023 11:21:03 GMT: INFO (info): (hist.c:331) (00: 0002880507) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:21:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:21:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104090 total) msec
Mar 27 2023 11:21:03 GMT: INFO (info): (hist.c:331) (00: 0001673859) (01: 0000403584) (02: 0000023990) (03: 0000002417)
Mar 27 2023 11:21:03 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:21:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:21:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:21:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:21:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 166 user-cpu-pct 135 kernel-cpu-pct 31 free-mem-kbytes 10649748 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:21:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 169 threads (13,64,39,30) heap-kbytes (13124035,13200372,14510592) heap-efficiency-pct 99.4
Mar 27 2023 11:21:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:21:13 GMT: INFO (info): (ticker.c:319) fds: proto (170,126830,126660) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:21:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6886910
Mar 27 2023 11:21:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14038166,12730920) ctrl (46,39) meta (0,0) rw (4204,2054)
Mar 27 2023 11:21:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53211971 master 15773122 prole 34411885 non-replica 2987144
Mar 27 2023 11:21:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (132,568,198) active (4,3,0) complete-pct 67.24
Mar 27 2023 11:21:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11901673924 index-bytes 3405566144 set-index-bytes 0 sindex-bytes 8496107780 used-pct 69.28
Mar 27 2023 11:21:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196715604656 avail-pct 46 cache-read-pct 0.04
Mar 27 2023 11:21:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2650738,0,0,231289,0) write (2104097,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:21:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:21:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605259,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:21:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12399 respond (0,111651)
Mar 27 2023 11:21:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2882027 total) msec
Mar 27 2023 11:21:13 GMT: INFO (info): (hist.c:331) (00: 0002880514) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:21:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:21:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104098 total) msec
Mar 27 2023 11:21:13 GMT: INFO (info): (hist.c:331) (00: 0001673867) (01: 0000403584) (02: 0000023990) (03: 0000002417)
Mar 27 2023 11:21:13 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:21:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:21:17 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (30121753,152181) total-ms 27340
Mar 27 2023 11:21:18 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:21:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 196640989184 free-wblocks 960746 write-q 0 write (430005,3.5) defrag-q 0 defrag-read (366625,17.6) defrag-write (124551,1.3)
Mar 27 2023 11:21:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:21:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:21:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 153 user-cpu-pct 121 kernel-cpu-pct 32 free-mem-kbytes 10650116 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:21:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 161 threads (11,64,39,30) heap-kbytes (13116570,13191356,14510592) heap-efficiency-pct 99.4
Mar 27 2023 11:21:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:21:23 GMT: INFO (info): (ticker.c:319) fds: proto (170,126831,126661) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:21:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6887177
Mar 27 2023 11:21:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14210348,14455708) ctrl (29,30) meta (0,0) rw (2541,519)
Mar 27 2023 11:21:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53192344 master 15773424 prole 34411891 non-replica 2967205
Mar 27 2023 11:21:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (130,567,195) active (2,3,0) complete-pct 67.38
Mar 27 2023 11:21:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11898516276 index-bytes 3404310016 set-index-bytes 0 sindex-bytes 8494206260 used-pct 69.26
Mar 27 2023 11:21:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196641132864 avail-pct 46 cache-read-pct 0.01
Mar 27 2023 11:21:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2650738,0,0,231289,0) write (2104100,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:21:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:21:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605271,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:21:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12400 respond (0,111651)
Mar 27 2023 11:21:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2882027 total) msec
Mar 27 2023 11:21:23 GMT: INFO (info): (hist.c:331) (00: 0002880514) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:21:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:21:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104101 total) msec
Mar 27 2023 11:21:23 GMT: INFO (info): (hist.c:331) (00: 0001673870) (01: 0000403584) (02: 0000023990) (03: 0000002417)
Mar 27 2023 11:21:23 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:21:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:21:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:21:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:21:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 169 user-cpu-pct 134 kernel-cpu-pct 35 free-mem-kbytes 10649536 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:21:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 173 threads (11,64,39,30) heap-kbytes (13115733,13192424,14510592) heap-efficiency-pct 99.4
Mar 27 2023 11:21:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:21:33 GMT: INFO (info): (ticker.c:319) fds: proto (170,126831,126661) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:21:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6887443
Mar 27 2023 11:21:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14336396,15092523) ctrl (53,59) meta (0,0) rw (26658,24714)
Mar 27 2023 11:21:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53192674 master 15773718 prole 34411927 non-replica 2947234
Mar 27 2023 11:21:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (128,565,192) active (2,5,0) complete-pct 67.57
Mar 27 2023 11:21:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11896520628 index-bytes 3404331136 set-index-bytes 0 sindex-bytes 8492189492 used-pct 69.25
Mar 27 2023 11:21:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196641534832 avail-pct 46 cache-read-pct 0.24
Mar 27 2023 11:21:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2650768,0,0,231293,0) write (2104133,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:21:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:21:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605327,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:21:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12404 respond (0,111651)
Mar 27 2023 11:21:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2882061 total) msec
Mar 27 2023 11:21:33 GMT: INFO (info): (hist.c:331) (00: 0002880548) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:21:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:21:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104134 total) msec
Mar 27 2023 11:21:33 GMT: INFO (info): (hist.c:331) (00: 0001673894) (01: 0000403593) (02: 0000023990) (03: 0000002417)
Mar 27 2023 11:21:33 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:21:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:21:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 196641811952 free-wblocks 960743 write-q 0 write (430010,0.2) defrag-q 0 defrag-read (366626,0.1) defrag-write (124551,0.0)
Mar 27 2023 11:21:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:21:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:21:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 178 user-cpu-pct 136 kernel-cpu-pct 42 free-mem-kbytes 10649692 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:21:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 186 threads (11,64,39,30) heap-kbytes (13111288,13189624,14510592) heap-efficiency-pct 99.4
Mar 27 2023 11:21:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:21:43 GMT: INFO (info): (ticker.c:319) fds: proto (170,126831,126661) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:21:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6887710
Mar 27 2023 11:21:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14524955,23764616) ctrl (51,52) meta (0,0) rw (21704,14749)
Mar 27 2023 11:21:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53193030 master 15774053 prole 34411948 non-replica 2927333
Mar 27 2023 11:21:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (126,563,189) active (2,6,0) complete-pct 67.76
Mar 27 2023 11:21:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11893396544 index-bytes 3404353920 set-index-bytes 0 sindex-bytes 8489042624 used-pct 69.23
Mar 27 2023 11:21:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196642067856 avail-pct 46 cache-read-pct 0.18
Mar 27 2023 11:21:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2650803,0,0,231295,0) write (2104157,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:21:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:21:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605346,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:21:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12404 respond (0,111651)
Mar 27 2023 11:21:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2882098 total) msec
Mar 27 2023 11:21:43 GMT: INFO (info): (hist.c:331) (00: 0002880585) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:21:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:21:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104158 total) msec
Mar 27 2023 11:21:43 GMT: INFO (info): (hist.c:331) (00: 0001673915) (01: 0000403596) (02: 0000023990) (03: 0000002417)
Mar 27 2023 11:21:43 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:21:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:21:45 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (30383743,261990) total-ms 27172
Mar 27 2023 11:21:46 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:21:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:21:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:21:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 163 user-cpu-pct 123 kernel-cpu-pct 40 free-mem-kbytes 10649508 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:21:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 173 threads (11,64,39,30) heap-kbytes (13110080,13188916,14510592) heap-efficiency-pct 99.4
Mar 27 2023 11:21:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:21:53 GMT: INFO (info): (ticker.c:319) fds: proto (171,126833,126662) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:21:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6887976
Mar 27 2023 11:21:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14800547,23425022) ctrl (51,47) meta (0,0) rw (3858,2206)
Mar 27 2023 11:21:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53153540 master 15774365 prole 34411970 non-replica 2927333
Mar 27 2023 11:21:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (124,559,186) active (2,3,0) complete-pct 68.04
Mar 27 2023 11:21:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11888932064 index-bytes 3401826560 set-index-bytes 0 sindex-bytes 8487105504 used-pct 69.20
Mar 27 2023 11:21:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196490685328 avail-pct 46 cache-read-pct 0.01
Mar 27 2023 11:21:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2650803,0,0,231295,0) write (2104161,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:21:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:21:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605357,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:21:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12404 respond (0,111651)
Mar 27 2023 11:21:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2882098 total) msec
Mar 27 2023 11:21:53 GMT: INFO (info): (hist.c:331) (00: 0002880585) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:21:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:21:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104162 total) msec
Mar 27 2023 11:21:53 GMT: INFO (info): (hist.c:331) (00: 0001673919) (01: 0000403596) (02: 0000023990) (03: 0000002417)
Mar 27 2023 11:21:53 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:21:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:21:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 196490916512 free-wblocks 961334 write-q 0 write (430017,0.3) defrag-q 0 defrag-read (367223,29.9) defrag-write (124553,0.1)
Mar 27 2023 11:22:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:22:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:22:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 165 user-cpu-pct 133 kernel-cpu-pct 32 free-mem-kbytes 10649548 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:22:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 174 threads (11,64,39,30) heap-kbytes (13109620,13187092,14508544) heap-efficiency-pct 99.4
Mar 27 2023 11:22:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:22:03 GMT: INFO (info): (ticker.c:319) fds: proto (170,126833,126663) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:22:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6888243
Mar 27 2023 11:22:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14298640,13549857) ctrl (47,39) meta (0,0) rw (34633,22614)
Mar 27 2023 11:22:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53153886 master 15774685 prole 34411996 non-replica 2927333
Mar 27 2023 11:22:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (122,556,183) active (2,1,0) complete-pct 68.27
Mar 27 2023 11:22:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11887755404 index-bytes 3401848704 set-index-bytes 0 sindex-bytes 8485906700 used-pct 69.20
Mar 27 2023 11:22:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196491071536 avail-pct 46 cache-read-pct 0.40
Mar 27 2023 11:22:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2650879,0,0,231302,0) write (2104206,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:22:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:22:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605406,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:22:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12408 respond (0,111651)
Mar 27 2023 11:22:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2882181 total) msec
Mar 27 2023 11:22:03 GMT: INFO (info): (hist.c:331) (00: 0002880668) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:22:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:22:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104207 total) msec
Mar 27 2023 11:22:03 GMT: INFO (info): (hist.c:331) (00: 0001673957) (01: 0000403603) (02: 0000023990) (03: 0000002417)
Mar 27 2023 11:22:03 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:22:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:22:13 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (30523667,139924) total-ms 26786
Mar 27 2023 11:22:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:22:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:22:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 156 user-cpu-pct 126 kernel-cpu-pct 30 free-mem-kbytes 10649068 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:22:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 165 threads (11,64,39,30) heap-kbytes (13109809,13185092,14508544) heap-efficiency-pct 99.4
Mar 27 2023 11:22:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:22:13 GMT: INFO (info): (ticker.c:319) fds: proto (120,126834,126714) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:22:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6888510
Mar 27 2023 11:22:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14480650,10822745) ctrl (46,43) meta (0,0) rw (18,1269)
Mar 27 2023 11:22:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53114255 master 15774922 prole 34412000 non-replica 2927323
Mar 27 2023 11:22:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (120,555,180) active (2,2,0) complete-pct 68.41
Mar 27 2023 11:22:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11884836520 index-bytes 3399312320 set-index-bytes 0 sindex-bytes 8485524200 used-pct 69.18
Mar 27 2023 11:22:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196341603584 avail-pct 46 cache-read-pct 0.02
Mar 27 2023 11:22:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2650879,0,0,231302,0) write (2104206,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:22:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:22:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605420,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:22:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12408 respond (0,111651)
Mar 27 2023 11:22:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2882181 total) msec
Mar 27 2023 11:22:13 GMT: INFO (info): (hist.c:331) (00: 0002880668) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:22:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:22:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104207 total) msec
Mar 27 2023 11:22:13 GMT: INFO (info): (hist.c:331) (00: 0001673957) (01: 0000403603) (02: 0000023990) (03: 0000002417)
Mar 27 2023 11:22:13 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:22:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:22:14 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:22:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 196341789184 free-wblocks 961916 write-q 0 write (430019,0.1) defrag-q 0 defrag-read (367807,29.2) defrag-write (124553,0.0)
Mar 27 2023 11:22:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:22:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:22:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 158 user-cpu-pct 127 kernel-cpu-pct 31 free-mem-kbytes 10649324 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:22:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 165 threads (11,64,39,30) heap-kbytes (13107594,13182484,14508544) heap-efficiency-pct 99.4
Mar 27 2023 11:22:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:22:23 GMT: INFO (info): (ticker.c:319) fds: proto (27,126834,126807) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:22:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6888776
Mar 27 2023 11:22:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14480988,14047218) ctrl (48,45) meta (0,0) rw (7159,4343)
Mar 27 2023 11:22:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53114558 master 15775212 prole 34412013 non-replica 2907352
Mar 27 2023 11:22:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (118,553,177) active (2,2,0) complete-pct 68.60
Mar 27 2023 11:22:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11884255524 index-bytes 3399331712 set-index-bytes 0 sindex-bytes 8484923812 used-pct 69.18
Mar 27 2023 11:22:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196342014240 avail-pct 46 cache-read-pct 0.00
Mar 27 2023 11:22:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2650879,0,0,231302,0) write (2104212,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:22:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:22:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605444,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:22:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12409 respond (0,111651)
Mar 27 2023 11:22:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2882181 total) msec
Mar 27 2023 11:22:23 GMT: INFO (info): (hist.c:331) (00: 0002880668) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:22:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:22:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104213 total) msec
Mar 27 2023 11:22:23 GMT: INFO (info): (hist.c:331) (00: 0001673963) (01: 0000403603) (02: 0000023990) (03: 0000002417)
Mar 27 2023 11:22:23 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:22:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:22:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:22:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:22:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 168 user-cpu-pct 135 kernel-cpu-pct 33 free-mem-kbytes 10648476 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:22:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 179 threads (11,64,39,30) heap-kbytes (13106961,13183876,14508544) heap-efficiency-pct 99.4
Mar 27 2023 11:22:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:22:33 GMT: INFO (info): (ticker.c:319) fds: proto (106,126915,126809) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:22:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6889043
Mar 27 2023 11:22:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14346098,18108236) ctrl (49,50) meta (0,0) rw (366811,386754)
Mar 27 2023 11:22:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53114909 master 15775527 prole 34412049 non-replica 2887428
Mar 27 2023 11:22:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (116,552,174) active (2,4,0) complete-pct 68.74
Mar 27 2023 11:22:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11882937652 index-bytes 3399354176 set-index-bytes 0 sindex-bytes 8483583476 used-pct 69.17
Mar 27 2023 11:22:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196342465520 avail-pct 46 cache-read-pct 2.92
Mar 27 2023 11:22:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2651486,0,0,231313,0) write (2104532,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:22:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:22:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605518,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:22:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12438 respond (0,111651)
Mar 27 2023 11:22:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2882799 total) msec
Mar 27 2023 11:22:33 GMT: INFO (info): (hist.c:331) (00: 0002881286) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:22:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:22:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104533 total) msec
Mar 27 2023 11:22:33 GMT: INFO (info): (hist.c:331) (00: 0001674226) (01: 0000403658) (02: 0000023992) (03: 0000002417)
Mar 27 2023 11:22:33 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:22:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:22:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 196342696080 free-wblocks 961911 write-q 0 write (430054,1.8) defrag-q 0 defrag-read (367836,1.5) defrag-write (124565,0.6)
Mar 27 2023 11:22:41 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (30666061,142394) total-ms 27064
Mar 27 2023 11:22:42 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:22:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:22:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:22:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 156 user-cpu-pct 122 kernel-cpu-pct 34 free-mem-kbytes 10647372 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:22:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 167 threads (11,64,39,30) heap-kbytes (13105201,13184776,14508544) heap-efficiency-pct 99.4
Mar 27 2023 11:22:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:22:43 GMT: INFO (info): (ticker.c:319) fds: proto (107,126916,126809) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:22:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6889310
Mar 27 2023 11:22:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14622639,17867510) ctrl (50,47) meta (0,0) rw (3603,3673)
Mar 27 2023 11:22:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53115207 master 15775823 prole 34412061 non-replica 2887428
Mar 27 2023 11:22:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (114,549,171) active (2,3,0) complete-pct 68.98
Mar 27 2023 11:22:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11880706568 index-bytes 3399373248 set-index-bytes 0 sindex-bytes 8481333320 used-pct 69.15
Mar 27 2023 11:22:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196342793792 avail-pct 46 cache-read-pct 0.02
Mar 27 2023 11:22:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2651486,0,0,231313,0) write (2104536,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:22:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:22:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605537,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:22:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12438 respond (0,111651)
Mar 27 2023 11:22:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2882799 total) msec
Mar 27 2023 11:22:43 GMT: INFO (info): (hist.c:331) (00: 0002881286) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:22:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:22:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104537 total) msec
Mar 27 2023 11:22:43 GMT: INFO (info): (hist.c:331) (00: 0001674230) (01: 0000403658) (02: 0000023992) (03: 0000002417)
Mar 27 2023 11:22:43 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:22:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:22:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:22:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:22:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 163 user-cpu-pct 132 kernel-cpu-pct 31 free-mem-kbytes 10647412 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:22:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 170 threads (13,64,39,30) heap-kbytes (13106009,13183500,14508544) heap-efficiency-pct 99.4
Mar 27 2023 11:22:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:22:53 GMT: INFO (info): (ticker.c:319) fds: proto (105,126916,126811) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:22:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6889576
Mar 27 2023 11:22:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (13397600,11517984) ctrl (23,22) meta (0,0) rw (1655,5375)
Mar 27 2023 11:22:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53115507 master 15776111 prole 34412073 non-replica 2887428
Mar 27 2023 11:22:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (114,547,171) active (4,2,0) complete-pct 69.07
Mar 27 2023 11:22:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11879138504 index-bytes 3399392448 set-index-bytes 0 sindex-bytes 8479746056 used-pct 69.15
Mar 27 2023 11:22:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196343121184 avail-pct 46 cache-read-pct 0.01
Mar 27 2023 11:22:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2651486,0,0,231313,0) write (2104538,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:22:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:22:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605554,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:22:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12438 respond (0,111651)
Mar 27 2023 11:22:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2882799 total) msec
Mar 27 2023 11:22:53 GMT: INFO (info): (hist.c:331) (00: 0002881286) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:22:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:22:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104539 total) msec
Mar 27 2023 11:22:53 GMT: INFO (info): (hist.c:331) (00: 0001674232) (01: 0000403658) (02: 0000023992) (03: 0000002417)
Mar 27 2023 11:22:53 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:22:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:22:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 196343286688 free-wblocks 961908 write-q 0 write (430057,0.2) defrag-q 0 defrag-read (367836,0.0) defrag-write (124565,0.0)
Mar 27 2023 11:23:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:23:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:23:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 162 user-cpu-pct 134 kernel-cpu-pct 28 free-mem-kbytes 10646760 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:23:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 167 threads (13,64,39,30) heap-kbytes (13106850,13183884,14508544) heap-efficiency-pct 99.4
Mar 27 2023 11:23:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:23:03 GMT: INFO (info): (ticker.c:319) fds: proto (106,126917,126811) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:23:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6889843
Mar 27 2023 11:23:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (13682236,7825107) ctrl (47,43) meta (0,0) rw (76588,66580)
Mar 27 2023 11:23:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53115807 master 15776396 prole 34412088 non-replica 2867507
Mar 27 2023 11:23:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (112,545,168) active (4,1,0) complete-pct 69.26
Mar 27 2023 11:23:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11878629248 index-bytes 3399411648 set-index-bytes 0 sindex-bytes 8479217600 used-pct 69.14
Mar 27 2023 11:23:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196343413984 avail-pct 46 cache-read-pct 0.30
Mar 27 2023 11:23:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2651516,0,0,231314,0) write (2104576,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:23:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:23:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605593,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:23:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12440 respond (0,111651)
Mar 27 2023 11:23:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2882830 total) msec
Mar 27 2023 11:23:03 GMT: INFO (info): (hist.c:331) (00: 0002881317) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:23:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:23:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104577 total) msec
Mar 27 2023 11:23:03 GMT: INFO (info): (hist.c:331) (00: 0001674261) (01: 0000403667) (02: 0000023992) (03: 0000002417)
Mar 27 2023 11:23:03 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:23:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:23:08 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (30810414,144353) total-ms 26164
Mar 27 2023 11:23:09 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:23:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:23:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:23:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 153 user-cpu-pct 121 kernel-cpu-pct 32 free-mem-kbytes 10648324 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:23:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 161 threads (13,64,39,30) heap-kbytes (13105232,13181764,14508544) heap-efficiency-pct 99.4
Mar 27 2023 11:23:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:23:13 GMT: INFO (info): (ticker.c:319) fds: proto (106,126918,126812) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:23:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6890109
Mar 27 2023 11:23:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14055259,12518777) ctrl (51,57) meta (0,0) rw (5289,3373)
Mar 27 2023 11:23:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53076226 master 15776694 prole 34412104 non-replica 2847600
Mar 27 2023 11:23:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (110,544,165) active (4,4,0) complete-pct 69.40
Mar 27 2023 11:23:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11874772988 index-bytes 3396878464 set-index-bytes 0 sindex-bytes 8477894524 used-pct 69.12
Mar 27 2023 11:23:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196193699776 avail-pct 46 cache-read-pct 0.01
Mar 27 2023 11:23:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2651516,0,0,231314,0) write (2104581,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:23:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:23:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605611,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:23:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12440 respond (0,111651)
Mar 27 2023 11:23:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2882830 total) msec
Mar 27 2023 11:23:13 GMT: INFO (info): (hist.c:331) (00: 0002881317) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:23:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:23:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104582 total) msec
Mar 27 2023 11:23:13 GMT: INFO (info): (hist.c:331) (00: 0001674266) (01: 0000403667) (02: 0000023992) (03: 0000002417)
Mar 27 2023 11:23:13 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:23:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:23:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 196193923376 free-wblocks 962494 write-q 0 write (430066,0.4) defrag-q 0 defrag-read (368431,29.8) defrag-write (124568,0.2)
Mar 27 2023 11:23:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:23:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:23:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 174 user-cpu-pct 135 kernel-cpu-pct 39 free-mem-kbytes 10649548 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:23:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 178 threads (13,64,39,30) heap-kbytes (13102369,13181236,14508544) heap-efficiency-pct 99.4
Mar 27 2023 11:23:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:23:23 GMT: INFO (info): (ticker.c:319) fds: proto (106,126919,126813) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:23:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6890376
Mar 27 2023 11:23:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (13528818,21798927) ctrl (42,32) meta (0,0) rw (61,5156)
Mar 27 2023 11:23:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53076564 master 15777011 prole 34412125 non-replica 2847600
Mar 27 2023 11:23:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (108,543,162) active (4,5,0) complete-pct 69.54
Mar 27 2023 11:23:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11872864324 index-bytes 3396900096 set-index-bytes 0 sindex-bytes 8475964228 used-pct 69.11
Mar 27 2023 11:23:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196194156832 avail-pct 46 cache-read-pct 0.01
Mar 27 2023 11:23:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2651516,0,0,231314,0) write (2104581,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:23:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:23:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605628,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:23:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12440 respond (0,111651)
Mar 27 2023 11:23:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2882830 total) msec
Mar 27 2023 11:23:23 GMT: INFO (info): (hist.c:331) (00: 0002881317) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:23:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:23:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104582 total) msec
Mar 27 2023 11:23:23 GMT: INFO (info): (hist.c:331) (00: 0001674266) (01: 0000403667) (02: 0000023992) (03: 0000002417)
Mar 27 2023 11:23:23 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:23:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:23:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:23:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:23:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 172 user-cpu-pct 136 kernel-cpu-pct 36 free-mem-kbytes 10647672 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:23:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 173 threads (13,64,39,30) heap-kbytes (13098192,13175584,14508544) heap-efficiency-pct 99.4
Mar 27 2023 11:23:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:23:33 GMT: INFO (info): (ticker.c:319) fds: proto (78,126973,126895) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:23:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6890642
Mar 27 2023 11:23:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (13135968,16651393) ctrl (57,61) meta (0,0) rw (382598,333072)
Mar 27 2023 11:23:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53076934 master 15777340 prole 34412166 non-replica 2847600
Mar 27 2023 11:23:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (106,539,159) active (4,4,0) complete-pct 69.82
Mar 27 2023 11:23:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11870507588 index-bytes 3396923776 set-index-bytes 0 sindex-bytes 8473583812 used-pct 69.10
Mar 27 2023 11:23:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196194864288 avail-pct 46 cache-read-pct 2.77
Mar 27 2023 11:23:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2651910,0,0,231327,0) write (2104931,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:23:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:23:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605707,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:23:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12456 respond (0,111651)
Mar 27 2023 11:23:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2883237 total) msec
Mar 27 2023 11:23:33 GMT: INFO (info): (hist.c:331) (00: 0002881724) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:23:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:23:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104932 total) msec
Mar 27 2023 11:23:33 GMT: INFO (info): (hist.c:331) (00: 0001674553) (01: 0000403727) (02: 0000023995) (03: 0000002417)
Mar 27 2023 11:23:33 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:23:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:23:36 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (31010800,200386) total-ms 27285
Mar 27 2023 11:23:37 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:23:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 196120346320 free-wblocks 962779 write-q 0 write (430101,1.8) defrag-q 0 defrag-read (368750,15.9) defrag-write (124581,0.6)
Mar 27 2023 11:23:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:23:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:23:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 161 user-cpu-pct 125 kernel-cpu-pct 36 free-mem-kbytes 10648348 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:23:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 168 threads (11,64,39,30) heap-kbytes (13095660,13172144,14508544) heap-efficiency-pct 99.4
Mar 27 2023 11:23:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:23:43 GMT: INFO (info): (ticker.c:319) fds: proto (79,126974,126895) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:23:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6890909
Mar 27 2023 11:23:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14033761,17619359) ctrl (24,17) meta (0,0) rw (4364,2957)
Mar 27 2023 11:23:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53057336 master 15777647 prole 34412183 non-replica 2847600
Mar 27 2023 11:23:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (104,538,156) active (2,3,0) complete-pct 69.96
Mar 27 2023 11:23:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11868571860 index-bytes 3395669504 set-index-bytes 0 sindex-bytes 8472902356 used-pct 69.08
Mar 27 2023 11:23:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196120510288 avail-pct 47 cache-read-pct 0.01
Mar 27 2023 11:23:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2651910,0,0,231327,0) write (2104935,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:23:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:23:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605723,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:23:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12458 respond (0,111651)
Mar 27 2023 11:23:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2883237 total) msec
Mar 27 2023 11:23:43 GMT: INFO (info): (hist.c:331) (00: 0002881724) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:23:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:23:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104936 total) msec
Mar 27 2023 11:23:43 GMT: INFO (info): (hist.c:331) (00: 0001674557) (01: 0000403727) (02: 0000023995) (03: 0000002417)
Mar 27 2023 11:23:43 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:23:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:23:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:23:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:23:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 163 user-cpu-pct 132 kernel-cpu-pct 31 free-mem-kbytes 10649548 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:23:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 169 threads (11,64,39,30) heap-kbytes (13095380,13170900,14506496) heap-efficiency-pct 99.4
Mar 27 2023 11:23:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:23:53 GMT: INFO (info): (ticker.c:319) fds: proto (78,126974,126896) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:23:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6891176
Mar 27 2023 11:23:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14365744,11813005) ctrl (52,52) meta (0,0) rw (1868,4328)
Mar 27 2023 11:23:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53057592 master 15777893 prole 34412193 non-replica 2827677
Mar 27 2023 11:23:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (102,535,153) active (2,2,0) complete-pct 70.19
Mar 27 2023 11:23:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11867775892 index-bytes 3395685888 set-index-bytes 0 sindex-bytes 8472090004 used-pct 69.08
Mar 27 2023 11:23:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196120795984 avail-pct 47 cache-read-pct 0.01
Mar 27 2023 11:23:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2651910,0,0,231327,0) write (2104937,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:23:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:23:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605741,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:23:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12459 respond (0,111651)
Mar 27 2023 11:23:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2883237 total) msec
Mar 27 2023 11:23:53 GMT: INFO (info): (hist.c:331) (00: 0002881724) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:23:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:23:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104938 total) msec
Mar 27 2023 11:23:53 GMT: INFO (info): (hist.c:331) (00: 0001674559) (01: 0000403727) (02: 0000023995) (03: 0000002417)
Mar 27 2023 11:23:53 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:23:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:23:57 GMT: INFO (info): (thr_info.c:3840) latencies command: unrecognized histogram: {Settlement}-query
Mar 27 2023 11:23:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 196121007200 free-wblocks 962777 write-q 0 write (430104,0.2) defrag-q 0 defrag-read (368750,0.0) defrag-write (124581,0.0)
Mar 27 2023 11:24:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:24:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:24:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 164 user-cpu-pct 134 kernel-cpu-pct 30 free-mem-kbytes 10649376 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:24:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 169 threads (11,64,39,30) heap-kbytes (13093578,13171332,14506496) heap-efficiency-pct 99.4
Mar 27 2023 11:24:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:24:03 GMT: INFO (info): (ticker.c:319) fds: proto (78,126976,126898) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:24:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6891442
Mar 27 2023 11:24:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14024800,12726232) ctrl (43,35) meta (0,0) rw (11648,7291)
Mar 27 2023 11:24:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53057941 master 15778216 prole 34412219 non-replica 2807783
Mar 27 2023 11:24:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (100,534,150) active (2,2,0) complete-pct 70.33
Mar 27 2023 11:24:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11865551844 index-bytes 3395708224 set-index-bytes 0 sindex-bytes 8469843620 used-pct 69.07
Mar 27 2023 11:24:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196121160784 avail-pct 47 cache-read-pct 0.09
Mar 27 2023 11:24:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2651921,0,0,231332,0) write (2104955,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:24:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:24:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605796,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:24:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12461 respond (0,111651)
Mar 27 2023 11:24:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2883253 total) msec
Mar 27 2023 11:24:03 GMT: INFO (info): (hist.c:331) (00: 0002881740) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:24:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:24:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104956 total) msec
Mar 27 2023 11:24:03 GMT: INFO (info): (hist.c:331) (00: 0001674575) (01: 0000403729) (02: 0000023995) (03: 0000002417)
Mar 27 2023 11:24:03 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:24:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:24:03 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (31150134,139334) total-ms 26303
Mar 27 2023 11:24:04 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:24:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:24:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:24:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 151 user-cpu-pct 120 kernel-cpu-pct 31 free-mem-kbytes 10650448 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:24:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 159 threads (11,64,39,30) heap-kbytes (13092148,13168536,14506496) heap-efficiency-pct 99.4
Mar 27 2023 11:24:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:24:13 GMT: INFO (info): (ticker.c:319) fds: proto (79,126977,126898) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:24:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6891709
Mar 27 2023 11:24:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14235095,13065741) ctrl (48,45) meta (0,0) rw (3159,4046)
Mar 27 2023 11:24:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53038291 master 15778461 prole 34412230 non-replica 2807783
Mar 27 2023 11:24:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (98,532,147) active (2,2,0) complete-pct 70.52
Mar 27 2023 11:24:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11862264264 index-bytes 3394450624 set-index-bytes 0 sindex-bytes 8467813640 used-pct 69.05
Mar 27 2023 11:24:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196045626912 avail-pct 47 cache-read-pct 0.01
Mar 27 2023 11:24:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2651921,0,0,231332,0) write (2104959,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:24:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:24:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605816,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:24:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12461 respond (0,111651)
Mar 27 2023 11:24:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2883253 total) msec
Mar 27 2023 11:24:13 GMT: INFO (info): (hist.c:331) (00: 0002881740) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:24:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:24:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104960 total) msec
Mar 27 2023 11:24:13 GMT: INFO (info): (hist.c:331) (00: 0001674579) (01: 0000403729) (02: 0000023995) (03: 0000002417)
Mar 27 2023 11:24:13 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:24:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:24:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 196045830608 free-wblocks 963072 write-q 0 write (430107,0.2) defrag-q 0 defrag-read (369048,14.9) defrag-write (124581,0.0)
Mar 27 2023 11:24:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:24:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:24:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 162 user-cpu-pct 132 kernel-cpu-pct 30 free-mem-kbytes 10650352 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:24:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 169 threads (11,64,39,30) heap-kbytes (13091829,13167144,14506496) heap-efficiency-pct 99.4
Mar 27 2023 11:24:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:24:23 GMT: INFO (info): (ticker.c:319) fds: proto (77,126977,126900) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:24:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6891975
Mar 27 2023 11:24:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14927285,10999662) ctrl (43,32) meta (0,0) rw (3039,4582)
Mar 27 2023 11:24:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 53038621 master 15778774 prole 34412247 non-replica 2807783
Mar 27 2023 11:24:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (96,530,144) active (2,1,0) complete-pct 70.71
Mar 27 2023 11:24:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11861066732 index-bytes 3394471744 set-index-bytes 0 sindex-bytes 8466594988 used-pct 69.04
Mar 27 2023 11:24:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 196046029680 avail-pct 47 cache-read-pct 0.01
Mar 27 2023 11:24:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2651921,0,0,231332,0) write (2104960,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:24:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:24:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605833,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:24:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12462 respond (0,111651)
Mar 27 2023 11:24:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2883253 total) msec
Mar 27 2023 11:24:23 GMT: INFO (info): (hist.c:331) (00: 0002881740) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:24:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:24:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2104961 total) msec
Mar 27 2023 11:24:23 GMT: INFO (info): (hist.c:331) (00: 0001674579) (01: 0000403730) (02: 0000023995) (03: 0000002417)
Mar 27 2023 11:24:23 GMT: INFO (info): (hist.c:331) (04: 0000000168) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:24:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:24:31 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (31294775,144641) total-ms 26282
Mar 27 2023 11:24:32 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:24:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:24:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:24:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 152 user-cpu-pct 123 kernel-cpu-pct 29 free-mem-kbytes 10650316 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:24:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 157 threads (11,64,39,30) heap-kbytes (13089949,13164996,14506496) heap-efficiency-pct 99.4
Mar 27 2023 11:24:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:24:33 GMT: INFO (info): (ticker.c:319) fds: proto (101,127060,126959) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:24:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6892242
Mar 27 2023 11:24:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14851200,7237232) ctrl (45,41) meta (0,0) rw (416069,463352)
Mar 27 2023 11:24:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52999133 master 15779074 prole 34412276 non-replica 2787849
Mar 27 2023 11:24:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (94,529,141) active (2,1,0) complete-pct 70.85
Mar 27 2023 11:24:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11858217548 index-bytes 3391944512 set-index-bytes 0 sindex-bytes 8466273036 used-pct 69.02
Mar 27 2023 11:24:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195896794368 avail-pct 47 cache-read-pct 3.04
Mar 27 2023 11:24:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652567,0,0,231339,0) write (2105306,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:24:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:24:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605895,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:24:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12488 respond (0,111651)
Mar 27 2023 11:24:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2883906 total) msec
Mar 27 2023 11:24:33 GMT: INFO (info): (hist.c:331) (00: 0002882393) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:24:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:24:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105307 total) msec
Mar 27 2023 11:24:33 GMT: INFO (info): (hist.c:331) (00: 0001674842) (01: 0000403808) (02: 0000023999) (03: 0000002417)
Mar 27 2023 11:24:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:24:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:24:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195897001808 free-wblocks 963656 write-q 0 write (430151,2.2) defrag-q 0 defrag-read (369672,31.2) defrag-write (124598,0.9)
Mar 27 2023 11:24:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:24:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:24:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 157 user-cpu-pct 130 kernel-cpu-pct 27 free-mem-kbytes 10650672 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:24:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 163 threads (11,64,39,30) heap-kbytes (13088895,13164960,14506496) heap-efficiency-pct 99.4
Mar 27 2023 11:24:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:24:43 GMT: INFO (info): (ticker.c:319) fds: proto (101,127060,126959) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:24:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6892508
Mar 27 2023 11:24:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14667306,7351210) ctrl (39,24) meta (0,0) rw (4369,4783)
Mar 27 2023 11:24:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52999448 master 15779379 prole 34412286 non-replica 2787849
Mar 27 2023 11:24:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (92,528,138) active (2,1,0) complete-pct 70.99
Mar 27 2023 11:24:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11857145612 index-bytes 3391964672 set-index-bytes 0 sindex-bytes 8465180940 used-pct 69.02
Mar 27 2023 11:24:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195897127936 avail-pct 47 cache-read-pct 0.01
Mar 27 2023 11:24:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652567,0,0,231339,0) write (2105310,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:24:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:24:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605915,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:24:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12489 respond (0,111651)
Mar 27 2023 11:24:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2883906 total) msec
Mar 27 2023 11:24:43 GMT: INFO (info): (hist.c:331) (00: 0002882393) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:24:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:24:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105311 total) msec
Mar 27 2023 11:24:43 GMT: INFO (info): (hist.c:331) (00: 0001674846) (01: 0000403808) (02: 0000023999) (03: 0000002417)
Mar 27 2023 11:24:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:24:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:24:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:24:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:24:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 162 user-cpu-pct 131 kernel-cpu-pct 31 free-mem-kbytes 10650596 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:24:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 168 threads (11,64,39,30) heap-kbytes (13086183,13163644,14506496) heap-efficiency-pct 99.4
Mar 27 2023 11:24:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:24:53 GMT: INFO (info): (ticker.c:319) fds: proto (100,127061,126961) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:24:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6892775
Mar 27 2023 11:24:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14650691,9991668) ctrl (46,43) meta (0,0) rw (4042,3633)
Mar 27 2023 11:24:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52999754 master 15779672 prole 34412299 non-replica 2767892
Mar 27 2023 11:24:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (90,527,135) active (2,2,0) complete-pct 71.13
Mar 27 2023 11:24:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11855427868 index-bytes 3391984256 set-index-bytes 0 sindex-bytes 8463443612 used-pct 69.01
Mar 27 2023 11:24:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195897425600 avail-pct 47 cache-read-pct 0.02
Mar 27 2023 11:24:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652567,0,0,231339,0) write (2105315,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:24:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:24:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605934,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:24:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12489 respond (0,111651)
Mar 27 2023 11:24:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2883906 total) msec
Mar 27 2023 11:24:53 GMT: INFO (info): (hist.c:331) (00: 0002882393) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:24:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:24:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105316 total) msec
Mar 27 2023 11:24:53 GMT: INFO (info): (hist.c:331) (00: 0001674851) (01: 0000403808) (02: 0000023999) (03: 0000002417)
Mar 27 2023 11:24:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:24:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:24:58 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (31449022,154247) total-ms 25840
Mar 27 2023 11:24:59 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:24:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195822550384 free-wblocks 963945 write-q 0 write (430155,0.2) defrag-q 0 defrag-read (369966,14.7) defrag-write (124599,0.1)
Mar 27 2023 11:25:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:25:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:25:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 152 user-cpu-pct 123 kernel-cpu-pct 29 free-mem-kbytes 10650912 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:25:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 158 threads (11,64,39,30) heap-kbytes (13085739,13161708,14502400) heap-efficiency-pct 99.4
Mar 27 2023 11:25:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:25:03 GMT: INFO (info): (ticker.c:319) fds: proto (100,127061,126961) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:25:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6893042
Mar 27 2023 11:25:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14656810,11384311) ctrl (41,30) meta (0,0) rw (3655,7339)
Mar 27 2023 11:25:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52980143 master 15779968 prole 34412323 non-replica 2748015
Mar 27 2023 11:25:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (88,526,132) active (2,2,0) complete-pct 71.27
Mar 27 2023 11:25:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11852560096 index-bytes 3390729152 set-index-bytes 0 sindex-bytes 8461830944 used-pct 68.99
Mar 27 2023 11:25:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195822744720 avail-pct 47 cache-read-pct 0.10
Mar 27 2023 11:25:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652579,0,0,231349,0) write (2105336,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:25:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:25:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605975,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:25:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12489 respond (0,111651)
Mar 27 2023 11:25:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2883928 total) msec
Mar 27 2023 11:25:03 GMT: INFO (info): (hist.c:331) (00: 0002882415) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:25:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:25:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105337 total) msec
Mar 27 2023 11:25:03 GMT: INFO (info): (hist.c:331) (00: 0001674872) (01: 0000403808) (02: 0000023999) (03: 0000002417)
Mar 27 2023 11:25:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:25:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:25:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:25:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:25:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 159 user-cpu-pct 132 kernel-cpu-pct 27 free-mem-kbytes 10650904 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:25:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 164 threads (11,64,39,30) heap-kbytes (13083485,13161324,14502400) heap-efficiency-pct 99.4
Mar 27 2023 11:25:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:25:13 GMT: INFO (info): (ticker.c:319) fds: proto (100,127061,126961) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:25:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6893308
Mar 27 2023 11:25:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14492907,7733165) ctrl (45,37) meta (0,0) rw (6736,1709)
Mar 27 2023 11:25:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52980464 master 15780285 prole 34412327 non-replica 2748012
Mar 27 2023 11:25:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (86,524,129) active (2,1,0) complete-pct 71.46
Mar 27 2023 11:25:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11850248500 index-bytes 3390749696 set-index-bytes 0 sindex-bytes 8459498804 used-pct 68.98
Mar 27 2023 11:25:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195823059872 avail-pct 47 cache-read-pct 0.02
Mar 27 2023 11:25:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652579,0,0,231349,0) write (2105341,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:25:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:25:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1605990,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:25:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12490 respond (0,111651)
Mar 27 2023 11:25:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2883928 total) msec
Mar 27 2023 11:25:13 GMT: INFO (info): (hist.c:331) (00: 0002882415) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:25:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:25:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105342 total) msec
Mar 27 2023 11:25:13 GMT: INFO (info): (hist.c:331) (00: 0001674876) (01: 0000403809) (02: 0000023999) (03: 0000002417)
Mar 27 2023 11:25:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:25:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:25:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195823255664 free-wblocks 963944 write-q 0 write (430157,0.1) defrag-q 0 defrag-read (369966,0.0) defrag-write (124599,0.0)
Mar 27 2023 11:25:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:25:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:25:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 164 user-cpu-pct 132 kernel-cpu-pct 32 free-mem-kbytes 10649860 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:25:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 168 threads (13,64,39,30) heap-kbytes (13082952,13159732,14500352) heap-efficiency-pct 99.4
Mar 27 2023 11:25:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:25:23 GMT: INFO (info): (ticker.c:319) fds: proto (99,127062,126963) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:25:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6893575
Mar 27 2023 11:25:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (13848587,12155958) ctrl (30,45) meta (0,0) rw (3469,4352)
Mar 27 2023 11:25:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52980779 master 15780585 prole 34412342 non-replica 2728067
Mar 27 2023 11:25:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (86,523,129) active (4,3,0) complete-pct 71.50
Mar 27 2023 11:25:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11848433012 index-bytes 3390769856 set-index-bytes 0 sindex-bytes 8457663156 used-pct 68.97
Mar 27 2023 11:25:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195823409744 avail-pct 47 cache-read-pct 0.01
Mar 27 2023 11:25:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652579,0,0,231349,0) write (2105344,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:25:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:25:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606007,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:25:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12490 respond (0,111651)
Mar 27 2023 11:25:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2883928 total) msec
Mar 27 2023 11:25:23 GMT: INFO (info): (hist.c:331) (00: 0002882415) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:25:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:25:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105345 total) msec
Mar 27 2023 11:25:23 GMT: INFO (info): (hist.c:331) (00: 0001674879) (01: 0000403809) (02: 0000023999) (03: 0000002417)
Mar 27 2023 11:25:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:25:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:25:25 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (31674334,225312) total-ms 26441
Mar 27 2023 11:25:26 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:25:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:25:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:25:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 156 user-cpu-pct 122 kernel-cpu-pct 34 free-mem-kbytes 10650436 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:25:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 163 threads (13,64,39,30) heap-kbytes (13082511,13158488,14500352) heap-efficiency-pct 99.4
Mar 27 2023 11:25:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:25:33 GMT: INFO (info): (ticker.c:319) fds: proto (25,127071,127046) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:25:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6893842
Mar 27 2023 11:25:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14440844,16094416) ctrl (45,37) meta (0,0) rw (37844,32358)
Mar 27 2023 11:25:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52961111 master 15780859 prole 34412360 non-replica 2728066
Mar 27 2023 11:25:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (84,521,126) active (4,2,0) complete-pct 71.69
Mar 27 2023 11:25:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11845414328 index-bytes 3389511104 set-index-bytes 0 sindex-bytes 8455903224 used-pct 68.95
Mar 27 2023 11:25:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195747647024 avail-pct 47 cache-read-pct 0.34
Mar 27 2023 11:25:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652623,0,0,231352,0) write (2105385,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:25:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:25:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606045,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:25:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12490 respond (0,111651)
Mar 27 2023 11:25:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2883975 total) msec
Mar 27 2023 11:25:33 GMT: INFO (info): (hist.c:331) (00: 0002882462) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:25:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:25:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105386 total) msec
Mar 27 2023 11:25:33 GMT: INFO (info): (hist.c:331) (00: 0001674908) (01: 0000403818) (02: 0000024002) (03: 0000002417)
Mar 27 2023 11:25:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:25:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:25:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195747793216 free-wblocks 964239 write-q 0 write (430162,0.2) defrag-q 0 defrag-read (370266,15.0) defrag-write (124600,0.1)
Mar 27 2023 11:25:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:25:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:25:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 157 user-cpu-pct 130 kernel-cpu-pct 27 free-mem-kbytes 10649420 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:25:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 163 threads (13,64,39,30) heap-kbytes (13082167,13159140,14500352) heap-efficiency-pct 99.4
Mar 27 2023 11:25:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:25:43 GMT: INFO (info): (ticker.c:319) fds: proto (25,127071,127046) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:25:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6894108
Mar 27 2023 11:25:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14201168,8545043) ctrl (43,32) meta (0,0) rw (948,2774)
Mar 27 2023 11:25:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52961416 master 15781158 prole 34412366 non-replica 2728066
Mar 27 2023 11:25:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (82,519,123) active (4,1,0) complete-pct 71.88
Mar 27 2023 11:25:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11844276616 index-bytes 3389530624 set-index-bytes 0 sindex-bytes 8454745992 used-pct 68.94
Mar 27 2023 11:25:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195747952800 avail-pct 47 cache-read-pct 0.02
Mar 27 2023 11:25:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652623,0,0,231352,0) write (2105386,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:25:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:25:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606054,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:25:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12490 respond (0,111651)
Mar 27 2023 11:25:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2883975 total) msec
Mar 27 2023 11:25:43 GMT: INFO (info): (hist.c:331) (00: 0002882462) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:25:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:25:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105387 total) msec
Mar 27 2023 11:25:43 GMT: INFO (info): (hist.c:331) (00: 0001674909) (01: 0000403818) (02: 0000024002) (03: 0000002417)
Mar 27 2023 11:25:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:25:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:25:52 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (31801038,126704) total-ms 26315
Mar 27 2023 11:25:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:25:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:25:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 154 user-cpu-pct 124 kernel-cpu-pct 30 free-mem-kbytes 10648484 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:25:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 162 threads (13,64,39,30) heap-kbytes (13079296,13154204,14500352) heap-efficiency-pct 99.4
Mar 27 2023 11:25:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:25:53 GMT: INFO (info): (ticker.c:319) fds: proto (27,127074,127047) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:25:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6894374
Mar 27 2023 11:25:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14058137,11999679) ctrl (49,52) meta (0,0) rw (4002,6372)
Mar 27 2023 11:25:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52921929 master 15781460 prole 34412403 non-replica 2728065
Mar 27 2023 11:25:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (80,518,120) active (4,4,0) complete-pct 72.02
Mar 27 2023 11:25:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11840973548 index-bytes 3387003456 set-index-bytes 0 sindex-bytes 8453970092 used-pct 68.92
Mar 27 2023 11:25:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195597572144 avail-pct 47 cache-read-pct 0.13
Mar 27 2023 11:25:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652634,0,0,231363,0) write (2105409,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:25:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:25:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606121,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:25:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12492 respond (0,111651)
Mar 27 2023 11:25:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2883997 total) msec
Mar 27 2023 11:25:53 GMT: INFO (info): (hist.c:331) (00: 0002882484) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:25:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:25:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105410 total) msec
Mar 27 2023 11:25:53 GMT: INFO (info): (hist.c:331) (00: 0001674931) (01: 0000403819) (02: 0000024002) (03: 0000002417)
Mar 27 2023 11:25:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:25:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:25:53 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:25:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195597800480 free-wblocks 964825 write-q 0 write (430166,0.2) defrag-q 0 defrag-read (370857,29.5) defrag-write (124601,0.1)
Mar 27 2023 11:26:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:26:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:26:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 172 user-cpu-pct 134 kernel-cpu-pct 38 free-mem-kbytes 10647936 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:26:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 178 threads (13,64,39,30) heap-kbytes (13079614,13154460,14500352) heap-efficiency-pct 99.4
Mar 27 2023 11:26:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:26:03 GMT: INFO (info): (ticker.c:319) fds: proto (27,127074,127047) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:26:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6894641
Mar 27 2023 11:26:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14150715,22231847) ctrl (44,37) meta (0,0) rw (40407,32111)
Mar 27 2023 11:26:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52922255 master 15781762 prole 34412427 non-replica 2728064
Mar 27 2023 11:26:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (78,517,117) active (4,5,0) complete-pct 72.16
Mar 27 2023 11:26:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11841015264 index-bytes 3387024320 set-index-bytes 0 sindex-bytes 8453990944 used-pct 68.92
Mar 27 2023 11:26:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195597987232 avail-pct 47 cache-read-pct 0.33
Mar 27 2023 11:26:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652678,0,0,231368,0) write (2105454,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:26:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:26:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606157,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:26:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12496 respond (0,111651)
Mar 27 2023 11:26:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884046 total) msec
Mar 27 2023 11:26:03 GMT: INFO (info): (hist.c:331) (00: 0002882533) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:26:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:26:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105455 total) msec
Mar 27 2023 11:26:03 GMT: INFO (info): (hist.c:331) (00: 0001674970) (01: 0000403825) (02: 0000024002) (03: 0000002417)
Mar 27 2023 11:26:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:26:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:26:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:26:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:26:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 168 user-cpu-pct 134 kernel-cpu-pct 34 free-mem-kbytes 10648908 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:26:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 173 threads (13,64,39,30) heap-kbytes (13080538,13155720,14500352) heap-efficiency-pct 99.4
Mar 27 2023 11:26:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:26:13 GMT: INFO (info): (ticker.c:319) fds: proto (27,127074,127047) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:26:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6894908
Mar 27 2023 11:26:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14357363,15592350) ctrl (51,47) meta (0,0) rw (4241,5282)
Mar 27 2023 11:26:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52922579 master 15782064 prole 34412449 non-replica 2728064
Mar 27 2023 11:26:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (76,513,114) active (4,2,0) complete-pct 72.44
Mar 27 2023 11:26:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11841050388 index-bytes 3387045056 set-index-bytes 0 sindex-bytes 8454005332 used-pct 68.92
Mar 27 2023 11:26:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195598382576 avail-pct 47 cache-read-pct 0.02
Mar 27 2023 11:26:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652681,0,0,231368,0) write (2105457,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:26:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:26:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606170,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:26:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12496 respond (0,111651)
Mar 27 2023 11:26:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884049 total) msec
Mar 27 2023 11:26:13 GMT: INFO (info): (hist.c:331) (00: 0002882536) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:26:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:26:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105458 total) msec
Mar 27 2023 11:26:13 GMT: INFO (info): (hist.c:331) (00: 0001674972) (01: 0000403826) (02: 0000024002) (03: 0000002417)
Mar 27 2023 11:26:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:26:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:26:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195598560400 free-wblocks 964822 write-q 0 write (430170,0.2) defrag-q 0 defrag-read (370857,0.0) defrag-write (124601,0.0)
Mar 27 2023 11:26:20 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (31801050,12) total-ms 26971
Mar 27 2023 11:26:21 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:26:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:26:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:26:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 146 user-cpu-pct 119 kernel-cpu-pct 27 free-mem-kbytes 10648868 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:26:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 154 threads (11,64,39,30) heap-kbytes (13076931,13152184,14500352) heap-efficiency-pct 99.4
Mar 27 2023 11:26:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:26:23 GMT: INFO (info): (ticker.c:319) fds: proto (28,127076,127048) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:26:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6895174
Mar 27 2023 11:26:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (13700242,9491510) ctrl (24,17) meta (0,0) rw (4616,2671)
Mar 27 2023 11:26:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52922903 master 15782381 prole 34412457 non-replica 2728064
Mar 27 2023 11:26:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (74,512,111) active (2,1,0) complete-pct 72.58
Mar 27 2023 11:26:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11841092024 index-bytes 3387065792 set-index-bytes 0 sindex-bytes 8454026232 used-pct 68.92
Mar 27 2023 11:26:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195598717072 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:26:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652681,0,0,231368,0) write (2105461,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:26:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:26:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606189,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:26:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12496 respond (0,111651)
Mar 27 2023 11:26:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884049 total) msec
Mar 27 2023 11:26:23 GMT: INFO (info): (hist.c:331) (00: 0002882536) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:26:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:26:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105462 total) msec
Mar 27 2023 11:26:23 GMT: INFO (info): (hist.c:331) (00: 0001674976) (01: 0000403826) (02: 0000024002) (03: 0000002417)
Mar 27 2023 11:26:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:26:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:26:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:26:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:26:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 158 user-cpu-pct 131 kernel-cpu-pct 27 free-mem-kbytes 10648716 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:26:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 163 threads (11,64,39,30) heap-kbytes (13076884,13152512,14500352) heap-efficiency-pct 99.4
Mar 27 2023 11:26:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:26:33 GMT: INFO (info): (ticker.c:319) fds: proto (28,127076,127048) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:26:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6895441
Mar 27 2023 11:26:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14633887,7195076) ctrl (39,24) meta (0,0) rw (8477,3788)
Mar 27 2023 11:26:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52923258 master 15782726 prole 34412467 non-replica 2728064
Mar 27 2023 11:26:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (72,511,108) active (2,1,0) complete-pct 72.72
Mar 27 2023 11:26:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11841142364 index-bytes 3387088512 set-index-bytes 0 sindex-bytes 8454053852 used-pct 68.92
Mar 27 2023 11:26:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195599094048 avail-pct 47 cache-read-pct 0.06
Mar 27 2023 11:26:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652686,0,0,231371,0) write (2105472,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:26:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:26:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606215,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:26:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12496 respond (0,111651)
Mar 27 2023 11:26:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884057 total) msec
Mar 27 2023 11:26:33 GMT: INFO (info): (hist.c:331) (00: 0002882544) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:26:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:26:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105473 total) msec
Mar 27 2023 11:26:33 GMT: INFO (info): (hist.c:331) (00: 0001674986) (01: 0000403827) (02: 0000024002) (03: 0000002417)
Mar 27 2023 11:26:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:26:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:26:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195599270416 free-wblocks 964819 write-q 0 write (430174,0.2) defrag-q 0 defrag-read (370858,0.1) defrag-write (124602,0.1)
Mar 27 2023 11:26:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:26:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:26:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 161 user-cpu-pct 133 kernel-cpu-pct 28 free-mem-kbytes 10648928 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:26:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 165 threads (11,64,39,30) heap-kbytes (13075701,13151436,14498304) heap-efficiency-pct 99.4
Mar 27 2023 11:26:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:26:43 GMT: INFO (info): (ticker.c:319) fds: proto (27,127076,127049) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:26:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6895708
Mar 27 2023 11:26:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14529111,7276363) ctrl (46,43) meta (0,0) rw (7207,7579)
Mar 27 2023 11:26:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52923555 master 15783016 prole 34412474 non-replica 2708102
Mar 27 2023 11:26:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (70,510,105) active (2,2,0) complete-pct 72.86
Mar 27 2023 11:26:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11840380060 index-bytes 3387107520 set-index-bytes 0 sindex-bytes 8453272540 used-pct 68.92
Mar 27 2023 11:26:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195599363200 avail-pct 47 cache-read-pct 0.03
Mar 27 2023 11:26:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652689,0,0,231371,0) write (2105478,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:26:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:26:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606230,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:26:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12496 respond (0,111651)
Mar 27 2023 11:26:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884060 total) msec
Mar 27 2023 11:26:43 GMT: INFO (info): (hist.c:331) (00: 0002882547) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:26:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:26:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105479 total) msec
Mar 27 2023 11:26:43 GMT: INFO (info): (hist.c:331) (00: 0001674991) (01: 0000403828) (02: 0000024002) (03: 0000002417)
Mar 27 2023 11:26:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:26:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:26:47 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (31845699,44649) total-ms 25781
Mar 27 2023 11:26:48 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:26:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:26:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:26:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 153 user-cpu-pct 123 kernel-cpu-pct 30 free-mem-kbytes 10648544 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:26:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 160 threads (11,64,39,30) heap-kbytes (13075742,13152684,14498304) heap-efficiency-pct 99.4
Mar 27 2023 11:26:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:26:53 GMT: INFO (info): (ticker.c:319) fds: proto (27,127078,127051) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:26:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6895974
Mar 27 2023 11:26:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14287064,11253118) ctrl (41,30) meta (0,0) rw (7449,5765)
Mar 27 2023 11:26:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52923877 master 15783325 prole 34412488 non-replica 2708101
Mar 27 2023 11:26:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (68,509,102) active (2,2,0) complete-pct 73.00
Mar 27 2023 11:26:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11839207144 index-bytes 3387128128 set-index-bytes 0 sindex-bytes 8452079016 used-pct 68.91
Mar 27 2023 11:26:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195599726384 avail-pct 47 cache-read-pct 0.03
Mar 27 2023 11:26:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652689,0,0,231371,0) write (2105486,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:26:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:26:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606260,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:26:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12496 respond (0,111651)
Mar 27 2023 11:26:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884060 total) msec
Mar 27 2023 11:26:53 GMT: INFO (info): (hist.c:331) (00: 0002882547) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:26:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:26:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105487 total) msec
Mar 27 2023 11:26:53 GMT: INFO (info): (hist.c:331) (00: 0001674999) (01: 0000403828) (02: 0000024002) (03: 0000002417)
Mar 27 2023 11:26:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:26:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:26:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195599899088 free-wblocks 964816 write-q 0 write (430177,0.2) defrag-q 0 defrag-read (370858,0.0) defrag-write (124602,0.0)
Mar 27 2023 11:27:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:27:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:27:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 167 user-cpu-pct 134 kernel-cpu-pct 33 free-mem-kbytes 10647108 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:27:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 175 threads (11,64,39,30) heap-kbytes (13074642,13151960,14498304) heap-efficiency-pct 99.4
Mar 27 2023 11:27:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:27:03 GMT: INFO (info): (ticker.c:319) fds: proto (23,127083,127060) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:27:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6896241
Mar 27 2023 11:27:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14674710,15862319) ctrl (48,45) meta (0,0) rw (21703,27684)
Mar 27 2023 11:27:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52924192 master 15783621 prole 34412507 non-replica 2708099
Mar 27 2023 11:27:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (66,507,99) active (2,2,0) complete-pct 73.19
Mar 27 2023 11:27:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11838058584 index-bytes 3387148288 set-index-bytes 0 sindex-bytes 8450910296 used-pct 68.91
Mar 27 2023 11:27:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195600058784 avail-pct 47 cache-read-pct 0.22
Mar 27 2023 11:27:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652718,0,0,231372,0) write (2105510,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:27:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:27:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606286,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:27:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12498 respond (0,111651)
Mar 27 2023 11:27:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884090 total) msec
Mar 27 2023 11:27:03 GMT: INFO (info): (hist.c:331) (00: 0002882577) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:27:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:27:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105511 total) msec
Mar 27 2023 11:27:03 GMT: INFO (info): (hist.c:331) (00: 0001675021) (01: 0000403830) (02: 0000024002) (03: 0000002417)
Mar 27 2023 11:27:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:27:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:27:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:27:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:27:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 163 user-cpu-pct 132 kernel-cpu-pct 31 free-mem-kbytes 10648068 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:27:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 168 threads (11,64,39,30) heap-kbytes (13075360,13152796,14498304) heap-efficiency-pct 99.4
Mar 27 2023 11:27:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:27:13 GMT: INFO (info): (ticker.c:319) fds: proto (24,127084,127060) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:27:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6896507
Mar 27 2023 11:27:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14819013,9647555) ctrl (45,37) meta (0,0) rw (2679,3981)
Mar 27 2023 11:27:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52924501 master 15783921 prole 34412516 non-replica 2708097
Mar 27 2023 11:27:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (64,505,96) active (2,1,0) complete-pct 73.37
Mar 27 2023 11:27:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11838101620 index-bytes 3387168064 set-index-bytes 0 sindex-bytes 8450933556 used-pct 68.91
Mar 27 2023 11:27:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195600367136 avail-pct 47 cache-read-pct 0.02
Mar 27 2023 11:27:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652718,0,0,231372,0) write (2105513,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:27:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:27:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606309,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:27:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12498 respond (0,111651)
Mar 27 2023 11:27:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884090 total) msec
Mar 27 2023 11:27:13 GMT: INFO (info): (hist.c:331) (00: 0002882577) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:27:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:27:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105514 total) msec
Mar 27 2023 11:27:13 GMT: INFO (info): (hist.c:331) (00: 0001675024) (01: 0000403830) (02: 0000024002) (03: 0000002417)
Mar 27 2023 11:27:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:27:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:27:14 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (31928831,83132) total-ms 26321
Mar 27 2023 11:27:15 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:27:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195526303648 free-wblocks 965105 write-q 0 write (430179,0.1) defrag-q 0 defrag-read (371149,14.6) defrag-write (124602,0.0)
Mar 27 2023 11:27:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:27:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:27:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 149 user-cpu-pct 121 kernel-cpu-pct 28 free-mem-kbytes 10648620 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:27:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 155 threads (11,64,39,30) heap-kbytes (13073869,13151220,14498304) heap-efficiency-pct 99.4
Mar 27 2023 11:27:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:27:23 GMT: INFO (info): (ticker.c:319) fds: proto (23,127084,127061) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:27:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6896774
Mar 27 2023 11:27:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14726857,7348324) ctrl (39,24) meta (0,0) rw (2036,8166)
Mar 27 2023 11:27:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52904853 master 15784221 prole 34412530 non-replica 2708097
Mar 27 2023 11:27:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (62,504,93) active (2,1,0) complete-pct 73.51
Mar 27 2023 11:27:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11836866204 index-bytes 3385910592 set-index-bytes 0 sindex-bytes 8450955612 used-pct 68.90
Mar 27 2023 11:27:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195526462080 avail-pct 47 cache-read-pct 0.03
Mar 27 2023 11:27:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652721,0,0,231373,0) write (2105517,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:27:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:27:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606333,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:27:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12501 respond (0,111651)
Mar 27 2023 11:27:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884094 total) msec
Mar 27 2023 11:27:23 GMT: INFO (info): (hist.c:331) (00: 0002882581) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:27:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:27:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105518 total) msec
Mar 27 2023 11:27:23 GMT: INFO (info): (hist.c:331) (00: 0001675027) (01: 0000403831) (02: 0000024002) (03: 0000002417)
Mar 27 2023 11:27:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:27:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:27:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:27:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:27:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 170 user-cpu-pct 136 kernel-cpu-pct 34 free-mem-kbytes 10647876 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:27:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 172 threads (11,64,39,30) heap-kbytes (13074991,13151688,14498304) heap-efficiency-pct 99.4
Mar 27 2023 11:27:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:27:33 GMT: INFO (info): (ticker.c:319) fds: proto (28,127089,127061) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:27:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6897040
Mar 27 2023 11:27:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14694622,11912033) ctrl (44,37) meta (0,0) rw (27571,28206)
Mar 27 2023 11:27:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52905196 master 15784547 prole 34412547 non-replica 2708093
Mar 27 2023 11:27:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (60,503,90) active (2,2,0) complete-pct 73.65
Mar 27 2023 11:27:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11836906468 index-bytes 3385932544 set-index-bytes 0 sindex-bytes 8450973924 used-pct 68.90
Mar 27 2023 11:27:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195526812704 avail-pct 47 cache-read-pct 0.26
Mar 27 2023 11:27:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652749,0,0,231374,0) write (2105547,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:27:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:27:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606367,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:27:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12501 respond (0,111651)
Mar 27 2023 11:27:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884123 total) msec
Mar 27 2023 11:27:33 GMT: INFO (info): (hist.c:331) (00: 0002882610) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:27:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:27:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105548 total) msec
Mar 27 2023 11:27:33 GMT: INFO (info): (hist.c:331) (00: 0001675056) (01: 0000403832) (02: 0000024002) (03: 0000002417)
Mar 27 2023 11:27:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:27:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:27:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195527013872 free-wblocks 965100 write-q 0 write (430186,0.3) defrag-q 0 defrag-read (371151,0.1) defrag-write (124603,0.1)
Mar 27 2023 11:27:42 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (31928858,27) total-ms 26488
Mar 27 2023 11:27:43 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:27:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:27:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:27:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 152 user-cpu-pct 121 kernel-cpu-pct 31 free-mem-kbytes 10647848 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:27:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 161 threads (11,64,39,30) heap-kbytes (13074293,13151440,14498304) heap-efficiency-pct 99.4
Mar 27 2023 11:27:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:27:43 GMT: INFO (info): (ticker.c:319) fds: proto (29,127090,127061) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:27:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6897307
Mar 27 2023 11:27:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14685833,13409127) ctrl (46,39) meta (0,0) rw (2988,5074)
Mar 27 2023 11:27:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52905514 master 15784855 prole 34412562 non-replica 2708093
Mar 27 2023 11:27:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (58,501,87) active (2,2,0) complete-pct 73.84
Mar 27 2023 11:27:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11836947388 index-bytes 3385952896 set-index-bytes 0 sindex-bytes 8450994492 used-pct 68.90
Mar 27 2023 11:27:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195527147968 avail-pct 47 cache-read-pct 0.01
Mar 27 2023 11:27:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652749,0,0,231374,0) write (2105550,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:27:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:27:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606394,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:27:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12501 respond (0,111651)
Mar 27 2023 11:27:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884123 total) msec
Mar 27 2023 11:27:43 GMT: INFO (info): (hist.c:331) (00: 0002882610) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:27:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:27:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105551 total) msec
Mar 27 2023 11:27:43 GMT: INFO (info): (hist.c:331) (00: 0001675059) (01: 0000403832) (02: 0000024002) (03: 0000002417)
Mar 27 2023 11:27:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:27:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:27:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:27:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:27:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 172 user-cpu-pct 134 kernel-cpu-pct 38 free-mem-kbytes 10648624 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:27:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 178 threads (11,64,39,30) heap-kbytes (13073986,13149120,14498304) heap-efficiency-pct 99.4
Mar 27 2023 11:27:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:27:53 GMT: INFO (info): (ticker.c:319) fds: proto (28,127090,127062) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:27:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6897574
Mar 27 2023 11:27:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14627677,17966959) ctrl (51,55) meta (0,0) rw (3050,2618)
Mar 27 2023 11:27:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52905839 master 15785166 prole 34412576 non-replica 2688131
Mar 27 2023 11:27:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (56,500,84) active (2,4,0) complete-pct 73.98
Mar 27 2023 11:27:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11836513748 index-bytes 3385973696 set-index-bytes 0 sindex-bytes 8450540052 used-pct 68.90
Mar 27 2023 11:27:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195527547360 avail-pct 47 cache-read-pct 0.02
Mar 27 2023 11:27:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2652751,0,0,231374,0) write (2105554,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:27:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:27:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606410,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:27:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12501 respond (0,111651)
Mar 27 2023 11:27:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884125 total) msec
Mar 27 2023 11:27:53 GMT: INFO (info): (hist.c:331) (00: 0002882612) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:27:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:27:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105555 total) msec
Mar 27 2023 11:27:53 GMT: INFO (info): (hist.c:331) (00: 0001675062) (01: 0000403833) (02: 0000024002) (03: 0000002417)
Mar 27 2023 11:27:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:27:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:27:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195527768320 free-wblocks 965098 write-q 0 write (430188,0.1) defrag-q 0 defrag-read (371151,0.0) defrag-write (124603,0.0)
Mar 27 2023 11:28:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:28:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:28:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 177 user-cpu-pct 139 kernel-cpu-pct 38 free-mem-kbytes 10647680 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:28:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 184 threads (13,64,39,30) heap-kbytes (13072563,13148364,14498304) heap-efficiency-pct 99.4
Mar 27 2023 11:28:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:28:03 GMT: INFO (info): (ticker.c:319) fds: proto (86,127149,127063) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:28:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6897840
Mar 27 2023 11:28:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (13996854,18058704) ctrl (30,37) meta (0,0) rw (312095,336746)
Mar 27 2023 11:28:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52906171 master 15785464 prole 34412610 non-replica 2688131
Mar 27 2023 11:28:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (56,497,84) active (4,3,0) complete-pct 74.12
Mar 27 2023 11:28:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11835605188 index-bytes 3385994944 set-index-bytes 0 sindex-bytes 8449610244 used-pct 68.89
Mar 27 2023 11:28:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195527959216 avail-pct 47 cache-read-pct 2.33
Mar 27 2023 11:28:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2653074,0,0,231386,0) write (2105844,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:28:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:28:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606477,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:28:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12509 respond (0,111651)
Mar 27 2023 11:28:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884460 total) msec
Mar 27 2023 11:28:03 GMT: INFO (info): (hist.c:331) (00: 0002882947) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:28:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:28:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105845 total) msec
Mar 27 2023 11:28:03 GMT: INFO (info): (hist.c:331) (00: 0001675297) (01: 0000403878) (02: 0000024012) (03: 0000002417)
Mar 27 2023 11:28:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:28:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:28:10 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (32019911,91053) total-ms 26815
Mar 27 2023 11:28:11 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:28:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:28:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:28:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 156 user-cpu-pct 125 kernel-cpu-pct 31 free-mem-kbytes 10649464 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:28:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 161 threads (13,64,39,30) heap-kbytes (13074241,13151144,14498304) heap-efficiency-pct 99.4
Mar 27 2023 11:28:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:28:13 GMT: INFO (info): (ticker.c:319) fds: proto (86,127150,127064) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:28:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6898107
Mar 27 2023 11:28:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14566327,11913272) ctrl (45,37) meta (0,0) rw (6993,4862)
Mar 27 2023 11:28:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52906452 master 15785737 prole 34412622 non-replica 2688129
Mar 27 2023 11:28:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (54,495,81) active (4,2,0) complete-pct 74.31
Mar 27 2023 11:28:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11834300400 index-bytes 3386012928 set-index-bytes 0 sindex-bytes 8448287472 used-pct 68.88
Mar 27 2023 11:28:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195528270176 avail-pct 47 cache-read-pct 0.01
Mar 27 2023 11:28:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2653074,0,0,231386,0) write (2105848,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:28:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:28:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606494,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:28:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12509 respond (0,111651)
Mar 27 2023 11:28:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884460 total) msec
Mar 27 2023 11:28:13 GMT: INFO (info): (hist.c:331) (00: 0002882947) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:28:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:28:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105849 total) msec
Mar 27 2023 11:28:13 GMT: INFO (info): (hist.c:331) (00: 0001675301) (01: 0000403878) (02: 0000024012) (03: 0000002417)
Mar 27 2023 11:28:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:28:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:28:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195528413568 free-wblocks 965093 write-q 0 write (430219,1.5) defrag-q 0 defrag-read (371175,1.2) defrag-write (124613,0.5)
Mar 27 2023 11:28:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:28:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:28:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 169 user-cpu-pct 136 kernel-cpu-pct 33 free-mem-kbytes 10648160 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:28:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 171 threads (13,64,39,30) heap-kbytes (13075082,13151264,14498304) heap-efficiency-pct 99.4
Mar 27 2023 11:28:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:28:23 GMT: INFO (info): (ticker.c:319) fds: proto (85,127150,127065) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:28:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6898374
Mar 27 2023 11:28:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (15505286,12558494) ctrl (49,46) meta (0,0) rw (4318,1287)
Mar 27 2023 11:28:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52906744 master 15786018 prole 34412633 non-replica 2688129
Mar 27 2023 11:28:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (52,493,78) active (4,3,0) complete-pct 74.50
Mar 27 2023 11:28:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11833912220 index-bytes 3386031616 set-index-bytes 0 sindex-bytes 8447880604 used-pct 68.88
Mar 27 2023 11:28:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195528585408 avail-pct 47 cache-read-pct 0.08
Mar 27 2023 11:28:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2653074,0,0,231386,0) write (2105853,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:28:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:28:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606515,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:28:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12510 respond (0,111651)
Mar 27 2023 11:28:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884460 total) msec
Mar 27 2023 11:28:23 GMT: INFO (info): (hist.c:331) (00: 0002882947) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:28:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:28:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2105854 total) msec
Mar 27 2023 11:28:23 GMT: INFO (info): (hist.c:331) (00: 0001675306) (01: 0000403878) (02: 0000024012) (03: 0000002417)
Mar 27 2023 11:28:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:28:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:28:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:28:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:28:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 175 user-cpu-pct 137 kernel-cpu-pct 38 free-mem-kbytes 10649092 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:28:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 178 threads (13,64,39,30) heap-kbytes (13071980,13148044,14498304) heap-efficiency-pct 99.4
Mar 27 2023 11:28:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:28:33 GMT: INFO (info): (ticker.c:319) fds: proto (108,127173,127065) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:28:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6898640
Mar 27 2023 11:28:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14051128,18247517) ctrl (46,43) meta (0,0) rw (524488,544555)
Mar 27 2023 11:28:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52907083 master 15786330 prole 34412660 non-replica 2668203
Mar 27 2023 11:28:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (50,492,75) active (4,4,0) complete-pct 74.64
Mar 27 2023 11:28:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11833959460 index-bytes 3386053312 set-index-bytes 0 sindex-bytes 8447906148 used-pct 68.88
Mar 27 2023 11:28:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195529029856 avail-pct 47 cache-read-pct 3.32
Mar 27 2023 11:28:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2653577,0,0,231400,0) write (2106312,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:28:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:28:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606578,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:28:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12522 respond (0,111651)
Mar 27 2023 11:28:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884977 total) msec
Mar 27 2023 11:28:33 GMT: INFO (info): (hist.c:331) (00: 0002883464) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:28:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:28:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2106313 total) msec
Mar 27 2023 11:28:33 GMT: INFO (info): (hist.c:331) (00: 0001675719) (01: 0000403923) (02: 0000024013) (03: 0000002417)
Mar 27 2023 11:28:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:28:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:28:38 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (32074736,54825) total-ms 27124
Mar 27 2023 11:28:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195454769264 free-wblocks 965375 write-q 0 write (430269,2.5) defrag-q 0 defrag-read (371503,16.4) defrag-write (124631,0.9)
Mar 27 2023 11:28:39 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:28:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:28:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:28:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 154 user-cpu-pct 121 kernel-cpu-pct 33 free-mem-kbytes 10648860 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:28:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 162 threads (13,64,39,30) heap-kbytes (13070785,13146248,14498304) heap-efficiency-pct 99.4
Mar 27 2023 11:28:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:28:43 GMT: INFO (info): (ticker.c:319) fds: proto (110,127175,127065) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:28:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6898907
Mar 27 2023 11:28:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (13983109,16216963) ctrl (54,54) meta (0,0) rw (30,2320)
Mar 27 2023 11:28:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52887377 master 15786579 prole 34412669 non-replica 2668203
Mar 27 2023 11:28:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (48,488,72) active (4,2,0) complete-pct 74.92
Mar 27 2023 11:28:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11831625240 index-bytes 3384792128 set-index-bytes 0 sindex-bytes 8446833112 used-pct 68.87
Mar 27 2023 11:28:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195454896432 avail-pct 47 cache-read-pct 0.01
Mar 27 2023 11:28:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2653577,0,0,231400,0) write (2106312,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:28:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:28:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606588,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:28:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12522 respond (0,111651)
Mar 27 2023 11:28:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884977 total) msec
Mar 27 2023 11:28:43 GMT: INFO (info): (hist.c:331) (00: 0002883464) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:28:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:28:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2106313 total) msec
Mar 27 2023 11:28:43 GMT: INFO (info): (hist.c:331) (00: 0001675719) (01: 0000403923) (02: 0000024013) (03: 0000002417)
Mar 27 2023 11:28:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:28:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:28:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:28:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:28:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 165 user-cpu-pct 133 kernel-cpu-pct 32 free-mem-kbytes 10649956 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:28:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 169 threads (13,64,39,30) heap-kbytes (13068780,13145344,14498304) heap-efficiency-pct 99.4
Mar 27 2023 11:28:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:28:53 GMT: INFO (info): (ticker.c:319) fds: proto (108,127175,127067) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:28:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6899173
Mar 27 2023 11:28:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14181246,12702162) ctrl (44,37) meta (0,0) rw (15148,15518)
Mar 27 2023 11:28:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52887683 master 15786868 prole 34412686 non-replica 2668202
Mar 27 2023 11:28:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (46,487,69) active (4,3,0) complete-pct 75.06
Mar 27 2023 11:28:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11830610536 index-bytes 3384811712 set-index-bytes 0 sindex-bytes 8445798824 used-pct 68.86
Mar 27 2023 11:28:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195455289504 avail-pct 47 cache-read-pct 0.10
Mar 27 2023 11:28:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2653590,0,0,231401,0) write (2106328,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:28:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:28:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606616,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:28:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12524 respond (0,111651)
Mar 27 2023 11:28:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884991 total) msec
Mar 27 2023 11:28:53 GMT: INFO (info): (hist.c:331) (00: 0002883478) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:28:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:28:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2106329 total) msec
Mar 27 2023 11:28:53 GMT: INFO (info): (hist.c:331) (00: 0001675733) (01: 0000403925) (02: 0000024013) (03: 0000002417)
Mar 27 2023 11:28:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:28:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:28:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195455424016 free-wblocks 965375 write-q 0 write (430271,0.1) defrag-q 0 defrag-read (371504,0.1) defrag-write (124631,0.0)
Mar 27 2023 11:29:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:29:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:29:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 160 user-cpu-pct 132 kernel-cpu-pct 28 free-mem-kbytes 10650392 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:29:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 167 threads (13,64,39,30) heap-kbytes (13067567,13143356,14498304) heap-efficiency-pct 99.4
Mar 27 2023 11:29:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:29:03 GMT: INFO (info): (ticker.c:319) fds: proto (108,127175,127067) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:29:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6899440
Mar 27 2023 11:29:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (13245273,14231569) ctrl (50,50) meta (0,0) rw (1048,1863)
Mar 27 2023 11:29:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52887945 master 15787121 prole 34412695 non-replica 2648285
Mar 27 2023 11:29:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (44,485,66) active (4,3,0) complete-pct 75.25
Mar 27 2023 11:29:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11828485960 index-bytes 3384828480 set-index-bytes 0 sindex-bytes 8443657480 used-pct 68.85
Mar 27 2023 11:29:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195455565680 avail-pct 47 cache-read-pct 0.01
Mar 27 2023 11:29:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2653590,0,0,231401,0) write (2106329,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:29:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:29:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606632,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:29:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12524 respond (0,111651)
Mar 27 2023 11:29:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884991 total) msec
Mar 27 2023 11:29:03 GMT: INFO (info): (hist.c:331) (00: 0002883478) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:29:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:29:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2106330 total) msec
Mar 27 2023 11:29:03 GMT: INFO (info): (hist.c:331) (00: 0001675734) (01: 0000403925) (02: 0000024013) (03: 0000002417)
Mar 27 2023 11:29:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:29:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:29:06 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (32242349,167613) total-ms 27338
Mar 27 2023 11:29:07 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:29:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:29:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:29:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 150 user-cpu-pct 119 kernel-cpu-pct 31 free-mem-kbytes 10649916 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:29:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 158 threads (11,64,39,30) heap-kbytes (13064636,13141384,14498304) heap-efficiency-pct 99.4
Mar 27 2023 11:29:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:29:13 GMT: INFO (info): (ticker.c:319) fds: proto (103,127177,127074) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:29:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6899706
Mar 27 2023 11:29:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (13812156,14443787) ctrl (24,17) meta (0,0) rw (2080,4287)
Mar 27 2023 11:29:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52868312 master 15787403 prole 34412706 non-replica 2648285
Mar 27 2023 11:29:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (42,484,63) active (2,2,0) complete-pct 75.39
Mar 27 2023 11:29:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11826027288 index-bytes 3383571968 set-index-bytes 0 sindex-bytes 8442455320 used-pct 68.84
Mar 27 2023 11:29:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195381485824 avail-pct 47 cache-read-pct 0.01
Mar 27 2023 11:29:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2653594,0,0,231401,0) write (2106331,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:29:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:29:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606645,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:29:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12524 respond (0,111651)
Mar 27 2023 11:29:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884995 total) msec
Mar 27 2023 11:29:13 GMT: INFO (info): (hist.c:331) (00: 0002883482) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:29:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:29:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2106332 total) msec
Mar 27 2023 11:29:13 GMT: INFO (info): (hist.c:331) (00: 0001675735) (01: 0000403926) (02: 0000024013) (03: 0000002417)
Mar 27 2023 11:29:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:29:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:29:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195381691104 free-wblocks 965663 write-q 0 write (430275,0.2) defrag-q 0 defrag-read (371796,14.6) defrag-write (124632,0.1)
Mar 27 2023 11:29:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:29:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:29:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 159 user-cpu-pct 132 kernel-cpu-pct 27 free-mem-kbytes 10650484 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:29:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 165 threads (11,64,39,30) heap-kbytes (13063267,13139572,14494208) heap-efficiency-pct 99.4
Mar 27 2023 11:29:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:29:23 GMT: INFO (info): (ticker.c:319) fds: proto (102,127177,127075) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:29:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6899973
Mar 27 2023 11:29:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14498876,8221873) ctrl (45,37) meta (0,0) rw (877,936)
Mar 27 2023 11:29:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52868615 master 15787704 prole 34412708 non-replica 2648283
Mar 27 2023 11:29:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (40,482,60) active (2,1,0) complete-pct 75.57
Mar 27 2023 11:29:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11825159136 index-bytes 3383591360 set-index-bytes 0 sindex-bytes 8441567776 used-pct 68.83
Mar 27 2023 11:29:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195381819568 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:29:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2653594,0,0,231401,0) write (2106332,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:29:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:29:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606653,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:29:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12524 respond (0,111651)
Mar 27 2023 11:29:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2884995 total) msec
Mar 27 2023 11:29:23 GMT: INFO (info): (hist.c:331) (00: 0002883482) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:29:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:29:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2106333 total) msec
Mar 27 2023 11:29:23 GMT: INFO (info): (hist.c:331) (00: 0001675736) (01: 0000403926) (02: 0000024013) (03: 0000002417)
Mar 27 2023 11:29:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:29:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:29:33 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (32343027,100678) total-ms 25622
Mar 27 2023 11:29:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:29:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:29:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 159 user-cpu-pct 132 kernel-cpu-pct 27 free-mem-kbytes 10650240 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:29:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 164 threads (11,64,39,30) heap-kbytes (13063279,13138332,14494208) heap-efficiency-pct 99.4
Mar 27 2023 11:29:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:29:33 GMT: INFO (info): (ticker.c:319) fds: proto (149,127301,127152) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:29:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6900240
Mar 27 2023 11:29:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14656664,7165488) ctrl (48,48) meta (0,0) rw (239768,244772)
Mar 27 2023 11:29:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52849056 master 15788041 prole 34412730 non-replica 2628293
Mar 27 2023 11:29:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (38,481,57) active (2,2,0) complete-pct 75.71
Mar 27 2023 11:29:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11822994204 index-bytes 3382339584 set-index-bytes 0 sindex-bytes 8440654620 used-pct 68.82
Mar 27 2023 11:29:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195308665808 avail-pct 47 cache-read-pct 1.77
Mar 27 2023 11:29:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2653957,0,0,231410,0) write (2106539,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:29:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:29:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606704,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:29:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12534 respond (0,111651)
Mar 27 2023 11:29:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2885367 total) msec
Mar 27 2023 11:29:33 GMT: INFO (info): (hist.c:331) (00: 0002883854) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:29:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:29:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2106540 total) msec
Mar 27 2023 11:29:33 GMT: INFO (info): (hist.c:331) (00: 0001675899) (01: 0000403968) (02: 0000024015) (03: 0000002417)
Mar 27 2023 11:29:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:29:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:29:34 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:29:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195308825552 free-wblocks 965949 write-q 0 write (430301,1.3) defrag-q 0 defrag-read (372104,15.4) defrag-write (124641,0.4)
Mar 27 2023 11:29:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:29:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:29:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 158 user-cpu-pct 126 kernel-cpu-pct 32 free-mem-kbytes 10649808 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:29:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 164 threads (11,64,39,30) heap-kbytes (13059054,13136204,14494208) heap-efficiency-pct 99.4
Mar 27 2023 11:29:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:29:43 GMT: INFO (info): (ticker.c:319) fds: proto (150,127302,127152) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:29:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6900506
Mar 27 2023 11:29:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14404911,13036887) ctrl (43,35) meta (0,0) rw (868,2712)
Mar 27 2023 11:29:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52849366 master 15788344 prole 34412737 non-replica 2608362
Mar 27 2023 11:29:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (36,480,54) active (2,2,0) complete-pct 75.85
Mar 27 2023 11:29:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11820803084 index-bytes 3382359424 set-index-bytes 0 sindex-bytes 8438443660 used-pct 68.81
Mar 27 2023 11:29:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195308960064 avail-pct 47 cache-read-pct 0.01
Mar 27 2023 11:29:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2653957,0,0,231410,0) write (2106540,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:29:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:29:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606715,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:29:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12534 respond (0,111651)
Mar 27 2023 11:29:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2885367 total) msec
Mar 27 2023 11:29:43 GMT: INFO (info): (hist.c:331) (00: 0002883854) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:29:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:29:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2106541 total) msec
Mar 27 2023 11:29:43 GMT: INFO (info): (hist.c:331) (00: 0001675900) (01: 0000403968) (02: 0000024015) (03: 0000002417)
Mar 27 2023 11:29:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:29:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:29:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:29:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:29:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 173 user-cpu-pct 137 kernel-cpu-pct 36 free-mem-kbytes 10651012 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:29:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 174 threads (11,64,39,30) heap-kbytes (13058658,13134988,14494208) heap-efficiency-pct 99.4
Mar 27 2023 11:29:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:29:53 GMT: INFO (info): (ticker.c:319) fds: proto (149,127302,127153) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:29:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6900773
Mar 27 2023 11:29:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14750499,14383083) ctrl (46,39) meta (0,0) rw (884,542)
Mar 27 2023 11:29:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52849697 master 15788664 prole 34412748 non-replica 2608362
Mar 27 2023 11:29:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (34,478,51) active (2,2,0) complete-pct 76.04
Mar 27 2023 11:29:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11818944576 index-bytes 3382380608 set-index-bytes 0 sindex-bytes 8436563968 used-pct 68.80
Mar 27 2023 11:29:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195309307920 avail-pct 47 cache-read-pct 0.03
Mar 27 2023 11:29:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2653957,0,0,231410,0) write (2106541,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:29:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:29:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606725,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:29:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12534 respond (0,111651)
Mar 27 2023 11:29:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2885367 total) msec
Mar 27 2023 11:29:53 GMT: INFO (info): (hist.c:331) (00: 0002883854) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:29:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:29:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2106542 total) msec
Mar 27 2023 11:29:53 GMT: INFO (info): (hist.c:331) (00: 0001675901) (01: 0000403968) (02: 0000024015) (03: 0000002417)
Mar 27 2023 11:29:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:29:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:29:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195309697664 free-wblocks 965938 write-q 0 write (430350,2.5) defrag-q 0 defrag-read (372144,2.0) defrag-write (124659,0.9)
Mar 27 2023 11:30:01 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (32550582,207555) total-ms 27050
Mar 27 2023 11:30:02 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:30:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:30:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:30:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 163 user-cpu-pct 129 kernel-cpu-pct 34 free-mem-kbytes 10650544 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:30:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 169 threads (11,64,39,30) heap-kbytes (13056725,13134244,14494208) heap-efficiency-pct 99.4
Mar 27 2023 11:30:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:30:03 GMT: INFO (info): (ticker.c:319) fds: proto (145,127302,127157) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:30:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6901040
Mar 27 2023 11:30:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14492523,14292536) ctrl (48,45) meta (0,0) rw (574822,623921)
Mar 27 2023 11:30:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52830031 master 15788958 prole 34412780 non-replica 2608358
Mar 27 2023 11:30:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (32,476,48) active (2,2,0) complete-pct 76.23
Mar 27 2023 11:30:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11816569608 index-bytes 3381121984 set-index-bytes 0 sindex-bytes 8435447624 used-pct 68.78
Mar 27 2023 11:30:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195234721312 avail-pct 47 cache-read-pct 2.97
Mar 27 2023 11:30:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2654387,0,0,231415,0) write (2106936,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:30:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:30:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606785,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:30:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12544 respond (0,111651)
Mar 27 2023 11:30:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2885802 total) msec
Mar 27 2023 11:30:03 GMT: INFO (info): (hist.c:331) (00: 0002884289) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:30:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:30:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2106937 total) msec
Mar 27 2023 11:30:03 GMT: INFO (info): (hist.c:331) (00: 0001676205) (01: 0000404058) (02: 0000024016) (03: 0000002417)
Mar 27 2023 11:30:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:30:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:30:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:30:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:30:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 171 user-cpu-pct 137 kernel-cpu-pct 34 free-mem-kbytes 10650400 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:30:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 174 threads (11,64,39,30) heap-kbytes (13057817,13134276,14494208) heap-efficiency-pct 99.4
Mar 27 2023 11:30:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:30:13 GMT: INFO (info): (ticker.c:319) fds: proto (145,127302,127157) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:30:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6901306
Mar 27 2023 11:30:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14582097,13324134) ctrl (48,45) meta (0,0) rw (3641,4361)
Mar 27 2023 11:30:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52830363 master 15789281 prole 34412789 non-replica 2608357
Mar 27 2023 11:30:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (30,474,45) active (2,2,0) complete-pct 76.42
Mar 27 2023 11:30:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11816402616 index-bytes 3381143232 set-index-bytes 0 sindex-bytes 8435259384 used-pct 68.78
Mar 27 2023 11:30:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195235066848 avail-pct 47 cache-read-pct 0.02
Mar 27 2023 11:30:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2654387,0,0,231415,0) write (2106939,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:30:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:30:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606800,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:30:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12544 respond (0,111651)
Mar 27 2023 11:30:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2885802 total) msec
Mar 27 2023 11:30:13 GMT: INFO (info): (hist.c:331) (00: 0002884289) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:30:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:30:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2106940 total) msec
Mar 27 2023 11:30:13 GMT: INFO (info): (hist.c:331) (00: 0001676208) (01: 0000404058) (02: 0000024016) (03: 0000002417)
Mar 27 2023 11:30:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:30:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:30:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195235271888 free-wblocks 966230 write-q 0 write (430360,0.5) defrag-q 0 defrag-read (372444,15.0) defrag-write (124662,0.2)
Mar 27 2023 11:30:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:30:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:30:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 168 user-cpu-pct 133 kernel-cpu-pct 35 free-mem-kbytes 10650180 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:30:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 175 threads (11,64,39,30) heap-kbytes (13056468,13131440,14492160) heap-efficiency-pct 99.4
Mar 27 2023 11:30:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:30:23 GMT: INFO (info): (ticker.c:319) fds: proto (144,127303,127159) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:30:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6901572
Mar 27 2023 11:30:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14661874,15644934) ctrl (44,37) meta (0,0) rw (4760,4532)
Mar 27 2023 11:30:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52830705 master 15789607 prole 34412805 non-replica 2588381
Mar 27 2023 11:30:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (28,473,42) active (2,3,0) complete-pct 76.56
Mar 27 2023 11:30:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11816052260 index-bytes 3381165120 set-index-bytes 0 sindex-bytes 8434887140 used-pct 68.78
Mar 27 2023 11:30:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195235468320 avail-pct 47 cache-read-pct 0.01
Mar 27 2023 11:30:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2654387,0,0,231415,0) write (2106942,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:30:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:30:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606818,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:30:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12544 respond (0,111651)
Mar 27 2023 11:30:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2885802 total) msec
Mar 27 2023 11:30:23 GMT: INFO (info): (hist.c:331) (00: 0002884289) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:30:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:30:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2106943 total) msec
Mar 27 2023 11:30:23 GMT: INFO (info): (hist.c:331) (00: 0001676211) (01: 0000404058) (02: 0000024016) (03: 0000002417)
Mar 27 2023 11:30:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:30:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:30:28 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (32611720,61138) total-ms 26629
Mar 27 2023 11:30:29 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:30:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:30:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:30:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 162 user-cpu-pct 126 kernel-cpu-pct 36 free-mem-kbytes 10647648 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:30:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 168 threads (11,64,39,30) heap-kbytes (13055630,13131112,14492160) heap-efficiency-pct 99.4
Mar 27 2023 11:30:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:30:33 GMT: INFO (info): (ticker.c:319) fds: proto (110,127356,127246) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:30:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6901839
Mar 27 2023 11:30:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14735810,17655798) ctrl (53,54) meta (0,0) rw (241098,251429)
Mar 27 2023 11:30:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52811130 master 15789932 prole 34412836 non-replica 2588381
Mar 27 2023 11:30:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (26,470,39) active (2,3,0) complete-pct 76.79
Mar 27 2023 11:30:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11813476460 index-bytes 3379912320 set-index-bytes 0 sindex-bytes 8433564140 used-pct 68.76
Mar 27 2023 11:30:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195161181520 avail-pct 47 cache-read-pct 2.19
Mar 27 2023 11:30:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2654822,0,0,231423,0) write (2107148,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:30:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:30:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606866,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:30:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12550 respond (0,111651)
Mar 27 2023 11:30:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2886245 total) msec
Mar 27 2023 11:30:33 GMT: INFO (info): (hist.c:331) (00: 0002884732) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:30:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:30:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2107149 total) msec
Mar 27 2023 11:30:33 GMT: INFO (info): (hist.c:331) (00: 0001676388) (01: 0000404086) (02: 0000024017) (03: 0000002417)
Mar 27 2023 11:30:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:30:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:30:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195161441808 free-wblocks 966517 write-q 0 write (430383,1.1) defrag-q 0 defrag-read (372754,15.5) defrag-write (124669,0.3)
Mar 27 2023 11:30:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:30:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:30:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 176 user-cpu-pct 138 kernel-cpu-pct 38 free-mem-kbytes 10647328 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:30:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 177 threads (11,64,39,30) heap-kbytes (13055920,13132552,14492160) heap-efficiency-pct 99.4
Mar 27 2023 11:30:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:30:43 GMT: INFO (info): (ticker.c:319) fds: proto (110,127356,127246) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:30:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6902106
Mar 27 2023 11:30:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14585352,17682334) ctrl (50,50) meta (0,0) rw (15004,18177)
Mar 27 2023 11:30:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52811458 master 15790236 prole 34412860 non-replica 2588374
Mar 27 2023 11:30:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (24,468,36) active (2,3,0) complete-pct 76.98
Mar 27 2023 11:30:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11812338988 index-bytes 3379933312 set-index-bytes 0 sindex-bytes 8432405676 used-pct 68.76
Mar 27 2023 11:30:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195161622064 avail-pct 47 cache-read-pct 0.11
Mar 27 2023 11:30:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2654835,0,0,231424,0) write (2107164,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:30:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:30:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606890,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:30:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12550 respond (0,111651)
Mar 27 2023 11:30:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2886259 total) msec
Mar 27 2023 11:30:43 GMT: INFO (info): (hist.c:331) (00: 0002884746) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:30:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:30:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2107165 total) msec
Mar 27 2023 11:30:43 GMT: INFO (info): (hist.c:331) (00: 0001676402) (01: 0000404088) (02: 0000024017) (03: 0000002417)
Mar 27 2023 11:30:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:30:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:30:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:30:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:30:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 168 user-cpu-pct 136 kernel-cpu-pct 32 free-mem-kbytes 10648572 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:30:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 172 threads (13,64,39,30) heap-kbytes (13057516,13132048,14492160) heap-efficiency-pct 99.4
Mar 27 2023 11:30:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:30:53 GMT: INFO (info): (ticker.c:319) fds: proto (112,127359,127247) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:30:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6902372
Mar 27 2023 11:30:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14299844,15093752) ctrl (28,35) meta (0,0) rw (4385,4264)
Mar 27 2023 11:30:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52811783 master 15790552 prole 34412869 non-replica 2568387
Mar 27 2023 11:30:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (24,466,36) active (4,3,0) complete-pct 77.07
Mar 27 2023 11:30:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11811711496 index-bytes 3379954112 set-index-bytes 0 sindex-bytes 8431757384 used-pct 68.75
Mar 27 2023 11:30:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195161998480 avail-pct 47 cache-read-pct 0.02
Mar 27 2023 11:30:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2654835,0,0,231424,0) write (2107169,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:30:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:30:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606905,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:30:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12551 respond (0,111651)
Mar 27 2023 11:30:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2886259 total) msec
Mar 27 2023 11:30:53 GMT: INFO (info): (hist.c:331) (00: 0002884746) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:30:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:30:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2107170 total) msec
Mar 27 2023 11:30:53 GMT: INFO (info): (hist.c:331) (00: 0001676407) (01: 0000404088) (02: 0000024017) (03: 0000002417)
Mar 27 2023 11:30:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:30:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:30:56 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (32726787,115067) total-ms 26831
Mar 27 2023 11:30:57 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:30:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195086602320 free-wblocks 966809 write-q 0 write (430390,0.3) defrag-q 0 defrag-read (373053,14.9) defrag-write (124671,0.1)
Mar 27 2023 11:31:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:31:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:31:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 150 user-cpu-pct 118 kernel-cpu-pct 32 free-mem-kbytes 10646700 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:31:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 161 threads (13,64,39,30) heap-kbytes (13056656,13131992,14492160) heap-efficiency-pct 99.4
Mar 27 2023 11:31:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:31:03 GMT: INFO (info): (ticker.c:319) fds: proto (111,127359,127248) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:31:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6902639
Mar 27 2023 11:31:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (13882658,14989582) ctrl (52,52) meta (0,0) rw (6842,5754)
Mar 27 2023 11:31:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52792122 master 15790856 prole 34412886 non-replica 2568387
Mar 27 2023 11:31:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (22,463,33) active (4,2,0) complete-pct 77.30
Mar 27 2023 11:31:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11809241156 index-bytes 3378695808 set-index-bytes 0 sindex-bytes 8430545348 used-pct 68.74
Mar 27 2023 11:31:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195086869232 avail-pct 47 cache-read-pct 0.07
Mar 27 2023 11:31:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2654843,0,0,231428,0) write (2107179,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:31:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:31:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606938,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:31:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12551 respond (0,111651)
Mar 27 2023 11:31:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2886271 total) msec
Mar 27 2023 11:31:03 GMT: INFO (info): (hist.c:331) (00: 0002884758) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:31:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:31:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2107180 total) msec
Mar 27 2023 11:31:03 GMT: INFO (info): (hist.c:331) (00: 0001676416) (01: 0000404089) (02: 0000024017) (03: 0000002417)
Mar 27 2023 11:31:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:31:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:31:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:31:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:31:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 161 user-cpu-pct 130 kernel-cpu-pct 31 free-mem-kbytes 10647664 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:31:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 170 threads (13,64,39,30) heap-kbytes (13055060,13131732,14492160) heap-efficiency-pct 99.4
Mar 27 2023 11:31:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:31:13 GMT: INFO (info): (ticker.c:319) fds: proto (111,127359,127248) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:31:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6902906
Mar 27 2023 11:31:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (13823468,14399384) ctrl (50,50) meta (0,0) rw (1779,2699)
Mar 27 2023 11:31:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52792376 master 15791099 prole 34412896 non-replica 2568384
Mar 27 2023 11:31:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (20,461,30) active (4,2,0) complete-pct 77.49
Mar 27 2023 11:31:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11808092096 index-bytes 3378712064 set-index-bytes 0 sindex-bytes 8429380032 used-pct 68.73
Mar 27 2023 11:31:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195087147872 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:31:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2654843,0,0,231428,0) write (2107181,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:31:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:31:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606953,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:31:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12551 respond (0,111651)
Mar 27 2023 11:31:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2886271 total) msec
Mar 27 2023 11:31:13 GMT: INFO (info): (hist.c:331) (00: 0002884758) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:31:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:31:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2107182 total) msec
Mar 27 2023 11:31:13 GMT: INFO (info): (hist.c:331) (00: 0001676418) (01: 0000404089) (02: 0000024017) (03: 0000002417)
Mar 27 2023 11:31:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:31:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:31:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195087310352 free-wblocks 966808 write-q 0 write (430392,0.1) defrag-q 0 defrag-read (373053,0.0) defrag-write (124671,0.0)
Mar 27 2023 11:31:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:31:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:31:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 166 user-cpu-pct 134 kernel-cpu-pct 32 free-mem-kbytes 10647908 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:31:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 173 threads (13,64,39,30) heap-kbytes (13055275,13129716,14492160) heap-efficiency-pct 99.4
Mar 27 2023 11:31:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:31:23 GMT: INFO (info): (ticker.c:319) fds: proto (111,127360,127249) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:31:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6903172
Mar 27 2023 11:31:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14158235,14203893) ctrl (50,50) meta (0,0) rw (2806,5405)
Mar 27 2023 11:31:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52792655 master 15791363 prole 34412911 non-replica 2568379
Mar 27 2023 11:31:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (18,459,27) active (4,2,0) complete-pct 77.68
Mar 27 2023 11:31:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11807730324 index-bytes 3378729920 set-index-bytes 0 sindex-bytes 8429000404 used-pct 68.73
Mar 27 2023 11:31:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195087499328 avail-pct 47 cache-read-pct 0.02
Mar 27 2023 11:31:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2654843,0,0,231428,0) write (2107184,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:31:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:31:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606974,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:31:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12551 respond (0,111651)
Mar 27 2023 11:31:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2886271 total) msec
Mar 27 2023 11:31:23 GMT: INFO (info): (hist.c:331) (00: 0002884758) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:31:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:31:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2107185 total) msec
Mar 27 2023 11:31:23 GMT: INFO (info): (hist.c:331) (00: 0001676421) (01: 0000404089) (02: 0000024017) (03: 0000002417)
Mar 27 2023 11:31:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:31:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:31:24 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (32823554,96767) total-ms 27031
Mar 27 2023 11:31:25 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:31:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:31:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:31:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 153 user-cpu-pct 121 kernel-cpu-pct 32 free-mem-kbytes 10646316 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:31:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 160 threads (13,64,39,30) heap-kbytes (13055096,13129248,14492160) heap-efficiency-pct 99.4
Mar 27 2023 11:31:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:31:33 GMT: INFO (info): (ticker.c:319) fds: proto (110,127360,127250) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:31:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6903439
Mar 27 2023 11:31:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (13742617,13157293) ctrl (42,32) meta (0,0) rw (1330,2529)
Mar 27 2023 11:31:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52772972 master 15791664 prole 34412921 non-replica 2568379
Mar 27 2023 11:31:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (16,458,24) active (4,3,0) complete-pct 77.82
Mar 27 2023 11:31:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11806487616 index-bytes 3377470208 set-index-bytes 0 sindex-bytes 8429017408 used-pct 68.72
Mar 27 2023 11:31:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195012392064 avail-pct 47 cache-read-pct 0.01
Mar 27 2023 11:31:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2654843,0,0,231428,0) write (2107185,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:31:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:31:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1606989,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:31:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12551 respond (0,111651)
Mar 27 2023 11:31:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2886271 total) msec
Mar 27 2023 11:31:33 GMT: INFO (info): (hist.c:331) (00: 0002884758) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:31:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:31:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2107186 total) msec
Mar 27 2023 11:31:33 GMT: INFO (info): (hist.c:331) (00: 0001676422) (01: 0000404089) (02: 0000024017) (03: 0000002417)
Mar 27 2023 11:31:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:31:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:31:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195012586384 free-wblocks 967101 write-q 0 write (430394,0.1) defrag-q 0 defrag-read (373348,14.8) defrag-write (124671,0.0)
Mar 27 2023 11:31:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:31:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:31:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 168 user-cpu-pct 135 kernel-cpu-pct 33 free-mem-kbytes 10647236 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:31:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 173 threads (13,64,39,30) heap-kbytes (13055078,13129848,14492160) heap-efficiency-pct 99.4
Mar 27 2023 11:31:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:31:43 GMT: INFO (info): (ticker.c:319) fds: proto (55,127364,127309) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:31:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6903705
Mar 27 2023 11:31:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (13971230,16280797) ctrl (48,45) meta (0,0) rw (7011,15534)
Mar 27 2023 11:31:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52773278 master 15791949 prole 34412942 non-replica 2568379
Mar 27 2023 11:31:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (14,456,21) active (4,3,0) complete-pct 78.01
Mar 27 2023 11:31:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11806531588 index-bytes 3377489792 set-index-bytes 0 sindex-bytes 8429041796 used-pct 68.72
Mar 27 2023 11:31:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195012823264 avail-pct 47 cache-read-pct 0.07
Mar 27 2023 11:31:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2654854,0,0,231432,0) write (2107199,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:31:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:31:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607021,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:31:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12551 respond (0,111651)
Mar 27 2023 11:31:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2886286 total) msec
Mar 27 2023 11:31:43 GMT: INFO (info): (hist.c:331) (00: 0002884773) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:31:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:31:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2107200 total) msec
Mar 27 2023 11:31:43 GMT: INFO (info): (hist.c:331) (00: 0001676435) (01: 0000404090) (02: 0000024017) (03: 0000002417)
Mar 27 2023 11:31:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:31:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:31:52 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (32823586,32) total-ms 26499
Mar 27 2023 11:31:53 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:31:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:31:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:31:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 155 user-cpu-pct 123 kernel-cpu-pct 32 free-mem-kbytes 10647132 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:31:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 162 threads (11,64,39,30) heap-kbytes (13051085,13125500,14492160) heap-efficiency-pct 99.4
Mar 27 2023 11:31:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:31:53 GMT: INFO (info): (ticker.c:319) fds: proto (20,127365,127345) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:31:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6903972
Mar 27 2023 11:31:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14647419,13159161) ctrl (26,23) meta (0,0) rw (6229,15814)
Mar 27 2023 11:31:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52773616 master 15792279 prole 34412958 non-replica 2568377
Mar 27 2023 11:31:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (12,455,18) active (2,2,0) complete-pct 78.15
Mar 27 2023 11:31:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11806572224 index-bytes 3377511424 set-index-bytes 0 sindex-bytes 8429060800 used-pct 68.72
Mar 27 2023 11:31:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195013236368 avail-pct 47 cache-read-pct 0.07
Mar 27 2023 11:31:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2654858,0,0,231433,0) write (2107207,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:31:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:31:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607058,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:31:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12551 respond (0,111651)
Mar 27 2023 11:31:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2886291 total) msec
Mar 27 2023 11:31:53 GMT: INFO (info): (hist.c:331) (00: 0002884778) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:31:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:31:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2107208 total) msec
Mar 27 2023 11:31:53 GMT: INFO (info): (hist.c:331) (00: 0001676443) (01: 0000404090) (02: 0000024017) (03: 0000002417)
Mar 27 2023 11:31:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:31:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:31:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195013495504 free-wblocks 967093 write-q 0 write (430438,2.2) defrag-q 0 defrag-read (373382,1.7) defrag-write (124686,0.8)
Mar 27 2023 11:32:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:32:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:32:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 167 user-cpu-pct 137 kernel-cpu-pct 30 free-mem-kbytes 10647876 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:32:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 170 threads (11,64,39,30) heap-kbytes (13052732,13128000,14492160) heap-efficiency-pct 99.4
Mar 27 2023 11:32:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:32:03 GMT: INFO (info): (ticker.c:319) fds: proto (92,127438,127346) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:32:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6904238
Mar 27 2023 11:32:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14901588,8468492) ctrl (48,45) meta (0,0) rw (447739,488194)
Mar 27 2023 11:32:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52773986 master 15792614 prole 34412993 non-replica 2568374
Mar 27 2023 11:32:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (10,453,15) active (2,2,0) complete-pct 78.33
Mar 27 2023 11:32:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11806615268 index-bytes 3377535104 set-index-bytes 0 sindex-bytes 8429080164 used-pct 68.72
Mar 27 2023 11:32:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195013699744 avail-pct 47 cache-read-pct 3.84
Mar 27 2023 11:32:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2655667,0,0,231448,0) write (2107567,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:32:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:32:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607134,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:32:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:32:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2887115 total) msec
Mar 27 2023 11:32:03 GMT: INFO (info): (hist.c:331) (00: 0002885602) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:32:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:32:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2107568 total) msec
Mar 27 2023 11:32:03 GMT: INFO (info): (hist.c:331) (00: 0001676755) (01: 0000404138) (02: 0000024017) (03: 0000002417)
Mar 27 2023 11:32:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:32:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:32:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:32:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:32:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 166 user-cpu-pct 136 kernel-cpu-pct 30 free-mem-kbytes 10647548 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:32:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 171 threads (11,64,39,30) heap-kbytes (13053665,13128836,14492160) heap-efficiency-pct 99.4
Mar 27 2023 11:32:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:32:13 GMT: INFO (info): (ticker.c:319) fds: proto (93,127439,127346) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:32:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6904505
Mar 27 2023 11:32:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14924436,12900623) ctrl (44,37) meta (0,0) rw (3648,1821)
Mar 27 2023 11:32:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52774271 master 15792889 prole 34413003 non-replica 2568373
Mar 27 2023 11:32:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (8,452,12) active (2,3,0) complete-pct 78.47
Mar 27 2023 11:32:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11806652256 index-bytes 3377553344 set-index-bytes 0 sindex-bytes 8429098912 used-pct 68.72
Mar 27 2023 11:32:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195013988944 avail-pct 47 cache-read-pct 0.01
Mar 27 2023 11:32:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2655667,0,0,231448,0) write (2107571,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:32:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:32:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607151,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:32:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:32:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2887115 total) msec
Mar 27 2023 11:32:13 GMT: INFO (info): (hist.c:331) (00: 0002885602) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:32:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:32:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2107572 total) msec
Mar 27 2023 11:32:13 GMT: INFO (info): (hist.c:331) (00: 0001676759) (01: 0000404138) (02: 0000024017) (03: 0000002417)
Mar 27 2023 11:32:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:32:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:32:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195014180800 free-wblocks 967092 write-q 0 write (430441,0.2) defrag-q 0 defrag-read (373383,0.1) defrag-write (124686,0.0)
Mar 27 2023 11:32:19 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (32823613,27) total-ms 26492
Mar 27 2023 11:32:20 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:32:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:32:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:32:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 153 user-cpu-pct 122 kernel-cpu-pct 31 free-mem-kbytes 10647068 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:32:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 161 threads (11,64,39,30) heap-kbytes (13052627,13127540,14492160) heap-efficiency-pct 99.4
Mar 27 2023 11:32:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:32:23 GMT: INFO (info): (ticker.c:319) fds: proto (92,127439,127347) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:32:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6904772
Mar 27 2023 11:32:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14711898,12991835) ctrl (47,43) meta (0,0) rw (887,5262)
Mar 27 2023 11:32:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52774580 master 15793184 prole 34413019 non-replica 2568370
Mar 27 2023 11:32:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (6,450,9) active (2,2,0) complete-pct 78.66
Mar 27 2023 11:32:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11806691804 index-bytes 3377573120 set-index-bytes 0 sindex-bytes 8429118684 used-pct 68.72
Mar 27 2023 11:32:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195014328016 avail-pct 47 cache-read-pct 0.01
Mar 27 2023 11:32:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2655667,0,0,231448,0) write (2107572,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:32:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:32:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607171,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:32:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:32:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2887115 total) msec
Mar 27 2023 11:32:23 GMT: INFO (info): (hist.c:331) (00: 0002885602) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:32:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:32:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2107573 total) msec
Mar 27 2023 11:32:23 GMT: INFO (info): (hist.c:331) (00: 0001676760) (01: 0000404138) (02: 0000024017) (03: 0000002417)
Mar 27 2023 11:32:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:32:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:32:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:32:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:32:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 173 user-cpu-pct 135 kernel-cpu-pct 38 free-mem-kbytes 10648324 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:32:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 181 threads (11,64,39,30) heap-kbytes (13051133,13125980,14492160) heap-efficiency-pct 99.4
Mar 27 2023 11:32:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:32:33 GMT: INFO (info): (ticker.c:319) fds: proto (94,127441,127347) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:32:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6905038
Mar 27 2023 11:32:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14502795,19875656) ctrl (51,52) meta (0,0) rw (235858,274786)
Mar 27 2023 11:32:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52774904 master 15793472 prole 34413055 non-replica 2568367
Mar 27 2023 11:32:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (4,448,6) active (2,3,0) complete-pct 78.85
Mar 27 2023 11:32:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11806735544 index-bytes 3377593856 set-index-bytes 0 sindex-bytes 8429141688 used-pct 68.72
Mar 27 2023 11:32:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195014712416 avail-pct 47 cache-read-pct 1.67
Mar 27 2023 11:32:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2655920,0,0,231451,0) write (2107791,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:32:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:32:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607225,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:32:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:32:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2887371 total) msec
Mar 27 2023 11:32:33 GMT: INFO (info): (hist.c:331) (00: 0002885858) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:32:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:32:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2107792 total) msec
Mar 27 2023 11:32:33 GMT: INFO (info): (hist.c:331) (00: 0001676948) (01: 0000404166) (02: 0000024019) (03: 0000002418)
Mar 27 2023 11:32:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:32:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:32:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195014898880 free-wblocks 967088 write-q 0 write (430466,1.2) defrag-q 0 defrag-read (373402,0.9) defrag-write (124695,0.4)
Mar 27 2023 11:32:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:32:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:32:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 173 user-cpu-pct 135 kernel-cpu-pct 38 free-mem-kbytes 10647524 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:32:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 176 threads (11,64,39,30) heap-kbytes (13050934,13125644,14492160) heap-efficiency-pct 99.4
Mar 27 2023 11:32:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:32:43 GMT: INFO (info): (ticker.c:319) fds: proto (96,127443,127347) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:32:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6905304
Mar 27 2023 11:32:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14898207,16759208) ctrl (52,52) meta (0,0) rw (4490,2523)
Mar 27 2023 11:32:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52775255 master 15793573 prole 34413305 non-replica 2568363
Mar 27 2023 11:32:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (2,445,3) active (2,2,0) complete-pct 79.08
Mar 27 2023 11:32:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11806777704 index-bytes 3377616320 set-index-bytes 0 sindex-bytes 8429161384 used-pct 68.72
Mar 27 2023 11:32:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195015144256 avail-pct 47 cache-read-pct 0.02
Mar 27 2023 11:32:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2655920,0,0,231451,0) write (2107796,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:32:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:32:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607243,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:32:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:32:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2887371 total) msec
Mar 27 2023 11:32:43 GMT: INFO (info): (hist.c:331) (00: 0002885858) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:32:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:32:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2107797 total) msec
Mar 27 2023 11:32:43 GMT: INFO (info): (hist.c:331) (00: 0001676953) (01: 0000404166) (02: 0000024019) (03: 0000002418)
Mar 27 2023 11:32:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:32:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:32:47 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (32823655,42) total-ms 26717
Mar 27 2023 11:32:48 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:32:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:32:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:32:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 136 user-cpu-pct 112 kernel-cpu-pct 24 free-mem-kbytes 10647968 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:32:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 147 threads (9,64,39,30) heap-kbytes (13046708,13121184,14492160) heap-efficiency-pct 99.4
Mar 27 2023 11:32:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:32:53 GMT: INFO (info): (ticker.c:319) fds: proto (95,127443,127348) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:32:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6905572
Mar 27 2023 11:32:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (8896998,18218751) ctrl (38,52) meta (0,0) rw (54,4067)
Mar 27 2023 11:32:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52775592 master 15793573 prole 34413649 non-replica 2548371
Mar 27 2023 11:32:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,443,0) active (0,3,0) complete-pct 79.27
Mar 27 2023 11:32:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11806123276 index-bytes 3377637888 set-index-bytes 0 sindex-bytes 8428485388 used-pct 68.72
Mar 27 2023 11:32:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195015489824 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:32:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2655920,0,0,231451,0) write (2107796,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:32:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:32:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607255,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:32:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:32:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2887371 total) msec
Mar 27 2023 11:32:53 GMT: INFO (info): (hist.c:331) (00: 0002885858) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:32:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:32:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2107797 total) msec
Mar 27 2023 11:32:53 GMT: INFO (info): (hist.c:331) (00: 0001676953) (01: 0000404166) (02: 0000024019) (03: 0000002418)
Mar 27 2023 11:32:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:32:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:32:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 195015698336 free-wblocks 967086 write-q 0 write (430469,0.2) defrag-q 0 defrag-read (373403,0.1) defrag-write (124695,0.0)
Mar 27 2023 11:33:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:33:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:33:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 117 user-cpu-pct 106 kernel-cpu-pct 11 free-mem-kbytes 10647380 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:33:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 127 threads (9,64,39,30) heap-kbytes (13038011,13115028,14492160) heap-efficiency-pct 99.4
Mar 27 2023 11:33:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:33:03 GMT: INFO (info): (ticker.c:319) fds: proto (94,127443,127349) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:33:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6905838
Mar 27 2023 11:33:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (153422,18827922) ctrl (17,37) meta (0,0) rw (3694,2054)
Mar 27 2023 11:33:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52775935 master 15793577 prole 34413988 non-replica 2528368
Mar 27 2023 11:33:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,440,0) active (0,2,0) complete-pct 79.41
Mar 27 2023 11:33:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11803910732 index-bytes 3377659840 set-index-bytes 0 sindex-bytes 8426250892 used-pct 68.71
Mar 27 2023 11:33:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 195015909376 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:33:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2655920,0,0,231451,0) write (2107800,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:33:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:33:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607270,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:33:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:33:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2887371 total) msec
Mar 27 2023 11:33:03 GMT: INFO (info): (hist.c:331) (00: 0002885858) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:33:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:33:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2107801 total) msec
Mar 27 2023 11:33:03 GMT: INFO (info): (hist.c:331) (00: 0001676957) (01: 0000404166) (02: 0000024019) (03: 0000002418)
Mar 27 2023 11:33:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:33:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:33:10 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (33009832,186177) total-ms 22351
Mar 27 2023 11:33:11 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:33:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:33:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:33:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 105 user-cpu-pct 96 kernel-cpu-pct 9 free-mem-kbytes 10647368 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:33:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 117 threads (9,64,39,30) heap-kbytes (13029878,13105768,14488064) heap-efficiency-pct 99.4
Mar 27 2023 11:33:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:33:13 GMT: INFO (info): (ticker.c:319) fds: proto (88,127444,127356) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:33:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6906104
Mar 27 2023 11:33:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (149327,18360135) ctrl (10,23) meta (0,0) rw (3515,2556)
Mar 27 2023 11:33:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52756258 master 15793579 prole 34414306 non-replica 2528368
Mar 27 2023 11:33:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,439,0) active (0,4,0) complete-pct 79.46
Mar 27 2023 11:33:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11800390140 index-bytes 3376400512 set-index-bytes 0 sindex-bytes 8423989628 used-pct 68.69
Mar 27 2023 11:33:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194941472048 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:33:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2655920,0,0,231451,0) write (2107802,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:33:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:33:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607281,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:33:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:33:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2887371 total) msec
Mar 27 2023 11:33:13 GMT: INFO (info): (hist.c:331) (00: 0002885858) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:33:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:33:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2107803 total) msec
Mar 27 2023 11:33:13 GMT: INFO (info): (hist.c:331) (00: 0001676959) (01: 0000404166) (02: 0000024019) (03: 0000002418)
Mar 27 2023 11:33:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:33:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:33:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 194941751936 free-wblocks 967375 write-q 0 write (430472,0.2) defrag-q 0 defrag-read (373695,14.6) defrag-write (124695,0.0)
Mar 27 2023 11:33:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:33:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:33:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 121 user-cpu-pct 108 kernel-cpu-pct 13 free-mem-kbytes 10649996 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:33:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 135 threads (9,64,39,30) heap-kbytes (13024140,13098892,14488064) heap-efficiency-pct 99.4
Mar 27 2023 11:33:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:33:23 GMT: INFO (info): (ticker.c:319) fds: proto (83,127444,127361) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:33:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6906371
Mar 27 2023 11:33:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (194391,23725980) ctrl (22,51) meta (0,0) rw (4054,4307)
Mar 27 2023 11:33:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52756627 master 15793582 prole 34414672 non-replica 2528363
Mar 27 2023 11:33:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,436,0) active (0,5,0) complete-pct 79.60
Mar 27 2023 11:33:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11799251756 index-bytes 3376424128 set-index-bytes 0 sindex-bytes 8422827628 used-pct 68.68
Mar 27 2023 11:33:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194942015968 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:33:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2655920,0,0,231451,0) write (2107805,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:33:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:33:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607299,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:33:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:33:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2887371 total) msec
Mar 27 2023 11:33:23 GMT: INFO (info): (hist.c:331) (00: 0002885858) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:33:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:33:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2107806 total) msec
Mar 27 2023 11:33:23 GMT: INFO (info): (hist.c:331) (00: 0001676962) (01: 0000404166) (02: 0000024019) (03: 0000002418)
Mar 27 2023 11:33:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:33:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:33:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:33:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:33:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 121 user-cpu-pct 108 kernel-cpu-pct 13 free-mem-kbytes 10650372 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:33:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 133 threads (9,64,39,30) heap-kbytes (13022180,13096372,14488064) heap-efficiency-pct 99.4
Mar 27 2023 11:33:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:33:33 GMT: INFO (info): (ticker.c:319) fds: proto (80,127506,127426) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:33:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6906638
Mar 27 2023 11:33:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (186217,22960381) ctrl (15,31) meta (0,0) rw (298654,330817)
Mar 27 2023 11:33:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52756966 master 15793585 prole 34415008 non-replica 2528363
Mar 27 2023 11:33:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,433,0) active (0,4,0) complete-pct 79.74
Mar 27 2023 11:33:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11799296560 index-bytes 3376445824 set-index-bytes 0 sindex-bytes 8422850736 used-pct 68.68
Mar 27 2023 11:33:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194942505056 avail-pct 47 cache-read-pct 60.87
Mar 27 2023 11:33:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2656167,0,0,231452,0) write (2108055,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:33:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:33:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607334,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:33:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:33:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2887619 total) msec
Mar 27 2023 11:33:33 GMT: INFO (info): (hist.c:331) (00: 0002886106) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:33:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:33:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108056 total) msec
Mar 27 2023 11:33:33 GMT: INFO (info): (hist.c:331) (00: 0001677163) (01: 0000404212) (02: 0000024021) (03: 0000002419)
Mar 27 2023 11:33:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:33:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:33:34 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (33079652,69820) total-ms 22195
Mar 27 2023 11:33:35 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:33:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 194868921824 free-wblocks 967657 write-q 0 write (430506,1.7) defrag-q 0 defrag-read (374010,15.8) defrag-write (124706,0.6)
Mar 27 2023 11:33:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:33:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:33:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 101 user-cpu-pct 94 kernel-cpu-pct 7 free-mem-kbytes 10651044 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:33:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 109 threads (9,64,39,30) heap-kbytes (13021945,13096040,14488064) heap-efficiency-pct 99.4
Mar 27 2023 11:33:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:33:43 GMT: INFO (info): (ticker.c:319) fds: proto (81,127507,127426) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:33:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6906904
Mar 27 2023 11:33:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (108624,13115228) ctrl (12,24) meta (0,0) rw (1566,3066)
Mar 27 2023 11:33:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52737301 master 15793587 prole 34415346 non-replica 2528363
Mar 27 2023 11:33:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,430,0) active (0,2,0) complete-pct 79.88
Mar 27 2023 11:33:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11798058132 index-bytes 3375187264 set-index-bytes 0 sindex-bytes 8422870868 used-pct 68.67
Mar 27 2023 11:33:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194869101328 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:33:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2656167,0,0,231452,0) write (2108057,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:33:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:33:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607345,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:33:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:33:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2887619 total) msec
Mar 27 2023 11:33:43 GMT: INFO (info): (hist.c:331) (00: 0002886106) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:33:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:33:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108058 total) msec
Mar 27 2023 11:33:43 GMT: INFO (info): (hist.c:331) (00: 0001677165) (01: 0000404212) (02: 0000024021) (03: 0000002419)
Mar 27 2023 11:33:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:33:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:33:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:33:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:33:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 108 user-cpu-pct 103 kernel-cpu-pct 5 free-mem-kbytes 10649936 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:33:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 115 threads (9,64,39,30) heap-kbytes (13021560,13094288,14488064) heap-efficiency-pct 99.4
Mar 27 2023 11:33:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:33:53 GMT: INFO (info): (ticker.c:319) fds: proto (79,127507,127428) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:33:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6907171
Mar 27 2023 11:33:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (82987,10103893) ctrl (13,29) meta (0,0) rw (2758,3440)
Mar 27 2023 11:33:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52737636 master 15793589 prole 34415679 non-replica 2508327
Mar 27 2023 11:33:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,428,0) active (0,2,0) complete-pct 79.97
Mar 27 2023 11:33:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11797706380 index-bytes 3375208704 set-index-bytes 0 sindex-bytes 8422497676 used-pct 68.67
Mar 27 2023 11:33:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194869452528 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:33:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2656167,0,0,231452,0) write (2108059,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:33:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:33:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607357,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:33:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:33:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2887619 total) msec
Mar 27 2023 11:33:53 GMT: INFO (info): (hist.c:331) (00: 0002886106) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:33:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:33:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108060 total) msec
Mar 27 2023 11:33:53 GMT: INFO (info): (hist.c:331) (00: 0001677167) (01: 0000404212) (02: 0000024021) (03: 0000002419)
Mar 27 2023 11:33:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:33:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:33:56 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (33097777,18125) total-ms 21466
Mar 27 2023 11:33:57 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:33:58 GMT: INFO (info): (thr_info.c:3840) latencies command: unrecognized histogram: {Settlement}-query
Mar 27 2023 11:33:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 194869636032 free-wblocks 967655 write-q 0 write (430508,0.1) defrag-q 0 defrag-read (374010,0.0) defrag-write (124706,0.0)
Mar 27 2023 11:34:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:34:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:34:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 101 user-cpu-pct 93 kernel-cpu-pct 8 free-mem-kbytes 10649896 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:34:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 109 threads (9,64,39,30) heap-kbytes (13020629,13094228,14488064) heap-efficiency-pct 99.4
Mar 27 2023 11:34:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:34:03 GMT: INFO (info): (ticker.c:319) fds: proto (78,127508,127430) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:34:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6907438
Mar 27 2023 11:34:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (104473,12692677) ctrl (7,16) meta (0,0) rw (3324,4257)
Mar 27 2023 11:34:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52737957 master 15793592 prole 34416002 non-replica 2508327
Mar 27 2023 11:34:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,427,0) active (0,3,0) complete-pct 80.02
Mar 27 2023 11:34:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11796766028 index-bytes 3375229248 set-index-bytes 0 sindex-bytes 8421536780 used-pct 68.67
Mar 27 2023 11:34:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194869850288 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:34:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2656167,0,0,231452,0) write (2108062,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:34:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:34:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607376,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:34:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:34:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2887619 total) msec
Mar 27 2023 11:34:03 GMT: INFO (info): (hist.c:331) (00: 0002886106) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:34:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:34:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108063 total) msec
Mar 27 2023 11:34:03 GMT: INFO (info): (hist.c:331) (00: 0001677170) (01: 0000404212) (02: 0000024021) (03: 0000002419)
Mar 27 2023 11:34:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:34:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:34:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:34:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:34:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 111 user-cpu-pct 103 kernel-cpu-pct 8 free-mem-kbytes 10649624 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:34:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 120 threads (9,64,39,30) heap-kbytes (13019176,13094184,14488064) heap-efficiency-pct 99.4
Mar 27 2023 11:34:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:34:13 GMT: INFO (info): (ticker.c:319) fds: proto (79,127509,127430) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:34:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6907704
Mar 27 2023 11:34:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (114176,13791954) ctrl (11,24) meta (0,0) rw (3052,3374)
Mar 27 2023 11:34:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52738285 master 15793595 prole 34416327 non-replica 2508327
Mar 27 2023 11:34:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,425,0) active (0,3,0) complete-pct 80.11
Mar 27 2023 11:34:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11795378204 index-bytes 3375250240 set-index-bytes 0 sindex-bytes 8420127964 used-pct 68.66
Mar 27 2023 11:34:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194870241120 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:34:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2656167,0,0,231452,0) write (2108065,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:34:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:34:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607389,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:34:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:34:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2887619 total) msec
Mar 27 2023 11:34:13 GMT: INFO (info): (hist.c:331) (00: 0002886106) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:34:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:34:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108066 total) msec
Mar 27 2023 11:34:13 GMT: INFO (info): (hist.c:331) (00: 0001677173) (01: 0000404212) (02: 0000024021) (03: 0000002419)
Mar 27 2023 11:34:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:34:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:34:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 194870440992 free-wblocks 967652 write-q 0 write (430511,0.2) defrag-q 0 defrag-read (374010,0.0) defrag-write (124706,0.0)
Mar 27 2023 11:34:19 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (33239307,141530) total-ms 22176
Mar 27 2023 11:34:20 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:34:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:34:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:34:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 99 user-cpu-pct 93 kernel-cpu-pct 6 free-mem-kbytes 10649172 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:34:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 110 threads (9,64,39,30) heap-kbytes (13017501,13091380,14481920) heap-efficiency-pct 99.4
Mar 27 2023 11:34:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:34:23 GMT: INFO (info): (ticker.c:319) fds: proto (77,127509,127432) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:34:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6907971
Mar 27 2023 11:34:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (117446,14496291) ctrl (10,25) meta (0,0) rw (944,2584)
Mar 27 2023 11:34:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52718576 master 15793596 prole 34416653 non-replica 2488321
Mar 27 2023 11:34:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,424,0) active (0,3,0) complete-pct 80.16
Mar 27 2023 11:34:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11792395888 index-bytes 3373988864 set-index-bytes 0 sindex-bytes 8418407024 used-pct 68.64
Mar 27 2023 11:34:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194796594944 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:34:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2656167,0,0,231452,0) write (2108066,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:34:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:34:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607399,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:34:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:34:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2887619 total) msec
Mar 27 2023 11:34:23 GMT: INFO (info): (hist.c:331) (00: 0002886106) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:34:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:34:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108067 total) msec
Mar 27 2023 11:34:23 GMT: INFO (info): (hist.c:331) (00: 0001677174) (01: 0000404212) (02: 0000024021) (03: 0000002419)
Mar 27 2023 11:34:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:34:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:34:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:34:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:34:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 112 user-cpu-pct 104 kernel-cpu-pct 8 free-mem-kbytes 10649312 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:34:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 124 threads (9,64,39,30) heap-kbytes (13016020,13091388,14481920) heap-efficiency-pct 99.4
Mar 27 2023 11:34:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:34:33 GMT: INFO (info): (ticker.c:319) fds: proto (80,127574,127494) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:34:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6908238
Mar 27 2023 11:34:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (117573,14432165) ctrl (13,29) meta (0,0) rw (279135,278484)
Mar 27 2023 11:34:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52718932 master 15793605 prole 34417000 non-replica 2488319
Mar 27 2023 11:34:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,422,0) active (0,3,0) complete-pct 80.25
Mar 27 2023 11:34:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11791260000 index-bytes 3374011648 set-index-bytes 0 sindex-bytes 8417248352 used-pct 68.63
Mar 27 2023 11:34:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194796958384 avail-pct 47 cache-read-pct 76.35
Mar 27 2023 11:34:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2656666,0,0,231461,0) write (2108314,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:34:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:34:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607455,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:34:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:34:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2888127 total) msec
Mar 27 2023 11:34:33 GMT: INFO (info): (hist.c:331) (00: 0002886614) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:34:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:34:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108315 total) msec
Mar 27 2023 11:34:33 GMT: INFO (info): (hist.c:331) (00: 0001677383) (01: 0000404250) (02: 0000024021) (03: 0000002420)
Mar 27 2023 11:34:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:34:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:34:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 194797128080 free-wblocks 967938 write-q 0 write (430536,1.2) defrag-q 0 defrag-read (374321,15.6) defrag-write (124715,0.4)
Mar 27 2023 11:34:42 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (33380285,140978) total-ms 21836
Mar 27 2023 11:34:43 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:34:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:34:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:34:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 102 user-cpu-pct 95 kernel-cpu-pct 7 free-mem-kbytes 10649304 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:34:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 111 threads (9,64,39,30) heap-kbytes (13013933,13088204,14481920) heap-efficiency-pct 99.4
Mar 27 2023 11:34:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:34:43 GMT: INFO (info): (ticker.c:319) fds: proto (80,127574,127494) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:34:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6908504
Mar 27 2023 11:34:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (119182,14484938) ctrl (13,29) meta (0,0) rw (4104,532)
Mar 27 2023 11:34:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52699247 master 15793610 prole 34417316 non-replica 2468297
Mar 27 2023 11:34:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,420,0) active (0,3,0) complete-pct 80.35
Mar 27 2023 11:34:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11787998612 index-bytes 3372751808 set-index-bytes 0 sindex-bytes 8415246804 used-pct 68.62
Mar 27 2023 11:34:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194723254368 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:34:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2656666,0,0,231461,0) write (2108319,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:34:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:34:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607470,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:34:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:34:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2888127 total) msec
Mar 27 2023 11:34:43 GMT: INFO (info): (hist.c:331) (00: 0002886614) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:34:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:34:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108320 total) msec
Mar 27 2023 11:34:43 GMT: INFO (info): (hist.c:331) (00: 0001677388) (01: 0000404250) (02: 0000024021) (03: 0000002420)
Mar 27 2023 11:34:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:34:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:34:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:34:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:34:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 114 user-cpu-pct 105 kernel-cpu-pct 9 free-mem-kbytes 10648600 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:34:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 123 threads (9,64,39,30) heap-kbytes (13011797,13088256,14481920) heap-efficiency-pct 99.4
Mar 27 2023 11:34:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:34:53 GMT: INFO (info): (ticker.c:319) fds: proto (80,127575,127495) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:34:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6908770
Mar 27 2023 11:34:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (132097,15957362) ctrl (13,29) meta (0,0) rw (3406,3461)
Mar 27 2023 11:34:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52699572 master 15793614 prole 34417637 non-replica 2448293
Mar 27 2023 11:34:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,418,0) active (0,3,0) complete-pct 80.44
Mar 27 2023 11:34:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11785804708 index-bytes 3372772608 set-index-bytes 0 sindex-bytes 8413032100 used-pct 68.60
Mar 27 2023 11:34:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194723682800 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:34:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2656666,0,0,231461,0) write (2108323,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:34:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:34:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607487,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:34:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:34:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2888127 total) msec
Mar 27 2023 11:34:53 GMT: INFO (info): (hist.c:331) (00: 0002886614) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:34:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:34:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108324 total) msec
Mar 27 2023 11:34:53 GMT: INFO (info): (hist.c:331) (00: 0001677392) (01: 0000404250) (02: 0000024021) (03: 0000002420)
Mar 27 2023 11:34:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:34:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:34:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 194723950752 free-wblocks 968225 write-q 0 write (430541,0.2) defrag-q 0 defrag-read (374613,14.6) defrag-write (124716,0.1)
Mar 27 2023 11:35:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:35:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:35:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 112 user-cpu-pct 105 kernel-cpu-pct 7 free-mem-kbytes 10649040 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:35:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 119 threads (9,64,39,30) heap-kbytes (13009600,13085352,14481920) heap-efficiency-pct 99.4
Mar 27 2023 11:35:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:35:03 GMT: INFO (info): (ticker.c:319) fds: proto (81,127576,127495) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:35:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6909037
Mar 27 2023 11:35:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (104256,12743640) ctrl (10,22) meta (0,0) rw (36156,26939)
Mar 27 2023 11:35:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52699904 master 15793618 prole 34417965 non-replica 2448292
Mar 27 2023 11:35:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,416,0) active (0,2,0) complete-pct 80.53
Mar 27 2023 11:35:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11783528040 index-bytes 3372793856 set-index-bytes 0 sindex-bytes 8410734184 used-pct 68.59
Mar 27 2023 11:35:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194724101552 avail-pct 47 cache-read-pct 91.02
Mar 27 2023 11:35:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2656733,0,0,231463,0) write (2108363,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:35:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:35:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607513,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:35:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:35:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2888196 total) msec
Mar 27 2023 11:35:03 GMT: INFO (info): (hist.c:331) (00: 0002886683) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:35:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:35:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108364 total) msec
Mar 27 2023 11:35:03 GMT: INFO (info): (hist.c:331) (00: 0001677431) (01: 0000404251) (02: 0000024021) (03: 0000002420)
Mar 27 2023 11:35:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:35:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:35:05 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (33575449,195164) total-ms 21730
Mar 27 2023 11:35:06 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:35:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:35:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:35:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 98 user-cpu-pct 92 kernel-cpu-pct 6 free-mem-kbytes 10648520 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:35:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 106 threads (9,64,39,30) heap-kbytes (13009123,13083984,14481920) heap-efficiency-pct 99.4
Mar 27 2023 11:35:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:35:13 GMT: INFO (info): (ticker.c:319) fds: proto (82,127577,127495) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:35:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6909304
Mar 27 2023 11:35:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (86455,10679474) ctrl (8,16) meta (0,0) rw (7350,1887)
Mar 27 2023 11:35:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52680228 master 15793623 prole 34418308 non-replica 2448292
Mar 27 2023 11:35:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,414,0) active (0,1,0) complete-pct 80.63
Mar 27 2023 11:35:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11781747656 index-bytes 3371534592 set-index-bytes 0 sindex-bytes 8410213064 used-pct 68.58
Mar 27 2023 11:35:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194650139520 avail-pct 47 cache-read-pct 100.00
Mar 27 2023 11:35:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2656736,0,0,231463,0) write (2108370,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:35:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:35:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607526,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:35:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:35:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2888199 total) msec
Mar 27 2023 11:35:13 GMT: INFO (info): (hist.c:331) (00: 0002886686) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:35:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:35:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108371 total) msec
Mar 27 2023 11:35:13 GMT: INFO (info): (hist.c:331) (00: 0001677438) (01: 0000404251) (02: 0000024021) (03: 0000002420)
Mar 27 2023 11:35:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:35:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:35:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 194650327504 free-wblocks 968513 write-q 0 write (430544,0.2) defrag-q 0 defrag-read (374904,14.6) defrag-write (124716,0.0)
Mar 27 2023 11:35:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:35:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:35:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 110 user-cpu-pct 104 kernel-cpu-pct 6 free-mem-kbytes 10648256 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:35:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 116 threads (9,64,39,30) heap-kbytes (13009094,13083972,14481920) heap-efficiency-pct 99.4
Mar 27 2023 11:35:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:35:23 GMT: INFO (info): (ticker.c:319) fds: proto (82,127578,127496) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:35:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6909570
Mar 27 2023 11:35:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (90107,10890578) ctrl (9,22) meta (0,0) rw (2601,4153)
Mar 27 2023 11:35:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52680564 master 15793625 prole 34418642 non-replica 2448291
Mar 27 2023 11:35:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,413,0) active (0,2,0) complete-pct 80.67
Mar 27 2023 11:35:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11781789036 index-bytes 3371556096 set-index-bytes 0 sindex-bytes 8410232940 used-pct 68.58
Mar 27 2023 11:35:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194650523024 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:35:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2656736,0,0,231463,0) write (2108372,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:35:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:35:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607537,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:35:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:35:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2888199 total) msec
Mar 27 2023 11:35:23 GMT: INFO (info): (hist.c:331) (00: 0002886686) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:35:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:35:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108373 total) msec
Mar 27 2023 11:35:23 GMT: INFO (info): (hist.c:331) (00: 0001677440) (01: 0000404251) (02: 0000024021) (03: 0000002420)
Mar 27 2023 11:35:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:35:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:35:27 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (33591982,16533) total-ms 21306
Mar 27 2023 11:35:28 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:35:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:35:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:35:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 107 user-cpu-pct 96 kernel-cpu-pct 11 free-mem-kbytes 10648116 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:35:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 116 threads (9,64,39,30) heap-kbytes (13009208,13084076,14479872) heap-efficiency-pct 99.4
Mar 27 2023 11:35:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:35:33 GMT: INFO (info): (ticker.c:319) fds: proto (54,127580,127526) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:35:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6909836
Mar 27 2023 11:35:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (148778,18106361) ctrl (14,31) meta (0,0) rw (55073,59707)
Mar 27 2023 11:35:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52660913 master 15793631 prole 34418990 non-replica 2448291
Mar 27 2023 11:35:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,411,0) active (0,3,0) complete-pct 80.77
Mar 27 2023 11:35:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11780548556 index-bytes 3370298432 set-index-bytes 0 sindex-bytes 8410250124 used-pct 68.57
Mar 27 2023 11:35:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194576569872 avail-pct 47 cache-read-pct 81.89
Mar 27 2023 11:35:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2656768,0,0,231466,0) write (2108403,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:35:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:35:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607571,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:35:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:35:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2888234 total) msec
Mar 27 2023 11:35:33 GMT: INFO (info): (hist.c:331) (00: 0002886721) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:35:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:35:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108404 total) msec
Mar 27 2023 11:35:33 GMT: INFO (info): (hist.c:331) (00: 0001677465) (01: 0000404256) (02: 0000024022) (03: 0000002420)
Mar 27 2023 11:35:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:35:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:35:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 194576786880 free-wblocks 968799 write-q 0 write (430553,0.4) defrag-q 0 defrag-read (375199,14.8) defrag-write (124718,0.1)
Mar 27 2023 11:35:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:35:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:35:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 114 user-cpu-pct 104 kernel-cpu-pct 10 free-mem-kbytes 10647364 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:35:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 126 threads (9,64,39,30) heap-kbytes (13009158,13084076,14479872) heap-efficiency-pct 99.4
Mar 27 2023 11:35:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:35:43 GMT: INFO (info): (ticker.c:319) fds: proto (54,127580,127526) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:35:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6910104
Mar 27 2023 11:35:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (153366,18679310) ctrl (15,31) meta (0,0) rw (1193,4317)
Mar 27 2023 11:35:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52661235 master 15793632 prole 34419311 non-replica 2448291
Mar 27 2023 11:35:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,408,0) active (0,2,0) complete-pct 80.91
Mar 27 2023 11:35:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11780591400 index-bytes 3370319040 set-index-bytes 0 sindex-bytes 8410272360 used-pct 68.57
Mar 27 2023 11:35:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194576938352 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:35:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2656768,0,0,231466,0) write (2108404,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:35:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:35:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607585,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:35:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:35:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2888234 total) msec
Mar 27 2023 11:35:43 GMT: INFO (info): (hist.c:331) (00: 0002886721) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:35:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:35:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108405 total) msec
Mar 27 2023 11:35:43 GMT: INFO (info): (hist.c:331) (00: 0001677466) (01: 0000404256) (02: 0000024022) (03: 0000002420)
Mar 27 2023 11:35:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:35:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:35:50 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (33591988,6) total-ms 22068
Mar 27 2023 11:35:51 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:35:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:35:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:35:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 99 user-cpu-pct 93 kernel-cpu-pct 6 free-mem-kbytes 10648108 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:35:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 107 threads (9,64,39,30) heap-kbytes (13008799,13082364,14477824) heap-efficiency-pct 99.4
Mar 27 2023 11:35:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:35:53 GMT: INFO (info): (ticker.c:319) fds: proto (30,127581,127551) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:35:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6910370
Mar 27 2023 11:35:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (93198,11453600) ctrl (6,14) meta (0,0) rw (9238,5689)
Mar 27 2023 11:35:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52661549 master 15793637 prole 34419621 non-replica 2428265
Mar 27 2023 11:35:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,407,0) active (0,2,0) complete-pct 80.95
Mar 27 2023 11:35:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11780214912 index-bytes 3370339136 set-index-bytes 0 sindex-bytes 8409875776 used-pct 68.57
Mar 27 2023 11:35:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194577319968 avail-pct 47 cache-read-pct 80.00
Mar 27 2023 11:35:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2656772,0,0,231467,0) write (2108412,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:35:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:35:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607602,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:35:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:35:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2888239 total) msec
Mar 27 2023 11:35:53 GMT: INFO (info): (hist.c:331) (00: 0002886726) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:35:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:35:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108413 total) msec
Mar 27 2023 11:35:53 GMT: INFO (info): (hist.c:331) (00: 0001677474) (01: 0000404256) (02: 0000024022) (03: 0000002420)
Mar 27 2023 11:35:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:35:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:35:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 194577550304 free-wblocks 968794 write-q 0 write (430559,0.3) defrag-q 0 defrag-read (375200,0.1) defrag-write (124719,0.1)
Mar 27 2023 11:36:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:36:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:36:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 107 user-cpu-pct 102 kernel-cpu-pct 5 free-mem-kbytes 10648264 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:36:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 114 threads (9,64,39,30) heap-kbytes (13007624,13082436,14477824) heap-efficiency-pct 99.4
Mar 27 2023 11:36:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:36:03 GMT: INFO (info): (ticker.c:319) fds: proto (28,127581,127553) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:36:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6910636
Mar 27 2023 11:36:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (77992,9657199) ctrl (15,35) meta (0,0) rw (36080,31235)
Mar 27 2023 11:36:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52661900 master 15793641 prole 34419968 non-replica 2408224
Mar 27 2023 11:36:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,405,0) active (0,2,0) complete-pct 81.05
Mar 27 2023 11:36:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11778796372 index-bytes 3370361600 set-index-bytes 0 sindex-bytes 8408434772 used-pct 68.56
Mar 27 2023 11:36:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194577750992 avail-pct 47 cache-read-pct 84.67
Mar 27 2023 11:36:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2656804,0,0,231467,0) write (2108448,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:36:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:36:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607638,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:36:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:36:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2888271 total) msec
Mar 27 2023 11:36:03 GMT: INFO (info): (hist.c:331) (00: 0002886758) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:36:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:36:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108449 total) msec
Mar 27 2023 11:36:03 GMT: INFO (info): (hist.c:331) (00: 0001677504) (01: 0000404262) (02: 0000024022) (03: 0000002420)
Mar 27 2023 11:36:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:36:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:36:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:36:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:36:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 110 user-cpu-pct 103 kernel-cpu-pct 7 free-mem-kbytes 10648360 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:36:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 122 threads (9,64,39,30) heap-kbytes (13004259,13079544,14477824) heap-efficiency-pct 99.4
Mar 27 2023 11:36:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:36:13 GMT: INFO (info): (ticker.c:319) fds: proto (28,127581,127553) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:36:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6910904
Mar 27 2023 11:36:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (128219,15649931) ctrl (12,29) meta (0,0) rw (153,2352)
Mar 27 2023 11:36:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52662207 master 15793642 prole 34420274 non-replica 2388228
Mar 27 2023 11:36:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,404,0) active (0,4,0) complete-pct 81.09
Mar 27 2023 11:36:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11775470336 index-bytes 3370381248 set-index-bytes 0 sindex-bytes 8405089088 used-pct 68.54
Mar 27 2023 11:36:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194578076848 avail-pct 47 cache-read-pct 100.00
Mar 27 2023 11:36:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2656805,0,0,231468,0) write (2108449,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:36:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:36:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607648,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:36:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:36:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2888273 total) msec
Mar 27 2023 11:36:13 GMT: INFO (info): (hist.c:331) (00: 0002886760) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:36:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:36:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108450 total) msec
Mar 27 2023 11:36:13 GMT: INFO (info): (hist.c:331) (00: 0001677505) (01: 0000404262) (02: 0000024022) (03: 0000002420)
Mar 27 2023 11:36:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:36:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:36:13 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (33796295,204307) total-ms 22037
Mar 27 2023 11:36:14 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:36:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 194502815504 free-wblocks 969088 write-q 0 write (430562,0.2) defrag-q 0 defrag-read (375496,14.8) defrag-write (124719,0.0)
Mar 27 2023 11:36:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:36:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:36:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 106 user-cpu-pct 95 kernel-cpu-pct 11 free-mem-kbytes 10648484 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:36:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 117 threads (9,64,39,30) heap-kbytes (13001868,13077776,14477824) heap-efficiency-pct 99.4
Mar 27 2023 11:36:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:36:23 GMT: INFO (info): (ticker.c:319) fds: proto (25,127582,127557) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:36:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6911170
Mar 27 2023 11:36:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (159591,19577254) ctrl (17,37) meta (0,0) rw (970,1762)
Mar 27 2023 11:36:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52642542 master 15793643 prole 34420634 non-replica 2388225
Mar 27 2023 11:36:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,401,0) active (0,3,0) complete-pct 81.24
Mar 27 2023 11:36:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11771862480 index-bytes 3369122688 set-index-bytes 0 sindex-bytes 8402739792 used-pct 68.52
Mar 27 2023 11:36:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194503000384 avail-pct 47 cache-read-pct 33.33
Mar 27 2023 11:36:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2656805,0,0,231468,0) write (2108451,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:36:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:36:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607658,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:36:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:36:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2888273 total) msec
Mar 27 2023 11:36:23 GMT: INFO (info): (hist.c:331) (00: 0002886760) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:36:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:36:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108452 total) msec
Mar 27 2023 11:36:23 GMT: INFO (info): (hist.c:331) (00: 0001677507) (01: 0000404262) (02: 0000024022) (03: 0000002420)
Mar 27 2023 11:36:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:36:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:36:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:36:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:36:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 115 user-cpu-pct 107 kernel-cpu-pct 8 free-mem-kbytes 10648008 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:36:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 124 threads (9,64,39,30) heap-kbytes (12999955,13075932,14475776) heap-efficiency-pct 99.4
Mar 27 2023 11:36:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:36:33 GMT: INFO (info): (ticker.c:319) fds: proto (68,127629,127561) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:36:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6911436
Mar 27 2023 11:36:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (126709,15305012) ctrl (11,24) meta (0,0) rw (287823,293443)
Mar 27 2023 11:36:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52642883 master 15793656 prole 34420962 non-replica 2388225
Mar 27 2023 11:36:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,399,0) active (0,3,0) complete-pct 81.33
Mar 27 2023 11:36:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11770286280 index-bytes 3369144512 set-index-bytes 0 sindex-bytes 8401141768 used-pct 68.51
Mar 27 2023 11:36:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194503440160 avail-pct 47 cache-read-pct 73.94
Mar 27 2023 11:36:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2657095,0,0,231479,0) write (2108709,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:36:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:36:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607723,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:36:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:36:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2888574 total) msec
Mar 27 2023 11:36:33 GMT: INFO (info): (hist.c:331) (00: 0002887061) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:36:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:36:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108710 total) msec
Mar 27 2023 11:36:33 GMT: INFO (info): (hist.c:331) (00: 0001677731) (01: 0000404296) (02: 0000024022) (03: 0000002420)
Mar 27 2023 11:36:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:36:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:36:36 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (33977126,180831) total-ms 21746
Mar 27 2023 11:36:37 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:36:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 194352572288 free-wblocks 969675 write-q 0 write (430588,1.3) defrag-q 0 defrag-read (376107,30.5) defrag-write (124727,0.4)
Mar 27 2023 11:36:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:36:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:36:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 99 user-cpu-pct 93 kernel-cpu-pct 6 free-mem-kbytes 10647356 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:36:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 106 threads (9,64,39,30) heap-kbytes (12999587,13075200,14475776) heap-efficiency-pct 99.4
Mar 27 2023 11:36:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:36:43 GMT: INFO (info): (ticker.c:319) fds: proto (69,127630,127561) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:36:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6911702
Mar 27 2023 11:36:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (94447,11275177) ctrl (10,22) meta (0,0) rw (3286,4234)
Mar 27 2023 11:36:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52603215 master 15793659 prole 34421328 non-replica 2388223
Mar 27 2023 11:36:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,397,0) active (0,2,0) complete-pct 81.42
Mar 27 2023 11:36:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11767374516 index-bytes 3366605760 set-index-bytes 0 sindex-bytes 8400768756 used-pct 68.50
Mar 27 2023 11:36:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194352750912 avail-pct 47 cache-read-pct 80.00
Mar 27 2023 11:36:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2657095,0,0,231479,0) write (2108712,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:36:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:36:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607741,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:36:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:36:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2888574 total) msec
Mar 27 2023 11:36:43 GMT: INFO (info): (hist.c:331) (00: 0002887061) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:36:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:36:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108713 total) msec
Mar 27 2023 11:36:43 GMT: INFO (info): (hist.c:331) (00: 0001677734) (01: 0000404296) (02: 0000024022) (03: 0000002420)
Mar 27 2023 11:36:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:36:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:36:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:36:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:36:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 107 user-cpu-pct 102 kernel-cpu-pct 5 free-mem-kbytes 10647844 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:36:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 115 threads (9,64,39,30) heap-kbytes (12998398,13073236,14475776) heap-efficiency-pct 99.4
Mar 27 2023 11:36:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:36:53 GMT: INFO (info): (ticker.c:319) fds: proto (69,127631,127562) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:36:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6911970
Mar 27 2023 11:36:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (84242,10364273) ctrl (10,25) meta (0,0) rw (3226,2949)
Mar 27 2023 11:36:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52603550 master 15793661 prole 34421661 non-replica 2368172
Mar 27 2023 11:36:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,396,0) active (0,2,0) complete-pct 81.47
Mar 27 2023 11:36:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11766166916 index-bytes 3366627200 set-index-bytes 0 sindex-bytes 8399539716 used-pct 68.49
Mar 27 2023 11:36:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194353163152 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:36:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2657095,0,0,231479,0) write (2108714,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:36:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:36:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607750,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:36:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:36:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2888574 total) msec
Mar 27 2023 11:36:53 GMT: INFO (info): (hist.c:331) (00: 0002887061) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:36:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:36:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2108715 total) msec
Mar 27 2023 11:36:53 GMT: INFO (info): (hist.c:331) (00: 0001677736) (01: 0000404296) (02: 0000024022) (03: 0000002420)
Mar 27 2023 11:36:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:36:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:36:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 194353480944 free-wblocks 969669 write-q 0 write (430642,2.7) defrag-q 0 defrag-read (376150,2.2) defrag-write (124746,0.9)
Mar 27 2023 11:36:59 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (34080072,102946) total-ms 21911
Mar 27 2023 11:37:00 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:37:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:37:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:37:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 102 user-cpu-pct 95 kernel-cpu-pct 7 free-mem-kbytes 10647872 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:37:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 112 threads (9,64,39,30) heap-kbytes (12995439,13072572,14475776) heap-efficiency-pct 99.4
Mar 27 2023 11:37:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:37:03 GMT: INFO (info): (ticker.c:319) fds: proto (83,127645,127562) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:37:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6912236
Mar 27 2023 11:37:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (97563,11751760) ctrl (13,33) meta (0,0) rw (595026,645674)
Mar 27 2023 11:37:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52603908 master 15793681 prole 34422002 non-replica 2348146
Mar 27 2023 11:37:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,395,0) active (0,3,0) complete-pct 81.52
Mar 27 2023 11:37:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11763615940 index-bytes 3366650112 set-index-bytes 0 sindex-bytes 8396965828 used-pct 68.47
Mar 27 2023 11:37:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194353639536 avail-pct 47 cache-read-pct 67.58
Mar 27 2023 11:37:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2657624,0,0,231498,0) write (2109227,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:37:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:37:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607860,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:37:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:37:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2889122 total) msec
Mar 27 2023 11:37:03 GMT: INFO (info): (hist.c:331) (00: 0002887609) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:37:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:37:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2109228 total) msec
Mar 27 2023 11:37:03 GMT: INFO (info): (hist.c:331) (00: 0001678181) (01: 0000404361) (02: 0000024025) (03: 0000002420)
Mar 27 2023 11:37:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:37:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:37:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:37:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:37:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 110 user-cpu-pct 104 kernel-cpu-pct 6 free-mem-kbytes 10647296 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:37:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 121 threads (9,64,39,30) heap-kbytes (12992658,13069528,14475776) heap-efficiency-pct 99.4
Mar 27 2023 11:37:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:37:13 GMT: INFO (info): (ticker.c:319) fds: proto (84,127646,127562) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:37:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6912502
Mar 27 2023 11:37:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (118345,14256760) ctrl (15,35) meta (0,0) rw (18022,12301)
Mar 27 2023 11:37:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52604230 master 15793688 prole 34422317 non-replica 2328048
Mar 27 2023 11:37:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,393,0) active (0,3,0) complete-pct 81.61
Mar 27 2023 11:37:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11760928220 index-bytes 3366670720 set-index-bytes 0 sindex-bytes 8394257500 used-pct 68.46
Mar 27 2023 11:37:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194354061824 avail-pct 47 cache-read-pct 86.54
Mar 27 2023 11:37:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2657640,0,0,231501,0) write (2109245,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:37:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:37:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607883,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:37:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:37:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2889141 total) msec
Mar 27 2023 11:37:13 GMT: INFO (info): (hist.c:331) (00: 0002887628) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:37:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:37:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2109246 total) msec
Mar 27 2023 11:37:13 GMT: INFO (info): (hist.c:331) (00: 0001678197) (01: 0000404362) (02: 0000024026) (03: 0000002420)
Mar 27 2023 11:37:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:37:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:37:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 194354291680 free-wblocks 969666 write-q 0 write (430646,0.2) defrag-q 0 defrag-read (376150,0.0) defrag-write (124746,0.0)
Mar 27 2023 11:37:22 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (34332016,251944) total-ms 22093
Mar 27 2023 11:37:23 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:37:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:37:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:37:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 103 user-cpu-pct 95 kernel-cpu-pct 8 free-mem-kbytes 10647172 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:37:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 111 threads (9,64,39,30) heap-kbytes (12990171,13066352,14473728) heap-efficiency-pct 99.4
Mar 27 2023 11:37:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:37:23 GMT: INFO (info): (ticker.c:319) fds: proto (83,127646,127563) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:37:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6912769
Mar 27 2023 11:37:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (116513,14499846) ctrl (13,29) meta (0,0) rw (4757,2879)
Mar 27 2023 11:37:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52564474 master 15793693 prole 34422635 non-replica 2328046
Mar 27 2023 11:37:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,391,0) active (0,3,0) complete-pct 81.70
Mar 27 2023 11:37:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11756000604 index-bytes 3364126336 set-index-bytes 0 sindex-bytes 8391874268 used-pct 68.43
Mar 27 2023 11:37:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194202262720 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:37:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2657640,0,0,231501,0) write (2109250,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:37:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:37:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607897,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:37:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:37:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2889141 total) msec
Mar 27 2023 11:37:23 GMT: INFO (info): (hist.c:331) (00: 0002887628) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:37:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:37:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2109251 total) msec
Mar 27 2023 11:37:23 GMT: INFO (info): (hist.c:331) (00: 0001678202) (01: 0000404362) (02: 0000024026) (03: 0000002420)
Mar 27 2023 11:37:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:37:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:37:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:37:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:37:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 115 user-cpu-pct 107 kernel-cpu-pct 8 free-mem-kbytes 10646400 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:37:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 124 threads (9,64,39,30) heap-kbytes (12988048,13062984,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:37:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:37:33 GMT: INFO (info): (ticker.c:319) fds: proto (121,127684,127563) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:37:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6913036
Mar 27 2023 11:37:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (118323,14169442) ctrl (12,27) meta (0,0) rw (559055,596724)
Mar 27 2023 11:37:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52564893 master 15793705 prole 34423042 non-replica 2307974
Mar 27 2023 11:37:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,389,0) active (0,2,0) complete-pct 81.80
Mar 27 2023 11:37:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11754296264 index-bytes 3364153152 set-index-bytes 0 sindex-bytes 8390143112 used-pct 68.42
Mar 27 2023 11:37:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194202804192 avail-pct 47 cache-read-pct 63.50
Mar 27 2023 11:37:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2658145,0,0,231511,0) write (2109726,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:37:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:37:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607973,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:37:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:37:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2889656 total) msec
Mar 27 2023 11:37:33 GMT: INFO (info): (hist.c:331) (00: 0002888143) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:37:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:37:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2109727 total) msec
Mar 27 2023 11:37:33 GMT: INFO (info): (hist.c:331) (00: 0001678601) (01: 0000404434) (02: 0000024029) (03: 0000002422)
Mar 27 2023 11:37:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:37:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:37:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 194203052000 free-wblocks 970259 write-q 0 write (430703,2.8) defrag-q 0 defrag-read (376796,32.3) defrag-write (124767,1.0)
Mar 27 2023 11:37:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:37:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:37:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 112 user-cpu-pct 104 kernel-cpu-pct 8 free-mem-kbytes 10647704 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:37:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 121 threads (9,64,39,30) heap-kbytes (12985800,13063056,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:37:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:37:43 GMT: INFO (info): (ticker.c:319) fds: proto (122,127685,127563) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:37:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6913302
Mar 27 2023 11:37:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (121144,14879172) ctrl (13,29) meta (0,0) rw (1774,1830)
Mar 27 2023 11:37:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52565240 master 15793707 prole 34423387 non-replica 2287897
Mar 27 2023 11:37:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,387,0) active (0,2,0) complete-pct 81.89
Mar 27 2023 11:37:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11752066648 index-bytes 3364175360 set-index-bytes 0 sindex-bytes 8387891288 used-pct 68.41
Mar 27 2023 11:37:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194203218640 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:37:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2658145,0,0,231511,0) write (2109728,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:37:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:37:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1607986,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:37:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:37:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2889656 total) msec
Mar 27 2023 11:37:43 GMT: INFO (info): (hist.c:331) (00: 0002888143) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:37:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:37:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2109729 total) msec
Mar 27 2023 11:37:43 GMT: INFO (info): (hist.c:331) (00: 0001678602) (01: 0000404435) (02: 0000024029) (03: 0000002422)
Mar 27 2023 11:37:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:37:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:37:45 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (34512454,180438) total-ms 22069
Mar 27 2023 11:37:46 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:37:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:37:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:37:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 101 user-cpu-pct 94 kernel-cpu-pct 7 free-mem-kbytes 10647668 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:37:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 111 threads (9,64,39,30) heap-kbytes (12983477,13059992,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:37:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:37:53 GMT: INFO (info): (ticker.c:319) fds: proto (123,127687,127564) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:37:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6913568
Mar 27 2023 11:37:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (120239,14706770) ctrl (13,29) meta (0,0) rw (8622,3511)
Mar 27 2023 11:37:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52545457 master 15793709 prole 34423702 non-replica 2287897
Mar 27 2023 11:37:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,385,0) active (0,2,0) complete-pct 81.98
Mar 27 2023 11:37:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11748532800 index-bytes 3362909248 set-index-bytes 0 sindex-bytes 8385623552 used-pct 68.39
Mar 27 2023 11:37:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194127671856 avail-pct 47 cache-read-pct 30.00
Mar 27 2023 11:37:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2658153,0,0,231511,0) write (2109732,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:37:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:37:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608000,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:37:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:37:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2889664 total) msec
Mar 27 2023 11:37:53 GMT: INFO (info): (hist.c:331) (00: 0002888151) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:37:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:37:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2109733 total) msec
Mar 27 2023 11:37:53 GMT: INFO (info): (hist.c:331) (00: 0001678605) (01: 0000404436) (02: 0000024029) (03: 0000002422)
Mar 27 2023 11:37:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:37:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:37:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 194127914912 free-wblocks 970550 write-q 0 write (430735,1.6) defrag-q 0 defrag-read (377117,16.0) defrag-write (124779,0.6)
Mar 27 2023 11:38:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:38:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:38:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 113 user-cpu-pct 106 kernel-cpu-pct 7 free-mem-kbytes 10649944 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:38:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 119 threads (9,64,39,30) heap-kbytes (12981583,13056928,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:38:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:38:03 GMT: INFO (info): (ticker.c:319) fds: proto (123,127687,127564) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:38:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6913836
Mar 27 2023 11:38:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (92048,11314236) ctrl (12,27) meta (0,0) rw (299282,340818)
Mar 27 2023 11:38:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52545813 master 15793716 prole 34424051 non-replica 2267840
Mar 27 2023 11:38:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,383,0) active (0,1,0) complete-pct 82.08
Mar 27 2023 11:38:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11747051880 index-bytes 3362932032 set-index-bytes 0 sindex-bytes 8384119848 used-pct 68.38
Mar 27 2023 11:38:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 194128104928 avail-pct 47 cache-read-pct 69.81
Mar 27 2023 11:38:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2658449,0,0,231517,0) write (2109993,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:38:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:38:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608055,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:38:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:38:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2889966 total) msec
Mar 27 2023 11:38:03 GMT: INFO (info): (hist.c:331) (00: 0002888453) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:38:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:38:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2109994 total) msec
Mar 27 2023 11:38:03 GMT: INFO (info): (hist.c:331) (00: 0001678828) (01: 0000404473) (02: 0000024029) (03: 0000002423)
Mar 27 2023 11:38:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:38:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:38:07 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (34678260,165806) total-ms 21116
Mar 27 2023 11:38:08 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:38:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:38:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:38:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 104 user-cpu-pct 95 kernel-cpu-pct 9 free-mem-kbytes 10648484 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:38:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 115 threads (9,64,39,30) heap-kbytes (12979234,13056848,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:38:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:38:13 GMT: INFO (info): (ticker.c:319) fds: proto (123,127688,127565) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:38:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6914102
Mar 27 2023 11:38:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (147064,17865239) ctrl (14,36) meta (0,0) rw (2764,6261)
Mar 27 2023 11:38:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52506001 master 15793719 prole 34424385 non-replica 2247741
Mar 27 2023 11:38:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,382,0) active (0,4,0) complete-pct 82.12
Mar 27 2023 11:38:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11742211760 index-bytes 3360384064 set-index-bytes 0 sindex-bytes 8381827696 used-pct 68.35
Mar 27 2023 11:38:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193978200720 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:38:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2658449,0,0,231517,0) write (2109996,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:38:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:38:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608072,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:38:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:38:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2889966 total) msec
Mar 27 2023 11:38:13 GMT: INFO (info): (hist.c:331) (00: 0002888453) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:38:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:38:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2109997 total) msec
Mar 27 2023 11:38:13 GMT: INFO (info): (hist.c:331) (00: 0001678831) (01: 0000404473) (02: 0000024029) (03: 0000002423)
Mar 27 2023 11:38:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:38:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:38:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 193978417312 free-wblocks 971135 write-q 0 write (430739,0.2) defrag-q 0 defrag-read (377705,29.4) defrag-write (124780,0.1)
Mar 27 2023 11:38:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:38:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:38:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 116 user-cpu-pct 106 kernel-cpu-pct 10 free-mem-kbytes 10649460 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:38:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 129 threads (9,64,39,30) heap-kbytes (12977156,13053828,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:38:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:38:23 GMT: INFO (info): (ticker.c:319) fds: proto (122,127688,127566) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:38:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6914368
Mar 27 2023 11:38:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (153626,18645673) ctrl (10,22) meta (0,0) rw (2533,4102)
Mar 27 2023 11:38:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52506321 master 15793722 prole 34424702 non-replica 2247739
Mar 27 2023 11:38:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,380,0) active (0,3,0) complete-pct 82.22
Mar 27 2023 11:38:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11740148460 index-bytes 3360404544 set-index-bytes 0 sindex-bytes 8379743916 used-pct 68.34
Mar 27 2023 11:38:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193978608288 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:38:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2658449,0,0,231517,0) write (2109999,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:38:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:38:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608091,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:38:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:38:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2889966 total) msec
Mar 27 2023 11:38:23 GMT: INFO (info): (hist.c:331) (00: 0002888453) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:38:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:38:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2110000 total) msec
Mar 27 2023 11:38:23 GMT: INFO (info): (hist.c:331) (00: 0001678834) (01: 0000404473) (02: 0000024029) (03: 0000002423)
Mar 27 2023 11:38:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:38:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:38:30 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (34876678,198418) total-ms 21455
Mar 27 2023 11:38:31 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:38:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:38:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:38:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 97 user-cpu-pct 93 kernel-cpu-pct 4 free-mem-kbytes 10649384 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:38:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 104 threads (9,64,39,30) heap-kbytes (12975380,13050512,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:38:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:38:33 GMT: INFO (info): (ticker.c:319) fds: proto (98,127698,127600) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:38:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6914636
Mar 27 2023 11:38:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (63726,7777614) ctrl (14,29) meta (0,0) rw (274829,277082)
Mar 27 2023 11:38:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52486625 master 15793728 prole 34425057 non-replica 2227608
Mar 27 2023 11:38:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,377,0) active (0,1,0) complete-pct 82.36
Mar 27 2023 11:38:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11737158900 index-bytes 3359144000 set-index-bytes 0 sindex-bytes 8378014900 used-pct 68.32
Mar 27 2023 11:38:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193904991552 avail-pct 47 cache-read-pct 64.58
Mar 27 2023 11:38:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2658682,0,0,231521,0) write (2110229,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:38:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:38:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608129,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:38:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:38:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2890203 total) msec
Mar 27 2023 11:38:33 GMT: INFO (info): (hist.c:331) (00: 0002888690) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:38:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:38:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2110230 total) msec
Mar 27 2023 11:38:33 GMT: INFO (info): (hist.c:331) (00: 0001679004) (01: 0000404521) (02: 0000024040) (03: 0000002424)
Mar 27 2023 11:38:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:38:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:38:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 193905185648 free-wblocks 971417 write-q 0 write (430764,1.2) defrag-q 0 defrag-read (378011,15.3) defrag-write (124787,0.3)
Mar 27 2023 11:38:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:38:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:38:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 109 user-cpu-pct 104 kernel-cpu-pct 5 free-mem-kbytes 10648756 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:38:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 114 threads (9,64,39,30) heap-kbytes (12973656,13050488,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:38:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:38:43 GMT: INFO (info): (ticker.c:319) fds: proto (99,127699,127600) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:38:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6914902
Mar 27 2023 11:38:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (75302,9133049) ctrl (11,27) meta (0,0) rw (3584,5610)
Mar 27 2023 11:38:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52486964 master 15793730 prole 34425394 non-replica 2207508
Mar 27 2023 11:38:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,376,0) active (0,2,0) complete-pct 82.41
Mar 27 2023 11:38:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11735450976 index-bytes 3359165696 set-index-bytes 0 sindex-bytes 8376285280 used-pct 68.31
Mar 27 2023 11:38:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193905338912 avail-pct 47 cache-read-pct 50.00
Mar 27 2023 11:38:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2658682,0,0,231521,0) write (2110231,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:38:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:38:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608144,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:38:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:38:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2890203 total) msec
Mar 27 2023 11:38:43 GMT: INFO (info): (hist.c:331) (00: 0002888690) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:38:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:38:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2110232 total) msec
Mar 27 2023 11:38:43 GMT: INFO (info): (hist.c:331) (00: 0001679006) (01: 0000404521) (02: 0000024040) (03: 0000002424)
Mar 27 2023 11:38:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:38:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:38:51 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (35063373,186695) total-ms 20819
Mar 27 2023 11:38:52 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:38:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:38:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:38:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 101 user-cpu-pct 94 kernel-cpu-pct 7 free-mem-kbytes 10647432 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:38:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 109 threads (9,64,39,30) heap-kbytes (12970711,13047516,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:38:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:38:53 GMT: INFO (info): (ticker.c:319) fds: proto (75,127699,127624) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:38:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6915168
Mar 27 2023 11:38:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (105821,12882551) ctrl (11,27) meta (0,0) rw (3119,5219)
Mar 27 2023 11:38:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52447051 master 15793734 prole 34425709 non-replica 2207507
Mar 27 2023 11:38:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,375,0) active (0,3,0) complete-pct 82.45
Mar 27 2023 11:38:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11730023308 index-bytes 3356611264 set-index-bytes 0 sindex-bytes 8373412044 used-pct 68.28
Mar 27 2023 11:38:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193756562720 avail-pct 47 cache-read-pct 63.64
Mar 27 2023 11:38:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2658684,0,0,231522,0) write (2110236,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:38:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:38:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608163,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:38:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:38:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2890206 total) msec
Mar 27 2023 11:38:53 GMT: INFO (info): (hist.c:331) (00: 0002888693) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:38:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:38:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2110237 total) msec
Mar 27 2023 11:38:53 GMT: INFO (info): (hist.c:331) (00: 0001679011) (01: 0000404521) (02: 0000024040) (03: 0000002424)
Mar 27 2023 11:38:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:38:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:38:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 193756762208 free-wblocks 972000 write-q 0 write (430767,0.2) defrag-q 0 defrag-read (378597,29.3) defrag-write (124788,0.1)
Mar 27 2023 11:39:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:39:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:39:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 111 user-cpu-pct 104 kernel-cpu-pct 7 free-mem-kbytes 10647476 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:39:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 120 threads (9,64,39,30) heap-kbytes (12968947,13044300,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:39:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:39:03 GMT: INFO (info): (ticker.c:319) fds: proto (73,127699,127626) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:39:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6915435
Mar 27 2023 11:39:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (118302,14475940) ctrl (13,29) meta (0,0) rw (6024,1392)
Mar 27 2023 11:39:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52447415 master 15793742 prole 34426065 non-replica 2187356
Mar 27 2023 11:39:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,373,0) active (0,3,0) complete-pct 82.55
Mar 27 2023 11:39:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11728382764 index-bytes 3356634560 set-index-bytes 0 sindex-bytes 8371748204 used-pct 68.27
Mar 27 2023 11:39:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193756954928 avail-pct 47 cache-read-pct 100.00
Mar 27 2023 11:39:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2658686,0,0,231524,0) write (2110246,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:39:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:39:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608183,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:39:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:39:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2890210 total) msec
Mar 27 2023 11:39:03 GMT: INFO (info): (hist.c:331) (00: 0002888697) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:39:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:39:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2110247 total) msec
Mar 27 2023 11:39:03 GMT: INFO (info): (hist.c:331) (00: 0001679021) (01: 0000404521) (02: 0000024040) (03: 0000002424)
Mar 27 2023 11:39:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:39:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:39:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:39:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:39:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 110 user-cpu-pct 103 kernel-cpu-pct 7 free-mem-kbytes 10647096 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:39:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 121 threads (9,64,39,30) heap-kbytes (12967569,13044412,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:39:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:39:13 GMT: INFO (info): (ticker.c:319) fds: proto (74,127700,127626) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:39:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6915702
Mar 27 2023 11:39:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (117483,14267796) ctrl (6,13) meta (0,0) rw (3180,3023)
Mar 27 2023 11:39:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52447733 master 15793744 prole 34426381 non-replica 2187355
Mar 27 2023 11:39:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,372,0) active (0,2,0) complete-pct 82.59
Mar 27 2023 11:39:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11726932916 index-bytes 3356654912 set-index-bytes 0 sindex-bytes 8370278004 used-pct 68.26
Mar 27 2023 11:39:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193757373664 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:39:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2658686,0,0,231524,0) write (2110248,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:39:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:39:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608195,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:39:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:39:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2890210 total) msec
Mar 27 2023 11:39:13 GMT: INFO (info): (hist.c:331) (00: 0002888697) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:39:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:39:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2110249 total) msec
Mar 27 2023 11:39:13 GMT: INFO (info): (hist.c:331) (00: 0001679023) (01: 0000404521) (02: 0000024040) (03: 0000002424)
Mar 27 2023 11:39:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:39:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:39:14 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (35206168,142795) total-ms 21844
Mar 27 2023 11:39:15 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:39:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 193681386992 free-wblocks 972293 write-q 0 write (430771,0.2) defrag-q 0 defrag-read (378896,14.9) defrag-write (124789,0.1)
Mar 27 2023 11:39:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:39:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:39:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 96 user-cpu-pct 92 kernel-cpu-pct 4 free-mem-kbytes 10649312 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:39:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 103 threads (9,64,39,30) heap-kbytes (12966345,13044408,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:39:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:39:23 GMT: INFO (info): (ticker.c:319) fds: proto (68,127700,127632) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:39:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6915968
Mar 27 2023 11:39:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (68903,8441096) ctrl (16,36) meta (0,0) rw (2550,2948)
Mar 27 2023 11:39:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52427943 master 15793747 prole 34426689 non-replica 2187353
Mar 27 2023 11:39:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,370,0) active (0,3,0) complete-pct 82.69
Mar 27 2023 11:39:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11724511304 index-bytes 3355388352 set-index-bytes 0 sindex-bytes 8369122952 used-pct 68.25
Mar 27 2023 11:39:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193681513232 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:39:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2658686,0,0,231524,0) write (2110251,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:39:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:39:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608205,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:39:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:39:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2890210 total) msec
Mar 27 2023 11:39:23 GMT: INFO (info): (hist.c:331) (00: 0002888697) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:39:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:39:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2110252 total) msec
Mar 27 2023 11:39:23 GMT: INFO (info): (hist.c:331) (00: 0001679026) (01: 0000404521) (02: 0000024040) (03: 0000002424)
Mar 27 2023 11:39:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:39:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:39:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:39:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:39:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 115 user-cpu-pct 104 kernel-cpu-pct 11 free-mem-kbytes 10649172 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:39:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 125 threads (9,64,39,30) heap-kbytes (12966117,13043104,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:39:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:39:33 GMT: INFO (info): (ticker.c:319) fds: proto (98,127782,127684) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:39:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6916234
Mar 27 2023 11:39:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (135575,16393349) ctrl (11,27) meta (0,0) rw (319952,344559)
Mar 27 2023 11:39:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52428299 master 15793755 prole 34427037 non-replica 2187349
Mar 27 2023 11:39:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,369,0) active (0,4,0) complete-pct 82.73
Mar 27 2023 11:39:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11724272912 index-bytes 3355411136 set-index-bytes 0 sindex-bytes 8368861776 used-pct 68.24
Mar 27 2023 11:39:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193681993488 avail-pct 47 cache-read-pct 67.05
Mar 27 2023 11:39:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659018,0,0,231529,0) write (2110526,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:39:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:39:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608238,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:39:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:39:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2890547 total) msec
Mar 27 2023 11:39:33 GMT: INFO (info): (hist.c:331) (00: 0002889034) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:39:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:39:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2110527 total) msec
Mar 27 2023 11:39:33 GMT: INFO (info): (hist.c:331) (00: 0001679237) (01: 0000404583) (02: 0000024042) (03: 0000002424)
Mar 27 2023 11:39:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:39:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:39:37 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (35263082,56914) total-ms 21817
Mar 27 2023 11:39:38 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:39:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 193607492176 free-wblocks 972580 write-q 0 write (430805,1.7) defrag-q 0 defrag-read (379213,15.9) defrag-write (124801,0.6)
Mar 27 2023 11:39:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:39:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:39:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 103 user-cpu-pct 94 kernel-cpu-pct 9 free-mem-kbytes 10649684 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:39:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 114 threads (9,64,39,30) heap-kbytes (12966245,13043140,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:39:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:39:43 GMT: INFO (info): (ticker.c:319) fds: proto (99,127783,127684) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:39:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6916501
Mar 27 2023 11:39:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (134499,16349362) ctrl (14,29) meta (0,0) rw (8819,9771)
Mar 27 2023 11:39:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52408496 master 15793761 prole 34427380 non-replica 2187344
Mar 27 2023 11:39:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,366,0) active (0,2,0) complete-pct 82.87
Mar 27 2023 11:39:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11723033064 index-bytes 3354143744 set-index-bytes 0 sindex-bytes 8368889320 used-pct 68.24
Mar 27 2023 11:39:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193607702576 avail-pct 47 cache-read-pct 66.67
Mar 27 2023 11:39:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659023,0,0,231531,0) write (2110536,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:39:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:39:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608263,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:39:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:39:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2890554 total) msec
Mar 27 2023 11:39:43 GMT: INFO (info): (hist.c:331) (00: 0002889041) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:39:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:39:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2110537 total) msec
Mar 27 2023 11:39:43 GMT: INFO (info): (hist.c:331) (00: 0001679246) (01: 0000404584) (02: 0000024042) (03: 0000002424)
Mar 27 2023 11:39:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:39:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:39:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:39:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:39:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 111 user-cpu-pct 104 kernel-cpu-pct 7 free-mem-kbytes 10648044 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:39:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 122 threads (9,64,39,30) heap-kbytes (12966287,13043120,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:39:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:39:53 GMT: INFO (info): (ticker.c:319) fds: proto (98,127783,127685) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:39:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6916768
Mar 27 2023 11:39:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (121092,14701093) ctrl (13,29) meta (0,0) rw (1274,7238)
Mar 27 2023 11:39:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52408871 master 15793763 prole 34427753 non-replica 2187343
Mar 27 2023 11:39:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,364,0) active (0,2,0) complete-pct 82.97
Mar 27 2023 11:39:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11723079736 index-bytes 3354167744 set-index-bytes 0 sindex-bytes 8368911992 used-pct 68.24
Mar 27 2023 11:39:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193608104640 avail-pct 47 cache-read-pct 87.50
Mar 27 2023 11:39:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659024,0,0,231532,0) write (2110539,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:39:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:39:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608296,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:39:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:39:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2890556 total) msec
Mar 27 2023 11:39:53 GMT: INFO (info): (hist.c:331) (00: 0002889043) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:39:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:39:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2110540 total) msec
Mar 27 2023 11:39:53 GMT: INFO (info): (hist.c:331) (00: 0001679249) (01: 0000404584) (02: 0000024042) (03: 0000002424)
Mar 27 2023 11:39:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:39:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:39:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 193608323904 free-wblocks 972575 write-q 0 write (430860,2.8) defrag-q 0 defrag-read (379265,2.6) defrag-write (124821,1.0)
Mar 27 2023 11:40:00 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (35263134,52) total-ms 21636
Mar 27 2023 11:40:01 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:40:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:40:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:40:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 104 user-cpu-pct 96 kernel-cpu-pct 8 free-mem-kbytes 10647620 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:40:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 112 threads (9,64,39,30) heap-kbytes (12965873,13042700,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:40:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:40:03 GMT: INFO (info): (ticker.c:319) fds: proto (100,127785,127685) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:40:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6917034
Mar 27 2023 11:40:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (107489,13469627) ctrl (10,22) meta (0,0) rw (580456,609209)
Mar 27 2023 11:40:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52409240 master 15793772 prole 34428119 non-replica 2187343
Mar 27 2023 11:40:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,362,0) active (0,1,0) complete-pct 83.06
Mar 27 2023 11:40:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11723127664 index-bytes 3354191360 set-index-bytes 0 sindex-bytes 8368936304 used-pct 68.24
Mar 27 2023 11:40:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193608448928 avail-pct 47 cache-read-pct 64.77
Mar 27 2023 11:40:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659550,0,0,231540,0) write (2111034,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:40:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:40:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608348,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:40:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:40:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891090 total) msec
Mar 27 2023 11:40:03 GMT: INFO (info): (hist.c:331) (00: 0002889577) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:40:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:40:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111035 total) msec
Mar 27 2023 11:40:03 GMT: INFO (info): (hist.c:331) (00: 0001679654) (01: 0000404670) (02: 0000024046) (03: 0000002424)
Mar 27 2023 11:40:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:40:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:40:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:40:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:40:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 106 user-cpu-pct 102 kernel-cpu-pct 4 free-mem-kbytes 10647848 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:40:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 110 threads (9,64,39,30) heap-kbytes (12964606,13041296,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:40:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:40:13 GMT: INFO (info): (ticker.c:319) fds: proto (101,127786,127685) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:40:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6917301
Mar 27 2023 11:40:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (60561,7398459) ctrl (6,14) meta (0,0) rw (12882,9657)
Mar 27 2023 11:40:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52409593 master 15793776 prole 34428468 non-replica 2167617
Mar 27 2023 11:40:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,361,0) active (0,1,0) complete-pct 83.11
Mar 27 2023 11:40:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11721866100 index-bytes 3354213952 set-index-bytes 0 sindex-bytes 8367652148 used-pct 68.23
Mar 27 2023 11:40:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193608840272 avail-pct 47 cache-read-pct 78.38
Mar 27 2023 11:40:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659565,0,0,231541,0) write (2111045,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:40:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:40:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608364,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:40:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:40:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891106 total) msec
Mar 27 2023 11:40:13 GMT: INFO (info): (hist.c:331) (00: 0002889593) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:40:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:40:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111046 total) msec
Mar 27 2023 11:40:13 GMT: INFO (info): (hist.c:331) (00: 0001679662) (01: 0000404673) (02: 0000024046) (03: 0000002424)
Mar 27 2023 11:40:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:40:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:40:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 193609058064 free-wblocks 972574 write-q 0 write (430866,0.3) defrag-q 0 defrag-read (379267,0.1) defrag-write (124822,0.1)
Mar 27 2023 11:40:21 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (35365793,102659) total-ms 20732
Mar 27 2023 11:40:22 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:40:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:40:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:40:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 95 user-cpu-pct 92 kernel-cpu-pct 3 free-mem-kbytes 10647892 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:40:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 101 threads (9,64,39,30) heap-kbytes (12963205,13041328,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:40:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:40:23 GMT: INFO (info): (ticker.c:319) fds: proto (101,127787,127686) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:40:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6917568
Mar 27 2023 11:40:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (60803,7408042) ctrl (4,9) meta (0,0) rw (2608,2916)
Mar 27 2023 11:40:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52409902 master 15793779 prole 34428780 non-replica 2167617
Mar 27 2023 11:40:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,360,0) active (0,1,0) complete-pct 83.15
Mar 27 2023 11:40:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11720404236 index-bytes 3354233728 set-index-bytes 0 sindex-bytes 8366170508 used-pct 68.22
Mar 27 2023 11:40:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193609142336 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:40:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659565,0,0,231541,0) write (2111048,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:40:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:40:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608374,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:40:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:40:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891106 total) msec
Mar 27 2023 11:40:23 GMT: INFO (info): (hist.c:331) (00: 0002889593) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:40:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:40:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111049 total) msec
Mar 27 2023 11:40:23 GMT: INFO (info): (hist.c:331) (00: 0001679665) (01: 0000404673) (02: 0000024046) (03: 0000002424)
Mar 27 2023 11:40:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:40:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:40:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:40:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:40:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 111 user-cpu-pct 104 kernel-cpu-pct 7 free-mem-kbytes 10647316 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:40:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 117 threads (9,64,39,30) heap-kbytes (12963616,13041124,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:40:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:40:33 GMT: INFO (info): (ticker.c:319) fds: proto (98,127791,127693) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:40:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6917834
Mar 27 2023 11:40:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (85150,10348600) ctrl (11,27) meta (0,0) rw (255940,256541)
Mar 27 2023 11:40:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52410232 master 15793783 prole 34429106 non-replica 2167614
Mar 27 2023 11:40:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,359,0) active (0,2,0) complete-pct 83.20
Mar 27 2023 11:40:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11720102220 index-bytes 3354254848 set-index-bytes 0 sindex-bytes 8365847372 used-pct 68.22
Mar 27 2023 11:40:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193609497488 avail-pct 47 cache-read-pct 62.28
Mar 27 2023 11:40:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659852,0,0,231545,0) write (2111260,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:40:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:40:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608405,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:40:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:40:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891397 total) msec
Mar 27 2023 11:40:33 GMT: INFO (info): (hist.c:331) (00: 0002889884) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:40:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:40:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111261 total) msec
Mar 27 2023 11:40:33 GMT: INFO (info): (hist.c:331) (00: 0001679833) (01: 0000404713) (02: 0000024050) (03: 0000002424)
Mar 27 2023 11:40:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:40:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:40:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 193609688064 free-wblocks 972571 write-q 0 write (430891,1.2) defrag-q 0 defrag-read (379289,1.1) defrag-write (124831,0.4)
Mar 27 2023 11:40:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:40:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:40:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 111 user-cpu-pct 104 kernel-cpu-pct 7 free-mem-kbytes 10645760 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:40:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 117 threads (9,64,39,30) heap-kbytes (12963584,13041064,14471680) heap-efficiency-pct 99.4
Mar 27 2023 11:40:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:40:43 GMT: INFO (info): (ticker.c:319) fds: proto (98,127791,127693) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:40:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6918100
Mar 27 2023 11:40:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (94698,11576468) ctrl (4,9) meta (0,0) rw (5343,2517)
Mar 27 2023 11:40:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52410559 master 15793787 prole 34429429 non-replica 2167614
Mar 27 2023 11:40:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,358,0) active (0,2,0) complete-pct 83.25
Mar 27 2023 11:40:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11720136228 index-bytes 3354275776 set-index-bytes 0 sindex-bytes 8365860452 used-pct 68.22
Mar 27 2023 11:40:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193609897056 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:40:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659852,0,0,231545,0) write (2111264,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:40:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:40:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608415,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:40:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:40:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891397 total) msec
Mar 27 2023 11:40:43 GMT: INFO (info): (hist.c:331) (00: 0002889884) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:40:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:40:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111265 total) msec
Mar 27 2023 11:40:43 GMT: INFO (info): (hist.c:331) (00: 0001679837) (01: 0000404713) (02: 0000024050) (03: 0000002424)
Mar 27 2023 11:40:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:40:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:40:43 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (35389260,23467) total-ms 20814
Mar 27 2023 11:40:44 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:40:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:40:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:40:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 93 user-cpu-pct 91 kernel-cpu-pct 2 free-mem-kbytes 10646084 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:40:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 95 threads (9,64,39,30) heap-kbytes (12962868,13039296,14469632) heap-efficiency-pct 99.4
Mar 27 2023 11:40:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:40:53 GMT: INFO (info): (ticker.c:319) fds: proto (98,127792,127694) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:40:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6918368
Mar 27 2023 11:40:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (24793,2970903) ctrl (12,26) meta (0,0) rw (49803,48957)
Mar 27 2023 11:40:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52390956 master 15793792 prole 34429547 non-replica 2147868
Mar 27 2023 11:40:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,356,0) active (0,0,0) complete-pct 83.34
Mar 27 2023 11:40:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11717782772 index-bytes 3353021184 set-index-bytes 0 sindex-bytes 8364761588 used-pct 68.21
Mar 27 2023 11:40:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193535413632 avail-pct 47 cache-read-pct 80.91
Mar 27 2023 11:40:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659941,0,0,231548,0) write (2111316,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:40:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:40:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608444,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:40:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:40:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891489 total) msec
Mar 27 2023 11:40:53 GMT: INFO (info): (hist.c:331) (00: 0002889976) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:40:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:40:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111317 total) msec
Mar 27 2023 11:40:53 GMT: INFO (info): (hist.c:331) (00: 0001679878) (01: 0000404724) (02: 0000024050) (03: 0000002424)
Mar 27 2023 11:40:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:40:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:40:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 193535500624 free-wblocks 972863 write-q 0 write (430895,0.2) defrag-q 0 defrag-read (379585,14.8) defrag-write (124832,0.1)
Mar 27 2023 11:41:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:41:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:41:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 104 user-cpu-pct 102 kernel-cpu-pct 2 free-mem-kbytes 10647020 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:41:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 108 threads (9,64,39,30) heap-kbytes (12961184,13039232,14469632) heap-efficiency-pct 99.4
Mar 27 2023 11:41:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:41:03 GMT: INFO (info): (ticker.c:319) fds: proto (96,127792,127696) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:41:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6918634
Mar 27 2023 11:41:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (42566,5143038) ctrl (4,12) meta (0,0) rw (1208,1251)
Mar 27 2023 11:41:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52391181 master 15793793 prole 34429771 non-replica 2147868
Mar 27 2023 11:41:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,356,0) active (0,1,0) complete-pct 83.34
Mar 27 2023 11:41:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11716110752 index-bytes 3353035584 set-index-bytes 0 sindex-bytes 8363075168 used-pct 68.20
Mar 27 2023 11:41:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193535622576 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:41:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659941,0,0,231548,0) write (2111317,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:41:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:41:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608450,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:41:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:41:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891489 total) msec
Mar 27 2023 11:41:03 GMT: INFO (info): (hist.c:331) (00: 0002889976) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:41:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:41:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111318 total) msec
Mar 27 2023 11:41:03 GMT: INFO (info): (hist.c:331) (00: 0001679879) (01: 0000404724) (02: 0000024050) (03: 0000002424)
Mar 27 2023 11:41:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:41:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:41:05 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (35508642,119382) total-ms 20486
Mar 27 2023 11:41:06 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:41:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:41:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:41:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 95 user-cpu-pct 92 kernel-cpu-pct 3 free-mem-kbytes 10647772 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:41:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 98 threads (9,64,39,30) heap-kbytes (12960853,13037748,14469632) heap-efficiency-pct 99.4
Mar 27 2023 11:41:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:41:13 GMT: INFO (info): (ticker.c:319) fds: proto (96,127792,127696) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:41:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6918900
Mar 27 2023 11:41:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (43592,5234334) ctrl (6,14) meta (0,0) rw (1585,1671)
Mar 27 2023 11:41:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52391445 master 15793795 prole 34430036 non-replica 2147868
Mar 27 2023 11:41:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,355,0) active (0,1,0) complete-pct 83.39
Mar 27 2023 11:41:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11715806028 index-bytes 3353052480 set-index-bytes 0 sindex-bytes 8362753548 used-pct 68.19
Mar 27 2023 11:41:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193535852208 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:41:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659941,0,0,231548,0) write (2111319,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:41:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:41:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608461,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:41:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:41:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891489 total) msec
Mar 27 2023 11:41:13 GMT: INFO (info): (hist.c:331) (00: 0002889976) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:41:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:41:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111320 total) msec
Mar 27 2023 11:41:13 GMT: INFO (info): (hist.c:331) (00: 0001679881) (01: 0000404724) (02: 0000024050) (03: 0000002424)
Mar 27 2023 11:41:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:41:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:41:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 193536092048 free-wblocks 972860 write-q 0 write (430898,0.2) defrag-q 0 defrag-read (379585,0.0) defrag-write (124832,0.0)
Mar 27 2023 11:41:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:41:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:41:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 108 user-cpu-pct 103 kernel-cpu-pct 5 free-mem-kbytes 10647124 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:41:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 114 threads (9,64,39,30) heap-kbytes (12960997,13037876,14469632) heap-efficiency-pct 99.4
Mar 27 2023 11:41:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:41:23 GMT: INFO (info): (ticker.c:319) fds: proto (90,127793,127703) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:41:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6919167
Mar 27 2023 11:41:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (79620,9764875) ctrl (4,9) meta (0,0) rw (1701,1329)
Mar 27 2023 11:41:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52391886 master 15793797 prole 34430475 non-replica 2147868
Mar 27 2023 11:41:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,354,0) active (0,1,0) complete-pct 83.43
Mar 27 2023 11:41:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11715870052 index-bytes 3353080704 set-index-bytes 0 sindex-bytes 8362789348 used-pct 68.20
Mar 27 2023 11:41:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193536274112 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:41:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659941,0,0,231548,0) write (2111321,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:41:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:41:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608468,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:41:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:41:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891489 total) msec
Mar 27 2023 11:41:23 GMT: INFO (info): (hist.c:331) (00: 0002889976) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:41:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:41:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111322 total) msec
Mar 27 2023 11:41:23 GMT: INFO (info): (hist.c:331) (00: 0001679883) (01: 0000404724) (02: 0000024050) (03: 0000002424)
Mar 27 2023 11:41:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:41:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:41:26 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (35515517,6875) total-ms 20625
Mar 27 2023 11:41:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:41:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:41:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 36 user-cpu-pct 33 kernel-cpu-pct 3 free-mem-kbytes 10649704 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:41:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 42 threads (9,64,39,30) heap-kbytes (12960946,13037808,14469632) heap-efficiency-pct 99.4
Mar 27 2023 11:41:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:41:33 GMT: INFO (info): (ticker.c:319) fds: proto (90,127793,127703) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:41:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6919434
Mar 27 2023 11:41:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (60691,7426444) ctrl (4,9) meta (0,0) rw (3089,9372)
Mar 27 2023 11:41:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52372450 master 15793801 prole 34430781 non-replica 2147868
Mar 27 2023 11:41:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,353,0) active (0,1,0) complete-pct 83.48
Mar 27 2023 11:41:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11714648820 index-bytes 3351836800 set-index-bytes 0 sindex-bytes 8362812020 used-pct 68.19
Mar 27 2023 11:41:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193461478752 avail-pct 47 cache-read-pct 64.29
Mar 27 2023 11:41:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659942,0,0,231549,0) write (2111326,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:41:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:41:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608484,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:41:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:41:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891491 total) msec
Mar 27 2023 11:41:33 GMT: INFO (info): (hist.c:331) (00: 0002889978) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:41:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:41:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111327 total) msec
Mar 27 2023 11:41:33 GMT: INFO (info): (hist.c:331) (00: 0001679888) (01: 0000404724) (02: 0000024050) (03: 0000002424)
Mar 27 2023 11:41:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:41:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:41:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 193461646512 free-wblocks 973168 write-q 0 write (430903,0.2) defrag-q 0 defrag-read (379898,15.6) defrag-write (124833,0.1)
Mar 27 2023 11:41:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:41:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:41:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 4 user-cpu-pct 1 kernel-cpu-pct 3 free-mem-kbytes 10648340 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:41:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 9 threads (9,64,39,30) heap-kbytes (12961105,13037968,14469632) heap-efficiency-pct 99.4
Mar 27 2023 11:41:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:41:43 GMT: INFO (info): (ticker.c:319) fds: proto (91,127794,127703) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:41:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6919700
Mar 27 2023 11:41:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (55517,6712398) ctrl (6,14) meta (0,0) rw (5267,2705)
Mar 27 2023 11:41:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52372745 master 15793805 prole 34431072 non-replica 2128067
Mar 27 2023 11:41:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,352,0) active (0,1,0) complete-pct 83.53
Mar 27 2023 11:41:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11714690704 index-bytes 3351855680 set-index-bytes 0 sindex-bytes 8362835024 used-pct 68.19
Mar 27 2023 11:41:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193461755344 avail-pct 47 cache-read-pct 50.00
Mar 27 2023 11:41:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659942,0,0,231549,0) write (2111330,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:41:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:41:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608498,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:41:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:41:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891491 total) msec
Mar 27 2023 11:41:43 GMT: INFO (info): (hist.c:331) (00: 0002889978) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:41:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:41:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111331 total) msec
Mar 27 2023 11:41:43 GMT: INFO (info): (hist.c:331) (00: 0001679891) (01: 0000404725) (02: 0000024050) (03: 0000002424)
Mar 27 2023 11:41:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:41:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:41:47 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:41:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:41:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:41:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 62 user-cpu-pct 60 kernel-cpu-pct 2 free-mem-kbytes 10648480 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:41:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 65 threads (9,64,39,30) heap-kbytes (12959967,13035928,14467584) heap-efficiency-pct 99.4
Mar 27 2023 11:41:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:41:53 GMT: INFO (info): (ticker.c:319) fds: proto (16,127795,127779) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:41:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6919967
Mar 27 2023 11:41:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (36821,4511536) ctrl (6,13) meta (0,0) rw (36,2768)
Mar 27 2023 11:41:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52372912 master 15793805 prole 34431239 non-replica 2128067
Mar 27 2023 11:41:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,351,0) active (0,0,0) complete-pct 83.58
Mar 27 2023 11:41:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11713660072 index-bytes 3351866368 set-index-bytes 0 sindex-bytes 8361793704 used-pct 68.18
Mar 27 2023 11:41:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193462005424 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:41:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659942,0,0,231549,0) write (2111330,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:41:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:41:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608512,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:41:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:41:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891491 total) msec
Mar 27 2023 11:41:53 GMT: INFO (info): (hist.c:331) (00: 0002889978) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:41:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:41:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111331 total) msec
Mar 27 2023 11:41:53 GMT: INFO (info): (hist.c:331) (00: 0001679891) (01: 0000404725) (02: 0000024050) (03: 0000002424)
Mar 27 2023 11:41:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:41:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:41:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 193462026720 free-wblocks 973166 write-q 0 write (430905,0.1) defrag-q 0 defrag-read (379899,0.1) defrag-write (124834,0.1)
Mar 27 2023 11:42:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:42:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:42:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 103 user-cpu-pct 101 kernel-cpu-pct 2 free-mem-kbytes 10648060 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:42:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 105 threads (9,64,39,30) heap-kbytes (12958593,13035868,14467584) heap-efficiency-pct 99.4
Mar 27 2023 11:42:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:42:03 GMT: INFO (info): (ticker.c:319) fds: proto (16,127795,127779) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:42:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6920234
Mar 27 2023 11:42:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (26033,3112219) ctrl (4,12) meta (0,0) rw (3292,9282)
Mar 27 2023 11:42:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52373051 master 15793809 prole 34431374 non-replica 2128067
Mar 27 2023 11:42:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,351,0) active (0,1,0) complete-pct 83.58
Mar 27 2023 11:42:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11712454268 index-bytes 3351875264 set-index-bytes 0 sindex-bytes 8360579004 used-pct 68.18
Mar 27 2023 11:42:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193462156240 avail-pct 47 cache-read-pct 70.59
Mar 27 2023 11:42:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659943,0,0,231550,0) write (2111335,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:42:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:42:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608539,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:42:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:42:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891493 total) msec
Mar 27 2023 11:42:03 GMT: INFO (info): (hist.c:331) (00: 0002889980) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:42:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:42:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111336 total) msec
Mar 27 2023 11:42:03 GMT: INFO (info): (hist.c:331) (00: 0001679896) (01: 0000404725) (02: 0000024050) (03: 0000002424)
Mar 27 2023 11:42:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:42:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:42:08 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (35642169,126652) total-ms 20379
Mar 27 2023 11:42:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:42:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:42:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 49 user-cpu-pct 46 kernel-cpu-pct 3 free-mem-kbytes 10648636 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:42:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 53 threads (9,64,39,30) heap-kbytes (12957646,13033912,14467584) heap-efficiency-pct 99.4
Mar 27 2023 11:42:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:42:13 GMT: INFO (info): (ticker.c:319) fds: proto (17,127796,127779) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:42:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6920500
Mar 27 2023 11:42:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (42625,5296165) ctrl (6,14) meta (0,0) rw (844,2912)
Mar 27 2023 11:42:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52353497 master 15793810 prole 34431620 non-replica 2108213
Mar 27 2023 11:42:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,350,0) active (0,1,0) complete-pct 83.62
Mar 27 2023 11:42:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11710301068 index-bytes 3350623808 set-index-bytes 0 sindex-bytes 8359677260 used-pct 68.16
Mar 27 2023 11:42:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193387143216 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:42:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659943,0,0,231550,0) write (2111336,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:42:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:42:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608549,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:42:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:42:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891493 total) msec
Mar 27 2023 11:42:13 GMT: INFO (info): (hist.c:331) (00: 0002889980) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:42:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:42:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111337 total) msec
Mar 27 2023 11:42:13 GMT: INFO (info): (hist.c:331) (00: 0001679897) (01: 0000404725) (02: 0000024050) (03: 0000002424)
Mar 27 2023 11:42:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:42:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:42:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 193387329328 free-wblocks 973459 write-q 0 write (430908,0.2) defrag-q 0 defrag-read (380194,14.8) defrag-write (124835,0.1)
Mar 27 2023 11:42:19 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:42:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:42:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:42:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 56 user-cpu-pct 49 kernel-cpu-pct 7 free-mem-kbytes 10647108 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:42:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 63 threads (9,64,39,30) heap-kbytes (12957156,13032568,14467584) heap-efficiency-pct 99.4
Mar 27 2023 11:42:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:42:23 GMT: INFO (info): (ticker.c:319) fds: proto (16,127796,127780) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:42:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6920766
Mar 27 2023 11:42:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (112840,13661252) ctrl (12,29) meta (0,0) rw (7038,2676)
Mar 27 2023 11:42:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52354138 master 15793814 prole 34432257 non-replica 2108213
Mar 27 2023 11:42:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,349,0) active (0,3,0) complete-pct 83.67
Mar 27 2023 11:42:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11709809844 index-bytes 3350664832 set-index-bytes 0 sindex-bytes 8359145012 used-pct 68.16
Mar 27 2023 11:42:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193387782704 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:42:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659943,0,0,231550,0) write (2111340,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:42:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:42:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608560,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:42:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:42:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891493 total) msec
Mar 27 2023 11:42:23 GMT: INFO (info): (hist.c:331) (00: 0002889980) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:42:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:42:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111341 total) msec
Mar 27 2023 11:42:23 GMT: INFO (info): (hist.c:331) (00: 0001679901) (01: 0000404725) (02: 0000024050) (03: 0000002424)
Mar 27 2023 11:42:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:42:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:42:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:42:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:42:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 115 user-cpu-pct 106 kernel-cpu-pct 9 free-mem-kbytes 10647236 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:42:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 124 threads (9,64,39,30) heap-kbytes (12955988,13032504,14467584) heap-efficiency-pct 99.4
Mar 27 2023 11:42:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:42:33 GMT: INFO (info): (ticker.c:319) fds: proto (16,127796,127780) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:42:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6921034
Mar 27 2023 11:42:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (146403,18109990) ctrl (8,13) meta (0,0) rw (2240,467)
Mar 27 2023 11:42:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52354911 master 15793816 prole 34433028 non-replica 2108213
Mar 27 2023 11:42:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,346,0) active (0,1,0) complete-pct 83.81
Mar 27 2023 11:42:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11708580344 index-bytes 3350714304 set-index-bytes 0 sindex-bytes 8357866040 used-pct 68.15
Mar 27 2023 11:42:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193388499792 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:42:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659943,0,0,231550,0) write (2111342,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:42:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:42:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608566,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:42:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:42:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891493 total) msec
Mar 27 2023 11:42:33 GMT: INFO (info): (hist.c:331) (00: 0002889980) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:42:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:42:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111343 total) msec
Mar 27 2023 11:42:33 GMT: INFO (info): (hist.c:331) (00: 0001679903) (01: 0000404725) (02: 0000024050) (03: 0000002424)
Mar 27 2023 11:42:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:42:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:42:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 193388689872 free-wblocks 973453 write-q 0 write (430914,0.3) defrag-q 0 defrag-read (380194,0.0) defrag-write (124835,0.0)
Mar 27 2023 11:42:40 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (35769493,127324) total-ms 21044
Mar 27 2023 11:42:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:42:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:42:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 71 user-cpu-pct 68 kernel-cpu-pct 3 free-mem-kbytes 10648104 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:42:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 75 threads (9,64,39,30) heap-kbytes (12954669,13028476,14463488) heap-efficiency-pct 99.4
Mar 27 2023 11:42:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:42:43 GMT: INFO (info): (ticker.c:319) fds: proto (17,127797,127780) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:42:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6921300
Mar 27 2023 11:42:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (54916,6802858) ctrl (2,2) meta (0,0) rw (1722,2121)
Mar 27 2023 11:42:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52335356 master 15793818 prole 34433325 non-replica 2108213
Mar 27 2023 11:42:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,345,0) active (0,0,0) complete-pct 83.86
Mar 27 2023 11:42:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11706041604 index-bytes 3349462784 set-index-bytes 0 sindex-bytes 8356578820 used-pct 68.14
Mar 27 2023 11:42:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193311372464 avail-pct 47 cache-read-pct 33.33
Mar 27 2023 11:42:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659943,0,0,231550,0) write (2111344,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:42:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:42:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608575,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:42:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:42:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891493 total) msec
Mar 27 2023 11:42:43 GMT: INFO (info): (hist.c:331) (00: 0002889980) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:42:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:42:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111345 total) msec
Mar 27 2023 11:42:43 GMT: INFO (info): (hist.c:331) (00: 0001679905) (01: 0000404725) (02: 0000024050) (03: 0000002424)
Mar 27 2023 11:42:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:42:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:42:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:42:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:42:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 2 user-cpu-pct 1 kernel-cpu-pct 1 free-mem-kbytes 10647952 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:42:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 2 threads (9,64,39,30) heap-kbytes (12954682,13028476,14463488) heap-efficiency-pct 99.4
Mar 27 2023 11:42:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:42:53 GMT: INFO (info): (ticker.c:319) fds: proto (16,127797,127781) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:42:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6921566
Mar 27 2023 11:42:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (7799,935306) ctrl (9,25) meta (0,0) rw (1653,4086)
Mar 27 2023 11:42:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52335415 master 15793820 prole 34433382 non-replica 2088342
Mar 27 2023 11:42:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,345,0) active (0,2,0) complete-pct 83.86
Mar 27 2023 11:42:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11706050868 index-bytes 3349466560 set-index-bytes 0 sindex-bytes 8356584308 used-pct 68.14
Mar 27 2023 11:42:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193311455312 avail-pct 47 cache-read-pct 100.00
Mar 27 2023 11:42:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659944,0,0,231551,0) write (2111347,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:42:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:42:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608593,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:42:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:42:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891495 total) msec
Mar 27 2023 11:42:53 GMT: INFO (info): (hist.c:331) (00: 0002889982) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:42:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:42:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111348 total) msec
Mar 27 2023 11:42:53 GMT: INFO (info): (hist.c:331) (00: 0001679908) (01: 0000404725) (02: 0000024050) (03: 0000002424)
Mar 27 2023 11:42:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:42:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:42:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 193311797760 free-wblocks 973837 write-q 0 write (430916,0.1) defrag-q 0 defrag-read (380580,19.3) defrag-write (124835,0.0)
Mar 27 2023 11:43:01 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:43:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:43:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:43:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 35 user-cpu-pct 28 kernel-cpu-pct 7 free-mem-kbytes 10647700 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:43:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 44 threads (9,64,39,30) heap-kbytes (12954424,13026832,14463488) heap-efficiency-pct 99.4
Mar 27 2023 11:43:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:43:03 GMT: INFO (info): (ticker.c:319) fds: proto (16,127798,127782) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:43:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6921833
Mar 27 2023 11:43:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (116798,14244886) ctrl (2,2) meta (0,0) rw (7251,5416)
Mar 27 2023 11:43:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52336070 master 15793824 prole 34434033 non-replica 2088342
Mar 27 2023 11:43:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,344,0) active (0,1,0) complete-pct 83.90
Mar 27 2023 11:43:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11705717028 index-bytes 3349508480 set-index-bytes 0 sindex-bytes 8356208548 used-pct 68.14
Mar 27 2023 11:43:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193312105632 avail-pct 47 cache-read-pct 80.00
Mar 27 2023 11:43:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659948,0,0,231553,0) write (2111355,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:43:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:43:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608624,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:43:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:43:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891501 total) msec
Mar 27 2023 11:43:03 GMT: INFO (info): (hist.c:331) (00: 0002889988) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:43:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:43:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111356 total) msec
Mar 27 2023 11:43:03 GMT: INFO (info): (hist.c:331) (00: 0001679915) (01: 0000404726) (02: 0000024050) (03: 0000002424)
Mar 27 2023 11:43:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:43:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:43:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:43:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:43:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 105 user-cpu-pct 102 kernel-cpu-pct 3 free-mem-kbytes 10647732 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:43:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 108 threads (9,64,39,30) heap-kbytes (12952977,13026740,14463488) heap-efficiency-pct 99.4
Mar 27 2023 11:43:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:43:13 GMT: INFO (info): (ticker.c:319) fds: proto (16,127799,127783) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:43:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6922099
Mar 27 2023 11:43:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (50003,6040999) ctrl (4,9) meta (0,0) rw (6465,2212)
Mar 27 2023 11:43:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52336373 master 15793830 prole 34434330 non-replica 2088342
Mar 27 2023 11:43:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,343,0) active (0,1,0) complete-pct 83.95
Mar 27 2023 11:43:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11704303292 index-bytes 3349527872 set-index-bytes 0 sindex-bytes 8354775420 used-pct 68.13
Mar 27 2023 11:43:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193312465296 avail-pct 47 cache-read-pct 91.67
Mar 27 2023 11:43:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659952,0,0,231557,0) write (2111365,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:43:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:43:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608643,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:43:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:43:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891509 total) msec
Mar 27 2023 11:43:13 GMT: INFO (info): (hist.c:331) (00: 0002889996) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:43:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:43:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111366 total) msec
Mar 27 2023 11:43:13 GMT: INFO (info): (hist.c:331) (00: 0001679925) (01: 0000404726) (02: 0000024050) (03: 0000002424)
Mar 27 2023 11:43:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:43:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:43:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 193312544080 free-wblocks 973835 write-q 0 write (430918,0.1) defrag-q 0 defrag-read (380580,0.0) defrag-write (124835,0.0)
Mar 27 2023 11:43:21 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (35940156,170663) total-ms 20413
Mar 27 2023 11:43:22 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:43:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:43:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:43:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 93 user-cpu-pct 91 kernel-cpu-pct 2 free-mem-kbytes 10647536 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:43:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 93 threads (9,64,39,30) heap-kbytes (12950150,13023352,14463488) heap-efficiency-pct 99.4
Mar 27 2023 11:43:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:43:23 GMT: INFO (info): (ticker.c:319) fds: proto (15,127799,127784) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:43:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6922366
Mar 27 2023 11:43:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (16941,2081667) ctrl (4,7) meta (0,0) rw (1472,2005)
Mar 27 2023 11:43:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52316589 master 15793831 prole 34434416 non-replica 2068482
Mar 27 2023 11:43:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,342,0) active (0,0,0) complete-pct 84.00
Mar 27 2023 11:43:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11700214504 index-bytes 3348261696 set-index-bytes 0 sindex-bytes 8351952808 used-pct 68.10
Mar 27 2023 11:43:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193236952576 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:43:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2659952,0,0,231557,0) write (2111366,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:43:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:43:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608649,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:43:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:43:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2891509 total) msec
Mar 27 2023 11:43:23 GMT: INFO (info): (hist.c:331) (00: 0002889996) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:43:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:43:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111367 total) msec
Mar 27 2023 11:43:23 GMT: INFO (info): (hist.c:331) (00: 0001679926) (01: 0000404726) (02: 0000024050) (03: 0000002424)
Mar 27 2023 11:43:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:43:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:43:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:43:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:43:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 109 user-cpu-pct 104 kernel-cpu-pct 5 free-mem-kbytes 10647108 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:43:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 114 threads (9,64,39,30) heap-kbytes (12947122,13022612,14463488) heap-efficiency-pct 99.4
Mar 27 2023 11:43:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:43:33 GMT: INFO (info): (ticker.c:319) fds: proto (192,127976,127784) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:43:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6922633
Mar 27 2023 11:43:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (57774,7010924) ctrl (4,12) meta (0,0) rw (378144,431225)
Mar 27 2023 11:43:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52316944 master 15793841 prole 34434761 non-replica 2048585
Mar 27 2023 11:43:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,342,0) active (0,1,0) complete-pct 84.00
Mar 27 2023 11:43:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11697936760 index-bytes 3348284416 set-index-bytes 0 sindex-bytes 8349652344 used-pct 68.09
Mar 27 2023 11:43:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193237447120 avail-pct 47 cache-read-pct 74.63
Mar 27 2023 11:43:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2660671,0,0,231566,0) write (2111679,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:43:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:43:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608720,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:43:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:43:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2892237 total) msec
Mar 27 2023 11:43:33 GMT: INFO (info): (hist.c:331) (00: 0002890724) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:43:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:43:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111680 total) msec
Mar 27 2023 11:43:33 GMT: INFO (info): (hist.c:331) (00: 0001680163) (01: 0000404801) (02: 0000024051) (03: 0000002424)
Mar 27 2023 11:43:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:43:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:43:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 193237492928 free-wblocks 974124 write-q 0 write (430955,1.9) defrag-q 0 defrag-read (380906,16.3) defrag-write (124848,0.6)
Mar 27 2023 11:43:43 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (36120665,180509) total-ms 20379
Mar 27 2023 11:43:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:43:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:43:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 95 user-cpu-pct 94 kernel-cpu-pct 1 free-mem-kbytes 10647284 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:43:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 95 threads (9,64,39,30) heap-kbytes (12945250,13019324,14459392) heap-efficiency-pct 99.4
Mar 27 2023 11:43:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:43:43 GMT: INFO (info): (ticker.c:319) fds: proto (193,127977,127784) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:43:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6922899
Mar 27 2023 11:43:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (6082,767760) ctrl (4,7) meta (0,0) rw (914,1345)
Mar 27 2023 11:43:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52297122 master 15793842 prole 34434798 non-replica 2048585
Mar 27 2023 11:43:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,341,0) active (0,0,0) complete-pct 84.04
Mar 27 2023 11:43:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11694811112 index-bytes 3347015808 set-index-bytes 0 sindex-bytes 8347795304 used-pct 68.07
Mar 27 2023 11:43:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193160485600 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:43:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2660671,0,0,231566,0) write (2111680,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:43:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:43:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608727,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:43:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:43:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2892237 total) msec
Mar 27 2023 11:43:43 GMT: INFO (info): (hist.c:331) (00: 0002890724) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:43:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:43:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111681 total) msec
Mar 27 2023 11:43:43 GMT: INFO (info): (hist.c:331) (00: 0001680164) (01: 0000404801) (02: 0000024051) (03: 0000002424)
Mar 27 2023 11:43:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:43:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:43:44 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:43:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:43:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:43:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 102 user-cpu-pct 98 kernel-cpu-pct 4 free-mem-kbytes 10647336 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:43:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 106 threads (9,64,39,30) heap-kbytes (12944582,13017776,14459392) heap-efficiency-pct 99.4
Mar 27 2023 11:43:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:43:53 GMT: INFO (info): (ticker.c:319) fds: proto (192,127977,127785) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:43:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6923166
Mar 27 2023 11:43:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (55474,6830215) ctrl (4,12) meta (0,0) rw (2115,4916)
Mar 27 2023 11:43:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52297416 master 15793845 prole 34435089 non-replica 2048584
Mar 27 2023 11:43:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,341,0) active (0,1,0) complete-pct 84.04
Mar 27 2023 11:43:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11694135468 index-bytes 3347034624 set-index-bytes 0 sindex-bytes 8347100844 used-pct 68.07
Mar 27 2023 11:43:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193160780512 avail-pct 47 cache-read-pct 71.43
Mar 27 2023 11:43:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2660672,0,0,231567,0) write (2111684,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:43:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:43:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608747,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:43:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:43:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2892239 total) msec
Mar 27 2023 11:43:53 GMT: INFO (info): (hist.c:331) (00: 0002890726) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:43:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:43:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111685 total) msec
Mar 27 2023 11:43:53 GMT: INFO (info): (hist.c:331) (00: 0001680167) (01: 0000404802) (02: 0000024051) (03: 0000002424)
Mar 27 2023 11:43:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:43:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:43:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 193161015520 free-wblocks 974424 write-q 0 write (430961,0.3) defrag-q 0 defrag-read (381213,15.4) defrag-write (124850,0.1)
Mar 27 2023 11:43:59 GMT: INFO (info): (thr_info.c:3840) latencies command: unrecognized histogram: {Settlement}-query
Mar 27 2023 11:44:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:44:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:44:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 114 user-cpu-pct 106 kernel-cpu-pct 8 free-mem-kbytes 10647428 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:44:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 122 threads (9,64,39,30) heap-kbytes (12943776,13015904,14457344) heap-efficiency-pct 99.4
Mar 27 2023 11:44:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:44:03 GMT: INFO (info): (ticker.c:319) fds: proto (193,127979,127786) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:44:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6923432
Mar 27 2023 11:44:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (127713,15687622) ctrl (12,29) meta (0,0) rw (48474,61355)
Mar 27 2023 11:44:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52298160 master 15793845 prole 34435833 non-replica 2028714
Mar 27 2023 11:44:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,340,0) active (0,3,0) complete-pct 84.09
Mar 27 2023 11:44:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11693068768 index-bytes 3347082240 set-index-bytes 0 sindex-bytes 8345986528 used-pct 68.06
Mar 27 2023 11:44:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193161457296 avail-pct 47 cache-read-pct 72.63
Mar 27 2023 11:44:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2660698,0,0,231567,0) write (2111708,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:44:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:44:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608762,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:44:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:44:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2892265 total) msec
Mar 27 2023 11:44:03 GMT: INFO (info): (hist.c:331) (00: 0002890752) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:44:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:44:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111709 total) msec
Mar 27 2023 11:44:03 GMT: INFO (info): (hist.c:331) (00: 0001680180) (01: 0000404813) (02: 0000024051) (03: 0000002424)
Mar 27 2023 11:44:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:44:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:44:04 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (36195240,74575) total-ms 20801
Mar 27 2023 11:44:05 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:44:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:44:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:44:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 101 user-cpu-pct 94 kernel-cpu-pct 7 free-mem-kbytes 10647416 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:44:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 110 threads (9,64,39,30) heap-kbytes (12941046,13015464,14457344) heap-efficiency-pct 99.4
Mar 27 2023 11:44:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:44:13 GMT: INFO (info): (ticker.c:319) fds: proto (194,127980,127786) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:44:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6923698
Mar 27 2023 11:44:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (120943,14875525) ctrl (10,18) meta (0,0) rw (857,2150)
Mar 27 2023 11:44:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52278936 master 15793846 prole 34436505 non-replica 2008840
Mar 27 2023 11:44:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,337,0) active (0,1,0) complete-pct 84.23
Mar 27 2023 11:44:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11689100192 index-bytes 3345851904 set-index-bytes 0 sindex-bytes 8343248288 used-pct 68.04
Mar 27 2023 11:44:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193084378368 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:44:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2660698,0,0,231567,0) write (2111709,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:44:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:44:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608772,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:44:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:44:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2892265 total) msec
Mar 27 2023 11:44:13 GMT: INFO (info): (hist.c:331) (00: 0002890752) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:44:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:44:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111710 total) msec
Mar 27 2023 11:44:13 GMT: INFO (info): (hist.c:331) (00: 0001680181) (01: 0000404813) (02: 0000024051) (03: 0000002424)
Mar 27 2023 11:44:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:44:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:44:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 193084582784 free-wblocks 974741 write-q 0 write (430967,0.3) defrag-q 0 defrag-read (381536,16.1) defrag-write (124850,0.0)
Mar 27 2023 11:44:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:44:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:44:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 109 user-cpu-pct 103 kernel-cpu-pct 6 free-mem-kbytes 10647532 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:44:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 117 threads (9,64,39,30) heap-kbytes (12939170,13010564,14457344) heap-efficiency-pct 99.5
Mar 27 2023 11:44:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:44:23 GMT: INFO (info): (ticker.c:319) fds: proto (193,127980,127787) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:44:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6923966
Mar 27 2023 11:44:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (100362,12464567) ctrl (11,27) meta (0,0) rw (2587,153)
Mar 27 2023 11:44:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52279454 master 15793846 prole 34437023 non-replica 2008837
Mar 27 2023 11:44:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,336,0) active (0,2,0) complete-pct 84.28
Mar 27 2023 11:44:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11687298864 index-bytes 3345885056 set-index-bytes 0 sindex-bytes 8341413808 used-pct 68.03
Mar 27 2023 11:44:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 193084831760 avail-pct 47 cache-read-pct 54.55
Mar 27 2023 11:44:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2660700,0,0,231567,0) write (2111711,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:44:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:44:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608776,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:44:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:44:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2892267 total) msec
Mar 27 2023 11:44:23 GMT: INFO (info): (hist.c:331) (00: 0002890754) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:44:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:44:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111712 total) msec
Mar 27 2023 11:44:23 GMT: INFO (info): (hist.c:331) (00: 0001680182) (01: 0000404814) (02: 0000024051) (03: 0000002424)
Mar 27 2023 11:44:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:44:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:44:26 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (36405818,210578) total-ms 20875
Mar 27 2023 11:44:27 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:44:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:44:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:44:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 98 user-cpu-pct 93 kernel-cpu-pct 5 free-mem-kbytes 10648632 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:44:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 103 threads (9,64,39,30) heap-kbytes (12937999,13007028,14457344) heap-efficiency-pct 99.5
Mar 27 2023 11:44:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:44:33 GMT: INFO (info): (ticker.c:319) fds: proto (38,127993,127955) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:44:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6924232
Mar 27 2023 11:44:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (72164,8968933) ctrl (6,11) meta (0,0) rw (177834,179487)
Mar 27 2023 11:44:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52240088 master 15793850 prole 34437398 non-replica 2008837
Mar 27 2023 11:44:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,334,0) active (0,1,0) complete-pct 84.37
Mar 27 2023 11:44:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11684273276 index-bytes 3343365632 set-index-bytes 0 sindex-bytes 8340907644 used-pct 68.01
Mar 27 2023 11:44:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192933173712 avail-pct 47 cache-read-pct 71.54
Mar 27 2023 11:44:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2660819,0,0,231570,0) write (2111828,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:44:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:44:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608796,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:44:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:44:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2892389 total) msec
Mar 27 2023 11:44:33 GMT: INFO (info): (hist.c:331) (00: 0002890876) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:44:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:44:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111829 total) msec
Mar 27 2023 11:44:33 GMT: INFO (info): (hist.c:331) (00: 0001680270) (01: 0000404841) (02: 0000024051) (03: 0000002426)
Mar 27 2023 11:44:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:44:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:44:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 192933318176 free-wblocks 975440 write-q 0 write (430984,0.9) defrag-q 0 defrag-read (382251,35.8) defrag-write (124855,0.2)
Mar 27 2023 11:44:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:44:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:44:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 103 user-cpu-pct 101 kernel-cpu-pct 2 free-mem-kbytes 10649364 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:44:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 106 threads (9,64,39,30) heap-kbytes (12937337,13004796,14457344) heap-efficiency-pct 99.5
Mar 27 2023 11:44:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:44:43 GMT: INFO (info): (ticker.c:319) fds: proto (38,127993,127955) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:44:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6924498
Mar 27 2023 11:44:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (34462,4192164) ctrl (4,7) meta (0,0) rw (269,965)
Mar 27 2023 11:44:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52240282 master 15793851 prole 34437591 non-replica 1988930
Mar 27 2023 11:44:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,333,0) active (0,0,0) complete-pct 84.42
Mar 27 2023 11:44:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11683640680 index-bytes 3343378048 set-index-bytes 0 sindex-bytes 8340262632 used-pct 68.01
Mar 27 2023 11:44:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192933335088 avail-pct 47 cache-read-pct 66.67
Mar 27 2023 11:44:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2660820,0,0,231571,0) write (2111830,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:44:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:44:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608802,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:44:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:44:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2892391 total) msec
Mar 27 2023 11:44:43 GMT: INFO (info): (hist.c:331) (00: 0002890878) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:44:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:44:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111831 total) msec
Mar 27 2023 11:44:43 GMT: INFO (info): (hist.c:331) (00: 0001680272) (01: 0000404841) (02: 0000024051) (03: 0000002426)
Mar 27 2023 11:44:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:44:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:44:48 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (36462643,56825) total-ms 20362
Mar 27 2023 11:44:49 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:44:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:44:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:44:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 93 user-cpu-pct 91 kernel-cpu-pct 2 free-mem-kbytes 10648368 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:44:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 96 threads (9,64,39,30) heap-kbytes (12935457,13004752,14457344) heap-efficiency-pct 99.5
Mar 27 2023 11:44:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:44:53 GMT: INFO (info): (ticker.c:319) fds: proto (38,127995,127957) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:44:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6924766
Mar 27 2023 11:44:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (31334,3721370) ctrl (6,18) meta (0,0) rw (1717,1761)
Mar 27 2023 11:44:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52240444 master 15793853 prole 34437754 non-replica 1969021
Mar 27 2023 11:44:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,333,0) active (0,1,0) complete-pct 84.42
Mar 27 2023 11:44:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11681743120 index-bytes 3343388416 set-index-bytes 0 sindex-bytes 8338354704 used-pct 68.00
Mar 27 2023 11:44:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192933489568 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:44:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2660820,0,0,231571,0) write (2111832,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:44:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:44:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608811,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:44:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:44:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2892391 total) msec
Mar 27 2023 11:44:53 GMT: INFO (info): (hist.c:331) (00: 0002890878) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:44:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:44:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111833 total) msec
Mar 27 2023 11:44:53 GMT: INFO (info): (hist.c:331) (00: 0001680274) (01: 0000404841) (02: 0000024051) (03: 0000002426)
Mar 27 2023 11:44:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:44:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:44:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 192933680480 free-wblocks 975438 write-q 0 write (430990,0.3) defrag-q 0 defrag-read (382255,0.2) defrag-write (124855,0.0)
Mar 27 2023 11:45:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:45:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:45:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 107 user-cpu-pct 103 kernel-cpu-pct 4 free-mem-kbytes 10647992 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:45:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 111 threads (9,64,39,30) heap-kbytes (12933459,13001508,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:45:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:45:03 GMT: INFO (info): (ticker.c:319) fds: proto (43,128000,127957) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:45:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6925032
Mar 27 2023 11:45:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (59839,7280002) ctrl (9,22) meta (0,0) rw (71279,90267)
Mar 27 2023 11:45:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52240800 master 15793859 prole 34438104 non-replica 1969021
Mar 27 2023 11:45:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,332,0) active (0,2,0) complete-pct 84.46
Mar 27 2023 11:45:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11679307928 index-bytes 3343411200 set-index-bytes 0 sindex-bytes 8335896728 used-pct 67.98
Mar 27 2023 11:45:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192933882704 avail-pct 47 cache-read-pct 83.00
Mar 27 2023 11:45:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2660917,0,0,231574,0) write (2111885,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:45:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:45:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608837,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:45:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:45:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2892491 total) msec
Mar 27 2023 11:45:03 GMT: INFO (info): (hist.c:331) (00: 0002890978) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:45:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:45:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111886 total) msec
Mar 27 2023 11:45:03 GMT: INFO (info): (hist.c:331) (00: 0001680311) (01: 0000404856) (02: 0000024052) (03: 0000002426)
Mar 27 2023 11:45:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:45:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:45:10 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (36648766,186123) total-ms 21320
Mar 27 2023 11:45:11 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:45:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:45:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:45:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 103 user-cpu-pct 95 kernel-cpu-pct 8 free-mem-kbytes 10648152 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:45:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 114 threads (9,64,39,30) heap-kbytes (12931639,12997688,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:45:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:45:13 GMT: INFO (info): (ticker.c:319) fds: proto (43,128000,127957) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:45:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6925298
Mar 27 2023 11:45:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (148220,18079976) ctrl (13,29) meta (0,0) rw (18,2293)
Mar 27 2023 11:45:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52221726 master 15793859 prole 34438937 non-replica 1949143
Mar 27 2023 11:45:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,330,0) active (0,2,0) complete-pct 84.56
Mar 27 2023 11:45:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11676240636 index-bytes 3342190464 set-index-bytes 0 sindex-bytes 8334050172 used-pct 67.96
Mar 27 2023 11:45:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192858427600 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:45:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2660917,0,0,231574,0) write (2111885,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:45:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:45:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608844,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:45:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:45:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2892491 total) msec
Mar 27 2023 11:45:13 GMT: INFO (info): (hist.c:331) (00: 0002890978) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:45:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:45:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111886 total) msec
Mar 27 2023 11:45:13 GMT: INFO (info): (hist.c:331) (00: 0001680311) (01: 0000404856) (02: 0000024052) (03: 0000002426)
Mar 27 2023 11:45:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:45:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:45:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 192858805856 free-wblocks 975735 write-q 0 write (430997,0.3) defrag-q 0 defrag-read (382559,15.2) defrag-write (124856,0.1)
Mar 27 2023 11:45:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:45:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:45:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 110 user-cpu-pct 104 kernel-cpu-pct 6 free-mem-kbytes 10646996 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:45:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 117 threads (9,64,39,30) heap-kbytes (12930429,12997704,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:45:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:45:23 GMT: INFO (info): (ticker.c:319) fds: proto (43,128001,127958) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:45:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6925566
Mar 27 2023 11:45:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (98676,12261245) ctrl (6,11) meta (0,0) rw (3229,3106)
Mar 27 2023 11:45:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52222308 master 15793861 prole 34439517 non-replica 1949143
Mar 27 2023 11:45:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,328,0) active (0,1,0) complete-pct 84.65
Mar 27 2023 11:45:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11675113496 index-bytes 3342227712 set-index-bytes 0 sindex-bytes 8332885784 used-pct 67.96
Mar 27 2023 11:45:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192859000128 avail-pct 47 cache-read-pct 50.00
Mar 27 2023 11:45:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2660918,0,0,231575,0) write (2111888,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:45:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:45:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608856,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:45:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:45:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2892493 total) msec
Mar 27 2023 11:45:23 GMT: INFO (info): (hist.c:331) (00: 0002890980) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:45:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:45:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2111889 total) msec
Mar 27 2023 11:45:23 GMT: INFO (info): (hist.c:331) (00: 0001680314) (01: 0000404856) (02: 0000024052) (03: 0000002426)
Mar 27 2023 11:45:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:45:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:45:32 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (36788243,139477) total-ms 21022
Mar 27 2023 11:45:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:45:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:45:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 95 user-cpu-pct 91 kernel-cpu-pct 4 free-mem-kbytes 10647168 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:45:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 98 threads (9,64,39,30) heap-kbytes (12928387,12995908,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:45:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:45:33 GMT: INFO (info): (ticker.c:319) fds: proto (94,128057,127963) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:45:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6925831
Mar 27 2023 11:45:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (45467,5611490) ctrl (2,2) meta (0,0) rw (366359,383749)
Mar 27 2023 11:45:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52182792 master 15793874 prole 34439775 non-replica 1949143
Mar 27 2023 11:45:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,327,0) active (0,0,0) complete-pct 84.70
Mar 27 2023 11:45:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11671168868 index-bytes 3339698688 set-index-bytes 0 sindex-bytes 8331470180 used-pct 67.94
Mar 27 2023 11:45:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192706105504 avail-pct 47 cache-read-pct 72.29
Mar 27 2023 11:45:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2661419,0,0,231583,0) write (2112205,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:45:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:45:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608899,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:45:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:45:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2893002 total) msec
Mar 27 2023 11:45:33 GMT: INFO (info): (hist.c:331) (00: 0002891489) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:45:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:45:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2112206 total) msec
Mar 27 2023 11:45:33 GMT: INFO (info): (hist.c:331) (00: 0001680568) (01: 0000404918) (02: 0000024053) (03: 0000002426)
Mar 27 2023 11:45:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:45:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:45:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 192706251904 free-wblocks 976340 write-q 0 write (431033,1.8) defrag-q 0 defrag-read (383196,31.9) defrag-write (124869,0.6)
Mar 27 2023 11:45:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:45:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:45:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 5 user-cpu-pct 2 kernel-cpu-pct 3 free-mem-kbytes 10647316 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:45:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 10 threads (9,64,39,30) heap-kbytes (12928437,12995928,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:45:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:45:43 GMT: INFO (info): (ticker.c:319) fds: proto (94,128057,127963) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:45:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6926098
Mar 27 2023 11:45:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (59067,7130460) ctrl (2,7) meta (0,0) rw (24,2517)
Mar 27 2023 11:45:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52183117 master 15793874 prole 34440100 non-replica 1949143
Mar 27 2023 11:45:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,327,0) active (0,1,0) complete-pct 84.70
Mar 27 2023 11:45:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11671211980 index-bytes 3339719488 set-index-bytes 0 sindex-bytes 8331492492 used-pct 67.94
Mar 27 2023 11:45:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192706415968 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:45:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2661419,0,0,231583,0) write (2112205,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:45:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:45:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608910,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:45:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:45:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2893002 total) msec
Mar 27 2023 11:45:43 GMT: INFO (info): (hist.c:331) (00: 0002891489) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:45:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:45:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2112206 total) msec
Mar 27 2023 11:45:43 GMT: INFO (info): (hist.c:331) (00: 0001680568) (01: 0000404918) (02: 0000024053) (03: 0000002426)
Mar 27 2023 11:45:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:45:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:45:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:45:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:45:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 2 user-cpu-pct 1 kernel-cpu-pct 1 free-mem-kbytes 10647096 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:45:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 3 threads (9,64,39,30) heap-kbytes (12928496,12995948,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:45:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:45:53 GMT: INFO (info): (ticker.c:319) fds: proto (95,128059,127964) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:45:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6926366
Mar 27 2023 11:45:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (12635,1516634) ctrl (4,9) meta (0,0) rw (3055,2569)
Mar 27 2023 11:45:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52183196 master 15793875 prole 34440178 non-replica 1949143
Mar 27 2023 11:45:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,326,0) active (0,1,0) complete-pct 84.74
Mar 27 2023 11:45:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11671222704 index-bytes 3339724544 set-index-bytes 0 sindex-bytes 8331498160 used-pct 67.94
Mar 27 2023 11:45:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192706494784 avail-pct 47 cache-read-pct 90.00
Mar 27 2023 11:45:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2661423,0,0,231583,0) write (2112208,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:45:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:45:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608921,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:45:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:45:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2893006 total) msec
Mar 27 2023 11:45:53 GMT: INFO (info): (hist.c:331) (00: 0002891493) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:45:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:45:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2112209 total) msec
Mar 27 2023 11:45:53 GMT: INFO (info): (hist.c:331) (00: 0001680570) (01: 0000404919) (02: 0000024053) (03: 0000002426)
Mar 27 2023 11:45:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:45:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:45:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 192706683936 free-wblocks 976331 write-q 0 write (431064,1.5) defrag-q 0 defrag-read (383221,1.2) defrag-write (124880,0.6)
Mar 27 2023 11:46:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:46:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:46:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 7 user-cpu-pct 3 kernel-cpu-pct 4 free-mem-kbytes 10646708 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:46:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 11 threads (9,64,39,30) heap-kbytes (12928034,12995728,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:46:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:46:03 GMT: INFO (info): (ticker.c:319) fds: proto (95,128059,127964) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:46:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6926631
Mar 27 2023 11:46:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (56156,7067957) ctrl (2,2) meta (0,0) rw (338954,360048)
Mar 27 2023 11:46:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52183525 master 15793882 prole 34440500 non-replica 1949143
Mar 27 2023 11:46:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,325,0) active (0,0,0) complete-pct 84.79
Mar 27 2023 11:46:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11671259816 index-bytes 3339745600 set-index-bytes 0 sindex-bytes 8331514216 used-pct 67.94
Mar 27 2023 11:46:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192706851232 avail-pct 47 cache-read-pct 66.19
Mar 27 2023 11:46:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2661704,0,0,231587,0) write (2112487,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:46:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:46:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608956,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:46:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:46:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2893291 total) msec
Mar 27 2023 11:46:03 GMT: INFO (info): (hist.c:331) (00: 0002891778) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:46:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:46:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2112488 total) msec
Mar 27 2023 11:46:03 GMT: INFO (info): (hist.c:331) (00: 0001680785) (01: 0000404982) (02: 0000024054) (03: 0000002426)
Mar 27 2023 11:46:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:46:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:46:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:46:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:46:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 3 user-cpu-pct 1 kernel-cpu-pct 2 free-mem-kbytes 10646648 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:46:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 10 threads (9,64,39,30) heap-kbytes (12928065,12995776,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:46:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:46:13 GMT: INFO (info): (ticker.c:319) fds: proto (95,128059,127964) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:46:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6926898
Mar 27 2023 11:46:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (59138,7270005) ctrl (6,18) meta (0,0) rw (566,1776)
Mar 27 2023 11:46:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52183862 master 15793884 prole 34440835 non-replica 1929252
Mar 27 2023 11:46:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,325,0) active (0,1,0) complete-pct 84.79
Mar 27 2023 11:46:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11671303080 index-bytes 3339767168 set-index-bytes 0 sindex-bytes 8331535912 used-pct 67.94
Mar 27 2023 11:46:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192707198832 avail-pct 47 cache-read-pct 63.64
Mar 27 2023 11:46:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2661706,0,0,231589,0) write (2112491,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:46:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:46:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608972,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:46:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:46:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2893295 total) msec
Mar 27 2023 11:46:13 GMT: INFO (info): (hist.c:331) (00: 0002891782) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:46:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:46:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2112492 total) msec
Mar 27 2023 11:46:13 GMT: INFO (info): (hist.c:331) (00: 0001680789) (01: 0000404982) (02: 0000024054) (03: 0000002426)
Mar 27 2023 11:46:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:46:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:46:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 192707227248 free-wblocks 976332 write-q 0 write (431066,0.1) defrag-q 0 defrag-read (383221,0.0) defrag-write (124880,0.0)
Mar 27 2023 11:46:23 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:46:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:46:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:46:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 5 user-cpu-pct 4 kernel-cpu-pct 1 free-mem-kbytes 10646640 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:46:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 4 threads (9,64,39,30) heap-kbytes (12928057,12995804,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:46:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:46:23 GMT: INFO (info): (ticker.c:319) fds: proto (95,128060,127965) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:46:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6927165
Mar 27 2023 11:46:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (6302,886616) ctrl (4,9) meta (0,0) rw (1776,1117)
Mar 27 2023 11:46:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52183898 master 15793886 prole 34440869 non-replica 1929252
Mar 27 2023 11:46:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,324,0) active (0,1,0) complete-pct 84.84
Mar 27 2023 11:46:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11671311128 index-bytes 3339769472 set-index-bytes 0 sindex-bytes 8331541656 used-pct 67.94
Mar 27 2023 11:46:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192707237824 avail-pct 47 cache-read-pct 50.00
Mar 27 2023 11:46:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2661706,0,0,231589,0) write (2112493,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:46:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:46:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1608980,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:46:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:46:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2893295 total) msec
Mar 27 2023 11:46:23 GMT: INFO (info): (hist.c:331) (00: 0002891782) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:46:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:46:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2112494 total) msec
Mar 27 2023 11:46:23 GMT: INFO (info): (hist.c:331) (00: 0001680791) (01: 0000404982) (02: 0000024054) (03: 0000002426)
Mar 27 2023 11:46:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:46:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:46:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:46:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:46:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 113 user-cpu-pct 105 kernel-cpu-pct 8 free-mem-kbytes 10646508 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:46:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 121 threads (9,64,39,30) heap-kbytes (12926841,12994052,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:46:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:46:33 GMT: INFO (info): (ticker.c:319) fds: proto (95,128060,127965) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:46:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6927431
Mar 27 2023 11:46:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (117406,14419296) ctrl (4,12) meta (0,0) rw (60547,64917)
Mar 27 2023 11:46:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52184546 master 15793890 prole 34441513 non-replica 1929252
Mar 27 2023 11:46:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,324,0) active (0,2,0) complete-pct 84.84
Mar 27 2023 11:46:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11669794264 index-bytes 3339810944 set-index-bytes 0 sindex-bytes 8329983320 used-pct 67.93
Mar 27 2023 11:46:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192707934032 avail-pct 47 cache-read-pct 83.78
Mar 27 2023 11:46:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2661833,0,0,231593,0) write (2112561,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:46:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:46:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609005,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:46:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:46:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2893426 total) msec
Mar 27 2023 11:46:33 GMT: INFO (info): (hist.c:331) (00: 0002891913) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:46:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:46:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2112562 total) msec
Mar 27 2023 11:46:33 GMT: INFO (info): (hist.c:331) (00: 0001680844) (01: 0000404996) (02: 0000024055) (03: 0000002426)
Mar 27 2023 11:46:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:46:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:46:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 192708088016 free-wblocks 976328 write-q 0 write (431076,0.5) defrag-q 0 defrag-read (383227,0.3) defrag-write (124883,0.2)
Mar 27 2023 11:46:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:46:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:46:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 108 user-cpu-pct 103 kernel-cpu-pct 5 free-mem-kbytes 10646332 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:46:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 110 threads (9,64,39,30) heap-kbytes (12925358,12993876,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:46:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:46:43 GMT: INFO (info): (ticker.c:319) fds: proto (96,128061,127965) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:46:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6927698
Mar 27 2023 11:46:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (58407,7076274) ctrl (6,11) meta (0,0) rw (757,2504)
Mar 27 2023 11:46:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52184855 master 15793891 prole 34441821 non-replica 1929252
Mar 27 2023 11:46:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,322,0) active (0,1,0) complete-pct 84.93
Mar 27 2023 11:46:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11668402360 index-bytes 3339830720 set-index-bytes 0 sindex-bytes 8328571640 used-pct 67.92
Mar 27 2023 11:46:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192708225392 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:46:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2661833,0,0,231593,0) write (2112562,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:46:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:46:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609015,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:46:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:46:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2893426 total) msec
Mar 27 2023 11:46:43 GMT: INFO (info): (hist.c:331) (00: 0002891913) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:46:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:46:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2112563 total) msec
Mar 27 2023 11:46:43 GMT: INFO (info): (hist.c:331) (00: 0001680845) (01: 0000404996) (02: 0000024055) (03: 0000002426)
Mar 27 2023 11:46:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:46:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:46:44 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (36915790,127547) total-ms 21051
Mar 27 2023 11:46:45 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:46:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:46:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:46:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 92 user-cpu-pct 91 kernel-cpu-pct 1 free-mem-kbytes 10647048 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:46:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 93 threads (9,64,39,30) heap-kbytes (12925387,12993344,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:46:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:46:53 GMT: INFO (info): (ticker.c:319) fds: proto (76,128063,127987) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:46:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6927964
Mar 27 2023 11:46:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (14535,1772223) ctrl (6,13) meta (0,0) rw (20169,23485)
Mar 27 2023 11:46:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52165069 master 15793899 prole 34441918 non-replica 1929252
Mar 27 2023 11:46:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,321,0) active (0,0,0) complete-pct 84.98
Mar 27 2023 11:46:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11666997160 index-bytes 3338564416 set-index-bytes 0 sindex-bytes 8328432744 used-pct 67.91
Mar 27 2023 11:46:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192631366000 avail-pct 47 cache-read-pct 80.95
Mar 27 2023 11:46:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2661855,0,0,231600,0) write (2112587,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:46:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:46:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609048,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:46:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:46:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2893455 total) msec
Mar 27 2023 11:46:53 GMT: INFO (info): (hist.c:331) (00: 0002891942) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:46:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:46:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2112588 total) msec
Mar 27 2023 11:46:53 GMT: INFO (info): (hist.c:331) (00: 0001680865) (01: 0000405001) (02: 0000024055) (03: 0000002426)
Mar 27 2023 11:46:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:46:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:46:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 192631634864 free-wblocks 976628 write-q 0 write (431080,0.2) defrag-q 0 defrag-read (383532,15.2) defrag-write (124884,0.1)
Mar 27 2023 11:47:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:47:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:47:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 110 user-cpu-pct 103 kernel-cpu-pct 7 free-mem-kbytes 10647172 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:47:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 118 threads (9,64,39,30) heap-kbytes (12925497,12993280,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:47:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:47:03 GMT: INFO (info): (ticker.c:319) fds: proto (76,128063,127987) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:47:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6928231
Mar 27 2023 11:47:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (102076,12413974) ctrl (9,25) meta (0,0) rw (25185,34756)
Mar 27 2023 11:47:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52165642 master 15793899 prole 34442491 non-replica 1929251
Mar 27 2023 11:47:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,321,0) active (0,2,0) complete-pct 84.98
Mar 27 2023 11:47:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11667075300 index-bytes 3338601088 set-index-bytes 0 sindex-bytes 8328474212 used-pct 67.91
Mar 27 2023 11:47:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192631941680 avail-pct 47 cache-read-pct 77.78
Mar 27 2023 11:47:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2661881,0,0,231600,0) write (2112613,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:47:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:47:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609070,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:47:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:47:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2893481 total) msec
Mar 27 2023 11:47:03 GMT: INFO (info): (hist.c:331) (00: 0002891968) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:47:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:47:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2112614 total) msec
Mar 27 2023 11:47:03 GMT: INFO (info): (hist.c:331) (00: 0001680886) (01: 0000405006) (02: 0000024055) (03: 0000002426)
Mar 27 2023 11:47:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:47:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:47:06 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (36915791,1) total-ms 20982
Mar 27 2023 11:47:07 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:47:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:47:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:47:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 95 user-cpu-pct 92 kernel-cpu-pct 3 free-mem-kbytes 10646660 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:47:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 102 threads (9,64,39,30) heap-kbytes (12925738,12993476,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:47:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:47:13 GMT: INFO (info): (ticker.c:319) fds: proto (77,128064,127987) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:47:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6928498
Mar 27 2023 11:47:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (66454,8096753) ctrl (6,11) meta (0,0) rw (21037,30906)
Mar 27 2023 11:47:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52166021 master 15793901 prole 34442868 non-replica 1929251
Mar 27 2023 11:47:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,319,0) active (0,1,0) complete-pct 85.07
Mar 27 2023 11:47:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11667131972 index-bytes 3338625344 set-index-bytes 0 sindex-bytes 8328506628 used-pct 67.91
Mar 27 2023 11:47:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192632332736 avail-pct 47 cache-read-pct 88.17
Mar 27 2023 11:47:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2661902,0,0,231601,0) write (2112632,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:47:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:47:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609097,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:47:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:47:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2893503 total) msec
Mar 27 2023 11:47:13 GMT: INFO (info): (hist.c:331) (00: 0002891990) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:47:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:47:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2112633 total) msec
Mar 27 2023 11:47:13 GMT: INFO (info): (hist.c:331) (00: 0001680902) (01: 0000405009) (02: 0000024055) (03: 0000002426)
Mar 27 2023 11:47:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:47:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:47:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 192632472544 free-wblocks 976626 write-q 0 write (431084,0.2) defrag-q 0 defrag-read (383533,0.1) defrag-write (124885,0.1)
Mar 27 2023 11:47:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:47:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:47:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 103 user-cpu-pct 101 kernel-cpu-pct 2 free-mem-kbytes 10646996 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:47:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 104 threads (9,64,39,30) heap-kbytes (12925736,12993496,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:47:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:47:23 GMT: INFO (info): (ticker.c:319) fds: proto (34,128064,128030) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:47:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6928764
Mar 27 2023 11:47:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (23414,2854867) ctrl (4,7) meta (0,0) rw (996,3201)
Mar 27 2023 11:47:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52166147 master 15793902 prole 34442993 non-replica 1929251
Mar 27 2023 11:47:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,318,0) active (0,0,0) complete-pct 85.12
Mar 27 2023 11:47:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11667148756 index-bytes 3338633408 set-index-bytes 0 sindex-bytes 8328515348 used-pct 67.91
Mar 27 2023 11:47:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192632472544 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:47:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2661902,0,0,231601,0) write (2112633,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:47:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:47:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609103,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:47:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:47:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2893503 total) msec
Mar 27 2023 11:47:23 GMT: INFO (info): (hist.c:331) (00: 0002891990) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:47:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:47:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2112634 total) msec
Mar 27 2023 11:47:23 GMT: INFO (info): (hist.c:331) (00: 0001680903) (01: 0000405009) (02: 0000024055) (03: 0000002426)
Mar 27 2023 11:47:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:47:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:47:28 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (36915797,6) total-ms 21099
Mar 27 2023 11:47:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:47:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:47:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 61 user-cpu-pct 53 kernel-cpu-pct 8 free-mem-kbytes 10646984 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:47:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 70 threads (9,64,39,30) heap-kbytes (12926812,12994516,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:47:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:47:33 GMT: INFO (info): (ticker.c:319) fds: proto (61,128100,128039) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:47:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6929030
Mar 27 2023 11:47:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (131015,16159980) ctrl (14,40) meta (0,0) rw (209747,241448)
Mar 27 2023 11:47:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52166839 master 15793907 prole 34443681 non-replica 1929251
Mar 27 2023 11:47:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,318,0) active (0,4,0) complete-pct 85.12
Mar 27 2023 11:47:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11667226208 index-bytes 3338677696 set-index-bytes 0 sindex-bytes 8328548512 used-pct 67.91
Mar 27 2023 11:47:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192633540928 avail-pct 47 cache-read-pct 73.53
Mar 27 2023 11:47:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2662232,0,0,231605,0) write (2112772,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:47:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:47:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609141,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:47:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:47:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2893837 total) msec
Mar 27 2023 11:47:33 GMT: INFO (info): (hist.c:331) (00: 0002892324) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:47:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:47:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2112773 total) msec
Mar 27 2023 11:47:33 GMT: INFO (info): (hist.c:331) (00: 0001681011) (01: 0000405040) (02: 0000024055) (03: 0000002426)
Mar 27 2023 11:47:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:47:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:47:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 192634116656 free-wblocks 976616 write-q 0 write (431109,1.2) defrag-q 0 defrag-read (383547,0.7) defrag-write (124891,0.3)
Mar 27 2023 11:47:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:47:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:47:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 12 user-cpu-pct 4 kernel-cpu-pct 8 free-mem-kbytes 10649000 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:47:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 22 threads (9,64,39,30) heap-kbytes (12926849,12994564,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:47:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:47:43 GMT: INFO (info): (ticker.c:319) fds: proto (63,128102,128039) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:47:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6929298
Mar 27 2023 11:47:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (142702,17606048) ctrl (10,15) meta (0,0) rw (7221,3036)
Mar 27 2023 11:47:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52167555 master 15793913 prole 34444391 non-replica 1929251
Mar 27 2023 11:47:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,314,0) active (0,1,0) complete-pct 85.31
Mar 27 2023 11:47:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11667328912 index-bytes 3338723520 set-index-bytes 0 sindex-bytes 8328605392 used-pct 67.91
Mar 27 2023 11:47:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192634218464 avail-pct 47 cache-read-pct 77.78
Mar 27 2023 11:47:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2662234,0,0,231607,0) write (2112780,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:47:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:47:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609162,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:47:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:47:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2893841 total) msec
Mar 27 2023 11:47:43 GMT: INFO (info): (hist.c:331) (00: 0002892328) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:47:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:47:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2112781 total) msec
Mar 27 2023 11:47:43 GMT: INFO (info): (hist.c:331) (00: 0001681018) (01: 0000405041) (02: 0000024055) (03: 0000002426)
Mar 27 2023 11:47:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:47:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:47:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:47:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:47:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 4 user-cpu-pct 1 kernel-cpu-pct 3 free-mem-kbytes 10649056 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:47:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 8 threads (9,64,39,30) heap-kbytes (12926896,12994616,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:47:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:47:53 GMT: INFO (info): (ticker.c:319) fds: proto (62,128102,128040) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:47:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6929564
Mar 27 2023 11:47:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (46267,5669993) ctrl (4,7) meta (0,0) rw (905,2947)
Mar 27 2023 11:47:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52167830 master 15793914 prole 34444665 non-replica 1929248
Mar 27 2023 11:47:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,313,0) active (0,0,0) complete-pct 85.35
Mar 27 2023 11:47:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11667364824 index-bytes 3338741120 set-index-bytes 0 sindex-bytes 8328623704 used-pct 67.91
Mar 27 2023 11:47:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192634524688 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:47:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2662234,0,0,231607,0) write (2112781,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:47:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:47:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609175,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:47:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:47:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2893841 total) msec
Mar 27 2023 11:47:53 GMT: INFO (info): (hist.c:331) (00: 0002892328) (01: 0000001249) (02: 0000000192) (03: 0000000066)
Mar 27 2023 11:47:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:47:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2112782 total) msec
Mar 27 2023 11:47:53 GMT: INFO (info): (hist.c:331) (00: 0001681019) (01: 0000405041) (02: 0000024055) (03: 0000002426)
Mar 27 2023 11:47:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:47:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:47:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 192634573088 free-wblocks 976614 write-q 0 write (431112,0.2) defrag-q 0 defrag-read (383547,0.0) defrag-write (124891,0.0)
Mar 27 2023 11:47:59 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:48:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:48:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:48:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 51 user-cpu-pct 47 kernel-cpu-pct 4 free-mem-kbytes 10648692 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:48:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 53 threads (9,64,39,30) heap-kbytes (12928677,12997028,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:48:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:48:03 GMT: INFO (info): (ticker.c:319) fds: proto (208,128248,128040) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:48:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6929830
Mar 27 2023 11:48:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (27273,3272455) ctrl (9,25) meta (0,0) rw (876728,994777)
Mar 27 2023 11:48:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52168028 master 15793935 prole 34444842 non-replica 1929248
Mar 27 2023 11:48:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,313,0) active (0,2,0) complete-pct 85.35
Mar 27 2023 11:48:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11667380396 index-bytes 3338753792 set-index-bytes 0 sindex-bytes 8328626604 used-pct 67.91
Mar 27 2023 11:48:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192636689936 avail-pct 47 cache-read-pct 59.27
Mar 27 2023 11:48:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664121,0,0,231625,0) write (2113414,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:48:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:48:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609291,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:48:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:48:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2895746 total) msec
Mar 27 2023 11:48:03 GMT: INFO (info): (hist.c:331) (00: 0002894228) (01: 0000001253) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:48:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:48:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113415 total) msec
Mar 27 2023 11:48:03 GMT: INFO (info): (hist.c:331) (00: 0001681450) (01: 0000405231) (02: 0000024066) (03: 0000002427)
Mar 27 2023 11:48:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:48:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:48:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:48:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:48:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 113 user-cpu-pct 104 kernel-cpu-pct 9 free-mem-kbytes 10648340 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:48:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 125 threads (9,64,39,30) heap-kbytes (12928867,12997100,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:48:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:48:13 GMT: INFO (info): (ticker.c:319) fds: proto (208,128249,128041) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:48:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6930098
Mar 27 2023 11:48:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (144735,17875531) ctrl (11,24) meta (0,0) rw (9725,4666)
Mar 27 2023 11:48:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52168836 master 15793939 prole 34445646 non-replica 1929247
Mar 27 2023 11:48:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,311,0) active (0,2,0) complete-pct 85.45
Mar 27 2023 11:48:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11667486248 index-bytes 3338805504 set-index-bytes 0 sindex-bytes 8328680744 used-pct 67.91
Mar 27 2023 11:48:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192637514784 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:48:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664121,0,0,231625,0) write (2113418,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:48:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:48:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609307,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:48:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:48:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2895746 total) msec
Mar 27 2023 11:48:13 GMT: INFO (info): (hist.c:331) (00: 0002894228) (01: 0000001253) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:48:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:48:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113419 total) msec
Mar 27 2023 11:48:13 GMT: INFO (info): (hist.c:331) (00: 0001681454) (01: 0000405231) (02: 0000024066) (03: 0000002427)
Mar 27 2023 11:48:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:48:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:48:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 192637783104 free-wblocks 976608 write-q 0 write (431204,4.6) defrag-q 0 defrag-read (383628,4.1) defrag-write (124925,1.7)
Mar 27 2023 11:48:22 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (36915821,24) total-ms 22429
Mar 27 2023 11:48:23 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:48:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:48:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:48:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 100 user-cpu-pct 93 kernel-cpu-pct 7 free-mem-kbytes 10648340 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:48:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 107 threads (9,64,39,30) heap-kbytes (12928939,12997164,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:48:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:48:23 GMT: INFO (info): (ticker.c:319) fds: proto (207,128249,128042) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:48:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6930363
Mar 27 2023 11:48:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (99807,12346488) ctrl (6,11) meta (0,0) rw (1819,2724)
Mar 27 2023 11:48:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52169346 master 15793941 prole 34446157 non-replica 1929247
Mar 27 2023 11:48:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,309,0) active (0,1,0) complete-pct 85.54
Mar 27 2023 11:48:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11667553816 index-bytes 3338838144 set-index-bytes 0 sindex-bytes 8328715672 used-pct 67.91
Mar 27 2023 11:48:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192638000384 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:48:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664121,0,0,231625,0) write (2113420,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:48:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:48:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609316,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:48:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:48:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2895746 total) msec
Mar 27 2023 11:48:23 GMT: INFO (info): (hist.c:331) (00: 0002894228) (01: 0000001253) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:48:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:48:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113421 total) msec
Mar 27 2023 11:48:23 GMT: INFO (info): (hist.c:331) (00: 0001681456) (01: 0000405231) (02: 0000024066) (03: 0000002427)
Mar 27 2023 11:48:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:48:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:48:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:48:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:48:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 104 user-cpu-pct 101 kernel-cpu-pct 3 free-mem-kbytes 10648472 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:48:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 110 threads (9,64,39,30) heap-kbytes (12929075,12997172,14455296) heap-efficiency-pct 99.5
Mar 27 2023 11:48:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:48:33 GMT: INFO (info): (ticker.c:319) fds: proto (207,128249,128042) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:48:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6930630
Mar 27 2023 11:48:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (55474,6883876) ctrl (6,14) meta (0,0) rw (9993,4584)
Mar 27 2023 11:48:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52169653 master 15793945 prole 34446460 non-replica 1929247
Mar 27 2023 11:48:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,308,0) active (0,1,0) complete-pct 85.59
Mar 27 2023 11:48:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11667586288 index-bytes 3338857792 set-index-bytes 0 sindex-bytes 8328728496 used-pct 67.91
Mar 27 2023 11:48:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192638281312 avail-pct 47 cache-read-pct 91.67
Mar 27 2023 11:48:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664134,0,0,231628,0) write (2113433,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:48:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:48:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609344,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:48:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:48:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2895762 total) msec
Mar 27 2023 11:48:33 GMT: INFO (info): (hist.c:331) (00: 0002894244) (01: 0000001253) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:48:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:48:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113434 total) msec
Mar 27 2023 11:48:33 GMT: INFO (info): (hist.c:331) (00: 0001681468) (01: 0000405232) (02: 0000024066) (03: 0000002427)
Mar 27 2023 11:48:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:48:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:48:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 192638581808 free-wblocks 976606 write-q 0 write (431206,0.1) defrag-q 0 defrag-read (383628,0.0) defrag-write (124925,0.0)
Mar 27 2023 11:48:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:48:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:48:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 113 user-cpu-pct 105 kernel-cpu-pct 8 free-mem-kbytes 10645284 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:48:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 125 threads (9,64,39,30) heap-kbytes (12927666,12994824,14453248) heap-efficiency-pct 99.5
Mar 27 2023 11:48:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:48:43 GMT: INFO (info): (ticker.c:319) fds: proto (208,128250,128042) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:48:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6930898
Mar 27 2023 11:48:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (136443,16538180) ctrl (16,40) meta (0,0) rw (5029,519)
Mar 27 2023 11:48:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52170389 master 15793948 prole 34447193 non-replica 1909284
Mar 27 2023 11:48:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,307,0) active (0,3,0) complete-pct 85.63
Mar 27 2023 11:48:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11666228868 index-bytes 3338904896 set-index-bytes 0 sindex-bytes 8327323972 used-pct 67.91
Mar 27 2023 11:48:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192638999808 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:48:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664134,0,0,231628,0) write (2113436,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:48:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:48:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609352,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:48:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:48:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2895762 total) msec
Mar 27 2023 11:48:43 GMT: INFO (info): (hist.c:331) (00: 0002894244) (01: 0000001253) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:48:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:48:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113437 total) msec
Mar 27 2023 11:48:43 GMT: INFO (info): (hist.c:331) (00: 0001681471) (01: 0000405232) (02: 0000024066) (03: 0000002427)
Mar 27 2023 11:48:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:48:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:48:44 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (36972465,56644) total-ms 21785
Mar 27 2023 11:48:45 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:48:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:48:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:48:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 102 user-cpu-pct 95 kernel-cpu-pct 7 free-mem-kbytes 10647160 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:48:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 111 threads (9,64,39,30) heap-kbytes (12926499,12994616,14453248) heap-efficiency-pct 99.5
Mar 27 2023 11:48:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:48:53 GMT: INFO (info): (ticker.c:319) fds: proto (206,128250,128044) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:48:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6931163
Mar 27 2023 11:48:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (116997,14103197) ctrl (8,13) meta (0,0) rw (6,413)
Mar 27 2023 11:48:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52171016 master 15793948 prole 34447821 non-replica 1909284
Mar 27 2023 11:48:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,304,0) active (0,1,0) complete-pct 85.77
Mar 27 2023 11:48:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11665086220 index-bytes 3338945024 set-index-bytes 0 sindex-bytes 8326141196 used-pct 67.90
Mar 27 2023 11:48:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192639556752 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:48:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664134,0,0,231628,0) write (2113436,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:48:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:48:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609360,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:48:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:48:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2895762 total) msec
Mar 27 2023 11:48:53 GMT: INFO (info): (hist.c:331) (00: 0002894244) (01: 0000001253) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:48:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:48:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113437 total) msec
Mar 27 2023 11:48:53 GMT: INFO (info): (hist.c:331) (00: 0001681471) (01: 0000405232) (02: 0000024066) (03: 0000002427)
Mar 27 2023 11:48:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:48:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:48:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 192639748976 free-wblocks 976597 write-q 0 write (431243,1.9) defrag-q 0 defrag-read (383654,1.3) defrag-write (124936,0.6)
Mar 27 2023 11:49:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:49:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:49:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 107 user-cpu-pct 103 kernel-cpu-pct 4 free-mem-kbytes 10647040 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:49:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 113 threads (9,64,39,30) heap-kbytes (12923939,12988428,14449152) heap-efficiency-pct 99.5
Mar 27 2023 11:49:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:49:03 GMT: INFO (info): (ticker.c:319) fds: proto (92,128323,128231) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:49:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6931430
Mar 27 2023 11:49:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (59516,7249653) ctrl (6,13) meta (0,0) rw (351290,383547)
Mar 27 2023 11:49:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52171363 master 15793949 prole 34448167 non-replica 1889289
Mar 27 2023 11:49:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,303,0) active (0,0,0) complete-pct 85.82
Mar 27 2023 11:49:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11663525968 index-bytes 3338967232 set-index-bytes 0 sindex-bytes 8324558736 used-pct 67.89
Mar 27 2023 11:49:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192639901392 avail-pct 47 cache-read-pct 62.87
Mar 27 2023 11:49:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664421,0,0,231629,0) write (2113702,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:49:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:49:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609388,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:49:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:49:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896050 total) msec
Mar 27 2023 11:49:03 GMT: INFO (info): (hist.c:331) (00: 0002894532) (01: 0000001253) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:49:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:49:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113703 total) msec
Mar 27 2023 11:49:03 GMT: INFO (info): (hist.c:331) (00: 0001681655) (01: 0000405313) (02: 0000024067) (03: 0000002427)
Mar 27 2023 11:49:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:49:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:49:07 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (37100728,128263) total-ms 21521
Mar 27 2023 11:49:08 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:49:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:49:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:49:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 95 user-cpu-pct 92 kernel-cpu-pct 3 free-mem-kbytes 10647508 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:49:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 98 threads (9,64,39,30) heap-kbytes (12922561,12988408,14449152) heap-efficiency-pct 99.5
Mar 27 2023 11:49:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:49:13 GMT: INFO (info): (ticker.c:319) fds: proto (93,128324,128231) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:49:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6931697
Mar 27 2023 11:49:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (48019,5915620) ctrl (2,7) meta (0,0) rw (1593,10424)
Mar 27 2023 11:49:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52151663 master 15793951 prole 34448428 non-replica 1889289
Mar 27 2023 11:49:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,303,0) active (0,1,0) complete-pct 85.82
Mar 27 2023 11:49:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11660889564 index-bytes 3337706432 set-index-bytes 0 sindex-bytes 8323183132 used-pct 67.88
Mar 27 2023 11:49:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192562773408 avail-pct 47 cache-read-pct 66.67
Mar 27 2023 11:49:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664422,0,0,231630,0) write (2113705,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:49:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:49:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609406,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:49:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:49:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896052 total) msec
Mar 27 2023 11:49:13 GMT: INFO (info): (hist.c:331) (00: 0002894534) (01: 0000001253) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:49:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:49:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113706 total) msec
Mar 27 2023 11:49:13 GMT: INFO (info): (hist.c:331) (00: 0001681658) (01: 0000405313) (02: 0000024067) (03: 0000002427)
Mar 27 2023 11:49:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:49:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:49:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 192562874512 free-wblocks 976988 write-q 0 write (431246,0.2) defrag-q 0 defrag-read (384046,19.6) defrag-write (124937,0.1)
Mar 27 2023 11:49:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:49:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:49:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 102 user-cpu-pct 101 kernel-cpu-pct 1 free-mem-kbytes 10647444 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:49:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 103 threads (9,64,39,30) heap-kbytes (12920561,12984812,14449152) heap-efficiency-pct 99.5
Mar 27 2023 11:49:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:49:23 GMT: INFO (info): (ticker.c:319) fds: proto (92,128324,128232) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:49:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6931962
Mar 27 2023 11:49:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (16033,2005612) ctrl (6,13) meta (0,0) rw (2583,1702)
Mar 27 2023 11:49:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52151765 master 15793954 prole 34448527 non-replica 1869405
Mar 27 2023 11:49:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,302,0) active (0,0,0) complete-pct 85.87
Mar 27 2023 11:49:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11658938204 index-bytes 3337712960 set-index-bytes 0 sindex-bytes 8321225244 used-pct 67.86
Mar 27 2023 11:49:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192562886688 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:49:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664422,0,0,231630,0) write (2113708,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:49:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:49:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609416,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:49:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:49:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896052 total) msec
Mar 27 2023 11:49:23 GMT: INFO (info): (hist.c:331) (00: 0002894534) (01: 0000001253) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:49:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:49:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113709 total) msec
Mar 27 2023 11:49:23 GMT: INFO (info): (hist.c:331) (00: 0001681661) (01: 0000405313) (02: 0000024067) (03: 0000002427)
Mar 27 2023 11:49:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:49:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:49:29 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (37254745,154017) total-ms 20767
Mar 27 2023 11:49:30 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:49:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:49:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:49:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 95 user-cpu-pct 92 kernel-cpu-pct 3 free-mem-kbytes 10647004 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:49:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 99 threads (9,64,39,30) heap-kbytes (12919105,12984632,14449152) heap-efficiency-pct 99.5
Mar 27 2023 11:49:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:49:33 GMT: INFO (info): (ticker.c:319) fds: proto (90,128324,128234) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:49:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6932230
Mar 27 2023 11:49:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (51841,6344149) ctrl (2,7) meta (0,0) rw (1105,1760)
Mar 27 2023 11:49:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52132094 master 15793956 prole 34448849 non-replica 1869405
Mar 27 2023 11:49:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,302,0) active (0,1,0) complete-pct 85.87
Mar 27 2023 11:49:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11656221440 index-bytes 3336454016 set-index-bytes 0 sindex-bytes 8319767424 used-pct 67.85
Mar 27 2023 11:49:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192485041360 avail-pct 47 cache-read-pct 60.00
Mar 27 2023 11:49:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664423,0,0,231631,0) write (2113711,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:49:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:49:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609427,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:49:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:49:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896054 total) msec
Mar 27 2023 11:49:33 GMT: INFO (info): (hist.c:331) (00: 0002894536) (01: 0000001253) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:49:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:49:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113712 total) msec
Mar 27 2023 11:49:33 GMT: INFO (info): (hist.c:331) (00: 0001681664) (01: 0000405313) (02: 0000024067) (03: 0000002427)
Mar 27 2023 11:49:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:49:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:49:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 192485203712 free-wblocks 977292 write-q 0 write (431248,0.1) defrag-q 0 defrag-read (384352,15.3) defrag-write (124937,0.0)
Mar 27 2023 11:49:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:49:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:49:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 105 user-cpu-pct 102 kernel-cpu-pct 3 free-mem-kbytes 10646948 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:49:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 108 threads (9,64,39,30) heap-kbytes (12918619,12981748,14443008) heap-efficiency-pct 99.5
Mar 27 2023 11:49:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:49:43 GMT: INFO (info): (ticker.c:319) fds: proto (91,128325,128234) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:49:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6932497
Mar 27 2023 11:49:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (47532,5698471) ctrl (6,14) meta (0,0) rw (742,2528)
Mar 27 2023 11:49:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52132384 master 15793957 prole 34449138 non-replica 1869404
Mar 27 2023 11:49:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,301,0) active (0,1,0) complete-pct 85.91
Mar 27 2023 11:49:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11655763608 index-bytes 3336472576 set-index-bytes 0 sindex-bytes 8319291032 used-pct 67.85
Mar 27 2023 11:49:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192485360032 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:49:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664423,0,0,231631,0) write (2113712,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:49:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:49:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609432,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:49:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:49:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896054 total) msec
Mar 27 2023 11:49:43 GMT: INFO (info): (hist.c:331) (00: 0002894536) (01: 0000001253) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:49:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:49:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113713 total) msec
Mar 27 2023 11:49:43 GMT: INFO (info): (hist.c:331) (00: 0001681665) (01: 0000405313) (02: 0000024067) (03: 0000002427)
Mar 27 2023 11:49:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:49:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:49:51 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (37348046,93301) total-ms 20923
Mar 27 2023 11:49:52 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:49:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:49:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:49:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 98 user-cpu-pct 93 kernel-cpu-pct 5 free-mem-kbytes 10646368 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:49:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 104 threads (9,64,39,30) heap-kbytes (12916389,12980168,14443008) heap-efficiency-pct 99.5
Mar 27 2023 11:49:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:49:53 GMT: INFO (info): (ticker.c:319) fds: proto (91,128326,128235) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:49:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6932762
Mar 27 2023 11:49:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (79443,9672951) ctrl (8,20) meta (0,0) rw (8448,3217)
Mar 27 2023 11:49:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52112937 master 15793963 prole 34449569 non-replica 1829589
Mar 27 2023 11:49:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,300,0) active (0,1,0) complete-pct 85.96
Mar 27 2023 11:49:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11652273452 index-bytes 3335227968 set-index-bytes 0 sindex-bytes 8317045484 used-pct 67.83
Mar 27 2023 11:49:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192409899680 avail-pct 47 cache-read-pct 22.22
Mar 27 2023 11:49:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664427,0,0,231631,0) write (2113720,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:49:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:49:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609448,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:49:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:49:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896058 total) msec
Mar 27 2023 11:49:53 GMT: INFO (info): (hist.c:331) (00: 0002894539) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:49:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:49:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113721 total) msec
Mar 27 2023 11:49:53 GMT: INFO (info): (hist.c:331) (00: 0001681672) (01: 0000405314) (02: 0000024067) (03: 0000002427)
Mar 27 2023 11:49:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:49:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:49:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 192410083328 free-wblocks 977618 write-q 0 write (431251,0.2) defrag-q 0 defrag-read (384681,16.5) defrag-write (124937,0.0)
Mar 27 2023 11:50:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:50:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:50:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 106 user-cpu-pct 102 kernel-cpu-pct 4 free-mem-kbytes 10646292 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:50:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 110 threads (9,64,39,30) heap-kbytes (12913972,12980076,14443008) heap-efficiency-pct 99.5
Mar 27 2023 11:50:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:50:03 GMT: INFO (info): (ticker.c:319) fds: proto (52,128328,128276) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:50:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6933030
Mar 27 2023 11:50:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (54789,6608208) ctrl (4,9) meta (0,0) rw (10235,7104)
Mar 27 2023 11:50:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52113288 master 15793969 prole 34449914 non-replica 1829589
Mar 27 2023 11:50:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,299,0) active (0,1,0) complete-pct 86.01
Mar 27 2023 11:50:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11649702856 index-bytes 3335250432 set-index-bytes 0 sindex-bytes 8314452424 used-pct 67.81
Mar 27 2023 11:50:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192410269360 avail-pct 47 cache-read-pct 87.50
Mar 27 2023 11:50:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664437,0,0,231635,0) write (2113734,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:50:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:50:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609481,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:50:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:50:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896072 total) msec
Mar 27 2023 11:50:03 GMT: INFO (info): (hist.c:331) (00: 0002894553) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:50:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:50:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113735 total) msec
Mar 27 2023 11:50:03 GMT: INFO (info): (hist.c:331) (00: 0001681683) (01: 0000405317) (02: 0000024067) (03: 0000002427)
Mar 27 2023 11:50:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:50:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:50:12 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (37553866,205820) total-ms 20578
Mar 27 2023 11:50:13 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:50:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:50:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:50:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 92 user-cpu-pct 91 kernel-cpu-pct 1 free-mem-kbytes 10646712 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:50:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 94 threads (9,64,39,30) heap-kbytes (12912489,12974140,14436864) heap-efficiency-pct 99.5
Mar 27 2023 11:50:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:50:13 GMT: INFO (info): (ticker.c:319) fds: proto (52,128328,128276) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:50:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6933296
Mar 27 2023 11:50:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (22657,2719002) ctrl (8,18) meta (0,0) rw (941,1623)
Mar 27 2023 11:50:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52073587 master 15793970 prole 34450028 non-replica 1829583
Mar 27 2023 11:50:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,298,0) active (0,0,0) complete-pct 86.06
Mar 27 2023 11:50:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11645723668 index-bytes 3332709568 set-index-bytes 0 sindex-bytes 8313014100 used-pct 67.79
Mar 27 2023 11:50:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192259517104 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:50:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664437,0,0,231635,0) write (2113735,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:50:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:50:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609487,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:50:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:50:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896072 total) msec
Mar 27 2023 11:50:13 GMT: INFO (info): (hist.c:331) (00: 0002894553) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:50:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:50:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113736 total) msec
Mar 27 2023 11:50:13 GMT: INFO (info): (hist.c:331) (00: 0001681684) (01: 0000405317) (02: 0000024067) (03: 0000002427)
Mar 27 2023 11:50:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:50:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:50:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 192259525232 free-wblocks 978208 write-q 0 write (431254,0.2) defrag-q 0 defrag-read (385274,29.6) defrag-write (124939,0.1)
Mar 27 2023 11:50:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:50:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:50:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 101 user-cpu-pct 101 kernel-cpu-pct 0 free-mem-kbytes 10646832 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:50:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 100 threads (9,64,39,30) heap-kbytes (12910885,12973436,14436864) heap-efficiency-pct 99.5
Mar 27 2023 11:50:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:50:23 GMT: INFO (info): (ticker.c:319) fds: proto (18,128329,128311) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:50:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6933562
Mar 27 2023 11:50:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (0,0) ctrl (4,11) meta (0,0) rw (2619,2801)
Mar 27 2023 11:50:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52073594 master 15793973 prole 34450032 non-replica 1789760
Mar 27 2023 11:50:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,298,0) active (0,0,0) complete-pct 86.06
Mar 27 2023 11:50:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11644135496 index-bytes 3332710016 set-index-bytes 0 sindex-bytes 8311425480 used-pct 67.78
Mar 27 2023 11:50:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192259557424 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:50:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664437,0,0,231635,0) write (2113738,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:50:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:50:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609497,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:50:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:50:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896072 total) msec
Mar 27 2023 11:50:23 GMT: INFO (info): (hist.c:331) (00: 0002894553) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:50:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:50:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113739 total) msec
Mar 27 2023 11:50:23 GMT: INFO (info): (hist.c:331) (00: 0001681687) (01: 0000405317) (02: 0000024067) (03: 0000002427)
Mar 27 2023 11:50:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:50:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:50:33 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (37850469,296603) total-ms 20012
Mar 27 2023 11:50:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:50:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:50:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 99 user-cpu-pct 99 kernel-cpu-pct 0 free-mem-kbytes 10646444 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:50:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 99 threads (9,64,39,30) heap-kbytes (12904260,12972876,14436864) heap-efficiency-pct 99.5
Mar 27 2023 11:50:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:50:33 GMT: INFO (info): (ticker.c:319) fds: proto (18,128329,128311) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:50:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6933830
Mar 27 2023 11:50:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (0,0) ctrl (8,22) meta (0,0) rw (796,1124)
Mar 27 2023 11:50:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52073593 master 15793974 prole 34450036 non-replica 1709951
Mar 27 2023 11:50:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,298,0) active (0,0,0) complete-pct 86.06
Mar 27 2023 11:50:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11637664112 index-bytes 3332709952 set-index-bytes 0 sindex-bytes 8304954160 used-pct 67.74
Mar 27 2023 11:50:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192259557632 avail-pct 47 cache-read-pct 100.00
Mar 27 2023 11:50:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664437,0,0,231635,0) write (2113739,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:50:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:50:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609515,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:50:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:50:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896072 total) msec
Mar 27 2023 11:50:33 GMT: INFO (info): (hist.c:331) (00: 0002894553) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:50:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:50:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113740 total) msec
Mar 27 2023 11:50:33 GMT: INFO (info): (hist.c:331) (00: 0001681688) (01: 0000405317) (02: 0000024067) (03: 0000002427)
Mar 27 2023 11:50:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:50:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:50:34 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:50:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 192259585568 free-wblocks 978208 write-q 0 write (431255,0.1) defrag-q 0 defrag-read (385274,0.0) defrag-write (124939,0.0)
Mar 27 2023 11:50:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:50:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:50:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 94 user-cpu-pct 93 kernel-cpu-pct 1 free-mem-kbytes 10649352 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:50:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 95 threads (9,64,39,30) heap-kbytes (12895495,12963052,14436864) heap-efficiency-pct 99.5
Mar 27 2023 11:50:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:50:43 GMT: INFO (info): (ticker.c:319) fds: proto (18,128329,128311) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:50:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6934095
Mar 27 2023 11:50:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (15252,1847138) ctrl (8,23) meta (0,0) rw (3908,2791)
Mar 27 2023 11:50:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52073686 master 15793978 prole 34450125 non-replica 1670025
Mar 27 2023 11:50:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,298,0) active (0,1,0) complete-pct 86.06
Mar 27 2023 11:50:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11629032296 index-bytes 3332715904 set-index-bytes 0 sindex-bytes 8296316392 used-pct 67.69
Mar 27 2023 11:50:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192259682480 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:50:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664437,0,0,231635,0) write (2113743,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:50:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:50:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609528,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:50:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:50:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896072 total) msec
Mar 27 2023 11:50:43 GMT: INFO (info): (hist.c:331) (00: 0002894553) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:50:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:50:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113744 total) msec
Mar 27 2023 11:50:43 GMT: INFO (info): (hist.c:331) (00: 0001681692) (01: 0000405317) (02: 0000024067) (03: 0000002427)
Mar 27 2023 11:50:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:50:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:50:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:50:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:50:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 112 user-cpu-pct 104 kernel-cpu-pct 8 free-mem-kbytes 10649424 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:50:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 122 threads (9,64,39,30) heap-kbytes (12888486,12947412,14436864) heap-efficiency-pct 99.5
Mar 27 2023 11:50:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:50:53 GMT: INFO (info): (ticker.c:319) fds: proto (17,128330,128313) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:50:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6934362
Mar 27 2023 11:50:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (128904,15634585) ctrl (14,34) meta (0,0) rw (48,4379)
Mar 27 2023 11:50:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 52074372 master 15793978 prole 34450811 non-replica 1670024
Mar 27 2023 11:50:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,297,0) active (0,3,0) complete-pct 86.10
Mar 27 2023 11:50:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11622188508 index-bytes 3332759808 set-index-bytes 0 sindex-bytes 8289428700 used-pct 67.65
Mar 27 2023 11:50:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 192260279440 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:50:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664437,0,0,231635,0) write (2113743,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:50:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:50:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609542,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:50:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:50:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896072 total) msec
Mar 27 2023 11:50:53 GMT: INFO (info): (hist.c:331) (00: 0002894553) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:50:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:50:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113744 total) msec
Mar 27 2023 11:50:53 GMT: INFO (info): (hist.c:331) (00: 0001681692) (01: 0000405317) (02: 0000024067) (03: 0000002427)
Mar 27 2023 11:50:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:50:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:50:55 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (38520485,670016) total-ms 21060
Mar 27 2023 11:50:56 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:50:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191797823856 free-wblocks 980229 write-q 0 write (431264,0.4) defrag-q 0 defrag-read (387306,101.6) defrag-write (124942,0.2)
Mar 27 2023 11:51:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:51:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:51:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 100 user-cpu-pct 93 kernel-cpu-pct 7 free-mem-kbytes 10649832 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:51:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 112 threads (9,64,39,30) heap-kbytes (12886481,12941048,14436864) heap-efficiency-pct 99.6
Mar 27 2023 11:51:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:51:03 GMT: INFO (info): (ticker.c:319) fds: proto (16,128331,128315) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:51:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6934630
Mar 27 2023 11:51:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (130091,16032710) ctrl (8,13) meta (0,0) rw (581,2014)
Mar 27 2023 11:51:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51955476 master 15793980 prole 34451545 non-replica 1670024
Mar 27 2023 11:51:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,294,0) active (0,1,0) complete-pct 86.24
Mar 27 2023 11:51:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11612682972 index-bytes 3325150464 set-index-bytes 0 sindex-bytes 8287532508 used-pct 67.59
Mar 27 2023 11:51:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191797995216 avail-pct 47 cache-read-pct 66.67
Mar 27 2023 11:51:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664439,0,0,231637,0) write (2113747,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:51:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:51:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609558,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:51:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:51:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896076 total) msec
Mar 27 2023 11:51:03 GMT: INFO (info): (hist.c:331) (00: 0002894557) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:51:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:51:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113748 total) msec
Mar 27 2023 11:51:03 GMT: INFO (info): (hist.c:331) (00: 0001681696) (01: 0000405317) (02: 0000024067) (03: 0000002427)
Mar 27 2023 11:51:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:51:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:51:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:51:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:51:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 105 user-cpu-pct 102 kernel-cpu-pct 3 free-mem-kbytes 10648104 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:51:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 108 threads (9,64,39,30) heap-kbytes (12886516,12941096,14436864) heap-efficiency-pct 99.6
Mar 27 2023 11:51:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:51:13 GMT: INFO (info): (ticker.c:319) fds: proto (17,128333,128316) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:51:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6934894
Mar 27 2023 11:51:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (46205,5790596) ctrl (4,7) meta (0,0) rw (1118,1226)
Mar 27 2023 11:51:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51955719 master 15793981 prole 34451787 non-replica 1670024
Mar 27 2023 11:51:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,293,0) active (0,0,0) complete-pct 86.29
Mar 27 2023 11:51:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11612708552 index-bytes 3325166016 set-index-bytes 0 sindex-bytes 8287542536 used-pct 67.59
Mar 27 2023 11:51:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191798220064 avail-pct 47 cache-read-pct 6.25
Mar 27 2023 11:51:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664443,0,0,231637,0) write (2113748,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:51:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:51:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609562,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:51:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:51:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896080 total) msec
Mar 27 2023 11:51:13 GMT: INFO (info): (hist.c:331) (00: 0002894561) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:51:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:51:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113749 total) msec
Mar 27 2023 11:51:13 GMT: INFO (info): (hist.c:331) (00: 0001681697) (01: 0000405317) (02: 0000024067) (03: 0000002427)
Mar 27 2023 11:51:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:51:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:51:17 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (38576109,55624) total-ms 20987
Mar 27 2023 11:51:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191644974768 free-wblocks 980893 write-q 0 write (431266,0.1) defrag-q 0 defrag-read (387973,33.3) defrag-write (124943,0.1)
Mar 27 2023 11:51:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:51:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:51:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 40 user-cpu-pct 39 kernel-cpu-pct 1 free-mem-kbytes 10648844 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:51:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 41 threads (9,64,39,30) heap-kbytes (12886534,12940980,14436864) heap-efficiency-pct 99.6
Mar 27 2023 11:51:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:51:23 GMT: INFO (info): (ticker.c:319) fds: proto (20,128338,128318) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:51:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6935162
Mar 27 2023 11:51:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (12310,1478837) ctrl (4,12) meta (0,0) rw (6423,6952)
Mar 27 2023 11:51:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51915871 master 15793987 prole 34451860 non-replica 1670024
Mar 27 2023 11:51:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,293,0) active (0,1,0) complete-pct 86.29
Mar 27 2023 11:51:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11610163076 index-bytes 3322615744 set-index-bytes 0 sindex-bytes 8287547332 used-pct 67.58
Mar 27 2023 11:51:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191645045104 avail-pct 47 cache-read-pct 91.84
Mar 27 2023 11:51:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664468,0,0,231643,0) write (2113764,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:51:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:51:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609582,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:51:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:51:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896111 total) msec
Mar 27 2023 11:51:23 GMT: INFO (info): (hist.c:331) (00: 0002894592) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:51:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:51:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113765 total) msec
Mar 27 2023 11:51:23 GMT: INFO (info): (hist.c:331) (00: 0001681710) (01: 0000405320) (02: 0000024067) (03: 0000002427)
Mar 27 2023 11:51:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:51:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:51:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:51:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:51:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 4 user-cpu-pct 1 kernel-cpu-pct 3 free-mem-kbytes 10649212 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:51:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 9 threads (9,64,39,30) heap-kbytes (12886592,12940984,14436864) heap-efficiency-pct 99.6
Mar 27 2023 11:51:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:51:33 GMT: INFO (info): (ticker.c:319) fds: proto (21,128339,128318) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:51:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6935430
Mar 27 2023 11:51:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (51804,6309786) ctrl (4,7) meta (0,0) rw (3283,2210)
Mar 27 2023 11:51:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51916169 master 15793989 prole 34452156 non-replica 1650076
Mar 27 2023 11:51:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,292,0) active (0,0,0) complete-pct 86.34
Mar 27 2023 11:51:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11610201844 index-bytes 3322634816 set-index-bytes 0 sindex-bytes 8287567028 used-pct 67.58
Mar 27 2023 11:51:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191645283936 avail-pct 47 cache-read-pct 100.00
Mar 27 2023 11:51:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664473,0,0,231644,0) write (2113769,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:51:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:51:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609595,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:51:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:51:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896117 total) msec
Mar 27 2023 11:51:33 GMT: INFO (info): (hist.c:331) (00: 0002894598) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:51:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:51:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113770 total) msec
Mar 27 2023 11:51:33 GMT: INFO (info): (hist.c:331) (00: 0001681714) (01: 0000405321) (02: 0000024067) (03: 0000002427)
Mar 27 2023 11:51:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:51:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:51:38 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:51:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191645296256 free-wblocks 980895 write-q 0 write (431267,0.1) defrag-q 0 defrag-read (387973,0.0) defrag-write (124943,0.0)
Mar 27 2023 11:51:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:51:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:51:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 55 user-cpu-pct 53 kernel-cpu-pct 2 free-mem-kbytes 10649024 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:51:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 56 threads (9,64,39,30) heap-kbytes (12885958,12938920,14436864) heap-efficiency-pct 99.6
Mar 27 2023 11:51:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:51:43 GMT: INFO (info): (ticker.c:319) fds: proto (22,128340,128318) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:51:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6935694
Mar 27 2023 11:51:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (23262,2909516) ctrl (4,12) meta (0,0) rw (2588,2129)
Mar 27 2023 11:51:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51916299 master 15793992 prole 34452283 non-replica 1650076
Mar 27 2023 11:51:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,292,0) active (0,1,0) complete-pct 86.34
Mar 27 2023 11:51:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11609519372 index-bytes 3322643136 set-index-bytes 0 sindex-bytes 8286876236 used-pct 67.58
Mar 27 2023 11:51:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191645414928 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:51:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664473,0,0,231644,0) write (2113772,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:51:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:51:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609611,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:51:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:51:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896117 total) msec
Mar 27 2023 11:51:43 GMT: INFO (info): (hist.c:331) (00: 0002894598) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:51:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:51:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113773 total) msec
Mar 27 2023 11:51:43 GMT: INFO (info): (hist.c:331) (00: 0001681717) (01: 0000405321) (02: 0000024067) (03: 0000002427)
Mar 27 2023 11:51:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:51:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:51:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:51:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:51:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 104 user-cpu-pct 102 kernel-cpu-pct 2 free-mem-kbytes 10648628 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:51:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 106 threads (9,64,39,30) heap-kbytes (12884474,12939072,14436864) heap-efficiency-pct 99.6
Mar 27 2023 11:51:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:51:53 GMT: INFO (info): (ticker.c:319) fds: proto (22,128341,128319) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:51:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6935962
Mar 27 2023 11:51:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (40851,4977334) ctrl (6,13) meta (0,0) rw (2465,452)
Mar 27 2023 11:51:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51916553 master 15793995 prole 34452534 non-replica 1650076
Mar 27 2023 11:51:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,291,0) active (0,0,0) complete-pct 86.38
Mar 27 2023 11:51:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11607976276 index-bytes 3322659392 set-index-bytes 0 sindex-bytes 8285316884 used-pct 67.57
Mar 27 2023 11:51:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191645708688 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:51:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2664473,0,0,231644,0) write (2113775,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:51:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:51:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609617,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:51:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:51:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896117 total) msec
Mar 27 2023 11:51:53 GMT: INFO (info): (hist.c:331) (00: 0002894598) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:51:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:51:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2113776 total) msec
Mar 27 2023 11:51:53 GMT: INFO (info): (hist.c:331) (00: 0001681720) (01: 0000405321) (02: 0000024067) (03: 0000002427)
Mar 27 2023 11:51:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:51:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:51:58 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (38703891,127782) total-ms 20123
Mar 27 2023 11:51:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191569663104 free-wblocks 981286 write-q 0 write (431270,0.2) defrag-q 0 defrag-read (388369,19.8) defrag-write (124944,0.1)
Mar 27 2023 11:52:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:52:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:52:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 58 user-cpu-pct 53 kernel-cpu-pct 5 free-mem-kbytes 10648624 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:52:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 65 threads (9,64,39,30) heap-kbytes (12881816,12933244,14436864) heap-efficiency-pct 99.6
Mar 27 2023 11:52:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:52:03 GMT: INFO (info): (ticker.c:319) fds: proto (108,128427,128319) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:52:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6936230
Mar 27 2023 11:52:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (87795,10814726) ctrl (14,40) meta (0,0) rw (357004,388210)
Mar 27 2023 11:52:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51897099 master 15794001 prole 34453022 non-replica 1610113
Mar 27 2023 11:52:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,291,0) active (0,4,0) complete-pct 86.38
Mar 27 2023 11:52:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11605844016 index-bytes 3321414336 set-index-bytes 0 sindex-bytes 8284429680 used-pct 67.55
Mar 27 2023 11:52:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191569999120 avail-pct 47 cache-read-pct 67.18
Mar 27 2023 11:52:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2665002,0,0,231650,0) write (2114051,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:52:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:52:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609647,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:52:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:52:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896652 total) msec
Mar 27 2023 11:52:03 GMT: INFO (info): (hist.c:331) (00: 0002895133) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:52:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:52:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2114052 total) msec
Mar 27 2023 11:52:03 GMT: INFO (info): (hist.c:331) (00: 0001681932) (01: 0000405345) (02: 0000024085) (03: 0000002449)
Mar 27 2023 11:52:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:52:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:52:09 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:52:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:52:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:52:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 54 user-cpu-pct 45 kernel-cpu-pct 9 free-mem-kbytes 10648400 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:52:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 66 threads (9,64,39,30) heap-kbytes (12880574,12931184,14436864) heap-efficiency-pct 99.6
Mar 27 2023 11:52:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:52:13 GMT: INFO (info): (ticker.c:319) fds: proto (109,128428,128319) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:52:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6936494
Mar 27 2023 11:52:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (168289,20639167) ctrl (6,6) meta (0,0) rw (42,4986)
Mar 27 2023 11:52:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51897984 master 15794001 prole 34453907 non-replica 1610113
Mar 27 2023 11:52:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,288,0) active (0,1,0) complete-pct 86.52
Mar 27 2023 11:52:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11604699616 index-bytes 3321470976 set-index-bytes 0 sindex-bytes 8283228640 used-pct 67.55
Mar 27 2023 11:52:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191570894592 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:52:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2665002,0,0,231650,0) write (2114051,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:52:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:52:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609657,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:52:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:52:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896652 total) msec
Mar 27 2023 11:52:13 GMT: INFO (info): (hist.c:331) (00: 0002895133) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:52:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:52:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2114052 total) msec
Mar 27 2023 11:52:13 GMT: INFO (info): (hist.c:331) (00: 0001681932) (01: 0000405345) (02: 0000024085) (03: 0000002449)
Mar 27 2023 11:52:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:52:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:52:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191571074096 free-wblocks 981282 write-q 0 write (431306,1.8) defrag-q 0 defrag-read (388396,1.4) defrag-write (124954,0.5)
Mar 27 2023 11:52:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:52:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:52:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 106 user-cpu-pct 102 kernel-cpu-pct 4 free-mem-kbytes 10645588 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:52:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 110 threads (9,64,39,30) heap-kbytes (12877684,12931152,14436864) heap-efficiency-pct 99.6
Mar 27 2023 11:52:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:52:23 GMT: INFO (info): (ticker.c:319) fds: proto (108,128428,128320) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:52:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6936762
Mar 27 2023 11:52:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (60620,7400114) ctrl (6,14) meta (0,0) rw (895,534)
Mar 27 2023 11:52:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51898341 master 15794002 prole 34454263 non-replica 1610109
Mar 27 2023 11:52:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,287,0) active (0,1,0) complete-pct 86.57
Mar 27 2023 11:52:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11601851308 index-bytes 3321493824 set-index-bytes 0 sindex-bytes 8280357484 used-pct 67.53
Mar 27 2023 11:52:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191571218992 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:52:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2665002,0,0,231650,0) write (2114052,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:52:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:52:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609660,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:52:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:52:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2896652 total) msec
Mar 27 2023 11:52:23 GMT: INFO (info): (hist.c:331) (00: 0002895133) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:52:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:52:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2114053 total) msec
Mar 27 2023 11:52:23 GMT: INFO (info): (hist.c:331) (00: 0001681933) (01: 0000405345) (02: 0000024085) (03: 0000002449)
Mar 27 2023 11:52:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:52:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:52:30 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (38959559,255668) total-ms 21039
Mar 27 2023 11:52:31 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:52:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:52:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:52:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 100 user-cpu-pct 94 kernel-cpu-pct 6 free-mem-kbytes 10645916 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:52:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 104 threads (9,64,39,30) heap-kbytes (12877985,12927400,14436864) heap-efficiency-pct 99.6
Mar 27 2023 11:52:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:52:33 GMT: INFO (info): (ticker.c:319) fds: proto (135,128455,128320) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:52:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6937029
Mar 27 2023 11:52:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (60301,7409629) ctrl (14,34) meta (0,0) rw (582127,711623)
Mar 27 2023 11:52:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51858748 master 15794016 prole 34454619 non-replica 1590156
Mar 27 2023 11:52:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,286,0) active (0,3,0) complete-pct 86.62
Mar 27 2023 11:52:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11597081104 index-bytes 3318959872 set-index-bytes 0 sindex-bytes 8278121232 used-pct 67.50
Mar 27 2023 11:52:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191419494496 avail-pct 47 cache-read-pct 63.44
Mar 27 2023 11:52:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2665719,0,0,231664,0) write (2114360,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:52:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:52:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609737,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:52:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:52:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2897383 total) msec
Mar 27 2023 11:52:33 GMT: INFO (info): (hist.c:331) (00: 0002895864) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:52:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:52:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2114361 total) msec
Mar 27 2023 11:52:33 GMT: INFO (info): (hist.c:331) (00: 0001682153) (01: 0000405426) (02: 0000024091) (03: 0000002450)
Mar 27 2023 11:52:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:52:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:52:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191420041968 free-wblocks 981908 write-q 0 write (431376,3.5) defrag-q 0 defrag-read (389085,34.5) defrag-write (124980,1.3)
Mar 27 2023 11:52:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:52:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:52:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 117 user-cpu-pct 106 kernel-cpu-pct 11 free-mem-kbytes 10646232 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:52:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 130 threads (9,64,39,30) heap-kbytes (12876831,12925564,14432768) heap-efficiency-pct 99.6
Mar 27 2023 11:52:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:52:43 GMT: INFO (info): (ticker.c:319) fds: proto (136,128456,128320) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:52:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6937294
Mar 27 2023 11:52:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (188427,23007588) ctrl (8,16) meta (0,0) rw (829,948)
Mar 27 2023 11:52:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51859758 master 15794017 prole 34455628 non-replica 1590156
Mar 27 2023 11:52:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,284,0) active (0,2,0) complete-pct 86.71
Mar 27 2023 11:52:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11596026340 index-bytes 3319024512 set-index-bytes 0 sindex-bytes 8277001828 used-pct 67.50
Mar 27 2023 11:52:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191420486528 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:52:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2665719,0,0,231664,0) write (2114361,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:52:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:52:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609740,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:52:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:52:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2897383 total) msec
Mar 27 2023 11:52:43 GMT: INFO (info): (hist.c:331) (00: 0002895864) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:52:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:52:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2114362 total) msec
Mar 27 2023 11:52:43 GMT: INFO (info): (hist.c:331) (00: 0001682154) (01: 0000405426) (02: 0000024091) (03: 0000002450)
Mar 27 2023 11:52:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:52:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:52:53 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (39070377,110818) total-ms 21718
Mar 27 2023 11:52:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:52:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:52:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 103 user-cpu-pct 100 kernel-cpu-pct 3 free-mem-kbytes 10646012 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:52:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 108 threads (9,64,39,30) heap-kbytes (12875338,12925580,14432768) heap-efficiency-pct 99.6
Mar 27 2023 11:52:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:52:53 GMT: INFO (info): (ticker.c:319) fds: proto (134,128456,128322) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:52:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6937562
Mar 27 2023 11:52:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (62837,7600933) ctrl (6,11) meta (0,0) rw (999,1797)
Mar 27 2023 11:52:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51860113 master 15794018 prole 34455986 non-replica 1590156
Mar 27 2023 11:52:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,282,0) active (0,1,0) complete-pct 86.80
Mar 27 2023 11:52:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11594477840 index-bytes 3319047232 set-index-bytes 0 sindex-bytes 8275430608 used-pct 67.49
Mar 27 2023 11:52:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191420877024 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:52:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2665719,0,0,231664,0) write (2114362,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:52:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:52:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609748,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:52:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:52:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2897383 total) msec
Mar 27 2023 11:52:53 GMT: INFO (info): (hist.c:331) (00: 0002895864) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:52:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:52:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2114363 total) msec
Mar 27 2023 11:52:53 GMT: INFO (info): (hist.c:331) (00: 0001682155) (01: 0000405426) (02: 0000024091) (03: 0000002450)
Mar 27 2023 11:52:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:52:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:52:54 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:52:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191421043168 free-wblocks 981902 write-q 0 write (431388,0.6) defrag-q 0 defrag-read (389092,0.3) defrag-write (124982,0.1)
Mar 27 2023 11:53:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:53:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:53:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 99 user-cpu-pct 95 kernel-cpu-pct 4 free-mem-kbytes 10647744 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:53:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 103 threads (9,64,39,30) heap-kbytes (12875544,12924908,14432768) heap-efficiency-pct 99.6
Mar 27 2023 11:53:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:53:03 GMT: INFO (info): (ticker.c:319) fds: proto (134,128456,128322) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:53:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6937827
Mar 27 2023 11:53:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (51832,6263138) ctrl (6,14) meta (0,0) rw (120863,133940)
Mar 27 2023 11:53:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51860396 master 15794022 prole 34456265 non-replica 1590154
Mar 27 2023 11:53:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,281,0) active (0,1,0) complete-pct 86.85
Mar 27 2023 11:53:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11594100752 index-bytes 3319065344 set-index-bytes 0 sindex-bytes 8275035408 used-pct 67.49
Mar 27 2023 11:53:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191421172400 avail-pct 47 cache-read-pct 77.84
Mar 27 2023 11:53:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2665802,0,0,231667,0) write (2114445,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:53:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:53:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609777,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:53:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:53:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2897469 total) msec
Mar 27 2023 11:53:03 GMT: INFO (info): (hist.c:331) (00: 0002895950) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:53:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:53:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2114446 total) msec
Mar 27 2023 11:53:03 GMT: INFO (info): (hist.c:331) (00: 0001682209) (01: 0000405455) (02: 0000024091) (03: 0000002450)
Mar 27 2023 11:53:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:53:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:53:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:53:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:53:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 108 user-cpu-pct 103 kernel-cpu-pct 5 free-mem-kbytes 10646864 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:53:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 115 threads (9,64,39,30) heap-kbytes (12874129,12922852,14432768) heap-efficiency-pct 99.6
Mar 27 2023 11:53:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:53:13 GMT: INFO (info): (ticker.c:319) fds: proto (134,128457,128323) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:53:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6938094
Mar 27 2023 11:53:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (85126,10446602) ctrl (8,20) meta (0,0) rw (1208,844)
Mar 27 2023 11:53:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51860838 master 15794023 prole 34456706 non-replica 1570205
Mar 27 2023 11:53:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,280,0) active (0,1,0) complete-pct 86.90
Mar 27 2023 11:53:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11592698024 index-bytes 3319093632 set-index-bytes 0 sindex-bytes 8273604392 used-pct 67.48
Mar 27 2023 11:53:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191421534000 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:53:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2665802,0,0,231667,0) write (2114446,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:53:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:53:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609784,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:53:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:53:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2897469 total) msec
Mar 27 2023 11:53:13 GMT: INFO (info): (hist.c:331) (00: 0002895950) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:53:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:53:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2114447 total) msec
Mar 27 2023 11:53:13 GMT: INFO (info): (hist.c:331) (00: 0001682210) (01: 0000405455) (02: 0000024091) (03: 0000002450)
Mar 27 2023 11:53:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:53:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:53:15 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (39144329,73952) total-ms 20893
Mar 27 2023 11:53:16 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:53:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191345808928 free-wblocks 982199 write-q 0 write (431391,0.2) defrag-q 0 defrag-read (389390,14.9) defrag-write (124982,0.0)
Mar 27 2023 11:53:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:53:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:53:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 101 user-cpu-pct 93 kernel-cpu-pct 8 free-mem-kbytes 10647712 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:53:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 112 threads (9,64,39,30) heap-kbytes (12872924,12922648,14432768) heap-efficiency-pct 99.6
Mar 27 2023 11:53:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:53:23 GMT: INFO (info): (ticker.c:319) fds: proto (125,128457,128332) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:53:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6938362
Mar 27 2023 11:53:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (129865,15885840) ctrl (12,29) meta (0,0) rw (1675,3192)
Mar 27 2023 11:53:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51841576 master 15794025 prole 34457397 non-replica 1570205
Mar 27 2023 11:53:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,279,0) active (0,3,0) complete-pct 86.94
Mar 27 2023 11:53:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11590323028 index-bytes 3317860864 set-index-bytes 0 sindex-bytes 8272462164 used-pct 67.46
Mar 27 2023 11:53:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191346222192 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:53:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2665802,0,0,231667,0) write (2114448,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:53:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:53:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609797,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:53:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:53:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2897469 total) msec
Mar 27 2023 11:53:23 GMT: INFO (info): (hist.c:331) (00: 0002895950) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:53:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:53:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2114449 total) msec
Mar 27 2023 11:53:23 GMT: INFO (info): (hist.c:331) (00: 0001682212) (01: 0000405455) (02: 0000024091) (03: 0000002450)
Mar 27 2023 11:53:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:53:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:53:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:53:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:53:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 114 user-cpu-pct 106 kernel-cpu-pct 8 free-mem-kbytes 10647460 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:53:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 122 threads (9,64,39,30) heap-kbytes (12869791,12916408,14432768) heap-efficiency-pct 99.6
Mar 27 2023 11:53:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:53:33 GMT: INFO (info): (ticker.c:319) fds: proto (263,128689,128426) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:53:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6938627
Mar 27 2023 11:53:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (120655,14834709) ctrl (10,18) meta (0,0) rw (367356,398818)
Mar 27 2023 11:53:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51842248 master 15794029 prole 34458065 non-replica 1570204
Mar 27 2023 11:53:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,276,0) active (0,1,0) complete-pct 87.08
Mar 27 2023 11:53:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11589878224 index-bytes 3317903872 set-index-bytes 0 sindex-bytes 8271974352 used-pct 67.46
Mar 27 2023 11:53:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191346997360 avail-pct 47 cache-read-pct 73.26
Mar 27 2023 11:53:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2666470,0,0,231669,0) write (2114718,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:53:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:53:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609825,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:53:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:53:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2898139 total) msec
Mar 27 2023 11:53:33 GMT: INFO (info): (hist.c:331) (00: 0002896620) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:53:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:53:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2114719 total) msec
Mar 27 2023 11:53:33 GMT: INFO (info): (hist.c:331) (00: 0001682421) (01: 0000405515) (02: 0000024092) (03: 0000002450)
Mar 27 2023 11:53:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:53:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:53:38 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (39214879,70550) total-ms 21990
Mar 27 2023 11:53:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191270521136 free-wblocks 982609 write-q 0 write (431430,2.0) defrag-q 0 defrag-read (389839,22.5) defrag-write (124994,0.6)
Mar 27 2023 11:53:39 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:53:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:53:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:53:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 101 user-cpu-pct 94 kernel-cpu-pct 7 free-mem-kbytes 10646812 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:53:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 108 threads (9,64,39,30) heap-kbytes (12869792,12916388,14432768) heap-efficiency-pct 99.6
Mar 27 2023 11:53:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:53:43 GMT: INFO (info): (ticker.c:319) fds: proto (264,128690,128426) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:53:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6938894
Mar 27 2023 11:53:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (105325,12857723) ctrl (9,22) meta (0,0) rw (4058,1379)
Mar 27 2023 11:53:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51822848 master 15794032 prole 34458611 non-replica 1570204
Mar 27 2023 11:53:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,275,0) active (0,2,0) complete-pct 87.13
Mar 27 2023 11:53:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11588674092 index-bytes 3316662272 set-index-bytes 0 sindex-bytes 8272011820 used-pct 67.45
Mar 27 2023 11:53:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191270736896 avail-pct 47 cache-read-pct 33.33
Mar 27 2023 11:53:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2666470,0,0,231669,0) write (2114721,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:53:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:53:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609835,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:53:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:53:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2898139 total) msec
Mar 27 2023 11:53:43 GMT: INFO (info): (hist.c:331) (00: 0002896620) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:53:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:53:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2114722 total) msec
Mar 27 2023 11:53:43 GMT: INFO (info): (hist.c:331) (00: 0001682424) (01: 0000405515) (02: 0000024092) (03: 0000002450)
Mar 27 2023 11:53:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:53:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:53:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:53:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:53:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 106 user-cpu-pct 102 kernel-cpu-pct 4 free-mem-kbytes 10646716 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:53:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 112 threads (9,64,39,30) heap-kbytes (12869744,12916408,14432768) heap-efficiency-pct 99.6
Mar 27 2023 11:53:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:53:53 GMT: INFO (info): (ticker.c:319) fds: proto (263,128690,128427) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:53:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6939162
Mar 27 2023 11:53:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (65478,8043270) ctrl (6,11) meta (0,0) rw (5855,1572)
Mar 27 2023 11:53:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51823168 master 15794035 prole 34458928 non-replica 1570204
Mar 27 2023 11:53:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,273,0) active (0,1,0) complete-pct 87.23
Mar 27 2023 11:53:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11588712012 index-bytes 3316682752 set-index-bytes 0 sindex-bytes 8272029260 used-pct 67.46
Mar 27 2023 11:53:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191271056256 avail-pct 47 cache-read-pct 33.33
Mar 27 2023 11:53:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2666473,0,0,231669,0) write (2114726,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:53:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:53:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609844,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:53:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:53:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2898142 total) msec
Mar 27 2023 11:53:53 GMT: INFO (info): (hist.c:331) (00: 0002896623) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:53:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:53:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2114727 total) msec
Mar 27 2023 11:53:53 GMT: INFO (info): (hist.c:331) (00: 0001682428) (01: 0000405516) (02: 0000024092) (03: 0000002450)
Mar 27 2023 11:53:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:53:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:53:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191271532608 free-wblocks 982601 write-q 0 write (431471,2.0) defrag-q 0 defrag-read (389873,1.7) defrag-write (125006,0.6)
Mar 27 2023 11:54:00 GMT: INFO (info): (thr_info.c:3840) latencies command: unrecognized histogram: {Settlement}-query
Mar 27 2023 11:54:00 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (39232748,17869) total-ms 20971
Mar 27 2023 11:54:01 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:54:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:54:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:54:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 98 user-cpu-pct 94 kernel-cpu-pct 4 free-mem-kbytes 10646696 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:54:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 102 threads (9,64,39,30) heap-kbytes (12867981,12913088,14430720) heap-efficiency-pct 99.7
Mar 27 2023 11:54:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:54:03 GMT: INFO (info): (ticker.c:319) fds: proto (263,128691,128428) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:54:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6939427
Mar 27 2023 11:54:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (51509,6253862) ctrl (6,14) meta (0,0) rw (436962,468088)
Mar 27 2023 11:54:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51823518 master 15794044 prole 34459270 non-replica 1550204
Mar 27 2023 11:54:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,272,0) active (0,1,0) complete-pct 87.27
Mar 27 2023 11:54:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11587816348 index-bytes 3316705152 set-index-bytes 0 sindex-bytes 8271111196 used-pct 67.45
Mar 27 2023 11:54:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191271661248 avail-pct 47 cache-read-pct 70.86
Mar 27 2023 11:54:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2667156,0,0,231676,0) write (2115048,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:54:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:54:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609891,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:54:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:54:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2898832 total) msec
Mar 27 2023 11:54:03 GMT: INFO (info): (hist.c:331) (00: 0002897313) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:54:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:54:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2115049 total) msec
Mar 27 2023 11:54:03 GMT: INFO (info): (hist.c:331) (00: 0001682702) (01: 0000405561) (02: 0000024092) (03: 0000002453)
Mar 27 2023 11:54:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:54:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:54:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:54:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:54:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 115 user-cpu-pct 106 kernel-cpu-pct 9 free-mem-kbytes 10646376 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:54:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 124 threads (9,64,39,30) heap-kbytes (12866626,12912984,14430720) heap-efficiency-pct 99.6
Mar 27 2023 11:54:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:54:13 GMT: INFO (info): (ticker.c:319) fds: proto (264,128692,128428) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:54:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6939694
Mar 27 2023 11:54:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (145089,17780697) ctrl (14,34) meta (0,0) rw (6837,5821)
Mar 27 2023 11:54:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51824304 master 15794049 prole 34460051 non-replica 1550204
Mar 27 2023 11:54:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,271,0) active (0,3,0) complete-pct 87.32
Mar 27 2023 11:54:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11586444064 index-bytes 3316755456 set-index-bytes 0 sindex-bytes 8269688608 used-pct 67.44
Mar 27 2023 11:54:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191272369056 avail-pct 47 cache-read-pct 73.33
Mar 27 2023 11:54:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2667159,0,0,231676,0) write (2115055,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:54:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:54:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609911,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:54:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:54:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2898835 total) msec
Mar 27 2023 11:54:13 GMT: INFO (info): (hist.c:331) (00: 0002897316) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:54:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:54:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2115056 total) msec
Mar 27 2023 11:54:13 GMT: INFO (info): (hist.c:331) (00: 0001682708) (01: 0000405562) (02: 0000024092) (03: 0000002453)
Mar 27 2023 11:54:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:54:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:54:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191272856144 free-wblocks 982599 write-q 0 write (431476,0.2) defrag-q 0 defrag-read (389873,0.0) defrag-write (125006,0.0)
Mar 27 2023 11:54:23 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (39342864,110116) total-ms 21741
Mar 27 2023 11:54:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:54:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:54:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 105 user-cpu-pct 98 kernel-cpu-pct 7 free-mem-kbytes 10646408 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:54:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 112 threads (9,64,39,30) heap-kbytes (12865888,12910352,14430720) heap-efficiency-pct 99.7
Mar 27 2023 11:54:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:54:23 GMT: INFO (info): (ticker.c:319) fds: proto (263,128692,128429) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:54:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6939962
Mar 27 2023 11:54:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (113109,13995604) ctrl (8,13) meta (0,0) rw (3549,1834)
Mar 27 2023 11:54:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51804929 master 15794054 prole 34460671 non-replica 1550204
Mar 27 2023 11:54:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,268,0) active (0,1,0) complete-pct 87.46
Mar 27 2023 11:54:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11584447860 index-bytes 3315515456 set-index-bytes 0 sindex-bytes 8268932404 used-pct 67.43
Mar 27 2023 11:54:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191197107280 avail-pct 47 cache-read-pct 37.50
Mar 27 2023 11:54:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2667160,0,0,231677,0) write (2115061,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:54:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:54:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609926,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:54:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:54:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2898837 total) msec
Mar 27 2023 11:54:23 GMT: INFO (info): (hist.c:331) (00: 0002897318) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:54:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:54:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2115062 total) msec
Mar 27 2023 11:54:23 GMT: INFO (info): (hist.c:331) (00: 0001682714) (01: 0000405562) (02: 0000024092) (03: 0000002453)
Mar 27 2023 11:54:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:54:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:54:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:54:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:54:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 5 user-cpu-pct 2 kernel-cpu-pct 3 free-mem-kbytes 10646368 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:54:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 10 threads (9,64,39,30) heap-kbytes (12865399,12909804,14430720) heap-efficiency-pct 99.7
Mar 27 2023 11:54:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:54:33 GMT: INFO (info): (ticker.c:319) fds: proto (263,128692,128429) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:54:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6940226
Mar 27 2023 11:54:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (43471,5336934) ctrl (2,2) meta (0,0) rw (440554,473383)
Mar 27 2023 11:54:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51805209 master 15794062 prole 34460943 non-replica 1550204
Mar 27 2023 11:54:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,267,0) active (0,0,0) complete-pct 87.51
Mar 27 2023 11:54:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11584490784 index-bytes 3315533376 set-index-bytes 0 sindex-bytes 8268957408 used-pct 67.43
Mar 27 2023 11:54:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191197407488 avail-pct 47 cache-read-pct 68.66
Mar 27 2023 11:54:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2667584,0,0,231682,0) write (2115376,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:54:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:54:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609973,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:54:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:54:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2899266 total) msec
Mar 27 2023 11:54:33 GMT: INFO (info): (hist.c:331) (00: 0002897747) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:54:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:54:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2115377 total) msec
Mar 27 2023 11:54:33 GMT: INFO (info): (hist.c:331) (00: 0001682961) (01: 0000405630) (02: 0000024092) (03: 0000002453)
Mar 27 2023 11:54:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:54:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:54:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191197434528 free-wblocks 982892 write-q 0 write (431515,2.0) defrag-q 0 defrag-read (390202,16.5) defrag-write (125019,0.6)
Mar 27 2023 11:54:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:54:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:54:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 4 user-cpu-pct 2 kernel-cpu-pct 2 free-mem-kbytes 10646332 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:54:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 5 threads (9,64,39,30) heap-kbytes (12865386,12909776,14430720) heap-efficiency-pct 99.7
Mar 27 2023 11:54:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:54:43 GMT: INFO (info): (ticker.c:319) fds: proto (264,128693,128429) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:54:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6940494
Mar 27 2023 11:54:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (26849,3269596) ctrl (6,18) meta (0,0) rw (4770,4472)
Mar 27 2023 11:54:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51805377 master 15794067 prole 34461106 non-replica 1530258
Mar 27 2023 11:54:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,267,0) active (0,1,0) complete-pct 87.51
Mar 27 2023 11:54:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11584511564 index-bytes 3315544128 set-index-bytes 0 sindex-bytes 8268967436 used-pct 67.43
Mar 27 2023 11:54:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191197586976 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:54:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2667584,0,0,231682,0) write (2115381,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:54:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:54:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609989,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:54:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:54:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2899266 total) msec
Mar 27 2023 11:54:43 GMT: INFO (info): (hist.c:331) (00: 0002897747) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:54:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:54:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2115382 total) msec
Mar 27 2023 11:54:43 GMT: INFO (info): (hist.c:331) (00: 0001682966) (01: 0000405630) (02: 0000024092) (03: 0000002453)
Mar 27 2023 11:54:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:54:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:54:44 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:54:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:54:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:54:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 102 user-cpu-pct 99 kernel-cpu-pct 3 free-mem-kbytes 10646048 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:54:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 104 threads (9,64,39,30) heap-kbytes (12863989,12909320,14430720) heap-efficiency-pct 99.6
Mar 27 2023 11:54:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:54:53 GMT: INFO (info): (ticker.c:319) fds: proto (218,128694,128476) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:54:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6940762
Mar 27 2023 11:54:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (38731,4646731) ctrl (4,9) meta (0,0) rw (24,1749)
Mar 27 2023 11:54:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51805586 master 15794067 prole 34461315 non-replica 1530258
Mar 27 2023 11:54:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,266,0) active (0,1,0) complete-pct 87.55
Mar 27 2023 11:54:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11583197828 index-bytes 3315557504 set-index-bytes 0 sindex-bytes 8267640324 used-pct 67.42
Mar 27 2023 11:54:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191197793328 avail-pct 47 cache-read-pct 0.00
Mar 27 2023 11:54:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2667584,0,0,231682,0) write (2115381,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:54:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:54:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1609999,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:54:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:54:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2899266 total) msec
Mar 27 2023 11:54:53 GMT: INFO (info): (hist.c:331) (00: 0002897747) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:54:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:54:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2115382 total) msec
Mar 27 2023 11:54:53 GMT: INFO (info): (hist.c:331) (00: 0001682966) (01: 0000405630) (02: 0000024092) (03: 0000002453)
Mar 27 2023 11:54:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:54:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:54:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191197929456 free-wblocks 982889 write-q 0 write (431518,0.2) defrag-q 0 defrag-read (390202,0.0) defrag-write (125019,0.0)
Mar 27 2023 11:55:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:55:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:55:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 104 user-cpu-pct 102 kernel-cpu-pct 2 free-mem-kbytes 10646328 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:55:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 109 threads (9,64,39,30) heap-kbytes (12862364,12909076,14430720) heap-efficiency-pct 99.6
Mar 27 2023 11:55:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:55:03 GMT: INFO (info): (ticker.c:319) fds: proto (218,128694,128476) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:55:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6941026
Mar 27 2023 11:55:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (55232,6679686) ctrl (2,5) meta (0,0) rw (7099,6741)
Mar 27 2023 11:55:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51805903 master 15794069 prole 34461630 non-replica 1530257
Mar 27 2023 11:55:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,266,0) active (0,1,0) complete-pct 87.55
Mar 27 2023 11:55:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11581528692 index-bytes 3315577792 set-index-bytes 0 sindex-bytes 8265950900 used-pct 67.41
Mar 27 2023 11:55:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191198073936 avail-pct 47 cache-read-pct 56.25
Mar 27 2023 11:55:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2667586,0,0,231682,0) write (2115385,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:55:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:55:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610012,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:55:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:55:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2899268 total) msec
Mar 27 2023 11:55:03 GMT: INFO (info): (hist.c:331) (00: 0002897749) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:55:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:55:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2115386 total) msec
Mar 27 2023 11:55:03 GMT: INFO (info): (hist.c:331) (00: 0001682969) (01: 0000405631) (02: 0000024092) (03: 0000002453)
Mar 27 2023 11:55:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:55:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:55:04 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (39470650,127786) total-ms 20544
Mar 27 2023 11:55:05 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:55:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:55:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:55:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 96 user-cpu-pct 92 kernel-cpu-pct 4 free-mem-kbytes 10645780 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:55:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 99 threads (9,64,39,30) heap-kbytes (12862519,12907976,14430720) heap-efficiency-pct 99.6
Mar 27 2023 11:55:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:55:13 GMT: INFO (info): (ticker.c:319) fds: proto (219,128695,128476) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:55:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6941294
Mar 27 2023 11:55:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (49299,6132081) ctrl (9,22) meta (0,0) rw (12314,9619)
Mar 27 2023 11:55:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51786239 master 15794077 prole 34461904 non-replica 1530257
Mar 27 2023 11:55:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,265,0) active (0,2,0) complete-pct 87.60
Mar 27 2023 11:55:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11580147328 index-bytes 3314319296 set-index-bytes 0 sindex-bytes 8265828032 used-pct 67.41
Mar 27 2023 11:55:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191121593088 avail-pct 48 cache-read-pct 76.00
Mar 27 2023 11:55:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2667593,0,0,231686,0) write (2115399,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:55:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:55:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610033,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:55:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:55:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2899279 total) msec
Mar 27 2023 11:55:13 GMT: INFO (info): (hist.c:331) (00: 0002897760) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:55:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:55:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2115400 total) msec
Mar 27 2023 11:55:13 GMT: INFO (info): (hist.c:331) (00: 0001682982) (01: 0000405632) (02: 0000024092) (03: 0000002453)
Mar 27 2023 11:55:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:55:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:55:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191121889648 free-wblocks 983188 write-q 0 write (431520,0.1) defrag-q 0 defrag-read (390503,15.1) defrag-write (125019,0.0)
Mar 27 2023 11:55:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:55:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:55:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 108 user-cpu-pct 103 kernel-cpu-pct 5 free-mem-kbytes 10646036 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:55:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 114 threads (9,64,39,30) heap-kbytes (12862500,12907940,14430720) heap-efficiency-pct 99.6
Mar 27 2023 11:55:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:55:23 GMT: INFO (info): (ticker.c:319) fds: proto (67,128695,128628) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:55:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6941559
Mar 27 2023 11:55:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (81858,9971731) ctrl (2,2) meta (0,0) rw (2756,1459)
Mar 27 2023 11:55:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51786691 master 15794081 prole 34462352 non-replica 1530257
Mar 27 2023 11:55:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,264,0) active (0,1,0) complete-pct 87.65
Mar 27 2023 11:55:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11580209724 index-bytes 3314348224 set-index-bytes 0 sindex-bytes 8265861500 used-pct 67.41
Mar 27 2023 11:55:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191122017424 avail-pct 48 cache-read-pct 75.00
Mar 27 2023 11:55:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2667594,0,0,231687,0) write (2115404,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:55:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:55:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610044,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:55:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:55:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2899281 total) msec
Mar 27 2023 11:55:23 GMT: INFO (info): (hist.c:331) (00: 0002897762) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:55:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:55:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2115405 total) msec
Mar 27 2023 11:55:23 GMT: INFO (info): (hist.c:331) (00: 0001682987) (01: 0000405632) (02: 0000024092) (03: 0000002453)
Mar 27 2023 11:55:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:55:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:55:26 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (39470656,6) total-ms 21014
Mar 27 2023 11:55:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:55:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:55:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 41 user-cpu-pct 33 kernel-cpu-pct 8 free-mem-kbytes 10645748 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:55:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 50 threads (9,64,39,30) heap-kbytes (12862728,12908456,14430720) heap-efficiency-pct 99.6
Mar 27 2023 11:55:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:55:33 GMT: INFO (info): (ticker.c:319) fds: proto (55,128733,128678) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:55:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6941826
Mar 27 2023 11:55:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (123383,15149710) ctrl (14,34) meta (0,0) rw (456805,482032)
Mar 27 2023 11:55:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51787393 master 15794085 prole 34463051 non-replica 1510269
Mar 27 2023 11:55:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,263,0) active (0,3,0) complete-pct 87.69
Mar 27 2023 11:55:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11580295712 index-bytes 3314393152 set-index-bytes 0 sindex-bytes 8265902560 used-pct 67.41
Mar 27 2023 11:55:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191122817632 avail-pct 48 cache-read-pct 63.91
Mar 27 2023 11:55:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2667902,0,0,231689,0) write (2115716,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:55:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:55:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610084,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:55:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:55:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2899591 total) msec
Mar 27 2023 11:55:33 GMT: INFO (info): (hist.c:331) (00: 0002898072) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:55:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:55:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2115717 total) msec
Mar 27 2023 11:55:33 GMT: INFO (info): (hist.c:331) (00: 0001683250) (01: 0000405681) (02: 0000024092) (03: 0000002453)
Mar 27 2023 11:55:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:55:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:55:37 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:55:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191123279552 free-wblocks 983181 write-q 0 write (431567,2.3) defrag-q 0 defrag-read (390541,1.9) defrag-write (125035,0.8)
Mar 27 2023 11:55:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:55:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:55:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 73 user-cpu-pct 66 kernel-cpu-pct 7 free-mem-kbytes 10646300 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:55:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 81 threads (9,64,39,30) heap-kbytes (12861649,12906512,14430720) heap-efficiency-pct 99.7
Mar 27 2023 11:55:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:55:43 GMT: INFO (info): (ticker.c:319) fds: proto (56,128734,128678) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:55:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6942094
Mar 27 2023 11:55:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (122899,14852148) ctrl (10,18) meta (0,0) rw (877,4683)
Mar 27 2023 11:55:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51788040 master 15794086 prole 34463697 non-replica 1510266
Mar 27 2023 11:55:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,260,0) active (0,1,0) complete-pct 87.83
Mar 27 2023 11:55:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11579328092 index-bytes 3314434560 set-index-bytes 0 sindex-bytes 8264893532 used-pct 67.40
Mar 27 2023 11:55:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191123438464 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 11:55:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2667902,0,0,231689,0) write (2115717,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:55:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:55:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610099,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:55:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:55:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2899591 total) msec
Mar 27 2023 11:55:43 GMT: INFO (info): (hist.c:331) (00: 0002898072) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:55:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:55:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2115718 total) msec
Mar 27 2023 11:55:43 GMT: INFO (info): (hist.c:331) (00: 0001683251) (01: 0000405681) (02: 0000024092) (03: 0000002453)
Mar 27 2023 11:55:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:55:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:55:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:55:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:55:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 106 user-cpu-pct 102 kernel-cpu-pct 4 free-mem-kbytes 10646172 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:55:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 110 threads (9,64,39,30) heap-kbytes (12860042,12906324,14430720) heap-efficiency-pct 99.6
Mar 27 2023 11:55:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:55:53 GMT: INFO (info): (ticker.c:319) fds: proto (54,128734,128680) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:55:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6942359
Mar 27 2023 11:55:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (58466,7065425) ctrl (6,14) meta (0,0) rw (2465,860)
Mar 27 2023 11:55:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51788352 master 15794089 prole 34464006 non-replica 1510266
Mar 27 2023 11:55:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,259,0) active (0,1,0) complete-pct 87.88
Mar 27 2023 11:55:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11577743676 index-bytes 3314454528 set-index-bytes 0 sindex-bytes 8263289148 used-pct 67.39
Mar 27 2023 11:55:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191123701936 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 11:55:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2667902,0,0,231689,0) write (2115720,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:55:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:55:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610106,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:55:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:55:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2899591 total) msec
Mar 27 2023 11:55:53 GMT: INFO (info): (hist.c:331) (00: 0002898072) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:55:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:55:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2115721 total) msec
Mar 27 2023 11:55:53 GMT: INFO (info): (hist.c:331) (00: 0001683254) (01: 0000405681) (02: 0000024092) (03: 0000002453)
Mar 27 2023 11:55:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:55:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:55:58 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (39598572,127916) total-ms 20386
Mar 27 2023 11:55:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191047652896 free-wblocks 983541 write-q 0 write (431571,0.2) defrag-q 0 defrag-read (390908,18.4) defrag-write (125037,0.1)
Mar 27 2023 11:56:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:56:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:56:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 49 user-cpu-pct 44 kernel-cpu-pct 5 free-mem-kbytes 10646496 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:56:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 52 threads (9,64,39,30) heap-kbytes (12859488,12903612,14430720) heap-efficiency-pct 99.7
Mar 27 2023 11:56:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:56:03 GMT: INFO (info): (ticker.c:319) fds: proto (54,128734,128680) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:56:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6942626
Mar 27 2023 11:56:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (61485,7560373) ctrl (9,22) meta (0,0) rw (2621,7249)
Mar 27 2023 11:56:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51768685 master 15794091 prole 34464328 non-replica 1510266
Mar 27 2023 11:56:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,258,0) active (0,2,0) complete-pct 87.93
Mar 27 2023 11:56:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11575977260 index-bytes 3313195840 set-index-bytes 0 sindex-bytes 8262781420 used-pct 67.38
Mar 27 2023 11:56:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191047887616 avail-pct 48 cache-read-pct 50.00
Mar 27 2023 11:56:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2667902,0,0,231689,0) write (2115722,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:56:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:56:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610117,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:56:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:56:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2899591 total) msec
Mar 27 2023 11:56:03 GMT: INFO (info): (hist.c:331) (00: 0002898072) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:56:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:56:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2115723 total) msec
Mar 27 2023 11:56:03 GMT: INFO (info): (hist.c:331) (00: 0001683256) (01: 0000405681) (02: 0000024092) (03: 0000002453)
Mar 27 2023 11:56:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:56:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:56:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:56:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:56:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 12 user-cpu-pct 3 kernel-cpu-pct 9 free-mem-kbytes 10645880 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:56:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 23 threads (9,64,39,30) heap-kbytes (12859639,12903564,14430720) heap-efficiency-pct 99.7
Mar 27 2023 11:56:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:56:13 GMT: INFO (info): (ticker.c:319) fds: proto (54,128734,128680) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:56:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6942894
Mar 27 2023 11:56:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (149872,17984936) ctrl (11,24) meta (0,0) rw (3534,1410)
Mar 27 2023 11:56:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51769455 master 15794095 prole 34465094 non-replica 1510266
Mar 27 2023 11:56:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,256,0) active (0,2,0) complete-pct 88.02
Mar 27 2023 11:56:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11576074396 index-bytes 3313245120 set-index-bytes 0 sindex-bytes 8262829276 used-pct 67.38
Mar 27 2023 11:56:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191048615312 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 11:56:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2667902,0,0,231689,0) write (2115726,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:56:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:56:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610129,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:56:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:56:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2899591 total) msec
Mar 27 2023 11:56:13 GMT: INFO (info): (hist.c:331) (00: 0002898072) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:56:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:56:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2115727 total) msec
Mar 27 2023 11:56:13 GMT: INFO (info): (hist.c:331) (00: 0001683260) (01: 0000405681) (02: 0000024092) (03: 0000002453)
Mar 27 2023 11:56:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:56:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:56:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191048874624 free-wblocks 983540 write-q 0 write (431575,0.2) defrag-q 0 defrag-read (390908,0.0) defrag-write (125037,0.0)
Mar 27 2023 11:56:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:56:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:56:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 8 user-cpu-pct 3 kernel-cpu-pct 5 free-mem-kbytes 10646204 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:56:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 14 threads (9,64,39,30) heap-kbytes (12859740,12903604,14430720) heap-efficiency-pct 99.7
Mar 27 2023 11:56:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:56:23 GMT: INFO (info): (ticker.c:319) fds: proto (55,128736,128681) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:56:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6943159
Mar 27 2023 11:56:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (90340,11104798) ctrl (6,11) meta (0,0) rw (5524,3176)
Mar 27 2023 11:56:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51769927 master 15794099 prole 34465562 non-replica 1510266
Mar 27 2023 11:56:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,254,0) active (0,1,0) complete-pct 88.11
Mar 27 2023 11:56:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11576136224 index-bytes 3313275328 set-index-bytes 0 sindex-bytes 8262860896 used-pct 67.38
Mar 27 2023 11:56:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191049015456 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 11:56:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2667902,0,0,231689,0) write (2115730,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:56:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:56:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610146,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:56:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:56:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2899591 total) msec
Mar 27 2023 11:56:23 GMT: INFO (info): (hist.c:331) (00: 0002898072) (01: 0000001254) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:56:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:56:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2115731 total) msec
Mar 27 2023 11:56:23 GMT: INFO (info): (hist.c:331) (00: 0001683264) (01: 0000405681) (02: 0000024092) (03: 0000002453)
Mar 27 2023 11:56:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:56:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:56:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:56:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:56:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 8 user-cpu-pct 3 kernel-cpu-pct 5 free-mem-kbytes 10649092 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:56:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 13 threads (9,64,39,30) heap-kbytes (12861724,12905636,14430720) heap-efficiency-pct 99.7
Mar 27 2023 11:56:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:56:33 GMT: INFO (info): (ticker.c:319) fds: proto (109,128831,128722) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:56:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6943426
Mar 27 2023 11:56:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (42485,5206309) ctrl (6,14) meta (0,0) rw (1097229,1199861)
Mar 27 2023 11:56:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51770200 master 15794113 prole 34465821 non-replica 1510264
Mar 27 2023 11:56:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,253,0) active (0,1,0) complete-pct 88.16
Mar 27 2023 11:56:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11576150292 index-bytes 3313292800 set-index-bytes 0 sindex-bytes 8262857492 used-pct 67.38
Mar 27 2023 11:56:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191051499280 avail-pct 48 cache-read-pct 49.99
Mar 27 2023 11:56:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2668809,0,0,231701,0) write (2116436,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:56:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:56:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610221,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:56:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:56:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2900510 total) msec
Mar 27 2023 11:56:33 GMT: INFO (info): (hist.c:331) (00: 0002898988) (01: 0000001257) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:56:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:56:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2116437 total) msec
Mar 27 2023 11:56:33 GMT: INFO (info): (hist.c:331) (00: 0001683747) (01: 0000405886) (02: 0000024109) (03: 0000002454)
Mar 27 2023 11:56:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:56:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:56:39 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:56:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191051672160 free-wblocks 983530 write-q 0 write (431683,5.4) defrag-q 0 defrag-read (390998,4.5) defrag-write (125075,1.9)
Mar 27 2023 11:56:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:56:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:56:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 52 user-cpu-pct 49 kernel-cpu-pct 3 free-mem-kbytes 10648744 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:56:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 58 threads (9,64,39,30) heap-kbytes (12861229,12902960,14428672) heap-efficiency-pct 99.7
Mar 27 2023 11:56:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:56:43 GMT: INFO (info): (ticker.c:319) fds: proto (110,128832,128722) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:56:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6943694
Mar 27 2023 11:56:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (60329,7264195) ctrl (2,5) meta (0,0) rw (1985,5243)
Mar 27 2023 11:56:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51770517 master 15794114 prole 34466137 non-replica 1490216
Mar 27 2023 11:56:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,253,0) active (0,1,0) complete-pct 88.16
Mar 27 2023 11:56:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11575751608 index-bytes 3313313088 set-index-bytes 0 sindex-bytes 8262438520 used-pct 67.38
Mar 27 2023 11:56:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191051825024 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 11:56:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2668809,0,0,231701,0) write (2116437,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:56:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:56:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610233,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:56:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:56:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2900510 total) msec
Mar 27 2023 11:56:43 GMT: INFO (info): (hist.c:331) (00: 0002898988) (01: 0000001257) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:56:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:56:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2116438 total) msec
Mar 27 2023 11:56:43 GMT: INFO (info): (hist.c:331) (00: 0001683748) (01: 0000405886) (02: 0000024109) (03: 0000002454)
Mar 27 2023 11:56:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:56:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:56:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:56:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:56:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 102 user-cpu-pct 101 kernel-cpu-pct 1 free-mem-kbytes 10649072 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:56:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 103 threads (9,64,39,30) heap-kbytes (12859840,12902976,14428672) heap-efficiency-pct 99.7
Mar 27 2023 11:56:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:56:53 GMT: INFO (info): (ticker.c:319) fds: proto (110,128833,128723) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:56:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6943959
Mar 27 2023 11:56:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (12830,1519786) ctrl (4,9) meta (0,0) rw (6877,3221)
Mar 27 2023 11:56:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51770588 master 15794117 prole 34466205 non-replica 1490216
Mar 27 2023 11:56:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,252,0) active (0,1,0) complete-pct 88.21
Mar 27 2023 11:56:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11574318692 index-bytes 3313317632 set-index-bytes 0 sindex-bytes 8261001060 used-pct 67.37
Mar 27 2023 11:56:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191051960592 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 11:56:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2668809,0,0,231701,0) write (2116440,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:56:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:56:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610248,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:56:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:56:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2900510 total) msec
Mar 27 2023 11:56:53 GMT: INFO (info): (hist.c:331) (00: 0002898988) (01: 0000001257) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:56:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:56:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2116441 total) msec
Mar 27 2023 11:56:53 GMT: INFO (info): (hist.c:331) (00: 0001683751) (01: 0000405886) (02: 0000024109) (03: 0000002454)
Mar 27 2023 11:56:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:56:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:56:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191052920736 free-wblocks 983523 write-q 0 write (431742,3.0) defrag-q 0 defrag-read (391049,2.5) defrag-write (125096,1.0)
Mar 27 2023 11:56:59 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (39709827,111255) total-ms 20182
Mar 27 2023 11:57:00 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:57:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:57:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:57:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 98 user-cpu-pct 94 kernel-cpu-pct 4 free-mem-kbytes 10648624 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:57:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 103 threads (9,64,39,30) heap-kbytes (12860276,12901396,14428672) heap-efficiency-pct 99.7
Mar 27 2023 11:57:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:57:03 GMT: INFO (info): (ticker.c:319) fds: proto (111,128834,128723) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:57:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6944226
Mar 27 2023 11:57:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (53921,6493792) ctrl (2,2) meta (0,0) rw (568107,646573)
Mar 27 2023 11:57:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51770932 master 15794131 prole 34466537 non-replica 1490216
Mar 27 2023 11:57:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,251,0) active (0,0,0) complete-pct 88.25
Mar 27 2023 11:57:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11573015016 index-bytes 3313339648 set-index-bytes 0 sindex-bytes 8259675368 used-pct 67.36
Mar 27 2023 11:57:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191053090704 avail-pct 48 cache-read-pct 55.25
Mar 27 2023 11:57:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669265,0,0,231712,0) write (2116745,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:57:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:57:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610339,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:57:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:57:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2900977 total) msec
Mar 27 2023 11:57:03 GMT: INFO (info): (hist.c:331) (00: 0002899454) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:57:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:57:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2116746 total) msec
Mar 27 2023 11:57:03 GMT: INFO (info): (hist.c:331) (00: 0001683936) (01: 0000406000) (02: 0000024115) (03: 0000002454)
Mar 27 2023 11:57:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:57:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:57:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:57:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:57:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 101 user-cpu-pct 101 kernel-cpu-pct 0 free-mem-kbytes 10648396 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:57:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 101 threads (9,64,39,30) heap-kbytes (12860230,12901396,14428672) heap-efficiency-pct 99.7
Mar 27 2023 11:57:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:57:13 GMT: INFO (info): (ticker.c:319) fds: proto (112,128835,128723) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:57:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6944494
Mar 27 2023 11:57:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (0,0) ctrl (4,11) meta (0,0) rw (793,3228)
Mar 27 2023 11:57:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51770941 master 15794132 prole 34466545 non-replica 1490216
Mar 27 2023 11:57:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,251,0) active (0,0,0) complete-pct 88.25
Mar 27 2023 11:57:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11573018208 index-bytes 3313340224 set-index-bytes 0 sindex-bytes 8259677984 used-pct 67.36
Mar 27 2023 11:57:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 191053126256 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 11:57:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669265,0,0,231712,0) write (2116746,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:57:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:57:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610361,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:57:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:57:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2900977 total) msec
Mar 27 2023 11:57:13 GMT: INFO (info): (hist.c:331) (00: 0002899454) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:57:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:57:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2116747 total) msec
Mar 27 2023 11:57:13 GMT: INFO (info): (hist.c:331) (00: 0001683937) (01: 0000406000) (02: 0000024115) (03: 0000002454)
Mar 27 2023 11:57:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:57:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:57:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 191053149488 free-wblocks 983524 write-q 0 write (431742,0.0) defrag-q 0 defrag-read (391049,0.0) defrag-write (125096,0.0)
Mar 27 2023 11:57:20 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (39726962,17135) total-ms 20070
Mar 27 2023 11:57:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:57:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:57:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 65 user-cpu-pct 65 kernel-cpu-pct 0 free-mem-kbytes 10648616 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:57:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 65 threads (9,64,39,30) heap-kbytes (12860272,12901384,14428672) heap-efficiency-pct 99.7
Mar 27 2023 11:57:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:57:23 GMT: INFO (info): (ticker.c:319) fds: proto (111,128835,128724) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:57:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6944758
Mar 27 2023 11:57:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (0,0) ctrl (4,11) meta (0,0) rw (3723,3034)
Mar 27 2023 11:57:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51750904 master 15794136 prole 34466552 non-replica 1490215
Mar 27 2023 11:57:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,251,0) active (0,0,0) complete-pct 88.25
Mar 27 2023 11:57:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11571736532 index-bytes 3312057856 set-index-bytes 0 sindex-bytes 8259678676 used-pct 67.36
Mar 27 2023 11:57:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190976370960 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 11:57:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669265,0,0,231712,0) write (2116750,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:57:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:57:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610378,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:57:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:57:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2900977 total) msec
Mar 27 2023 11:57:23 GMT: INFO (info): (hist.c:331) (00: 0002899454) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:57:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:57:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2116751 total) msec
Mar 27 2023 11:57:23 GMT: INFO (info): (hist.c:331) (00: 0001683941) (01: 0000406000) (02: 0000024115) (03: 0000002454)
Mar 27 2023 11:57:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:57:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:57:31 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:57:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:57:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:57:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 34 user-cpu-pct 28 kernel-cpu-pct 6 free-mem-kbytes 10648052 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:57:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 41 threads (9,64,39,30) heap-kbytes (12860360,12901400,14428672) heap-efficiency-pct 99.7
Mar 27 2023 11:57:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:57:33 GMT: INFO (info): (ticker.c:319) fds: proto (111,128835,128724) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:57:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6945026
Mar 27 2023 11:57:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (91784,11219624) ctrl (7,20) meta (0,0) rw (46922,64009)
Mar 27 2023 11:57:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51751431 master 15794140 prole 34467075 non-replica 1490215
Mar 27 2023 11:57:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,251,0) active (0,2,0) complete-pct 88.25
Mar 27 2023 11:57:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11571809728 index-bytes 3312091584 set-index-bytes 0 sindex-bytes 8259718144 used-pct 67.36
Mar 27 2023 11:57:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190976960000 avail-pct 48 cache-read-pct 81.47
Mar 27 2023 11:57:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669429,0,0,231715,0) write (2116801,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:57:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:57:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610415,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:57:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:57:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901144 total) msec
Mar 27 2023 11:57:33 GMT: INFO (info): (hist.c:331) (00: 0002899621) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:57:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:57:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2116802 total) msec
Mar 27 2023 11:57:33 GMT: INFO (info): (hist.c:331) (00: 0001683980) (01: 0000406012) (02: 0000024115) (03: 0000002454)
Mar 27 2023 11:57:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:57:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:57:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 190977480240 free-wblocks 983896 write-q 0 write (431752,0.5) defrag-q 0 defrag-read (391431,19.1) defrag-write (125098,0.1)
Mar 27 2023 11:57:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:57:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:57:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 117 user-cpu-pct 106 kernel-cpu-pct 11 free-mem-kbytes 10648816 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:57:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 126 threads (9,64,39,30) heap-kbytes (12859201,12899180,14322176) heap-efficiency-pct 99.7
Mar 27 2023 11:57:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:57:43 GMT: INFO (info): (ticker.c:319) fds: proto (112,128836,128724) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:57:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6945292
Mar 27 2023 11:57:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (151289,18527938) ctrl (13,29) meta (0,0) rw (5287,5868)
Mar 27 2023 11:57:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51752221 master 15794144 prole 34467861 non-replica 1470224
Mar 27 2023 11:57:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,249,0) active (0,2,0) complete-pct 88.35
Mar 27 2023 11:57:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11570709388 index-bytes 3312142144 set-index-bytes 0 sindex-bytes 8258567244 used-pct 67.35
Mar 27 2023 11:57:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190977776000 avail-pct 48 cache-read-pct 63.64
Mar 27 2023 11:57:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669436,0,0,231717,0) write (2116809,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:57:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:57:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610438,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:57:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:57:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901153 total) msec
Mar 27 2023 11:57:43 GMT: INFO (info): (hist.c:331) (00: 0002899630) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:57:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:57:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2116810 total) msec
Mar 27 2023 11:57:43 GMT: INFO (info): (hist.c:331) (00: 0001683987) (01: 0000406013) (02: 0000024115) (03: 0000002454)
Mar 27 2023 11:57:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:57:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:57:52 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (39868763,141801) total-ms 20728
Mar 27 2023 11:57:53 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:57:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:57:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:57:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 97 user-cpu-pct 93 kernel-cpu-pct 4 free-mem-kbytes 10648248 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:57:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 102 threads (9,64,39,30) heap-kbytes (12856379,12898796,14322176) heap-efficiency-pct 99.7
Mar 27 2023 11:57:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:57:53 GMT: INFO (info): (ticker.c:319) fds: proto (71,128836,128765) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:57:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6945558
Mar 27 2023 11:57:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (64988,7875347) ctrl (8,16) meta (0,0) rw (2131,2998)
Mar 27 2023 11:57:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51752548 master 15794145 prole 34468188 non-replica 1450211
Mar 27 2023 11:57:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,247,0) active (0,1,0) complete-pct 88.44
Mar 27 2023 11:57:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11568030440 index-bytes 3312163072 set-index-bytes 0 sindex-bytes 8255867368 used-pct 67.33
Mar 27 2023 11:57:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190978117616 avail-pct 48 cache-read-pct 80.00
Mar 27 2023 11:57:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669436,0,0,231717,0) write (2116810,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:57:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:57:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610457,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:57:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:57:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901153 total) msec
Mar 27 2023 11:57:53 GMT: INFO (info): (hist.c:331) (00: 0002899630) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:57:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:57:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2116811 total) msec
Mar 27 2023 11:57:53 GMT: INFO (info): (hist.c:331) (00: 0001683988) (01: 0000406013) (02: 0000024115) (03: 0000002454)
Mar 27 2023 11:57:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:57:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:57:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 190978264096 free-wblocks 983894 write-q 0 write (431755,0.2) defrag-q 0 defrag-read (391432,0.1) defrag-write (125098,0.0)
Mar 27 2023 11:58:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:58:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:58:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 107 user-cpu-pct 103 kernel-cpu-pct 4 free-mem-kbytes 10648692 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:58:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 111 threads (9,64,39,30) heap-kbytes (12855081,12895040,14322176) heap-efficiency-pct 99.7
Mar 27 2023 11:58:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:58:03 GMT: INFO (info): (ticker.c:319) fds: proto (70,128837,128767) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:58:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6945826
Mar 27 2023 11:58:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (51593,6186649) ctrl (4,9) meta (0,0) rw (168358,177651)
Mar 27 2023 11:58:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51752854 master 15794158 prole 34468481 non-replica 1450211
Mar 27 2023 11:58:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,246,0) active (0,1,0) complete-pct 88.49
Mar 27 2023 11:58:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11566238388 index-bytes 3312182656 set-index-bytes 0 sindex-bytes 8254055732 used-pct 67.32
Mar 27 2023 11:58:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190978545984 avail-pct 48 cache-read-pct 74.01
Mar 27 2023 11:58:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669548,0,0,231725,0) write (2116913,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:58:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:58:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610525,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:58:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:58:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901273 total) msec
Mar 27 2023 11:58:03 GMT: INFO (info): (hist.c:331) (00: 0002899750) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:58:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:58:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2116914 total) msec
Mar 27 2023 11:58:03 GMT: INFO (info): (hist.c:331) (00: 0001684059) (01: 0000406045) (02: 0000024115) (03: 0000002454)
Mar 27 2023 11:58:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:58:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:58:13 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (39983028,114265) total-ms 20261
Mar 27 2023 11:58:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:58:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:58:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 100 user-cpu-pct 97 kernel-cpu-pct 3 free-mem-kbytes 10648980 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:58:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 104 threads (9,64,39,30) heap-kbytes (12854441,12892608,14322176) heap-efficiency-pct 99.7
Mar 27 2023 11:58:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:58:13 GMT: INFO (info): (ticker.c:319) fds: proto (70,128838,128768) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:58:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6946091
Mar 27 2023 11:58:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (53685,6576317) ctrl (6,14) meta (0,0) rw (2135,4801)
Mar 27 2023 11:58:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51713165 master 15794161 prole 34468793 non-replica 1450211
Mar 27 2023 11:58:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,245,0) active (0,1,0) complete-pct 88.54
Mar 27 2023 11:58:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11563046256 index-bytes 3309642560 set-index-bytes 0 sindex-bytes 8253403696 used-pct 67.31
Mar 27 2023 11:58:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190823993536 avail-pct 48 cache-read-pct 81.82
Mar 27 2023 11:58:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669551,0,0,231726,0) write (2116917,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:58:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:58:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610544,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:58:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:58:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901277 total) msec
Mar 27 2023 11:58:13 GMT: INFO (info): (hist.c:331) (00: 0002899754) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:58:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:58:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2116918 total) msec
Mar 27 2023 11:58:13 GMT: INFO (info): (hist.c:331) (00: 0001684063) (01: 0000406045) (02: 0000024115) (03: 0000002454)
Mar 27 2023 11:58:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:58:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:58:14 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:58:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 190824169392 free-wblocks 984532 write-q 0 write (431771,0.8) defrag-q 0 defrag-read (392084,32.6) defrag-write (125102,0.2)
Mar 27 2023 11:58:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:58:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:58:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 101 user-cpu-pct 98 kernel-cpu-pct 3 free-mem-kbytes 10647632 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:58:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 103 threads (9,64,39,30) heap-kbytes (12853437,12892004,14322176) heap-efficiency-pct 99.7
Mar 27 2023 11:58:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:58:23 GMT: INFO (info): (ticker.c:319) fds: proto (57,128838,128781) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:58:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6946358
Mar 27 2023 11:58:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (36815,4427706) ctrl (4,7) meta (0,0) rw (4251,4874)
Mar 27 2023 11:58:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51713384 master 15794165 prole 34469008 non-replica 1430244
Mar 27 2023 11:58:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,244,0) active (0,0,0) complete-pct 88.58
Mar 27 2023 11:58:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11562025624 index-bytes 3309656576 set-index-bytes 0 sindex-bytes 8252369048 used-pct 67.30
Mar 27 2023 11:58:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190824239840 avail-pct 48 cache-read-pct 71.43
Mar 27 2023 11:58:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669552,0,0,231727,0) write (2116922,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:58:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:58:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610565,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:58:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:58:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901279 total) msec
Mar 27 2023 11:58:23 GMT: INFO (info): (hist.c:331) (00: 0002899756) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:58:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:58:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2116923 total) msec
Mar 27 2023 11:58:23 GMT: INFO (info): (hist.c:331) (00: 0001684068) (01: 0000406045) (02: 0000024115) (03: 0000002454)
Mar 27 2023 11:58:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:58:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:58:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:58:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:58:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 106 user-cpu-pct 102 kernel-cpu-pct 4 free-mem-kbytes 10648428 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:58:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 108 threads (9,64,39,30) heap-kbytes (12852213,12892056,14322176) heap-efficiency-pct 99.7
Mar 27 2023 11:58:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:58:33 GMT: INFO (info): (ticker.c:319) fds: proto (57,128838,128781) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:58:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6946626
Mar 27 2023 11:58:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (42721,5206601) ctrl (6,18) meta (0,0) rw (42055,38680)
Mar 27 2023 11:58:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51713606 master 15794167 prole 34469228 non-replica 1430244
Mar 27 2023 11:58:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,244,0) active (0,1,0) complete-pct 88.58
Mar 27 2023 11:58:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11560614968 index-bytes 3309670784 set-index-bytes 0 sindex-bytes 8250944184 used-pct 67.29
Mar 27 2023 11:58:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190824533840 avail-pct 48 cache-read-pct 79.57
Mar 27 2023 11:58:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669573,0,0,231727,0) write (2116944,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:58:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:58:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610586,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:58:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:58:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901300 total) msec
Mar 27 2023 11:58:33 GMT: INFO (info): (hist.c:331) (00: 0002899777) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:58:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:58:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2116945 total) msec
Mar 27 2023 11:58:33 GMT: INFO (info): (hist.c:331) (00: 0001684080) (01: 0000406053) (02: 0000024117) (03: 0000002454)
Mar 27 2023 11:58:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:58:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:58:34 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (40086615,103587) total-ms 20010
Mar 27 2023 11:58:35 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:58:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 190824659792 free-wblocks 984532 write-q 0 write (431775,0.2) defrag-q 0 defrag-read (392086,0.1) defrag-write (125103,0.1)
Mar 27 2023 11:58:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:58:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:58:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 95 user-cpu-pct 92 kernel-cpu-pct 3 free-mem-kbytes 10647724 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:58:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 98 threads (9,64,39,30) heap-kbytes (12851460,12890912,14322176) heap-efficiency-pct 99.7
Mar 27 2023 11:58:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:58:43 GMT: INFO (info): (ticker.c:319) fds: proto (58,128839,128781) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:58:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6946891
Mar 27 2023 11:58:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (44646,5479632) ctrl (4,9) meta (0,0) rw (11951,6070)
Mar 27 2023 11:58:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51713861 master 15794171 prole 34469479 non-replica 1430244
Mar 27 2023 11:58:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,243,0) active (0,1,0) complete-pct 88.63
Mar 27 2023 11:58:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11559941728 index-bytes 3309687104 set-index-bytes 0 sindex-bytes 8250254624 used-pct 67.29
Mar 27 2023 11:58:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190824798160 avail-pct 48 cache-read-pct 77.14
Mar 27 2023 11:58:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669586,0,0,231728,0) write (2116957,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:58:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:58:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610612,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:58:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:58:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901314 total) msec
Mar 27 2023 11:58:43 GMT: INFO (info): (hist.c:331) (00: 0002899791) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:58:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:58:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2116958 total) msec
Mar 27 2023 11:58:43 GMT: INFO (info): (hist.c:331) (00: 0001684089) (01: 0000406057) (02: 0000024117) (03: 0000002454)
Mar 27 2023 11:58:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:58:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:58:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:58:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:58:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 107 user-cpu-pct 103 kernel-cpu-pct 4 free-mem-kbytes 10647252 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:58:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 110 threads (9,64,39,30) heap-kbytes (12850721,12888620,14322176) heap-efficiency-pct 99.7
Mar 27 2023 11:58:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:58:53 GMT: INFO (info): (ticker.c:319) fds: proto (33,128839,128806) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:58:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6947158
Mar 27 2023 11:58:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (54398,6719555) ctrl (6,14) meta (0,0) rw (1630,3690)
Mar 27 2023 11:58:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51714161 master 15794175 prole 34469775 non-replica 1410218
Mar 27 2023 11:58:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,242,0) active (0,1,0) complete-pct 88.68
Mar 27 2023 11:58:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11559190156 index-bytes 3309706304 set-index-bytes 0 sindex-bytes 8249483852 used-pct 67.28
Mar 27 2023 11:58:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190825089632 avail-pct 48 cache-read-pct 87.50
Mar 27 2023 11:58:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669590,0,0,231731,0) write (2116964,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:58:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:58:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610637,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:58:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:58:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901321 total) msec
Mar 27 2023 11:58:53 GMT: INFO (info): (hist.c:331) (00: 0002899798) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:58:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:58:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2116965 total) msec
Mar 27 2023 11:58:53 GMT: INFO (info): (hist.c:331) (00: 0001684096) (01: 0000406057) (02: 0000024117) (03: 0000002454)
Mar 27 2023 11:58:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:58:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:58:55 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (40155179,68564) total-ms 20010
Mar 27 2023 11:58:56 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:58:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 190747567344 free-wblocks 984833 write-q 0 write (431783,0.4) defrag-q 0 defrag-read (392397,15.6) defrag-write (125106,0.2)
Mar 27 2023 11:59:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:59:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:59:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 97 user-cpu-pct 93 kernel-cpu-pct 4 free-mem-kbytes 10646132 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:59:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 101 threads (9,64,39,30) heap-kbytes (12849048,12888508,14322176) heap-efficiency-pct 99.7
Mar 27 2023 11:59:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:59:03 GMT: INFO (info): (ticker.c:319) fds: proto (35,128854,128819) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:59:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6947426
Mar 27 2023 11:59:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (51218,6196656) ctrl (6,13) meta (0,0) rw (54360,65889)
Mar 27 2023 11:59:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51694487 master 15794180 prole 34470063 non-replica 1410215
Mar 27 2023 11:59:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,241,0) active (0,0,0) complete-pct 88.72
Mar 27 2023 11:59:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11556358048 index-bytes 3308447168 set-index-bytes 0 sindex-bytes 8247910880 used-pct 67.27
Mar 27 2023 11:59:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190747680400 avail-pct 48 cache-read-pct 80.00
Mar 27 2023 11:59:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669646,0,0,231731,0) write (2117021,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:59:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:59:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610667,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:59:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:59:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901377 total) msec
Mar 27 2023 11:59:03 GMT: INFO (info): (hist.c:331) (00: 0002899854) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:59:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:59:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117022 total) msec
Mar 27 2023 11:59:03 GMT: INFO (info): (hist.c:331) (00: 0001684144) (01: 0000406064) (02: 0000024119) (03: 0000002454)
Mar 27 2023 11:59:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:59:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:59:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:59:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:59:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 102 user-cpu-pct 101 kernel-cpu-pct 1 free-mem-kbytes 10646264 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:59:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 105 threads (9,64,39,30) heap-kbytes (12848175,12886712,14322176) heap-efficiency-pct 99.7
Mar 27 2023 11:59:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:59:13 GMT: INFO (info): (ticker.c:319) fds: proto (36,128855,128819) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:59:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6947691
Mar 27 2023 11:59:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (23708,2919630) ctrl (4,12) meta (0,0) rw (788,3699)
Mar 27 2023 11:59:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51694634 master 15794181 prole 34470209 non-replica 1390261
Mar 27 2023 11:59:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,241,0) active (0,1,0) complete-pct 88.72
Mar 27 2023 11:59:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11555537076 index-bytes 3308456576 set-index-bytes 0 sindex-bytes 8247080500 used-pct 67.26
Mar 27 2023 11:59:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190747852784 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 11:59:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669646,0,0,231731,0) write (2117022,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:59:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:59:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610679,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:59:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:59:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901377 total) msec
Mar 27 2023 11:59:13 GMT: INFO (info): (hist.c:331) (00: 0002899854) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:59:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:59:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117023 total) msec
Mar 27 2023 11:59:13 GMT: INFO (info): (hist.c:331) (00: 0001684145) (01: 0000406064) (02: 0000024119) (03: 0000002454)
Mar 27 2023 11:59:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:59:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:59:16 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (40256904,101725) total-ms 20470
Mar 27 2023 11:59:17 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 11:59:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 190671542512 free-wblocks 985132 write-q 0 write (431786,0.2) defrag-q 0 defrag-read (392697,15.0) defrag-write (125106,0.0)
Mar 27 2023 11:59:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:59:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:59:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 96 user-cpu-pct 92 kernel-cpu-pct 4 free-mem-kbytes 10645872 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:59:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 99 threads (9,64,39,30) heap-kbytes (12846773,12884896,14322176) heap-efficiency-pct 99.7
Mar 27 2023 11:59:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:59:23 GMT: INFO (info): (ticker.c:319) fds: proto (35,128855,128820) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:59:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6947958
Mar 27 2023 11:59:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (50319,6196398) ctrl (4,9) meta (0,0) rw (3428,5282)
Mar 27 2023 11:59:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51674875 master 15794185 prole 34470472 non-replica 1390261
Mar 27 2023 11:59:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,240,0) active (0,1,0) complete-pct 88.77
Mar 27 2023 11:59:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11552901948 index-bytes 3307192000 set-index-bytes 0 sindex-bytes 8245709948 used-pct 67.25
Mar 27 2023 11:59:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190671659248 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 11:59:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669646,0,0,231731,0) write (2117026,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:59:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:59:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610701,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:59:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:59:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901377 total) msec
Mar 27 2023 11:59:23 GMT: INFO (info): (hist.c:331) (00: 0002899854) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:59:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:59:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117027 total) msec
Mar 27 2023 11:59:23 GMT: INFO (info): (hist.c:331) (00: 0001684149) (01: 0000406064) (02: 0000024119) (03: 0000002454)
Mar 27 2023 11:59:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:59:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:59:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:59:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:59:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 107 user-cpu-pct 103 kernel-cpu-pct 4 free-mem-kbytes 10646268 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:59:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 110 threads (9,64,39,30) heap-kbytes (12845362,12884748,14322176) heap-efficiency-pct 99.7
Mar 27 2023 11:59:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:59:33 GMT: INFO (info): (ticker.c:319) fds: proto (35,128855,128820) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:59:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6948226
Mar 27 2023 11:59:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (54640,6546440) ctrl (4,7) meta (0,0) rw (44212,40765)
Mar 27 2023 11:59:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51675132 master 15794189 prole 34470725 non-replica 1390261
Mar 27 2023 11:59:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,239,0) active (0,0,0) complete-pct 88.82
Mar 27 2023 11:59:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11551500148 index-bytes 3307208448 set-index-bytes 0 sindex-bytes 8244291700 used-pct 67.24
Mar 27 2023 11:59:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190671963136 avail-pct 48 cache-read-pct 77.01
Mar 27 2023 11:59:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669664,0,0,231731,0) write (2117048,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:59:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:59:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610719,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:59:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:59:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901395 total) msec
Mar 27 2023 11:59:33 GMT: INFO (info): (hist.c:331) (00: 0002899872) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:59:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:59:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117049 total) msec
Mar 27 2023 11:59:33 GMT: INFO (info): (hist.c:331) (00: 0001684166) (01: 0000406069) (02: 0000024119) (03: 0000002454)
Mar 27 2023 11:59:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:59:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:59:38 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (40366817,109913) total-ms 20525
Mar 27 2023 11:59:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 190595127760 free-wblocks 985429 write-q 0 write (431790,0.2) defrag-q 0 defrag-read (392999,15.1) defrag-write (125107,0.1)
Mar 27 2023 11:59:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:59:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:59:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 46 user-cpu-pct 45 kernel-cpu-pct 1 free-mem-kbytes 10646232 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:59:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 48 threads (9,64,39,30) heap-kbytes (12844937,12882076,14260736) heap-efficiency-pct 99.7
Mar 27 2023 11:59:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:59:43 GMT: INFO (info): (ticker.c:319) fds: proto (36,128856,128820) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:59:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6948491
Mar 27 2023 11:59:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (15893,1953976) ctrl (7,20) meta (0,0) rw (36,6574)
Mar 27 2023 11:59:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51655259 master 15794189 prole 34470809 non-replica 1390261
Mar 27 2023 11:59:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,239,0) active (0,2,0) complete-pct 88.82
Mar 27 2023 11:59:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11549837928 index-bytes 3305936576 set-index-bytes 0 sindex-bytes 8243901352 used-pct 67.23
Mar 27 2023 11:59:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190595281584 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 11:59:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669664,0,0,231731,0) write (2117048,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:59:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:59:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610734,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:59:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:59:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901395 total) msec
Mar 27 2023 11:59:43 GMT: INFO (info): (hist.c:331) (00: 0002899872) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:59:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:59:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117049 total) msec
Mar 27 2023 11:59:43 GMT: INFO (info): (hist.c:331) (00: 0001684166) (01: 0000406069) (02: 0000024119) (03: 0000002454)
Mar 27 2023 11:59:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:59:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:59:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 11:59:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 11:59:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 14 user-cpu-pct 4 kernel-cpu-pct 10 free-mem-kbytes 10646252 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 11:59:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 28 threads (9,64,39,30) heap-kbytes (12845023,12882100,14260736) heap-efficiency-pct 99.7
Mar 27 2023 11:59:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 11:59:53 GMT: INFO (info): (ticker.c:319) fds: proto (35,128856,128821) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 11:59:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6948758
Mar 27 2023 11:59:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (186477,22927484) ctrl (9,22) meta (0,0) rw (1633,6366)
Mar 27 2023 11:59:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51656292 master 15794191 prole 34471840 non-replica 1370246
Mar 27 2023 11:59:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,238,0) active (0,3,0) complete-pct 88.86
Mar 27 2023 11:59:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11549965156 index-bytes 3306002688 set-index-bytes 0 sindex-bytes 8243962468 used-pct 67.23
Mar 27 2023 11:59:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190596245392 avail-pct 48 cache-read-pct 25.00
Mar 27 2023 11:59:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669664,0,0,231731,0) write (2117050,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 11:59:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:59:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610752,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 11:59:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 11:59:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901395 total) msec
Mar 27 2023 11:59:53 GMT: INFO (info): (hist.c:331) (00: 0002899872) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 11:59:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 11:59:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117051 total) msec
Mar 27 2023 11:59:53 GMT: INFO (info): (hist.c:331) (00: 0001684168) (01: 0000406069) (02: 0000024119) (03: 0000002454)
Mar 27 2023 11:59:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 11:59:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 11:59:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 190596513120 free-wblocks 985425 write-q 0 write (431798,0.4) defrag-q 0 defrag-read (393001,0.1) defrag-write (125107,0.0)
Mar 27 2023 11:59:59 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 12:00:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:00:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:00:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 52 user-cpu-pct 48 kernel-cpu-pct 4 free-mem-kbytes 10646184 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:00:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 57 threads (9,64,39,30) heap-kbytes (12844774,12882120,14260736) heap-efficiency-pct 99.7
Mar 27 2023 12:00:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:00:03 GMT: INFO (info): (ticker.c:319) fds: proto (27,128862,128835) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:00:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6949026
Mar 27 2023 12:00:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (63856,7824408) ctrl (8,13) meta (0,0) rw (59525,53029)
Mar 27 2023 12:00:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51656645 master 15794195 prole 34472189 non-replica 1370246
Mar 27 2023 12:00:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,235,0) active (0,1,0) complete-pct 89.00
Mar 27 2023 12:00:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11549303620 index-bytes 3306025280 set-index-bytes 0 sindex-bytes 8243278340 used-pct 67.23
Mar 27 2023 12:00:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190596659184 avail-pct 48 cache-read-pct 84.72
Mar 27 2023 12:00:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669714,0,0,231732,0) write (2117081,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:00:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:00:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610779,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:00:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:00:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901446 total) msec
Mar 27 2023 12:00:03 GMT: INFO (info): (hist.c:331) (00: 0002899923) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:00:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:00:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117082 total) msec
Mar 27 2023 12:00:03 GMT: INFO (info): (hist.c:331) (00: 0001684190) (01: 0000406077) (02: 0000024120) (03: 0000002454)
Mar 27 2023 12:00:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:00:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:00:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:00:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:00:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 106 user-cpu-pct 102 kernel-cpu-pct 4 free-mem-kbytes 10645628 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:00:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 109 threads (9,64,39,30) heap-kbytes (12842415,12881988,14260736) heap-efficiency-pct 99.7
Mar 27 2023 12:00:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:00:13 GMT: INFO (info): (ticker.c:319) fds: proto (28,128863,128835) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:00:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6949290
Mar 27 2023 12:00:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (55564,6793701) ctrl (6,13) meta (0,0) rw (3447,1597)
Mar 27 2023 12:00:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51656966 master 15794199 prole 34472506 non-replica 1350210
Mar 27 2023 12:00:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,234,0) active (0,0,0) complete-pct 89.05
Mar 27 2023 12:00:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11546933864 index-bytes 3306045824 set-index-bytes 0 sindex-bytes 8240888040 used-pct 67.21
Mar 27 2023 12:00:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190596993968 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:00:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669714,0,0,231732,0) write (2117085,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:00:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:00:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610789,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:00:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:00:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901446 total) msec
Mar 27 2023 12:00:13 GMT: INFO (info): (hist.c:331) (00: 0002899923) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:00:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:00:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117086 total) msec
Mar 27 2023 12:00:13 GMT: INFO (info): (hist.c:331) (00: 0001684194) (01: 0000406077) (02: 0000024120) (03: 0000002454)
Mar 27 2023 12:00:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:00:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:00:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 190597101488 free-wblocks 985423 write-q 0 write (431800,0.1) defrag-q 0 defrag-read (393001,0.0) defrag-write (125107,0.0)
Mar 27 2023 12:00:19 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (40578037,211220) total-ms 20521
Mar 27 2023 12:00:20 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 12:00:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:00:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:00:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 95 user-cpu-pct 92 kernel-cpu-pct 3 free-mem-kbytes 10645944 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:00:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 98 threads (9,64,39,30) heap-kbytes (12839679,12878180,14258688) heap-efficiency-pct 99.7
Mar 27 2023 12:00:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:00:23 GMT: INFO (info): (ticker.c:319) fds: proto (27,128863,128836) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:00:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6949558
Mar 27 2023 12:00:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (47873,5755637) ctrl (2,7) meta (0,0) rw (12,818)
Mar 27 2023 12:00:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51637211 master 15794199 prole 34472766 non-replica 1350210
Mar 27 2023 12:00:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,234,0) active (0,1,0) complete-pct 89.05
Mar 27 2023 12:00:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11543011136 index-bytes 3304781504 set-index-bytes 0 sindex-bytes 8238229632 used-pct 67.19
Mar 27 2023 12:00:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190520782320 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:00:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669714,0,0,231732,0) write (2117085,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:00:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:00:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610796,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:00:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:00:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901446 total) msec
Mar 27 2023 12:00:23 GMT: INFO (info): (hist.c:331) (00: 0002899923) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:00:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:00:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117086 total) msec
Mar 27 2023 12:00:23 GMT: INFO (info): (hist.c:331) (00: 0001684194) (01: 0000406077) (02: 0000024120) (03: 0000002454)
Mar 27 2023 12:00:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:00:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:00:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:00:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:00:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 102 user-cpu-pct 101 kernel-cpu-pct 1 free-mem-kbytes 10645780 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:00:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 104 threads (9,64,39,30) heap-kbytes (12837549,12872840,14258688) heap-efficiency-pct 99.7
Mar 27 2023 12:00:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:00:33 GMT: INFO (info): (ticker.c:319) fds: proto (33,128869,128836) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:00:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6949825
Mar 27 2023 12:00:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (16501,1994084) ctrl (4,7) meta (0,0) rw (106611,119539)
Mar 27 2023 12:00:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51637309 master 15794205 prole 34472858 non-replica 1330215
Mar 27 2023 12:00:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,233,0) active (0,0,0) complete-pct 89.10
Mar 27 2023 12:00:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11540875128 index-bytes 3304787776 set-index-bytes 0 sindex-bytes 8236087352 used-pct 67.18
Mar 27 2023 12:00:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190520909008 avail-pct 48 cache-read-pct 75.98
Mar 27 2023 12:00:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669816,0,0,231736,0) write (2117173,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:00:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:00:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610825,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:00:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:00:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901552 total) msec
Mar 27 2023 12:00:33 GMT: INFO (info): (hist.c:331) (00: 0002900029) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:00:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:00:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117174 total) msec
Mar 27 2023 12:00:33 GMT: INFO (info): (hist.c:331) (00: 0001684269) (01: 0000406090) (02: 0000024120) (03: 0000002454)
Mar 27 2023 12:00:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:00:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:00:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 190521113120 free-wblocks 985726 write-q 0 write (431810,0.5) defrag-q 0 defrag-read (393313,15.6) defrag-write (125111,0.2)
Mar 27 2023 12:00:40 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (40734223,156186) total-ms 19929
Mar 27 2023 12:00:41 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 12:00:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:00:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:00:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 96 user-cpu-pct 93 kernel-cpu-pct 3 free-mem-kbytes 10646108 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:00:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 100 threads (9,64,39,30) heap-kbytes (12836016,12872496,14258688) heap-efficiency-pct 99.7
Mar 27 2023 12:00:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:00:43 GMT: INFO (info): (ticker.c:319) fds: proto (33,128870,128837) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:00:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6950090
Mar 27 2023 12:00:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (57452,7024012) ctrl (4,12) meta (0,0) rw (3544,1828)
Mar 27 2023 12:00:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51617609 master 15794209 prole 34473190 non-replica 1330215
Mar 27 2023 12:00:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,233,0) active (0,1,0) complete-pct 89.10
Mar 27 2023 12:00:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11538112300 index-bytes 3303526976 set-index-bytes 0 sindex-bytes 8234585324 used-pct 67.16
Mar 27 2023 12:00:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190443117984 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:00:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669816,0,0,231736,0) write (2117177,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:00:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:00:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610838,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:00:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:00:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901552 total) msec
Mar 27 2023 12:00:43 GMT: INFO (info): (hist.c:331) (00: 0002900029) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:00:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:00:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117178 total) msec
Mar 27 2023 12:00:43 GMT: INFO (info): (hist.c:331) (00: 0001684273) (01: 0000406090) (02: 0000024120) (03: 0000002454)
Mar 27 2023 12:00:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:00:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:00:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:00:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:00:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 105 user-cpu-pct 102 kernel-cpu-pct 3 free-mem-kbytes 10645944 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:00:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 108 threads (9,64,39,30) heap-kbytes (12835882,12870924,14258688) heap-efficiency-pct 99.7
Mar 27 2023 12:00:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:00:53 GMT: INFO (info): (ticker.c:319) fds: proto (33,128870,128837) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:00:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6950358
Mar 27 2023 12:00:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (45160,5597887) ctrl (4,9) meta (0,0) rw (2568,839)
Mar 27 2023 12:00:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51617854 master 15794212 prole 34473432 non-replica 1330215
Mar 27 2023 12:00:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,232,0) active (0,1,0) complete-pct 89.14
Mar 27 2023 12:00:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11537933276 index-bytes 3303542656 set-index-bytes 0 sindex-bytes 8234390620 used-pct 67.16
Mar 27 2023 12:00:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190443325008 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:00:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669816,0,0,231736,0) write (2117180,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:00:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:00:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610847,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:00:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:00:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901552 total) msec
Mar 27 2023 12:00:53 GMT: INFO (info): (hist.c:331) (00: 0002900029) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:00:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:00:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117181 total) msec
Mar 27 2023 12:00:53 GMT: INFO (info): (hist.c:331) (00: 0001684276) (01: 0000406090) (02: 0000024120) (03: 0000002454)
Mar 27 2023 12:00:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:00:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:00:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 190443495712 free-wblocks 986093 write-q 0 write (431814,0.2) defrag-q 0 defrag-read (393684,18.5) defrag-write (125111,0.0)
Mar 27 2023 12:01:01 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (40795657,61434) total-ms 20033
Mar 27 2023 12:01:02 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 12:01:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:01:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:01:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 94 user-cpu-pct 92 kernel-cpu-pct 2 free-mem-kbytes 10645972 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:01:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 95 threads (9,64,39,30) heap-kbytes (12834272,12868500,14258688) heap-efficiency-pct 99.7
Mar 27 2023 12:01:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:01:03 GMT: INFO (info): (ticker.c:319) fds: proto (33,128870,128837) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:01:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6950623
Mar 27 2023 12:01:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (26139,3184759) ctrl (4,7) meta (0,0) rw (10794,16959)
Mar 27 2023 12:01:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51598022 master 15794218 prole 34473589 non-replica 1310202
Mar 27 2023 12:01:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,231,0) active (0,0,0) complete-pct 89.19
Mar 27 2023 12:01:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11535143640 index-bytes 3302273408 set-index-bytes 0 sindex-bytes 8232870232 used-pct 67.14
Mar 27 2023 12:01:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190366457488 avail-pct 48 cache-read-pct 76.09
Mar 27 2023 12:01:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669823,0,0,231737,0) write (2117193,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:01:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:01:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610873,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:01:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:01:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901560 total) msec
Mar 27 2023 12:01:03 GMT: INFO (info): (hist.c:331) (00: 0002900037) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:01:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:01:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117194 total) msec
Mar 27 2023 12:01:03 GMT: INFO (info): (hist.c:331) (00: 0001684286) (01: 0000406093) (02: 0000024120) (03: 0000002454)
Mar 27 2023 12:01:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:01:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:01:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:01:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:01:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 105 user-cpu-pct 102 kernel-cpu-pct 3 free-mem-kbytes 10645964 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:01:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 108 threads (9,64,39,30) heap-kbytes (12831446,12868440,14258688) heap-efficiency-pct 99.7
Mar 27 2023 12:01:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:01:13 GMT: INFO (info): (ticker.c:319) fds: proto (33,128870,128837) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:01:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6950890
Mar 27 2023 12:01:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (46441,5825068) ctrl (6,18) meta (0,0) rw (847,6717)
Mar 27 2023 12:01:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51598236 master 15794219 prole 34473802 non-replica 1270105
Mar 27 2023 12:01:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,231,0) active (0,1,0) complete-pct 89.19
Mar 27 2023 12:01:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11532448156 index-bytes 3302287104 set-index-bytes 0 sindex-bytes 8230161052 used-pct 67.13
Mar 27 2023 12:01:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190366714016 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:01:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669823,0,0,231737,0) write (2117194,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:01:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:01:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610887,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:01:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:01:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901560 total) msec
Mar 27 2023 12:01:13 GMT: INFO (info): (hist.c:331) (00: 0002900037) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:01:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:01:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117195 total) msec
Mar 27 2023 12:01:13 GMT: INFO (info): (hist.c:331) (00: 0001684287) (01: 0000406093) (02: 0000024120) (03: 0000002454)
Mar 27 2023 12:01:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:01:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:01:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 190366800864 free-wblocks 986422 write-q 0 write (431816,0.1) defrag-q 0 defrag-read (394015,16.5) defrag-write (125112,0.1)
Mar 27 2023 12:01:23 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (41053194,257537) total-ms 20587
Mar 27 2023 12:01:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:01:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:01:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 102 user-cpu-pct 98 kernel-cpu-pct 4 free-mem-kbytes 10645476 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:01:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 107 threads (9,64,39,30) heap-kbytes (12828014,12865080,14256640) heap-efficiency-pct 99.7
Mar 27 2023 12:01:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:01:23 GMT: INFO (info): (ticker.c:319) fds: proto (32,128871,128839) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:01:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6951158
Mar 27 2023 12:01:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (66646,8332841) ctrl (9,22) meta (0,0) rw (1911,2968)
Mar 27 2023 12:01:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51578552 master 15794220 prole 34474130 non-replica 1270105
Mar 27 2023 12:01:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,230,0) active (0,2,0) complete-pct 89.24
Mar 27 2023 12:01:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11527731960 index-bytes 3301027328 set-index-bytes 0 sindex-bytes 8226704632 used-pct 67.10
Mar 27 2023 12:01:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190289927728 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:01:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669823,0,0,231737,0) write (2117195,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:01:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:01:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610896,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:01:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:01:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901560 total) msec
Mar 27 2023 12:01:23 GMT: INFO (info): (hist.c:331) (00: 0002900037) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:01:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:01:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117196 total) msec
Mar 27 2023 12:01:23 GMT: INFO (info): (hist.c:331) (00: 0001684288) (01: 0000406093) (02: 0000024120) (03: 0000002454)
Mar 27 2023 12:01:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:01:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:01:24 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 12:01:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:01:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:01:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 110 user-cpu-pct 101 kernel-cpu-pct 9 free-mem-kbytes 10645288 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:01:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 121 threads (9,64,39,30) heap-kbytes (12825031,12856028,14252544) heap-efficiency-pct 99.8
Mar 27 2023 12:01:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:01:33 GMT: INFO (info): (ticker.c:319) fds: proto (34,128887,128853) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:01:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6951423
Mar 27 2023 12:01:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (151748,18444062) ctrl (13,29) meta (0,0) rw (58751,70295)
Mar 27 2023 12:01:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51579384 master 15794223 prole 34474959 non-replica 1250119
Mar 27 2023 12:01:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,228,0) active (0,2,0) complete-pct 89.33
Mar 27 2023 12:01:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11525155088 index-bytes 3301080576 set-index-bytes 0 sindex-bytes 8224074512 used-pct 67.09
Mar 27 2023 12:01:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190290694656 avail-pct 48 cache-read-pct 69.05
Mar 27 2023 12:01:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669887,0,0,231738,0) write (2117259,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:01:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:01:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610917,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:01:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:01:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901625 total) msec
Mar 27 2023 12:01:33 GMT: INFO (info): (hist.c:331) (00: 0002900102) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:01:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:01:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117260 total) msec
Mar 27 2023 12:01:33 GMT: INFO (info): (hist.c:331) (00: 0001684338) (01: 0000406103) (02: 0000024120) (03: 0000002458)
Mar 27 2023 12:01:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:01:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:01:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 190291028368 free-wblocks 986719 write-q 0 write (431826,0.5) defrag-q 0 defrag-read (394321,15.3) defrag-write (125113,0.1)
Mar 27 2023 12:01:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:01:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:01:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 108 user-cpu-pct 103 kernel-cpu-pct 5 free-mem-kbytes 10645900 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:01:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 115 threads (9,64,39,30) heap-kbytes (12822681,12855736,14252544) heap-efficiency-pct 99.7
Mar 27 2023 12:01:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:01:43 GMT: INFO (info): (ticker.c:319) fds: proto (34,128888,128854) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:01:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6951690
Mar 27 2023 12:01:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (86617,10681874) ctrl (8,16) meta (0,0) rw (8115,16851)
Mar 27 2023 12:01:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51579844 master 15794227 prole 34475415 non-replica 1230118
Mar 27 2023 12:01:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,226,0) active (0,1,0) complete-pct 89.42
Mar 27 2023 12:01:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11523096348 index-bytes 3301110016 set-index-bytes 0 sindex-bytes 8221986332 used-pct 67.07
Mar 27 2023 12:01:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190291200640 avail-pct 48 cache-read-pct 72.97
Mar 27 2023 12:01:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669893,0,0,231738,0) write (2117267,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:01:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:01:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610941,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:01:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:01:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901631 total) msec
Mar 27 2023 12:01:43 GMT: INFO (info): (hist.c:331) (00: 0002900108) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:01:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:01:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117268 total) msec
Mar 27 2023 12:01:43 GMT: INFO (info): (hist.c:331) (00: 0001684345) (01: 0000406104) (02: 0000024120) (03: 0000002458)
Mar 27 2023 12:01:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:01:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:01:46 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (41271163,217969) total-ms 21579
Mar 27 2023 12:01:47 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 12:01:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:01:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:01:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 97 user-cpu-pct 93 kernel-cpu-pct 4 free-mem-kbytes 10645508 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:01:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 100 threads (9,64,39,30) heap-kbytes (12820206,12852072,14252544) heap-efficiency-pct 99.8
Mar 27 2023 12:01:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:01:53 GMT: INFO (info): (ticker.c:319) fds: proto (35,128889,128854) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:01:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6951958
Mar 27 2023 12:01:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (49476,6096388) ctrl (4,9) meta (0,0) rw (11593,28280)
Mar 27 2023 12:01:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51540040 master 15794230 prole 34475705 non-replica 1230118
Mar 27 2023 12:01:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,225,0) active (0,1,0) complete-pct 89.47
Mar 27 2023 12:01:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11518253792 index-bytes 3298562560 set-index-bytes 0 sindex-bytes 8219691232 used-pct 67.05
Mar 27 2023 12:01:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190136660784 avail-pct 48 cache-read-pct 70.73
Mar 27 2023 12:01:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669914,0,0,231739,0) write (2117279,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:01:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:01:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1610969,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:01:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:01:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901653 total) msec
Mar 27 2023 12:01:53 GMT: INFO (info): (hist.c:331) (00: 0002900130) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:01:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:01:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117280 total) msec
Mar 27 2023 12:01:53 GMT: INFO (info): (hist.c:331) (00: 0001684354) (01: 0000406107) (02: 0000024120) (03: 0000002458)
Mar 27 2023 12:01:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:01:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:01:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 190136790800 free-wblocks 987410 write-q 0 write (431831,0.2) defrag-q 0 defrag-read (395017,34.8) defrag-write (125114,0.1)
Mar 27 2023 12:02:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:02:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:02:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 105 user-cpu-pct 102 kernel-cpu-pct 3 free-mem-kbytes 10645700 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:02:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 109 threads (9,64,39,30) heap-kbytes (12819035,12849180,14252544) heap-efficiency-pct 99.8
Mar 27 2023 12:02:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:02:03 GMT: INFO (info): (ticker.c:319) fds: proto (35,128889,128854) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:02:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6952223
Mar 27 2023 12:02:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (49860,6064753) ctrl (4,7) meta (0,0) rw (16066,26055)
Mar 27 2023 12:02:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51540325 master 15794235 prole 34475985 non-replica 1230118
Mar 27 2023 12:02:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,224,0) active (0,0,0) complete-pct 89.52
Mar 27 2023 12:02:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11517060328 index-bytes 3298580800 set-index-bytes 0 sindex-bytes 8218479528 used-pct 67.04
Mar 27 2023 12:02:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 190136893120 avail-pct 48 cache-read-pct 76.00
Mar 27 2023 12:02:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669928,0,0,231742,0) write (2117297,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:02:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:02:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611000,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:02:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:02:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901670 total) msec
Mar 27 2023 12:02:03 GMT: INFO (info): (hist.c:331) (00: 0002900147) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:02:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:02:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117298 total) msec
Mar 27 2023 12:02:03 GMT: INFO (info): (hist.c:331) (00: 0001684368) (01: 0000406111) (02: 0000024120) (03: 0000002458)
Mar 27 2023 12:02:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:02:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:02:07 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (41392692,121529) total-ms 20373
Mar 27 2023 12:02:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:02:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:02:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 38 user-cpu-pct 36 kernel-cpu-pct 2 free-mem-kbytes 10644700 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:02:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 38 threads (9,64,39,30) heap-kbytes (12819054,12849140,14252544) heap-efficiency-pct 99.8
Mar 27 2023 12:02:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:02:13 GMT: INFO (info): (ticker.c:319) fds: proto (35,128890,128855) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:02:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6952490
Mar 27 2023 12:02:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (21724,2684235) ctrl (5,14) meta (0,0) rw (10881,10149)
Mar 27 2023 12:02:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51500473 master 15794239 prole 34476116 non-replica 1230118
Mar 27 2023 12:02:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,224,0) active (0,2,0) complete-pct 89.52
Mar 27 2023 12:02:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11514520340 index-bytes 3296030272 set-index-bytes 0 sindex-bytes 8218490068 used-pct 67.02
Mar 27 2023 12:02:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189982285952 avail-pct 48 cache-read-pct 86.05
Mar 27 2023 12:02:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669944,0,0,231746,0) write (2117311,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:02:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:02:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611026,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:02:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:02:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901690 total) msec
Mar 27 2023 12:02:13 GMT: INFO (info): (hist.c:331) (00: 0002900167) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:02:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:02:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117312 total) msec
Mar 27 2023 12:02:13 GMT: INFO (info): (hist.c:331) (00: 0001684380) (01: 0000406113) (02: 0000024120) (03: 0000002458)
Mar 27 2023 12:02:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:02:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:02:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189982799504 free-wblocks 988016 write-q 0 write (431836,0.2) defrag-q 0 defrag-read (395627,30.5) defrag-write (125115,0.1)
Mar 27 2023 12:02:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:02:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:02:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 15 user-cpu-pct 4 kernel-cpu-pct 11 free-mem-kbytes 10645600 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:02:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 27 threads (9,64,39,30) heap-kbytes (12819133,12849152,14252544) heap-efficiency-pct 99.8
Mar 27 2023 12:02:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:02:23 GMT: INFO (info): (ticker.c:319) fds: proto (35,128890,128855) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:02:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6952758
Mar 27 2023 12:02:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (183200,22481406) ctrl (9,18) meta (0,0) rw (2063,3306)
Mar 27 2023 12:02:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51501479 master 15794241 prole 34477120 non-replica 1230118
Mar 27 2023 12:02:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,222,0) active (0,2,0) complete-pct 89.61
Mar 27 2023 12:02:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11514651764 index-bytes 3296094656 set-index-bytes 0 sindex-bytes 8218557108 used-pct 67.02
Mar 27 2023 12:02:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189983241952 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:02:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669944,0,0,231746,0) write (2117313,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:02:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:02:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611040,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:02:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:02:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901690 total) msec
Mar 27 2023 12:02:23 GMT: INFO (info): (hist.c:331) (00: 0002900167) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:02:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:02:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117314 total) msec
Mar 27 2023 12:02:23 GMT: INFO (info): (hist.c:331) (00: 0001684382) (01: 0000406113) (02: 0000024120) (03: 0000002458)
Mar 27 2023 12:02:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:02:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:02:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:02:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:02:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 5 user-cpu-pct 2 kernel-cpu-pct 3 free-mem-kbytes 10646656 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:02:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 10 threads (9,64,39,30) heap-kbytes (12819213,12849248,14252544) heap-efficiency-pct 99.8
Mar 27 2023 12:02:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:02:33 GMT: INFO (info): (ticker.c:319) fds: proto (34,128891,128857) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:02:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6953023
Mar 27 2023 12:02:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (64681,8073187) ctrl (6,11) meta (0,0) rw (9444,9802)
Mar 27 2023 12:02:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51501853 master 15794247 prole 34477488 non-replica 1230118
Mar 27 2023 12:02:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,220,0) active (0,1,0) complete-pct 89.71
Mar 27 2023 12:02:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11514694884 index-bytes 3296118592 set-index-bytes 0 sindex-bytes 8218576292 used-pct 67.02
Mar 27 2023 12:02:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189983630128 avail-pct 48 cache-read-pct 87.50
Mar 27 2023 12:02:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669952,0,0,231748,0) write (2117323,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:02:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:02:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611062,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:02:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:02:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901700 total) msec
Mar 27 2023 12:02:33 GMT: INFO (info): (hist.c:331) (00: 0002900177) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:02:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:02:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117324 total) msec
Mar 27 2023 12:02:33 GMT: INFO (info): (hist.c:331) (00: 0001684391) (01: 0000406114) (02: 0000024120) (03: 0000002458)
Mar 27 2023 12:02:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:02:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:02:38 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 12:02:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189983803472 free-wblocks 988012 write-q 0 write (431840,0.2) defrag-q 0 defrag-read (395627,0.0) defrag-write (125115,0.0)
Mar 27 2023 12:02:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:02:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:02:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 60 user-cpu-pct 57 kernel-cpu-pct 3 free-mem-kbytes 10646424 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:02:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 64 threads (9,64,39,30) heap-kbytes (12818313,12848452,14252544) heap-efficiency-pct 99.8
Mar 27 2023 12:02:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:02:43 GMT: INFO (info): (ticker.c:319) fds: proto (34,128892,128858) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:02:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6953290
Mar 27 2023 12:02:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (52600,6434692) ctrl (4,7) meta (0,0) rw (36,3148)
Mar 27 2023 12:02:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51502137 master 15794247 prole 34477772 non-replica 1210100
Mar 27 2023 12:02:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,219,0) active (0,0,0) complete-pct 89.75
Mar 27 2023 12:02:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11513872112 index-bytes 3296136768 set-index-bytes 0 sindex-bytes 8217735344 used-pct 67.02
Mar 27 2023 12:02:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189983917712 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:02:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669952,0,0,231748,0) write (2117323,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:02:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:02:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611074,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:02:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:02:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901700 total) msec
Mar 27 2023 12:02:43 GMT: INFO (info): (hist.c:331) (00: 0002900177) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:02:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:02:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117324 total) msec
Mar 27 2023 12:02:43 GMT: INFO (info): (hist.c:331) (00: 0001684391) (01: 0000406114) (02: 0000024120) (03: 0000002458)
Mar 27 2023 12:02:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:02:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:02:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:02:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:02:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 105 user-cpu-pct 102 kernel-cpu-pct 3 free-mem-kbytes 10646600 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:02:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 109 threads (9,64,39,30) heap-kbytes (12816890,12848392,14252544) heap-efficiency-pct 99.8
Mar 27 2023 12:02:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:02:53 GMT: INFO (info): (ticker.c:319) fds: proto (21,128892,128871) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:02:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6953558
Mar 27 2023 12:02:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (48360,5959422) ctrl (9,25) meta (0,0) rw (5262,5240)
Mar 27 2023 12:02:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51502415 master 15794253 prole 34478044 non-replica 1190099
Mar 27 2023 12:02:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,219,0) active (0,2,0) complete-pct 89.75
Mar 27 2023 12:02:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11512478708 index-bytes 3296154560 set-index-bytes 0 sindex-bytes 8216324148 used-pct 67.01
Mar 27 2023 12:02:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189984214208 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:02:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2669952,0,0,231748,0) write (2117329,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:02:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:02:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611092,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:02:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:02:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901700 total) msec
Mar 27 2023 12:02:53 GMT: INFO (info): (hist.c:331) (00: 0002900177) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:02:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:02:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117330 total) msec
Mar 27 2023 12:02:53 GMT: INFO (info): (hist.c:331) (00: 0001684397) (01: 0000406114) (02: 0000024120) (03: 0000002458)
Mar 27 2023 12:02:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:02:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:02:58 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (41551739,159047) total-ms 20420
Mar 27 2023 12:02:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189907272176 free-wblocks 988323 write-q 0 write (431844,0.2) defrag-q 0 defrag-read (395943,15.8) defrag-write (125116,0.1)
Mar 27 2023 12:02:59 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 12:03:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:03:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:03:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 99 user-cpu-pct 94 kernel-cpu-pct 5 free-mem-kbytes 10647016 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:03:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 104 threads (9,64,39,30) heap-kbytes (12814234,12844380,14250496) heap-efficiency-pct 99.8
Mar 27 2023 12:03:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:03:03 GMT: INFO (info): (ticker.c:319) fds: proto (65,128937,128872) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:03:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6953822
Mar 27 2023 12:03:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (78467,9567015) ctrl (4,7) meta (0,0) rw (71209,82280)
Mar 27 2023 12:03:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51482865 master 15794257 prole 34478508 non-replica 1190099
Mar 27 2023 12:03:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,218,0) active (0,1,0) complete-pct 89.80
Mar 27 2023 12:03:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11508832836 index-bytes 3294903360 set-index-bytes 0 sindex-bytes 8213929476 used-pct 66.99
Mar 27 2023 12:03:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189907428000 avail-pct 48 cache-read-pct 85.03
Mar 27 2023 12:03:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670207,0,0,231752,0) write (2117409,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:03:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:03:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611127,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:03:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:03:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901959 total) msec
Mar 27 2023 12:03:03 GMT: INFO (info): (hist.c:331) (00: 0002900436) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:03:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:03:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117410 total) msec
Mar 27 2023 12:03:03 GMT: INFO (info): (hist.c:331) (00: 0001684467) (01: 0000406123) (02: 0000024121) (03: 0000002458)
Mar 27 2023 12:03:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:03:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:03:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:03:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:03:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 107 user-cpu-pct 103 kernel-cpu-pct 4 free-mem-kbytes 10647604 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:03:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 109 threads (9,64,39,30) heap-kbytes (12812875,12844260,14250496) heap-efficiency-pct 99.8
Mar 27 2023 12:03:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:03:13 GMT: INFO (info): (ticker.c:319) fds: proto (64,128938,128874) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:03:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6954090
Mar 27 2023 12:03:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (56103,6843125) ctrl (4,9) meta (0,0) rw (1908,4488)
Mar 27 2023 12:03:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51483154 master 15794259 prole 34478795 non-replica 1190099
Mar 27 2023 12:03:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,217,0) active (0,1,0) complete-pct 89.85
Mar 27 2023 12:03:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11507539148 index-bytes 3294921856 set-index-bytes 0 sindex-bytes 8212617292 used-pct 66.98
Mar 27 2023 12:03:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189907707808 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:03:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670207,0,0,231752,0) write (2117411,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:03:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:03:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611138,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:03:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:03:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901959 total) msec
Mar 27 2023 12:03:13 GMT: INFO (info): (hist.c:331) (00: 0002900436) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:03:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:03:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117412 total) msec
Mar 27 2023 12:03:13 GMT: INFO (info): (hist.c:331) (00: 0001684469) (01: 0000406123) (02: 0000024121) (03: 0000002458)
Mar 27 2023 12:03:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:03:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:03:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189907868384 free-wblocks 988322 write-q 0 write (431851,0.3) defrag-q 0 defrag-read (395948,0.2) defrag-write (125118,0.1)
Mar 27 2023 12:03:20 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (41649032,97293) total-ms 20360
Mar 27 2023 12:03:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:03:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:03:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 67 user-cpu-pct 64 kernel-cpu-pct 3 free-mem-kbytes 10646524 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:03:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 71 threads (9,64,39,30) heap-kbytes (12812576,12841580,14250496) heap-efficiency-pct 99.8
Mar 27 2023 12:03:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:03:23 GMT: INFO (info): (ticker.c:319) fds: proto (64,128938,128874) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:03:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6954357
Mar 27 2023 12:03:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (50483,6058368) ctrl (4,9) meta (0,0) rw (4238,4044)
Mar 27 2023 12:03:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51463411 master 15794264 prole 34479048 non-replica 1190099
Mar 27 2023 12:03:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,216,0) active (0,1,0) complete-pct 89.89
Mar 27 2023 12:03:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11505897276 index-bytes 3293658304 set-index-bytes 0 sindex-bytes 8212238972 used-pct 66.97
Mar 27 2023 12:03:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189830723488 avail-pct 48 cache-read-pct 36.36
Mar 27 2023 12:03:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670208,0,0,231753,0) write (2117417,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:03:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:03:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611156,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:03:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:03:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2901961 total) msec
Mar 27 2023 12:03:23 GMT: INFO (info): (hist.c:331) (00: 0002900438) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:03:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:03:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117418 total) msec
Mar 27 2023 12:03:23 GMT: INFO (info): (hist.c:331) (00: 0001684475) (01: 0000406123) (02: 0000024121) (03: 0000002458)
Mar 27 2023 12:03:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:03:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:03:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:03:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:03:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 4 user-cpu-pct 2 kernel-cpu-pct 2 free-mem-kbytes 10646220 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:03:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 5 threads (9,64,39,30) heap-kbytes (12812343,12841432,14250496) heap-efficiency-pct 99.8
Mar 27 2023 12:03:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:03:33 GMT: INFO (info): (ticker.c:319) fds: proto (64,128938,128874) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:03:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6954622
Mar 27 2023 12:03:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (24474,2895680) ctrl (6,13) meta (0,0) rw (48369,99071)
Mar 27 2023 12:03:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51463600 master 15794270 prole 34479231 non-replica 1190099
Mar 27 2023 12:03:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,215,0) active (0,0,0) complete-pct 89.94
Mar 27 2023 12:03:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11505923732 index-bytes 3293670400 set-index-bytes 0 sindex-bytes 8212253332 used-pct 66.97
Mar 27 2023 12:03:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189830926704 avail-pct 48 cache-read-pct 64.85
Mar 27 2023 12:03:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670249,0,0,231754,0) write (2117448,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:03:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:03:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611196,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:03:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:03:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902003 total) msec
Mar 27 2023 12:03:33 GMT: INFO (info): (hist.c:331) (00: 0002900480) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:03:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:03:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117449 total) msec
Mar 27 2023 12:03:33 GMT: INFO (info): (hist.c:331) (00: 0001684498) (01: 0000406131) (02: 0000024121) (03: 0000002458)
Mar 27 2023 12:03:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:03:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:03:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189831054144 free-wblocks 988624 write-q 0 write (431862,0.6) defrag-q 0 defrag-read (396260,15.6) defrag-write (125122,0.2)
Mar 27 2023 12:03:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:03:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:03:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 4 user-cpu-pct 1 kernel-cpu-pct 3 free-mem-kbytes 10647216 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:03:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 8 threads (9,64,39,30) heap-kbytes (12812463,12841476,14250496) heap-efficiency-pct 99.8
Mar 27 2023 12:03:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:03:43 GMT: INFO (info): (ticker.c:319) fds: proto (64,128939,128875) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:03:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6954890
Mar 27 2023 12:03:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (44953,5414828) ctrl (2,7) meta (0,0) rw (4927,2701)
Mar 27 2023 12:03:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51463826 master 15794274 prole 34479453 non-replica 1190099
Mar 27 2023 12:03:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,215,0) active (0,1,0) complete-pct 89.94
Mar 27 2023 12:03:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11505953892 index-bytes 3293684864 set-index-bytes 0 sindex-bytes 8212269028 used-pct 66.97
Mar 27 2023 12:03:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189831205744 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:03:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670249,0,0,231754,0) write (2117452,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:03:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:03:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611207,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:03:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:03:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902003 total) msec
Mar 27 2023 12:03:43 GMT: INFO (info): (hist.c:331) (00: 0002900480) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:03:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:03:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117453 total) msec
Mar 27 2023 12:03:43 GMT: INFO (info): (hist.c:331) (00: 0001684502) (01: 0000406131) (02: 0000024121) (03: 0000002458)
Mar 27 2023 12:03:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:03:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:03:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:03:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:03:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 4 user-cpu-pct 1 kernel-cpu-pct 3 free-mem-kbytes 10646828 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:03:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 9 threads (9,64,39,30) heap-kbytes (12812444,12841512,14250496) heap-efficiency-pct 99.8
Mar 27 2023 12:03:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:03:53 GMT: INFO (info): (ticker.c:319) fds: proto (63,128939,128876) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:03:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6955155
Mar 27 2023 12:03:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (53096,6440877) ctrl (6,14) meta (0,0) rw (3741,2658)
Mar 27 2023 12:03:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51464119 master 15794278 prole 34479742 non-replica 1190099
Mar 27 2023 12:03:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,214,0) active (0,1,0) complete-pct 89.99
Mar 27 2023 12:03:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11505986852 index-bytes 3293703616 set-index-bytes 0 sindex-bytes 8212283236 used-pct 66.97
Mar 27 2023 12:03:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189831498144 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:03:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670249,0,0,231754,0) write (2117456,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:03:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:03:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611220,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:03:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:03:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902003 total) msec
Mar 27 2023 12:03:53 GMT: INFO (info): (hist.c:331) (00: 0002900480) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:03:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:03:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117457 total) msec
Mar 27 2023 12:03:53 GMT: INFO (info): (hist.c:331) (00: 0001684506) (01: 0000406131) (02: 0000024121) (03: 0000002458)
Mar 27 2023 12:03:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:03:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:03:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189832025840 free-wblocks 988618 write-q 0 write (431879,0.9) defrag-q 0 defrag-read (396273,0.6) defrag-write (125127,0.2)
Mar 27 2023 12:04:00 GMT: INFO (info): (thr_info.c:3840) latencies command: unrecognized histogram: {Settlement}-query
Mar 27 2023 12:04:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:04:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:04:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 5 user-cpu-pct 2 kernel-cpu-pct 3 free-mem-kbytes 10646036 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:04:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 6 threads (9,64,39,30) heap-kbytes (12812579,12841472,14250496) heap-efficiency-pct 99.8
Mar 27 2023 12:04:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:04:03 GMT: INFO (info): (ticker.c:319) fds: proto (63,128940,128877) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:04:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6955422
Mar 27 2023 12:04:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (30922,3781070) ctrl (6,13) meta (0,0) rw (127953,164791)
Mar 27 2023 12:04:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51464300 master 15794286 prole 34479915 non-replica 1190099
Mar 27 2023 12:04:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,213,0) active (0,0,0) complete-pct 90.03
Mar 27 2023 12:04:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11506009696 index-bytes 3293715200 set-index-bytes 0 sindex-bytes 8212294496 used-pct 66.97
Mar 27 2023 12:04:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189832036064 avail-pct 48 cache-read-pct 66.37
Mar 27 2023 12:04:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670489,0,0,231762,0) write (2117572,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:04:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:04:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611263,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:04:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:04:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902251 total) msec
Mar 27 2023 12:04:03 GMT: INFO (info): (hist.c:331) (00: 0002900728) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:04:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:04:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117573 total) msec
Mar 27 2023 12:04:03 GMT: INFO (info): (hist.c:331) (00: 0001684598) (01: 0000406154) (02: 0000024122) (03: 0000002458)
Mar 27 2023 12:04:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:04:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:04:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:04:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:04:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 1 user-cpu-pct 1 kernel-cpu-pct 0 free-mem-kbytes 10647012 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:04:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 1 threads (9,64,39,30) heap-kbytes (12812644,12841472,14250496) heap-efficiency-pct 99.8
Mar 27 2023 12:04:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:04:13 GMT: INFO (info): (ticker.c:319) fds: proto (63,128941,128878) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:04:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6955690
Mar 27 2023 12:04:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (0,0) ctrl (2,5) meta (0,0) rw (2900,2699)
Mar 27 2023 12:04:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51464309 master 15794289 prole 34479921 non-replica 1170070
Mar 27 2023 12:04:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,213,0) active (0,0,0) complete-pct 90.03
Mar 27 2023 12:04:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11506012708 index-bytes 3293715776 set-index-bytes 0 sindex-bytes 8212296932 used-pct 66.97
Mar 27 2023 12:04:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189832076624 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:04:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670489,0,0,231762,0) write (2117575,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:04:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:04:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611278,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:04:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:04:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902251 total) msec
Mar 27 2023 12:04:13 GMT: INFO (info): (hist.c:331) (00: 0002900728) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:04:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:04:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117576 total) msec
Mar 27 2023 12:04:13 GMT: INFO (info): (hist.c:331) (00: 0001684601) (01: 0000406154) (02: 0000024122) (03: 0000002458)
Mar 27 2023 12:04:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:04:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:04:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189832089376 free-wblocks 988621 write-q 0 write (431879,0.0) defrag-q 0 defrag-read (396273,0.0) defrag-write (125127,0.0)
Mar 27 2023 12:04:21 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 12:04:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:04:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:04:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 30 user-cpu-pct 29 kernel-cpu-pct 1 free-mem-kbytes 10647100 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:04:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 32 threads (9,64,39,30) heap-kbytes (12811984,12840848,14250496) heap-efficiency-pct 99.8
Mar 27 2023 12:04:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:04:23 GMT: INFO (info): (ticker.c:319) fds: proto (42,128941,128899) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:04:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6955955
Mar 27 2023 12:04:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (22623,2731255) ctrl (14,38) meta (0,0) rw (1670,2235)
Mar 27 2023 12:04:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51464431 master 15794291 prole 34480041 non-replica 1150067
Mar 27 2023 12:04:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,213,0) active (0,3,0) complete-pct 90.03
Mar 27 2023 12:04:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11505406092 index-bytes 3293723584 set-index-bytes 0 sindex-bytes 8211682508 used-pct 66.97
Mar 27 2023 12:04:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189832191648 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:04:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670489,0,0,231762,0) write (2117577,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:04:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:04:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611288,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:04:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:04:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902251 total) msec
Mar 27 2023 12:04:23 GMT: INFO (info): (hist.c:331) (00: 0002900728) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:04:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:04:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117578 total) msec
Mar 27 2023 12:04:23 GMT: INFO (info): (hist.c:331) (00: 0001684603) (01: 0000406154) (02: 0000024122) (03: 0000002458)
Mar 27 2023 12:04:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:04:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:04:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:04:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:04:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 118 user-cpu-pct 107 kernel-cpu-pct 11 free-mem-kbytes 10647064 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:04:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 130 threads (9,64,39,30) heap-kbytes (12809874,12840836,14250496) heap-efficiency-pct 99.8
Mar 27 2023 12:04:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:04:33 GMT: INFO (info): (ticker.c:319) fds: proto (41,128941,128900) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:04:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6956222
Mar 27 2023 12:04:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (180671,21824814) ctrl (8,16) meta (0,0) rw (23771,14496)
Mar 27 2023 12:04:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51465444 master 15794296 prole 34481049 non-replica 1150067
Mar 27 2023 12:04:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,211,0) active (0,2,0) complete-pct 90.13
Mar 27 2023 12:04:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11503137428 index-bytes 3293788416 set-index-bytes 0 sindex-bytes 8209349012 used-pct 66.96
Mar 27 2023 12:04:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189833160608 avail-pct 48 cache-read-pct 71.43
Mar 27 2023 12:04:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670525,0,0,231765,0) write (2117601,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:04:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:04:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611313,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:04:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:04:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902290 total) msec
Mar 27 2023 12:04:33 GMT: INFO (info): (hist.c:331) (00: 0002900767) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:04:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:04:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117602 total) msec
Mar 27 2023 12:04:33 GMT: INFO (info): (hist.c:331) (00: 0001684622) (01: 0000406159) (02: 0000024122) (03: 0000002458)
Mar 27 2023 12:04:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:04:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:04:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189833372800 free-wblocks 988617 write-q 0 write (431884,0.2) defrag-q 0 defrag-read (396274,0.1) defrag-write (125128,0.1)
Mar 27 2023 12:04:42 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (41898426,249394) total-ms 20905
Mar 27 2023 12:04:43 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 12:04:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:04:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:04:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 97 user-cpu-pct 93 kernel-cpu-pct 4 free-mem-kbytes 10648080 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:04:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 102 threads (9,64,39,30) heap-kbytes (12806774,12836380,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:04:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:04:43 GMT: INFO (info): (ticker.c:319) fds: proto (41,128942,128901) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:04:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6956490
Mar 27 2023 12:04:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (68745,8545633) ctrl (11,24) meta (0,0) rw (24457,25688)
Mar 27 2023 12:04:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51445836 master 15794298 prole 34481472 non-replica 1150067
Mar 27 2023 12:04:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,209,0) active (0,2,0) complete-pct 90.22
Mar 27 2023 12:04:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11498718352 index-bytes 3292533504 set-index-bytes 0 sindex-bytes 8206184848 used-pct 66.93
Mar 27 2023 12:04:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189757272736 avail-pct 48 cache-read-pct 75.47
Mar 27 2023 12:04:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670556,0,0,231766,0) write (2117624,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:04:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:04:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611331,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:04:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:04:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902322 total) msec
Mar 27 2023 12:04:43 GMT: INFO (info): (hist.c:331) (00: 0002900799) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:04:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:04:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117625 total) msec
Mar 27 2023 12:04:43 GMT: INFO (info): (hist.c:331) (00: 0001684639) (01: 0000406164) (02: 0000024123) (03: 0000002458)
Mar 27 2023 12:04:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:04:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:04:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:04:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:04:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 119 user-cpu-pct 108 kernel-cpu-pct 11 free-mem-kbytes 10645888 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:04:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 135 threads (9,64,39,30) heap-kbytes (12806656,12833668,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:04:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:04:53 GMT: INFO (info): (ticker.c:319) fds: proto (41,128942,128901) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:04:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6956755
Mar 27 2023 12:04:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (217688,26880134) ctrl (9,22) meta (0,0) rw (7943,1777)
Mar 27 2023 12:04:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51447006 master 15794304 prole 34482636 non-replica 1150067
Mar 27 2023 12:04:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,208,0) active (0,3,0) complete-pct 90.27
Mar 27 2023 12:04:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11498654876 index-bytes 3292608384 set-index-bytes 0 sindex-bytes 8206046492 used-pct 66.93
Mar 27 2023 12:04:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189758346944 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:04:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670556,0,0,231766,0) write (2117630,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:04:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:04:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611344,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:04:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:04:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902322 total) msec
Mar 27 2023 12:04:53 GMT: INFO (info): (hist.c:331) (00: 0002900799) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:04:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:04:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117631 total) msec
Mar 27 2023 12:04:53 GMT: INFO (info): (hist.c:331) (00: 0001684645) (01: 0000406164) (02: 0000024123) (03: 0000002458)
Mar 27 2023 12:04:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:04:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:04:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189758549616 free-wblocks 988969 write-q 0 write (431893,0.4) defrag-q 0 defrag-read (396634,18.0) defrag-write (125129,0.1)
Mar 27 2023 12:05:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:05:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:05:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 107 user-cpu-pct 103 kernel-cpu-pct 4 free-mem-kbytes 10646900 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:05:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 113 threads (9,64,39,30) heap-kbytes (12806780,12833568,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:05:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:05:03 GMT: INFO (info): (ticker.c:319) fds: proto (33,128944,128911) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:05:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6957022
Mar 27 2023 12:05:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (69774,8404053) ctrl (8,13) meta (0,0) rw (16210,24029)
Mar 27 2023 12:05:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51447412 master 15794305 prole 34483041 non-replica 1150067
Mar 27 2023 12:05:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,205,0) active (0,1,0) complete-pct 90.41
Mar 27 2023 12:05:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11498703276 index-bytes 3292634368 set-index-bytes 0 sindex-bytes 8206068908 used-pct 66.93
Mar 27 2023 12:05:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189758728416 avail-pct 48 cache-read-pct 80.16
Mar 27 2023 12:05:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670606,0,0,231767,0) write (2117648,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:05:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:05:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611364,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:05:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:05:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902373 total) msec
Mar 27 2023 12:05:03 GMT: INFO (info): (hist.c:331) (00: 0002900850) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:05:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:05:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117649 total) msec
Mar 27 2023 12:05:03 GMT: INFO (info): (hist.c:331) (00: 0001684658) (01: 0000406169) (02: 0000024123) (03: 0000002458)
Mar 27 2023 12:05:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:05:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:05:04 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (41905364,6938) total-ms 21135
Mar 27 2023 12:05:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:05:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:05:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 5 user-cpu-pct 4 kernel-cpu-pct 1 free-mem-kbytes 10647580 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:05:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 6 threads (9,64,39,30) heap-kbytes (12806759,12833564,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:05:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:05:13 GMT: INFO (info): (ticker.c:319) fds: proto (33,128945,128912) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:05:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6957289
Mar 27 2023 12:05:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (21064,2504915) ctrl (4,7) meta (0,0) rw (6827,9184)
Mar 27 2023 12:05:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51427538 master 15794313 prole 34483158 non-replica 1150067
Mar 27 2023 12:05:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,204,0) active (0,0,0) complete-pct 90.45
Mar 27 2023 12:05:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11497437624 index-bytes 3291362432 set-index-bytes 0 sindex-bytes 8206075192 used-pct 66.92
Mar 27 2023 12:05:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189682219328 avail-pct 48 cache-read-pct 87.50
Mar 27 2023 12:05:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670612,0,0,231773,0) write (2117662,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:05:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:05:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611388,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:05:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:05:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902385 total) msec
Mar 27 2023 12:05:13 GMT: INFO (info): (hist.c:331) (00: 0002900862) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:05:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:05:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117663 total) msec
Mar 27 2023 12:05:13 GMT: INFO (info): (hist.c:331) (00: 0001684672) (01: 0000406169) (02: 0000024123) (03: 0000002458)
Mar 27 2023 12:05:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:05:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:05:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189682301168 free-wblocks 989298 write-q 0 write (431895,0.1) defrag-q 0 defrag-read (396965,16.5) defrag-write (125129,0.0)
Mar 27 2023 12:05:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:05:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:05:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 6 user-cpu-pct 2 kernel-cpu-pct 4 free-mem-kbytes 10647808 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:05:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 11 threads (9,64,39,30) heap-kbytes (12806706,12833500,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:05:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:05:23 GMT: INFO (info): (ticker.c:319) fds: proto (25,128945,128920) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:05:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6957554
Mar 27 2023 12:05:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (68017,8377353) ctrl (7,20) meta (0,0) rw (1034,2378)
Mar 27 2023 12:05:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51427904 master 15794314 prole 34483523 non-replica 1150067
Mar 27 2023 12:05:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,204,0) active (0,2,0) complete-pct 90.45
Mar 27 2023 12:05:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11497485900 index-bytes 3291385856 set-index-bytes 0 sindex-bytes 8206100044 used-pct 66.92
Mar 27 2023 12:05:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189682614096 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:05:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670612,0,0,231773,0) write (2117663,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:05:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:05:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611397,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:05:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:05:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902385 total) msec
Mar 27 2023 12:05:23 GMT: INFO (info): (hist.c:331) (00: 0002900862) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:05:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:05:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117664 total) msec
Mar 27 2023 12:05:23 GMT: INFO (info): (hist.c:331) (00: 0001684673) (01: 0000406169) (02: 0000024123) (03: 0000002458)
Mar 27 2023 12:05:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:05:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:05:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:05:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:05:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 12 user-cpu-pct 4 kernel-cpu-pct 8 free-mem-kbytes 10647916 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:05:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 23 threads (9,64,39,30) heap-kbytes (12806555,12833328,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:05:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:05:33 GMT: INFO (info): (ticker.c:319) fds: proto (25,128945,128920) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:05:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6957822
Mar 27 2023 12:05:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (150687,18389715) ctrl (11,24) meta (0,0) rw (22773,29661)
Mar 27 2023 12:05:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51428687 master 15794317 prole 34484303 non-replica 1150067
Mar 27 2023 12:05:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,202,0) active (0,2,0) complete-pct 90.55
Mar 27 2023 12:05:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11497583764 index-bytes 3291435968 set-index-bytes 0 sindex-bytes 8206147796 used-pct 66.92
Mar 27 2023 12:05:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189683321536 avail-pct 48 cache-read-pct 78.10
Mar 27 2023 12:05:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670633,0,0,231775,0) write (2117686,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:05:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:05:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611420,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:05:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:05:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902408 total) msec
Mar 27 2023 12:05:33 GMT: INFO (info): (hist.c:331) (00: 0002900885) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:05:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:05:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117687 total) msec
Mar 27 2023 12:05:33 GMT: INFO (info): (hist.c:331) (00: 0001684690) (01: 0000406175) (02: 0000024123) (03: 0000002458)
Mar 27 2023 12:05:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:05:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:05:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189683596144 free-wblocks 989293 write-q 0 write (431901,0.3) defrag-q 0 defrag-read (396966,0.1) defrag-write (125130,0.1)
Mar 27 2023 12:05:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:05:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:05:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 6 user-cpu-pct 2 kernel-cpu-pct 4 free-mem-kbytes 10647616 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:05:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 12 threads (9,64,39,30) heap-kbytes (12806680,12833424,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:05:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:05:43 GMT: INFO (info): (ticker.c:319) fds: proto (25,128946,128921) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:05:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6958089
Mar 27 2023 12:05:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (78529,9709238) ctrl (8,16) meta (0,0) rw (4283,1824)
Mar 27 2023 12:05:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51429137 master 15794320 prole 34484750 non-replica 1130051
Mar 27 2023 12:05:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,200,0) active (0,1,0) complete-pct 90.64
Mar 27 2023 12:05:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11497645776 index-bytes 3291464768 set-index-bytes 0 sindex-bytes 8206181008 used-pct 66.93
Mar 27 2023 12:05:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189683771040 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:05:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670633,0,0,231775,0) write (2117689,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:05:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:05:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611431,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:05:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:05:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902408 total) msec
Mar 27 2023 12:05:43 GMT: INFO (info): (hist.c:331) (00: 0002900885) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:05:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:05:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117690 total) msec
Mar 27 2023 12:05:43 GMT: INFO (info): (hist.c:331) (00: 0001684693) (01: 0000406175) (02: 0000024123) (03: 0000002458)
Mar 27 2023 12:05:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:05:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:05:45 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 12:05:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:05:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:05:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 91 user-cpu-pct 89 kernel-cpu-pct 2 free-mem-kbytes 10647816 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:05:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 92 threads (9,64,39,30) heap-kbytes (12805299,12831208,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:05:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:05:53 GMT: INFO (info): (ticker.c:319) fds: proto (25,128946,128921) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:05:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6958354
Mar 27 2023 12:05:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (25494,3064985) ctrl (4,7) meta (0,0) rw (7783,1278)
Mar 27 2023 12:05:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51429276 master 15794322 prole 34484887 non-replica 1130051
Mar 27 2023 12:05:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,199,0) active (0,0,0) complete-pct 90.69
Mar 27 2023 12:05:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11496331740 index-bytes 3291473664 set-index-bytes 0 sindex-bytes 8204858076 used-pct 66.92
Mar 27 2023 12:05:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189683939456 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:05:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670633,0,0,231775,0) write (2117691,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:05:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:05:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611444,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:05:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:05:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902408 total) msec
Mar 27 2023 12:05:53 GMT: INFO (info): (hist.c:331) (00: 0002900885) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:05:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:05:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117692 total) msec
Mar 27 2023 12:05:53 GMT: INFO (info): (hist.c:331) (00: 0001684694) (01: 0000406176) (02: 0000024123) (03: 0000002458)
Mar 27 2023 12:05:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:05:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:05:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189684012896 free-wblocks 989290 write-q 0 write (431905,0.2) defrag-q 0 defrag-read (396966,0.0) defrag-write (125130,0.0)
Mar 27 2023 12:06:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:06:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:06:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 111 user-cpu-pct 104 kernel-cpu-pct 7 free-mem-kbytes 10646500 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:06:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 117 threads (9,64,39,30) heap-kbytes (12802857,12830880,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:06:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:06:03 GMT: INFO (info): (ticker.c:319) fds: proto (26,128953,128927) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:06:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6958622
Mar 27 2023 12:06:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (102929,12511212) ctrl (14,40) meta (0,0) rw (22462,28526)
Mar 27 2023 12:06:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51429836 master 15794328 prole 34485441 non-replica 1110029
Mar 27 2023 12:06:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,199,0) active (0,4,0) complete-pct 90.69
Mar 27 2023 12:06:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11493894920 index-bytes 3291509504 set-index-bytes 0 sindex-bytes 8202385416 used-pct 66.90
Mar 27 2023 12:06:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189684505680 avail-pct 48 cache-read-pct 88.32
Mar 27 2023 12:06:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670688,0,0,231777,0) write (2117717,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:06:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:06:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611475,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:06:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:06:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902465 total) msec
Mar 27 2023 12:06:03 GMT: INFO (info): (hist.c:331) (00: 0002900942) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:06:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:06:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117718 total) msec
Mar 27 2023 12:06:03 GMT: INFO (info): (hist.c:331) (00: 0001684714) (01: 0000406182) (02: 0000024123) (03: 0000002458)
Mar 27 2023 12:06:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:06:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:06:05 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (42064665,159301) total-ms 20681
Mar 27 2023 12:06:06 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 12:06:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:06:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:06:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 106 user-cpu-pct 96 kernel-cpu-pct 10 free-mem-kbytes 10646560 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:06:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 117 threads (9,64,39,30) heap-kbytes (12801528,12827868,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:06:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:06:13 GMT: INFO (info): (ticker.c:319) fds: proto (26,128954,128928) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:06:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6958888
Mar 27 2023 12:06:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (166550,20476570) ctrl (10,15) meta (0,0) rw (2552,3195)
Mar 27 2023 12:06:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51410718 master 15794331 prole 34486336 non-replica 1110029
Mar 27 2023 12:06:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,195,0) active (0,1,0) complete-pct 90.88
Mar 27 2023 12:06:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11491385012 index-bytes 3290285952 set-index-bytes 0 sindex-bytes 8201099060 used-pct 66.89
Mar 27 2023 12:06:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189608862384 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:06:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670688,0,0,231777,0) write (2117720,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:06:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:06:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611488,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:06:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:06:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902465 total) msec
Mar 27 2023 12:06:13 GMT: INFO (info): (hist.c:331) (00: 0002900942) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:06:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:06:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117721 total) msec
Mar 27 2023 12:06:13 GMT: INFO (info): (hist.c:331) (00: 0001684717) (01: 0000406182) (02: 0000024123) (03: 0000002458)
Mar 27 2023 12:06:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:06:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:06:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189609024992 free-wblocks 989584 write-q 0 write (431911,0.3) defrag-q 0 defrag-read (397266,15.0) defrag-write (125130,0.0)
Mar 27 2023 12:06:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:06:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:06:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 106 user-cpu-pct 103 kernel-cpu-pct 3 free-mem-kbytes 10645460 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:06:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 110 threads (9,64,39,30) heap-kbytes (12800410,12824292,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:06:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:06:23 GMT: INFO (info): (ticker.c:319) fds: proto (26,128954,128928) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:06:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6959154
Mar 27 2023 12:06:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (53388,6513730) ctrl (6,13) meta (0,0) rw (5176,6204)
Mar 27 2023 12:06:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51410973 master 15794334 prole 34486588 non-replica 1110029
Mar 27 2023 12:06:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,194,0) active (0,0,0) complete-pct 90.92
Mar 27 2023 12:06:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11490199940 index-bytes 3290302272 set-index-bytes 0 sindex-bytes 8199897668 used-pct 66.88
Mar 27 2023 12:06:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189609158656 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:06:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670688,0,0,231777,0) write (2117723,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:06:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:06:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611508,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:06:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:06:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902465 total) msec
Mar 27 2023 12:06:23 GMT: INFO (info): (hist.c:331) (00: 0002900942) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:06:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:06:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117724 total) msec
Mar 27 2023 12:06:23 GMT: INFO (info): (hist.c:331) (00: 0001684720) (01: 0000406182) (02: 0000024123) (03: 0000002458)
Mar 27 2023 12:06:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:06:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:06:27 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (42161831,97166) total-ms 20639
Mar 27 2023 12:06:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:06:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:06:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 38 user-cpu-pct 37 kernel-cpu-pct 1 free-mem-kbytes 10645492 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:06:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 39 threads (9,64,39,30) heap-kbytes (12800403,12824160,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:06:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:06:33 GMT: INFO (info): (ticker.c:319) fds: proto (26,128954,128928) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:06:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6959422
Mar 27 2023 12:06:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (19058,2377137) ctrl (4,12) meta (0,0) rw (3703,3012)
Mar 27 2023 12:06:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51391065 master 15794338 prole 34486698 non-replica 1090023
Mar 27 2023 12:06:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,194,0) active (0,1,0) complete-pct 90.92
Mar 27 2023 12:06:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11488931932 index-bytes 3289028160 set-index-bytes 0 sindex-bytes 8199903772 used-pct 66.87
Mar 27 2023 12:06:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189533435840 avail-pct 48 cache-read-pct 50.00
Mar 27 2023 12:06:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670688,0,0,231777,0) write (2117727,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:06:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:06:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611528,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:06:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:06:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902465 total) msec
Mar 27 2023 12:06:33 GMT: INFO (info): (hist.c:331) (00: 0002900942) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:06:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:06:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117728 total) msec
Mar 27 2023 12:06:33 GMT: INFO (info): (hist.c:331) (00: 0001684724) (01: 0000406182) (02: 0000024123) (03: 0000002458)
Mar 27 2023 12:06:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:06:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:06:38 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 12:06:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189533642736 free-wblocks 989897 write-q 0 write (431914,0.2) defrag-q 0 defrag-read (397582,15.8) defrag-write (125131,0.1)
Mar 27 2023 12:06:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:06:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:06:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 58 user-cpu-pct 56 kernel-cpu-pct 2 free-mem-kbytes 10645840 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:06:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 63 threads (9,64,39,30) heap-kbytes (12799456,12823524,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:06:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:06:43 GMT: INFO (info): (ticker.c:319) fds: proto (26,128955,128929) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:06:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6959687
Mar 27 2023 12:06:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (45520,5374728) ctrl (4,7) meta (0,0) rw (3288,11745)
Mar 27 2023 12:06:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51391326 master 15794341 prole 34486956 non-replica 1090023
Mar 27 2023 12:06:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,193,0) active (0,0,0) complete-pct 90.97
Mar 27 2023 12:06:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11488088172 index-bytes 3289044864 set-index-bytes 0 sindex-bytes 8199043308 used-pct 66.87
Mar 27 2023 12:06:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189533741984 avail-pct 48 cache-read-pct 40.00
Mar 27 2023 12:06:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670688,0,0,231777,0) write (2117730,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:06:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:06:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611553,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:06:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:06:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902465 total) msec
Mar 27 2023 12:06:43 GMT: INFO (info): (hist.c:331) (00: 0002900942) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:06:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:06:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117731 total) msec
Mar 27 2023 12:06:43 GMT: INFO (info): (hist.c:331) (00: 0001684727) (01: 0000406182) (02: 0000024123) (03: 0000002458)
Mar 27 2023 12:06:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:06:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:06:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:06:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:06:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 106 user-cpu-pct 102 kernel-cpu-pct 4 free-mem-kbytes 10645428 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:06:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 111 threads (9,64,39,30) heap-kbytes (12798018,12823464,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:06:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:06:53 GMT: INFO (info): (ticker.c:319) fds: proto (27,128956,128929) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:06:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6959954
Mar 27 2023 12:06:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (58803,7044323) ctrl (4,12) meta (0,0) rw (2068,2542)
Mar 27 2023 12:06:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51391652 master 15794344 prole 34487279 non-replica 1090023
Mar 27 2023 12:06:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,193,0) active (0,1,0) complete-pct 90.97
Mar 27 2023 12:06:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11486711992 index-bytes 3289065728 set-index-bytes 0 sindex-bytes 8197646264 used-pct 66.86
Mar 27 2023 12:06:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189534040976 avail-pct 48 cache-read-pct 50.00
Mar 27 2023 12:06:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670689,0,0,231778,0) write (2117734,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:06:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:06:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611574,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:06:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:06:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902467 total) msec
Mar 27 2023 12:06:53 GMT: INFO (info): (hist.c:331) (00: 0002900944) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:06:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:06:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117735 total) msec
Mar 27 2023 12:06:53 GMT: INFO (info): (hist.c:331) (00: 0001684731) (01: 0000406182) (02: 0000024123) (03: 0000002458)
Mar 27 2023 12:06:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:06:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:06:58 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (42290224,128393) total-ms 20429
Mar 27 2023 12:06:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189455988544 free-wblocks 990202 write-q 0 write (431916,0.1) defrag-q 0 defrag-read (397890,15.4) defrag-write (125132,0.1)
Mar 27 2023 12:07:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:07:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:07:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 52 user-cpu-pct 51 kernel-cpu-pct 1 free-mem-kbytes 10645620 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:07:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 53 threads (9,64,39,30) heap-kbytes (12797071,12822136,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:07:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:07:03 GMT: INFO (info): (ticker.c:319) fds: proto (49,128989,128940) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:07:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6960221
Mar 27 2023 12:07:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (11265,1311051) ctrl (6,14) meta (0,0) rw (117360,195344)
Mar 27 2023 12:07:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51371710 master 15794352 prole 34487335 non-replica 1090023
Mar 27 2023 12:07:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,192,0) active (0,1,0) complete-pct 91.02
Mar 27 2023 12:07:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11484518956 index-bytes 3287789440 set-index-bytes 0 sindex-bytes 8196729516 used-pct 66.85
Mar 27 2023 12:07:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189456108784 avail-pct 48 cache-read-pct 62.43
Mar 27 2023 12:07:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670805,0,0,231780,0) write (2117804,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:07:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:07:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611598,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:07:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:07:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902585 total) msec
Mar 27 2023 12:07:03 GMT: INFO (info): (hist.c:331) (00: 0002901062) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:07:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:07:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117805 total) msec
Mar 27 2023 12:07:03 GMT: INFO (info): (hist.c:331) (00: 0001684781) (01: 0000406201) (02: 0000024124) (03: 0000002458)
Mar 27 2023 12:07:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:07:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:07:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:07:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:07:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 12 user-cpu-pct 3 kernel-cpu-pct 9 free-mem-kbytes 10645416 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:07:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 25 threads (9,64,39,30) heap-kbytes (12797129,12822164,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:07:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:07:13 GMT: INFO (info): (ticker.c:319) fds: proto (49,128990,128941) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:07:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6960487
Mar 27 2023 12:07:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (166256,20212822) ctrl (16,40) meta (0,0) rw (5261,3036)
Mar 27 2023 12:07:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51372625 master 15794357 prole 34488245 non-replica 1090023
Mar 27 2023 12:07:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,191,0) active (0,3,0) complete-pct 91.06
Mar 27 2023 12:07:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11484643324 index-bytes 3287848000 set-index-bytes 0 sindex-bytes 8196795324 used-pct 66.85
Mar 27 2023 12:07:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189456980640 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:07:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670805,0,0,231780,0) write (2117809,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:07:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:07:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611615,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:07:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:07:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902585 total) msec
Mar 27 2023 12:07:13 GMT: INFO (info): (hist.c:331) (00: 0002901062) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:07:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:07:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117810 total) msec
Mar 27 2023 12:07:13 GMT: INFO (info): (hist.c:331) (00: 0001684785) (01: 0000406202) (02: 0000024124) (03: 0000002458)
Mar 27 2023 12:07:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:07:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:07:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189457327168 free-wblocks 990197 write-q 0 write (431935,0.9) defrag-q 0 defrag-read (397902,0.6) defrag-write (125137,0.2)
Mar 27 2023 12:07:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:07:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:07:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 7 user-cpu-pct 2 kernel-cpu-pct 5 free-mem-kbytes 10645504 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:07:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 13 threads (9,64,39,30) heap-kbytes (12797267,12822312,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:07:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:07:23 GMT: INFO (info): (ticker.c:319) fds: proto (49,128990,128941) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:07:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6960754
Mar 27 2023 12:07:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (85206,10371781) ctrl (4,4) meta (0,0) rw (3397,2818)
Mar 27 2023 12:07:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51373083 master 15794361 prole 34488699 non-replica 1090023
Mar 27 2023 12:07:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,189,0) active (0,1,0) complete-pct 91.16
Mar 27 2023 12:07:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11484703308 index-bytes 3287877312 set-index-bytes 0 sindex-bytes 8196825996 used-pct 66.85
Mar 27 2023 12:07:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189457471664 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:07:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670805,0,0,231780,0) write (2117813,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:07:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:07:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611634,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:07:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:07:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902585 total) msec
Mar 27 2023 12:07:23 GMT: INFO (info): (hist.c:331) (00: 0002901062) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:07:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:07:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117814 total) msec
Mar 27 2023 12:07:23 GMT: INFO (info): (hist.c:331) (00: 0001684789) (01: 0000406202) (02: 0000024124) (03: 0000002458)
Mar 27 2023 12:07:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:07:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:07:29 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 12:07:33 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:07:33 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:07:33 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 45 user-cpu-pct 42 kernel-cpu-pct 3 free-mem-kbytes 10645636 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:07:33 GMT: INFO (info): (ticker.c:286) process: cpu-pct 51 threads (9,64,39,30) heap-kbytes (12797296,12822280,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:07:33 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:07:33 GMT: INFO (info): (ticker.c:319) fds: proto (49,128990,128941) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:07:33 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6961021
Mar 27 2023 12:07:33 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (59721,7311100) ctrl (6,14) meta (0,0) rw (6528,2394)
Mar 27 2023 12:07:33 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51373417 master 15794363 prole 34489031 non-replica 1090020
Mar 27 2023 12:07:33 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,188,0) active (0,1,0) complete-pct 91.20
Mar 27 2023 12:07:33 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11484742996 index-bytes 3287898688 set-index-bytes 0 sindex-bytes 8196844308 used-pct 66.85
Mar 27 2023 12:07:33 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189457793104 avail-pct 48 cache-read-pct 75.00
Mar 27 2023 12:07:33 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670809,0,0,231781,0) write (2117818,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:07:33 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:07:33 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611650,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:07:33 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:07:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902590 total) msec
Mar 27 2023 12:07:33 GMT: INFO (info): (hist.c:331) (00: 0002901067) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:07:33 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:07:33 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117819 total) msec
Mar 27 2023 12:07:33 GMT: INFO (info): (hist.c:331) (00: 0001684792) (01: 0000406204) (02: 0000024124) (03: 0000002458)
Mar 27 2023 12:07:33 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:07:33 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:07:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189457855024 free-wblocks 990195 write-q 0 write (431938,0.2) defrag-q 0 defrag-read (397902,0.0) defrag-write (125137,0.0)
Mar 27 2023 12:07:43 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:07:43 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:07:43 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 102 user-cpu-pct 101 kernel-cpu-pct 1 free-mem-kbytes 10645036 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:07:43 GMT: INFO (info): (ticker.c:286) process: cpu-pct 102 threads (9,64,39,30) heap-kbytes (12797259,12822340,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:07:43 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:07:43 GMT: INFO (info): (ticker.c:319) fds: proto (49,128991,128942) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:07:43 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6961286
Mar 27 2023 12:07:43 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (6308,756275) ctrl (6,13) meta (0,0) rw (3608,2679)
Mar 27 2023 12:07:43 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51373475 master 15794367 prole 34489085 non-replica 1090020
Mar 27 2023 12:07:43 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,187,0) active (0,0,0) complete-pct 91.25
Mar 27 2023 12:07:43 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11484749760 index-bytes 3287902400 set-index-bytes 0 sindex-bytes 8196847360 used-pct 66.85
Mar 27 2023 12:07:43 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189457880720 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:07:43 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670809,0,0,231781,0) write (2117822,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:07:43 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:07:43 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611663,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:07:43 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:07:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902590 total) msec
Mar 27 2023 12:07:43 GMT: INFO (info): (hist.c:331) (00: 0002901067) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:07:43 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:07:43 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117823 total) msec
Mar 27 2023 12:07:43 GMT: INFO (info): (hist.c:331) (00: 0001684796) (01: 0000406204) (02: 0000024124) (03: 0000002458)
Mar 27 2023 12:07:43 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:07:43 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:07:50 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (42290257,33) total-ms 20142
Mar 27 2023 12:07:51 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 12:07:53 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:07:53 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:07:53 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 93 user-cpu-pct 91 kernel-cpu-pct 2 free-mem-kbytes 10645220 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:07:53 GMT: INFO (info): (ticker.c:286) process: cpu-pct 95 threads (9,64,39,30) heap-kbytes (12797248,12822348,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:07:53 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:07:53 GMT: INFO (info): (ticker.c:319) fds: proto (48,128991,128943) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:07:53 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6961554
Mar 27 2023 12:07:53 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (28957,3608281) ctrl (8,23) meta (0,0) rw (48,3430)
Mar 27 2023 12:07:53 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51373658 master 15794367 prole 34489271 non-replica 1090019
Mar 27 2023 12:07:53 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,187,0) active (0,1,0) complete-pct 91.25
Mar 27 2023 12:07:53 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11484771064 index-bytes 3287914112 set-index-bytes 0 sindex-bytes 8196856952 used-pct 66.85
Mar 27 2023 12:07:53 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189458053328 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:07:53 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670809,0,0,231781,0) write (2117822,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:07:53 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:07:53 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611672,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:07:53 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:07:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902590 total) msec
Mar 27 2023 12:07:53 GMT: INFO (info): (hist.c:331) (00: 0002901067) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:07:53 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:07:53 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117823 total) msec
Mar 27 2023 12:07:53 GMT: INFO (info): (hist.c:331) (00: 0001684796) (01: 0000406204) (02: 0000024124) (03: 0000002458)
Mar 27 2023 12:07:53 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:07:53 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:07:59 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189458392336 free-wblocks 990192 write-q 0 write (431946,0.4) defrag-q 0 defrag-read (397908,0.3) defrag-write (125139,0.1)
Mar 27 2023 12:08:03 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:08:03 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:08:03 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 115 user-cpu-pct 106 kernel-cpu-pct 9 free-mem-kbytes 10645008 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:08:03 GMT: INFO (info): (ticker.c:286) process: cpu-pct 126 threads (9,64,39,30) heap-kbytes (12797186,12822184,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:08:03 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:08:03 GMT: INFO (info): (ticker.c:319) fds: proto (27,129002,128975) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:08:03 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6961821
Mar 27 2023 12:08:03 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (154364,18785590) ctrl (12,29) meta (0,0) rw (63121,71359)
Mar 27 2023 12:08:03 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51374477 master 15794374 prole 34490083 non-replica 1090019
Mar 27 2023 12:08:03 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,186,0) active (0,3,0) complete-pct 91.30
Mar 27 2023 12:08:03 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11484873004 index-bytes 3287966528 set-index-bytes 0 sindex-bytes 8196906476 used-pct 66.85
Mar 27 2023 12:08:03 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189458820208 avail-pct 48 cache-read-pct 79.67
Mar 27 2023 12:08:03 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670890,0,0,231786,0) write (2117892,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:08:03 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:08:03 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611714,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:08:03 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:08:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902676 total) msec
Mar 27 2023 12:08:03 GMT: INFO (info): (hist.c:331) (00: 0002901153) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:08:03 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:08:03 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117893 total) msec
Mar 27 2023 12:08:03 GMT: INFO (info): (hist.c:331) (00: 0001684855) (01: 0000406215) (02: 0000024124) (03: 0000002458)
Mar 27 2023 12:08:03 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:08:03 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:08:12 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (42290262,5) total-ms 21103
Mar 27 2023 12:08:13 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:08:13 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:08:13 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 94 user-cpu-pct 87 kernel-cpu-pct 7 free-mem-kbytes 10645300 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:08:13 GMT: INFO (info): (ticker.c:286) process: cpu-pct 103 threads (9,64,39,30) heap-kbytes (12797219,12822224,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:08:13 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:08:13 GMT: INFO (info): (ticker.c:319) fds: proto (26,129003,128977) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:08:13 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6962086
Mar 27 2023 12:08:13 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (124282,15101620) ctrl (13,26) meta (0,0) rw (4451,2768)
Mar 27 2023 12:08:13 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51375167 master 15794378 prole 34490770 non-replica 1090019
Mar 27 2023 12:08:13 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,183,0) active (0,2,0) complete-pct 91.44
Mar 27 2023 12:08:13 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11484970224 index-bytes 3288010688 set-index-bytes 0 sindex-bytes 8196959536 used-pct 66.85
Mar 27 2023 12:08:13 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189459435904 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:08:13 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670890,0,0,231786,0) write (2117896,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:08:13 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:08:13 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611727,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:08:13 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:08:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902676 total) msec
Mar 27 2023 12:08:13 GMT: INFO (info): (hist.c:331) (00: 0002901153) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:08:13 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:08:13 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117897 total) msec
Mar 27 2023 12:08:13 GMT: INFO (info): (hist.c:331) (00: 0001684859) (01: 0000406215) (02: 0000024124) (03: 0000002458)
Mar 27 2023 12:08:13 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:08:13 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:08:19 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189459797648 free-wblocks 990189 write-q 0 write (431951,0.2) defrag-q 0 defrag-read (397908,0.0) defrag-write (125139,0.0)
Mar 27 2023 12:08:23 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 12:08:23 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:08:23 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:08:23 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 17 user-cpu-pct 11 kernel-cpu-pct 6 free-mem-kbytes 10644408 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:08:23 GMT: INFO (info): (ticker.c:286) process: cpu-pct 26 threads (9,64,39,30) heap-kbytes (12797355,12822304,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:08:23 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:08:23 GMT: INFO (info): (ticker.c:319) fds: proto (26,129003,128977) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:08:23 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6962354
Mar 27 2023 12:08:23 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (115456,14334952) ctrl (8,16) meta (0,0) rw (4579,2564)
Mar 27 2023 12:08:23 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51375782 master 15794382 prole 34491381 non-replica 1090018
Mar 27 2023 12:08:23 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,181,0) active (0,1,0) complete-pct 91.53
Mar 27 2023 12:08:23 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11485051848 index-bytes 3288050048 set-index-bytes 0 sindex-bytes 8197001800 used-pct 66.85
Mar 27 2023 12:08:23 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189460031216 avail-pct 48 cache-read-pct 0.00
Mar 27 2023 12:08:23 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670890,0,0,231786,0) write (2117900,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:08:23 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:08:23 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611740,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:08:23 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:08:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902676 total) msec
Mar 27 2023 12:08:23 GMT: INFO (info): (hist.c:331) (00: 0002901153) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:08:23 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:08:23 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117901 total) msec
Mar 27 2023 12:08:23 GMT: INFO (info): (hist.c:331) (00: 0001684863) (01: 0000406215) (02: 0000024124) (03: 0000002458)
Mar 27 2023 12:08:23 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:08:23 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:08:34 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:08:34 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:08:34 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 108 user-cpu-pct 103 kernel-cpu-pct 5 free-mem-kbytes 10644816 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:08:34 GMT: INFO (info): (ticker.c:286) process: cpu-pct 111 threads (9,64,39,30) heap-kbytes (12797138,12820620,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:08:34 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:08:34 GMT: INFO (info): (ticker.c:319) fds: proto (26,129003,128977) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:08:34 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6962621
Mar 27 2023 12:08:34 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (60022,7314822) ctrl (6,14) meta (0,0) rw (1755,5477)
Mar 27 2023 12:08:34 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51376114 master 15794384 prole 34491711 non-replica 1069948
Mar 27 2023 12:08:34 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,180,0) active (0,1,0) complete-pct 91.58
Mar 27 2023 12:08:34 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11484817948 index-bytes 3288071296 set-index-bytes 0 sindex-bytes 8196746652 used-pct 66.85
Mar 27 2023 12:08:34 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189460422416 avail-pct 48 cache-read-pct 50.00
Mar 27 2023 12:08:34 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670890,0,0,231786,0) write (2117902,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:08:34 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:08:34 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611755,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:08:34 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:08:34 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902676 total) msec
Mar 27 2023 12:08:34 GMT: INFO (info): (hist.c:331) (00: 0002901153) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:08:34 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:08:34 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117903 total) msec
Mar 27 2023 12:08:34 GMT: INFO (info): (hist.c:331) (00: 0001684865) (01: 0000406215) (02: 0000024124) (03: 0000002458)
Mar 27 2023 12:08:34 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:08:34 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:08:39 GMT: INFO (drv_ssd): (drv_ssd.c:1893) {Settlement} /dev/sdb: used-bytes 189460601648 free-wblocks 990185 write-q 0 write (431956,0.2) defrag-q 0 defrag-read (397909,0.1) defrag-write (125140,0.1)
Mar 27 2023 12:08:43 GMT: INFO (sindex): (gc.c:228) {Settlement} sindex-gc-done: cleaned (42360551,70289) total-ms 20085
Mar 27 2023 12:08:44 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:08:44 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:08:44 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 97 user-cpu-pct 95 kernel-cpu-pct 2 free-mem-kbytes 10644600 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:08:44 GMT: INFO (info): (ticker.c:286) process: cpu-pct 100 threads (9,64,39,30) heap-kbytes (12795473,12820536,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:08:44 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:08:44 GMT: INFO (info): (ticker.c:319) fds: proto (26,129004,128978) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:08:44 GMT: INFO (info): (ticker.c:328) heartbeat-received: self 2 foreign 6962886
Mar 27 2023 12:08:44 GMT: INFO (info): (ticker.c:354) fabric-bytes-per-second: bulk (40579,4992339) ctrl (6,14) meta (0,0) rw (4780,1192)
Mar 27 2023 12:08:44 GMT: INFO (info): (ticker.c:413) {Settlement} objects: all 51376339 master 15794389 prole 34491932 non-replica 1069948
Mar 27 2023 12:08:44 GMT: INFO (info): (ticker.c:470) {Settlement} migrations: remaining (0,179,0) active (0,1,0) complete-pct 91.62
Mar 27 2023 12:08:44 GMT: INFO (info): (ticker.c:498) {Settlement} memory-usage: total-bytes 11483250408 index-bytes 3288085696 set-index-bytes 0 sindex-bytes 8195164712 used-pct 66.84
Mar 27 2023 12:08:44 GMT: INFO (info): (ticker.c:567) {Settlement} device-usage: used-bytes 189460651696 avail-pct 48 cache-read-pct 25.00
Mar 27 2023 12:08:44 GMT: INFO (info): (ticker.c:616) {Settlement} client: tsvc (0,0) proxy (0,0,0) read (2670890,0,0,231786,0) write (2117907,1,0,0) delete (0,0,0,0,0) udf (0,0,0,0) lang (0,0,0,0)
Mar 27 2023 12:08:44 GMT: INFO (info): (ticker.c:844) {Settlement} pi-query: short-basic (0,0,0) long-basic (3,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:08:44 GMT: INFO (info): (ticker.c:880) {Settlement} si-query: short-basic (0,0,0) long-basic (1611768,0,0) aggr (0,0,0) udf-bg (0,0,0) ops-bg (0,0,0)
Mar 27 2023 12:08:44 GMT: INFO (info): (ticker.c:949) {Settlement} dup-res: ask 12555 respond (0,111651)
Mar 27 2023 12:08:44 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-read (2902676 total) msec
Mar 27 2023 12:08:44 GMT: INFO (info): (hist.c:331) (00: 0002901153) (01: 0000001258) (02: 0000000192) (03: 0000000067)
Mar 27 2023 12:08:44 GMT: INFO (info): (hist.c:340) (04: 0000000004) (07: 0000000002)
Mar 27 2023 12:08:44 GMT: INFO (info): (hist.c:320) histogram dump: {Settlement}-write (2117908 total) msec
Mar 27 2023 12:08:44 GMT: INFO (info): (hist.c:331) (00: 0001684870) (01: 0000406215) (02: 0000024124) (03: 0000002458)
Mar 27 2023 12:08:44 GMT: INFO (info): (hist.c:331) (04: 0000000169) (05: 0000000016) (06: 0000000012) (07: 0000000033)
Mar 27 2023 12:08:44 GMT: INFO (info): (hist.c:340) (08: 0000000011)
Mar 27 2023 12:08:44 GMT: INFO (sindex): (gc.c:203) {Settlement} sindex-gc-start
Mar 27 2023 12:08:54 GMT: INFO (info): (ticker.c:162) NODE-ID bb9c365eb0a0142 CLUSTER-SIZE 5
Mar 27 2023 12:08:54 GMT: INFO (info): (ticker.c:243) cluster-clock: skew-ms 0
Mar 27 2023 12:08:54 GMT: INFO (info): (ticker.c:264) system: total-cpu-pct 108 user-cpu-pct 102 kernel-cpu-pct 6 free-mem-kbytes 10647856 free-mem-pct 43 thp-mem-kbytes 2048
Mar 27 2023 12:08:54 GMT: INFO (info): (ticker.c:286) process: cpu-pct 115 threads (9,64,39,30) heap-kbytes (12793844,12817384,14242304) heap-efficiency-pct 99.8
Mar 27 2023 12:08:54 GMT: INFO (info): (ticker.c:296) in-progress: info-q 0 rw-hash 0 proxy-hash 0 tree-gc-q 0
Mar 27 2023 12:08:54 GMT: INFO (info): (ticker.c:319) fds: proto (26,129004,128978) heartbeat (4,11,7) fabric (96,120,24)
Mar 27 2023 12:08:54 GMT: INFO (info): (ti
Raw
aerospike-node-2.log
View raw

(Sorry about that, but we can’t show files that are this big right now.)

Raw
aerospike-node-4.log
View raw

(Sorry about that, but we can’t show files that are this big right now.)

Raw
aerospike-node-5.log
View raw

(Sorry about that, but we can’t show files that are this big right now.)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment