-
-
Save anonymous/2ef16a696527acd86795c3080edf3e91 to your computer and use it in GitHub Desktop.
This file has been truncated, but you can view the full file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Query (id=514ee9ab39cdc507:7b38551b00000000): | |
Summary: | |
Session ID: c44bdbae62c1e2cb:799ff15c4a08fb98 | |
Session Type: HIVESERVER2 | |
HiveServer2 Protocol Version: V6 | |
Start Time: 2017-05-15 11:32:21.898800000 | |
End Time: 2017-05-15 11:44:40.288157000 | |
Query Type: QUERY | |
Query State: FINISHED | |
Query Status: OK | |
Impala Version: impalad version 2.7.0-cdh5.10.1 RELEASE (build 876895d2a90346e69f2aea02d5528c2125ae7a32) | |
User: hdfs | |
Connected User: hdfs | |
Delegated User: | |
Network Address: ::ffff:172.16.0.220:57996 | |
Default Db: 24x7_prod | |
Sql Statement: SELECT `@associative_tag.Propensity`, | |
`@dataset_a.Device`, | |
`y`, | |
x_rank, | |
seg_rank | |
FROM | |
(SELECT `@associative_tag.Propensity`, | |
`@dataset_a.Device`, | |
`y`, | |
x_rank, | |
dense_rank() over( | |
ORDER BY `y__SUM` DESC, `@dataset_a.Device` ASC) seg_rank | |
FROM | |
(SELECT `@associative_tag.Propensity`, | |
`@dataset_a.Device`, | |
`y`, | |
x_rank, | |
sum(`y`) over(partition BY `@dataset_a.Device`) `y__SUM` | |
FROM | |
(SELECT `@associative_tag.Propensity`, | |
`@dataset_a.Device`, | |
`y`, | |
dense_rank() over( | |
ORDER BY `y__SUM` DESC, `@associative_tag.Propensity`) x_rank | |
FROM | |
(SELECT `@associative_tag.Propensity`, | |
`@dataset_a.Device`, | |
`y`, | |
sum(`y`) over(partition BY `@associative_tag.Propensity`) `y__SUM` | |
FROM | |
(SELECT `@dataset_a.Device`, | |
`@associative_tag.Propensity`, | |
count(DISTINCT if(1 = 1, `@dataset_a.header_associativetag__LEVEL`, NULL)) `y` | |
FROM | |
(SELECT `@dataset_a.header_associativetag`, | |
min(if(1 = 1, `@dataset_a.header_associativetag`, NULL)) `@dataset_a.header_associativetag__LEVEL` | |
FROM | |
(SELECT `header_associativetag` `@dataset_a.header_associativetag` | |
FROM dataset_a_batch | |
WHERE `cuberon_event_date` BETWEEN "2017-04-23" AND "2017-05-07") Q1 | |
GROUP BY `@dataset_a.header_associativetag`) Q2 | |
JOIN | |
(SELECT `@dataset_a.header_associativetag` __JOIN_KEY0__, | |
`@dataset_a.Device`, | |
`__LEVEL_EXISTS__` | |
FROM | |
(SELECT `@dataset_a.header_associativetag`, | |
`@dataset_a.Device`, | |
`__LEVEL_EXISTS__` | |
FROM | |
(SELECT `@dataset_a.header_associativetag`, | |
`@dataset_a.Device`, | |
sum(if(1 = 1, 1, 0)) > 0 `__LEVEL_EXISTS__` | |
FROM | |
(SELECT `header_associativetag` `@dataset_a.header_associativetag`, | |
`body_customproperties_devicedetails_value` `@dataset_a.Device` | |
FROM dataset_a_batch | |
WHERE `cuberon_event_date` BETWEEN "2017-04-23" AND "2017-05-07") Q1 | |
GROUP BY `@dataset_a.header_associativetag`, | |
`@dataset_a.Device`) Q2) __JOIN_QUERY__) __subquery0__ ON Q2.`@dataset_a.header_associativetag` = __subquery0__.__JOIN_KEY0__ | |
LEFT OUTER JOIN | |
(SELECT `@dataset_a.header_associativetag` __JOIN_KEY0__, | |
`@associative_tag.Propensity` | |
FROM | |
(SELECT `@dataset_a.header_associativetag`, | |
`@associative_tag.Propensity` | |
FROM | |
(SELECT `@dataset_a.header_associativetag`, | |
min(if(1 = 1, `@dataset_a.Propensity`, NULL)) `@associative_tag.Propensity` | |
FROM | |
(SELECT `header_associativetag` `@dataset_a.header_associativetag`, | |
`body_customproperties_eventdata_value_f_c_ops` `@dataset_a.Propensity`, | |
`cuberon_event_epoch_target` `@Event.Event Time` | |
FROM dataset_a_batch | |
WHERE `cuberon_event_date` BETWEEN "2017-04-23" AND "2017-05-07") Q1 | |
JOIN | |
(SELECT `@dataset_a.header_associativetag` __JOIN_KEY0__, | |
`@associative_tag.Propensity__JOINER` | |
FROM | |
(SELECT `@dataset_a.header_associativetag`, | |
`@associative_tag.Propensity__JOINER` | |
FROM | |
(SELECT `@dataset_a.header_associativetag`, | |
max(if(1 = 1, `@Event.Event Time`, NULL)) `@associative_tag.Propensity__JOINER` | |
FROM | |
(SELECT `header_associativetag` `@dataset_a.header_associativetag`, | |
`body_customproperties_eventdata_value_f_c_ops` `@dataset_a.Propensity`, | |
`cuberon_event_epoch_target` `@Event.Event Time` | |
FROM dataset_a_batch | |
WHERE `cuberon_event_date` BETWEEN "2017-04-23" AND "2017-05-07") Q1 | |
WHERE `@dataset_a.Propensity` IS NOT NULL | |
GROUP BY `@dataset_a.header_associativetag`) Q2) __JOIN_QUERY__) __subquery0__ ON Q1.`@dataset_a.header_associativetag` = __subquery0__.__JOIN_KEY0__ | |
AND Q1.`@Event.Event Time` = __subquery0__.`@associative_tag.Propensity__JOINER` | |
GROUP BY `@dataset_a.header_associativetag`) Q2) __JOIN_QUERY__) __subquery1__ ON Q2.`@dataset_a.header_associativetag` = __subquery1__.__JOIN_KEY0__ | |
WHERE (`@associative_tag.Propensity` = 'Business-Medium' | |
AND `@associative_tag.Propensity` IS NOT NULL) | |
GROUP BY `@dataset_a.Device`, | |
`@associative_tag.Propensity`) XR1) XR2 ) SR1 | |
WHERE x_rank <= 10) SR2 ) SR3 | |
WHERE seg_rank <= 20 | |
ORDER BY seg_rank, | |
x_rank | |
Coordinator: cdh1.net.cuberonlabs.com:22000 | |
Query Options (non default): QUERY_TIMEOUT_S=600,MT_DOP=0 | |
Plan: | |
---------------- | |
Estimated Per-Host Requirements: Memory=21.30GB VCores=3 | |
PLAN-ROOT SINK | |
| | |
23:SORT | |
| order by: seg_rank ASC, x_rank ASC | |
| hosts=17 per-host-mem=unavailable | |
| tuple-ids=35 row-size=76B cardinality=23 | |
| | |
22:SELECT | |
| predicates: dense_rank() <= 20 | |
| hosts=17 per-host-mem=unavailable | |
| tuple-ids=48,47 row-size=92B cardinality=23 | |
| | |
21:ANALYTIC | |
| functions: dense_rank() | |
| order by: sum(y) DESC, `@dataset_a.Device` ASC | |
| window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | |
| hosts=17 per-host-mem=unavailable | |
| tuple-ids=48,47 row-size=92B cardinality=227 | |
| | |
40:MERGING-EXCHANGE [UNPARTITIONED] | |
| order by: sum(y) DESC, `@dataset_a.Device` ASC | |
| hosts=17 per-host-mem=unavailable | |
| tuple-ids=48 row-size=84B cardinality=227 | |
| | |
20:SORT | |
| order by: sum(y) DESC, `@dataset_a.Device` ASC | |
| hosts=17 per-host-mem=16.00MB | |
| tuple-ids=48 row-size=84B cardinality=227 | |
| | |
19:ANALYTIC | |
| functions: sum(count(if(TRUE, `@dataset_a.header_associativetag__LEVEL`, NULL))) | |
| partition by: `@dataset_a.Device` | |
| hosts=17 per-host-mem=0B | |
| tuple-ids=44,43 row-size=84B cardinality=227 | |
| | |
18:SORT | |
| order by: `@dataset_a.Device` ASC NULLS FIRST | |
| hosts=17 per-host-mem=16.00MB | |
| tuple-ids=44 row-size=76B cardinality=227 | |
| | |
39:EXCHANGE [HASH(`@dataset_a.Device`)] | |
| hosts=17 per-host-mem=0B | |
| tuple-ids=41,40 row-size=76B cardinality=227 | |
| | |
17:SELECT | |
| predicates: dense_rank() <= 10 | |
| hosts=17 per-host-mem=unavailable | |
| tuple-ids=41,40 row-size=76B cardinality=227 | |
| | |
16:ANALYTIC | |
| functions: dense_rank() | |
| order by: sum(y) DESC, `@associative_tag.Propensity` ASC | |
| window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | |
| hosts=17 per-host-mem=unavailable | |
| tuple-ids=41,40 row-size=76B cardinality=2266 | |
| | |
38:MERGING-EXCHANGE [UNPARTITIONED] | |
| order by: sum(y) DESC, `@associative_tag.Propensity` ASC | |
| hosts=17 per-host-mem=unavailable | |
| tuple-ids=41 row-size=68B cardinality=2266 | |
| | |
15:SORT | |
| order by: sum(y) DESC, `@associative_tag.Propensity` ASC | |
| hosts=17 per-host-mem=16.00MB | |
| tuple-ids=41 row-size=68B cardinality=2266 | |
| | |
14:ANALYTIC | |
| functions: sum(count(if(TRUE, `@dataset_a.header_associativetag__LEVEL`, NULL))) | |
| partition by: `@associative_tag.Propensity` | |
| hosts=17 per-host-mem=0B | |
| tuple-ids=37,36 row-size=68B cardinality=2266 | |
| | |
13:SORT | |
| order by: `@associative_tag.Propensity` ASC NULLS FIRST | |
| hosts=17 per-host-mem=16.00MB | |
| tuple-ids=37 row-size=60B cardinality=2266 | |
| | |
37:EXCHANGE [HASH(`@associative_tag.Propensity`)] | |
| hosts=17 per-host-mem=0B | |
| tuple-ids=23 row-size=60B cardinality=2266 | |
| | |
12:AGGREGATE [FINALIZE] | |
| output: count(if(TRUE, `@dataset_a.header_associativetag__LEVEL`, NULL)) | |
| group by: `@dataset_a.Device`, `@associative_tag.Propensity` | |
| hosts=17 per-host-mem=10.00MB | |
| tuple-ids=23 row-size=60B cardinality=2266 | |
| | |
36:AGGREGATE | |
| group by: `@dataset_a.Device`, `@associative_tag.Propensity`, if(TRUE, `@dataset_a.header_associativetag__LEVEL`, NULL) | |
| hosts=17 per-host-mem=2.89GB | |
| tuple-ids=22 row-size=68B cardinality=41522992 | |
| | |
35:EXCHANGE [HASH(`@dataset_a.Device`,`@associative_tag.Propensity`)] | |
| hosts=17 per-host-mem=0B | |
| tuple-ids=22 row-size=68B cardinality=41522992 | |
| | |
11:AGGREGATE [STREAMING] | |
| group by: `@dataset_a.Device`, min(if(TRUE, `@dataset_a.Propensity`, NULL)), if(TRUE, min(if(TRUE, `@dataset_a.header_associativetag`, NULL)), NULL) | |
| hosts=17 per-host-mem=2.89GB | |
| tuple-ids=22 row-size=68B cardinality=41522992 | |
| | |
10:HASH JOIN [LEFT OUTER JOIN, PARTITIONED] | |
| hash predicates: `@dataset_a.header_associativetag` = `@dataset_a.header_associativetag` | |
| other predicates: min(if(TRUE, `@dataset_a.Propensity`, NULL)) IS NOT NULL, min(if(TRUE, `@dataset_a.Propensity`, NULL)) = 'Business-Medium' | |
| hosts=17 per-host-mem=3.12MB | |
| tuple-ids=6,2,18N row-size=251B cardinality=41522992 | |
| | |
|--34:AGGREGATE [FINALIZE] | |
| | output: min:merge(if(TRUE, `@dataset_a.Propensity`, NULL)) | |
| | group by: `@dataset_a.header_associativetag` | |
| | having: min(if(TRUE, `@dataset_a.Propensity`, NULL)) IS NOT NULL, min(if(TRUE, `@dataset_a.Propensity`, NULL)) = 'Business-Medium' | |
| | hosts=17 per-host-mem=52.96MB | |
| | tuple-ids=18 row-size=77B cardinality=655319 | |
| | | |
| 33:EXCHANGE [HASH(`@dataset_a.header_associativetag`)] | |
| | hosts=17 per-host-mem=0B | |
| | tuple-ids=18 row-size=77B cardinality=17897362 | |
| | | |
| 08:AGGREGATE [STREAMING] | |
| | output: min(if(TRUE, body_customproperties_eventdata_value_f_c_ops, NULL)) | |
| | group by: header_associativetag | |
| | hosts=17 per-host-mem=216.74MB | |
| | tuple-ids=18 row-size=77B cardinality=17897362 | |
| | | |
| 07:HASH JOIN [INNER JOIN, PARTITIONED] | |
| | hash predicates: cuberon_event_epoch_target = max(if(TRUE, `@Event.Event Time`, NULL)), header_associativetag = `@dataset_a.header_associativetag` | |
| | runtime filters: RF001 <- max(if(TRUE, `@Event.Event Time`, NULL)), RF002 <- `@dataset_a.header_associativetag` | |
| | hosts=17 per-host-mem=83.72MB | |
| | tuple-ids=10,14 row-size=167B cardinality=17897362 | |
| | | |
| |--32:EXCHANGE [HASH(max(if(TRUE, `@Event.Event Time`, NULL)),`@dataset_a.header_associativetag`)] | |
| | | hosts=17 per-host-mem=0B | |
| | | tuple-ids=14 row-size=69B cardinality=19650614 | |
| | | | |
| | 30:AGGREGATE [FINALIZE] | |
| | | output: max:merge(if(TRUE, `@Event.Event Time`, NULL)) | |
| | | group by: `@dataset_a.header_associativetag` | |
| | | hosts=17 per-host-mem=194.24MB | |
| | | tuple-ids=14 row-size=69B cardinality=19650614 | |
| | | | |
| | 29:EXCHANGE [HASH(`@dataset_a.header_associativetag`)] | |
| | | hosts=17 per-host-mem=0B | |
| | | tuple-ids=14 row-size=69B cardinality=19650614 | |
| | | | |
| | 06:AGGREGATE [STREAMING] | |
| | | output: max(if(TRUE, cuberon_event_epoch_target, NULL)) | |
| | | group by: header_associativetag | |
| | | hosts=17 per-host-mem=1.39GB | |
| | | tuple-ids=14 row-size=69B cardinality=19650614 | |
| | | | |
| | 05:SCAN HDFS [24x7_prod.dataset_a_batch, RANDOM] | |
| | partitions=7/8 files=503 size=46.87GB | |
| | predicates: 24x7_prod.dataset_a_batch.body_customproperties_eventdata_value_f_c_ops IS NOT NULL | |
| | table stats: 215756183 rows total | |
| | column stats: all | |
| | hosts=17 per-host-mem=264.00MB | |
| | tuple-ids=12 row-size=98B cardinality=19650614 | |
| | | |
| 31:EXCHANGE [HASH(cuberon_event_epoch_target,header_associativetag)] | |
| | hosts=17 per-host-mem=0B | |
| | tuple-ids=10 row-size=98B cardinality=196506140 | |
| | | |
| 04:SCAN HDFS [24x7_prod.dataset_a_batch, RANDOM] | |
| partitions=7/8 files=503 size=46.87GB | |
| runtime filters: RF001 -> cuberon_event_epoch_target, RF002 -> header_associativetag | |
| table stats: 215756183 rows total | |
| column stats: all | |
| hosts=17 per-host-mem=264.00MB | |
| tuple-ids=10 row-size=98B cardinality=196506140 | |
| | |
09:HASH JOIN [INNER JOIN, PARTITIONED] | |
| hash predicates: `@dataset_a.header_associativetag` = `@dataset_a.header_associativetag` | |
| runtime filters: RF000 <- `@dataset_a.header_associativetag` | |
| hosts=17 per-host-mem=216.74MB | |
| tuple-ids=6,2 row-size=174B cardinality=41522992 | |
| | |
|--27:AGGREGATE [FINALIZE] | |
| | output: min:merge(if(TRUE, `@dataset_a.header_associativetag`, NULL)) | |
| | group by: `@dataset_a.header_associativetag` | |
| | hosts=17 per-host-mem=216.74MB | |
| | tuple-ids=2 row-size=77B cardinality=45590648 | |
| | | |
| 26:EXCHANGE [HASH(`@dataset_a.header_associativetag`)] | |
| | hosts=17 per-host-mem=0B | |
| | tuple-ids=2 row-size=77B cardinality=45590648 | |
| | | |
| 01:AGGREGATE [STREAMING] | |
| | output: min(if(TRUE, header_associativetag, NULL)) | |
| | group by: header_associativetag | |
| | hosts=17 per-host-mem=3.60GB | |
| | tuple-ids=2 row-size=77B cardinality=45590648 | |
| | | |
| 00:SCAN HDFS [24x7_prod.dataset_a_batch, RANDOM] | |
| partitions=7/8 files=503 size=46.87GB | |
| table stats: 215756183 rows total | |
| column stats: all | |
| hosts=17 per-host-mem=88.00MB | |
| tuple-ids=0 row-size=61B cardinality=196506140 | |
| | |
28:EXCHANGE [HASH(`@dataset_a.header_associativetag`)] | |
| hosts=17 per-host-mem=0B | |
| tuple-ids=6 row-size=97B cardinality=196506140 | |
| | |
25:AGGREGATE [FINALIZE] | |
| group by: `@dataset_a.header_associativetag`, `@dataset_a.Device` | |
| hosts=17 per-host-mem=1.60GB | |
| tuple-ids=6 row-size=97B cardinality=196506140 | |
| | |
24:EXCHANGE [HASH(`@dataset_a.header_associativetag`,`@dataset_a.Device`)] | |
| hosts=17 per-host-mem=0B | |
| tuple-ids=6 row-size=97B cardinality=196506140 | |
| | |
03:AGGREGATE [STREAMING] | |
| group by: header_associativetag, body_customproperties_devicedetails_value | |
| hosts=17 per-host-mem=19.53GB | |
| tuple-ids=6 row-size=97B cardinality=196506140 | |
| | |
02:SCAN HDFS [24x7_prod.dataset_a_batch, RANDOM] | |
partitions=7/8 files=503 size=46.87GB | |
runtime filters: RF000 -> 24x7_prod.dataset_a_batch.header_associativetag | |
table stats: 215756183 rows total | |
column stats: all | |
hosts=17 per-host-mem=176.00MB | |
tuple-ids=4 row-size=97B cardinality=196506140 | |
---------------- | |
Estimated Per-Host Mem: 22872427775 | |
Estimated Per-Host VCores: 3 | |
Request Pool: root.hdfs | |
Admission result: Admitted immediately | |
ExecSummary: | |
Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail | |
---------------------------------------------------------------------------------------------------------------------------------- | |
23:SORT 1 273.728us 273.728us 20 23 24.03 MB -1.00 B | |
22:SELECT 1 77.148us 77.148us 20 23 24.00 KB -1.00 B | |
21:ANALYTIC 1 344.908us 344.908us 52 227 8.03 MB -1.00 B | |
40:MERGING-EXCHANGE 1 443.832us 443.832us 52 227 0 -1.00 B UNPARTITIONED | |
20:SORT 1 396.724us 396.724us 52 227 24.03 MB 16.00 MB | |
19:ANALYTIC 1 179.456us 179.456us 52 227 8.03 MB 0 | |
18:SORT 1 678.452us 678.452us 52 227 24.03 MB 16.00 MB | |
39:EXCHANGE 1 11.348us 11.348us 52 227 0 0 HASH(`@dataset_a.Device`) | |
17:SELECT 1 44.280us 44.280us 52 227 24.00 KB -1.00 B | |
16:ANALYTIC 1 170.736us 170.736us 52 2.27K 8.03 MB -1.00 B | |
38:MERGING-EXCHANGE 1 41.420us 41.420us 52 2.27K 0 -1.00 B UNPARTITIONED | |
15:SORT 17 101.031us 287.881us 52 2.27K 24.03 MB 16.00 MB | |
14:ANALYTIC 17 192.790us 529.572us 52 2.27K 8.03 MB 0 | |
13:SORT 17 221.655us 559.936us 52 2.27K 24.08 MB 16.00 MB | |
37:EXCHANGE 17 12.627us 135.244us 52 2.27K 0 0 HASH(`@associative_tag.Prop... | |
12:AGGREGATE 17 1.898ms 4.211ms 52 2.27K 2.56 MB 10.00 MB FINALIZE | |
36:AGGREGATE 17 3.646ms 14.411ms 35.85K 41.52M 11.19 MB 2.89 GB | |
35:EXCHANGE 17 210.341us 1.386ms 35.85K 41.52M 0 0 HASH(`@dataset_a.Device`,`@... | |
11:AGGREGATE 17 71.502ms 80.600ms 35.85K 41.52M 9.44 MB 2.89 GB STREAMING | |
10:HASH JOIN 17 342.957ms 377.603ms 35.85K 41.52M 1.28 MB 3.12 MB LEFT OUTER JOIN, PARTITIONED | |
|--34:AGGREGATE 17 23.275ms 27.444ms 17.92K 655.32K 20.08 MB 52.96 MB FINALIZE | |
| 33:EXCHANGE 17 2.052ms 5.782ms 518.12K 17.90M 0 0 HASH(`@dataset_a.header_ass... | |
| 08:AGGREGATE 17 94.774ms 120.072ms 518.12K 17.90M 13.04 MB 216.74 MB STREAMING | |
| 07:HASH JOIN 17 215.970ms 258.952ms 1.36M 17.90M 10.18 MB 83.72 MB INNER JOIN, PARTITIONED | |
| |--32:EXCHANGE 17 1.122ms 1.351ms 518.12K 19.65M 0 0 HASH(max(if(TRUE, `@Event.E... | |
| | 30:AGGREGATE 17 24.420ms 29.346ms 518.12K 19.65M 11.13 MB 194.24 MB FINALIZE | |
| | 29:EXCHANGE 17 3.543ms 4.587ms 1.99M 19.65M 0 0 HASH(`@dataset_a.header_ass... | |
| | 06:AGGREGATE 17 223.177ms 314.593ms 1.99M 19.65M 21.14 MB 1.39 GB STREAMING | |
| | 05:SCAN HDFS 17 159.508ms 237.531ms 3.63M 19.65M 77.55 MB 264.00 MB 24x7_prod.dataset_a_batch | |
| 31:EXCHANGE 17 130.445ms 188.042ms 37.77M 196.51M 0 0 HASH(cuberon_event_epoch_ta... | |
| 04:SCAN HDFS 17 980.913ms 1s024ms 37.77M 196.51M 98.90 MB 264.00 MB 24x7_prod.dataset_a_batch | |
09:HASH JOIN 17 1s671ms 2s004ms 43.32M 41.52M 457.17 MB 216.74 MB INNER JOIN, PARTITIONED | |
|--27:AGGREGATE 17 2s587ms 2s868ms 41.76M 45.59M 530.16 MB 216.74 MB FINALIZE | |
| 26:EXCHANGE 17 198.242ms 222.558ms 73.99M 45.59M 0 0 HASH(`@dataset_a.header_ass... | |
| 01:AGGREGATE 17 5s439ms 7s140ms 73.99M 45.59M 1.07 GB 3.60 GB STREAMING | |
| 00:SCAN HDFS 17 80.893ms 146.873ms 196.51M 196.51M 27.62 MB 88.00 MB 24x7_prod.dataset_a_batch | |
28:EXCHANGE 17 152.883ms 206.050ms 43.32M 196.51M 0 0 HASH(`@dataset_a.header_ass... | |
25:AGGREGATE 17 1s544ms 1s796ms 43.32M 196.51M 330.17 MB 1.60 GB FINALIZE | |
24:EXCHANGE 17 202.057ms 234.085ms 76.67M 196.51M 0 0 HASH(`@dataset_a.header_ass... | |
03:AGGREGATE 17 2s677ms 3s556ms 76.67M 196.51M 652.25 MB 19.53 GB STREAMING | |
02:SCAN HDFS 17 905.576ms 943.004ms 196.51M 196.51M 40.59 MB 176.00 MB 24x7_prod.dataset_a_batch | |
Planner Timeline: 55.086ms | |
- Analysis finished: 7.378ms (7.378ms) | |
- Equivalence classes computed: 8.023ms (644.847us) | |
- Single node plan created: 24.813ms (16.790ms) | |
- Runtime filters computed: 25.174ms (360.534us) | |
- Distributed plan created: 26.995ms (1.821ms) | |
- Lineage info computed: 28.087ms (1.091ms) | |
- Planning finished: 55.086ms (26.999ms) | |
Query Timeline: 12m18s | |
- Query submitted: 57.136us (57.136us) | |
- Planning finished: 114.390ms (114.332ms) | |
- Submit for admission: 124.498ms (10.108ms) | |
- Completed admission: 124.554ms (56.176us) | |
- Ready to start 173 fragment instances: 126.245ms (1.690ms) | |
- All 173 fragment instances started: 185.952ms (59.707ms) | |
- First dynamic filter received: 933.984ms (748.032ms) | |
- Rows available: 14s019ms (13s085ms) | |
- First row fetched: 14s899ms (879.593ms) | |
- Unregister query: 12m18s (12m3s) | |
- ComputeScanRangeAssignmentTimer: 5.390ms | |
ImpalaServer: | |
- ClientFetchWaitTimer: 12m4s | |
- RowMaterializationTimer: 20.465ms | |
Execution Profile 514ee9ab39cdc507:7b38551b00000000:(Total: 13s912ms, non-child: 0.000ns, % non-child: 0.00%) | |
Number of filters: 3 | |
Filter routing table: | |
ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled | |
---------------------------------------------------------------------------------------------------------------------------- | |
2 7 4 17 REMOTE false 17 (17) N/A N/A true | |
1 7 4 17 REMOTE false 17 (17) N/A N/A true | |
0 9 2 17 REMOTE false 17 (17) N/A N/A true | |
Fragment instance start latencies: Count: 173, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 4ms, 90th %-ile: 5ms, 95th %-ile: 6ms, 99.9th %-ile: 10ms | |
Per Node Peak Memory Usage: cdh8.net.cuberonlabs.com:22000(1.63 GB) cdh7.net.cuberonlabs.com:22000(1.58 GB) cdh5.net.cuberonlabs.com:22000(2.15 GB) cdh12.net.cuberonlabs.com:22000(1.12 GB) cdh2.net.cuberonlabs.com:22000(1.74 GB) cdh10.net.cuberonlabs.com:22000(1.66 GB) cdh17.net.cuberonlabs.com:22000(1.75 GB) cdh3.net.cuberonlabs.com:22000(2.16 GB) cdh15.net.cuberonlabs.com:22000(1.57 GB) cdh14.net.cuberonlabs.com:22000(1.44 GB) cdh9.net.cuberonlabs.com:22000(1.69 GB) cdh6.net.cuberonlabs.com:22000(1.67 GB) cdh11.net.cuberonlabs.com:22000(1.48 GB) cdh13.net.cuberonlabs.com:22000(1.66 GB) cdh16.net.cuberonlabs.com:22000(1.64 GB) cdh4.net.cuberonlabs.com:22000(2.13 GB) cdh1.net.cuberonlabs.com:22000(1.81 GB) | |
Final filter table: | |
ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled | |
---------------------------------------------------------------------------------------------------------------------------- | |
2 7 4 17 REMOTE false 0 (17) 948.745ms 1s286ms false | |
1 7 4 17 REMOTE false 0 (17) 933.986ms 1s291ms false | |
0 9 2 17 REMOTE false 0 (17) 11s613ms 12s251ms false | |
- FiltersReceived: 51 (51) | |
- FinalizationTimer: 0.000ns | |
Coordinator Fragment F13: | |
Instance 514ee9ab39cdc507:7b38551b00000000 (host=cdh1.net.cuberonlabs.com:22000):(Total: 14s771ms, non-child: 883.087ms, % non-child: 5.98%) | |
MemoryUsage(500.000ms): 24.56 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB | |
- AverageThreadTokens: 0.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 32.08 MB (33634378) | |
- PerHostPeakMemUsage: 1.81 GB (1939587581) | |
- RowsProduced: 20 (20) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 0.000ns | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 1 (1) | |
- TotalThreadsTotalWallClockTime: 14s727ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 104.000ms | |
- TotalThreadsVoluntaryContextSwitches: 29 (29) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 879.799ms | |
- ExecTreeExecTime: 10.040us | |
- OpenTime: 13s848ms | |
- ExecTreeOpenTime: 13s743ms | |
- PrepareTime: 43.208ms | |
- ExecTreePrepareTime: 341.064us | |
BlockMgr: | |
- BlockWritesOutstanding: 0 (0) | |
- BlocksCreated: 408 (408) | |
- BlocksRecycled: 301 (301) | |
- BufferedPins: 0 (0) | |
- BytesWritten: 0 | |
- MaxBlockSize: 8.00 MB (8388608) | |
- MemoryLimit: 48.00 GB (51539607552) | |
- PeakMemoryUsage: 1.34 GB (1443135488) | |
- ScratchFileUsedBytes: 0 | |
- TotalBufferWaitTime: 0.000ns | |
- TotalEncryptionTime: 0.000ns | |
- TotalReadBlockTime: 0.000ns | |
PLAN_ROOT_SINK: | |
- PeakMemoryUsage: 0 | |
CodeGen:(Total: 143.939ms, non-child: 143.939ms, % non-child: 100.00%) | |
- CodegenTime: 1.365ms | |
- CompileTime: 16.076ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 62 (62) | |
- NumInstructions: 1.13K (1129) | |
- OptimizationTime: 86.696ms | |
- PeakMemoryUsage: 564.50 KB (578048) | |
- PrepareTime: 40.096ms | |
SORT_NODE (id=23):(Total: 13s744ms, non-child: 273.728us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 12.720us | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.03 MB (25194496) | |
- RowsReturned: 20 (20) | |
- RowsReturnedRate: 1.00 /sec | |
- SortDataSize: 1.78 KB (1824) | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
SELECT_NODE (id=22):(Total: 13s743ms, non-child: 77.148us, % non-child: 0.00%) | |
- PeakMemoryUsage: 24.00 KB (24576) | |
- RowsReturned: 20 (20) | |
- RowsReturnedRate: 1.00 /sec | |
ANALYTIC_EVAL_NODE (id=21):(Total: 13s743ms, non-child: 344.908us, % non-child: 0.00%) | |
- EvaluationTime: 83.272us | |
- GetNewBlockTime: 1.612us | |
- PeakMemoryUsage: 8.03 MB (8422421) | |
- PinTime: 0.000ns | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=40):(Total: 13s743ms, non-child: 443.832us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 1.88 KB (1920) | |
- ConvertRowBatchTime: 0.000ns | |
- DeserializeRowBatchTimer: 23.304us | |
- FirstBatchArrivalWaitTime: 13s743ms | |
- MergeGetNext: 428.888us | |
- MergeGetNextBatch: 421.580us | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Averaged Fragment F12:(Total: 13s890ms, non-child: 4.292ms, % non-child: 0.03%) | |
split sizes: min: 0, max: 0, avg: 0, stddev: 0 | |
completion times: min:13s891ms max:13s891ms mean: 13s891ms stddev:0.000ns | |
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec | |
num instances: 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 56.06 MB (58784661) | |
- PerHostPeakMemUsage: 1.81 GB (1939587581) | |
- RowsProduced: 52 (52) | |
- TotalNetworkReceiveTime: 13s760ms | |
- TotalNetworkSendTime: 193.768us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 1 (1) | |
- TotalThreadsTotalWallClockTime: 13s854ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 92.000ms | |
- TotalThreadsVoluntaryContextSwitches: 35 (35) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 393.468us | |
- ExecTreeExecTime: 5.612us | |
- OpenTime: 13s854ms | |
- ExecTreeOpenTime: 13s761ms | |
- PrepareTime: 35.893ms | |
- ExecTreePrepareTime: 501.208us | |
DataStreamSender (dst_id=40):(Total: 117.204us, non-child: 117.204us, % non-child: 100.00%) | |
- BytesSent: 1.88 KB (1920) | |
- NetworkThroughput(*): 44.29 MB/sec | |
- OverallThroughput: 15.62 MB/sec | |
- PeakMemoryUsage: 1.97 KB (2016) | |
- RowsReturned: 52 (52) | |
- SerializeBatchTime: 42.220us | |
- TransmitDataRPCTime: 41.340us | |
- UncompressedRowBatchSize: 5.23 KB (5353) | |
CodeGen:(Total: 124.678ms, non-child: 124.678ms, % non-child: 100.00%) | |
- CodegenTime: 858.552us | |
- CompileTime: 14.428ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 75.882ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 33.847ms | |
SORT_NODE (id=20):(Total: 13s761ms, non-child: 396.724us, % non-child: 0.00%) | |
- InMemorySortTime: 30.228us | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.03 MB (25194496) | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
- SortDataSize: 5.02 KB (5141) | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=19):(Total: 13s761ms, non-child: 179.456us, % non-child: 0.00%) | |
- EvaluationTime: 43.688us | |
- GetNewBlockTime: 2.436us | |
- PeakMemoryUsage: 8.03 MB (8417280) | |
- PinTime: 0.000ns | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=18):(Total: 13s760ms, non-child: 678.452us, % non-child: 0.00%) | |
- InMemorySortTime: 30.656us | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.03 MB (25194718) | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
- SortDataSize: 4.61 KB (4725) | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=39):(Total: 13s760ms, non-child: 13s760ms, % non-child: 100.00%) | |
- BytesReceived: 2.00 KB (2046) | |
- ConvertRowBatchTime: 2.744us | |
- DeserializeRowBatchTimer: 21.812us | |
- FirstBatchArrivalWaitTime: 13s760ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Fragment F12: | |
Instance 514ee9ab39cdc507:ac (host=cdh1.net.cuberonlabs.com:22000):(Total: 13s890ms, non-child: 4.292ms, % non-child: 0.03%) | |
MemoryUsage(500.000ms): 48.45 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 56.06 MB (58784661) | |
- PerHostPeakMemUsage: 1.81 GB (1939587581) | |
- RowsProduced: 52 (52) | |
- TotalNetworkReceiveTime: 13s760ms | |
- TotalNetworkSendTime: 193.768us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 1 (1) | |
- TotalThreadsTotalWallClockTime: 13s854ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 92.000ms | |
- TotalThreadsVoluntaryContextSwitches: 35 (35) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 393.468us | |
- ExecTreeExecTime: 5.612us | |
- OpenTime: 13s854ms | |
- ExecTreeOpenTime: 13s761ms | |
- PrepareTime: 35.893ms | |
- ExecTreePrepareTime: 501.208us | |
DataStreamSender (dst_id=40):(Total: 117.204us, non-child: 117.204us, % non-child: 100.00%) | |
- BytesSent: 1.88 KB (1920) | |
- NetworkThroughput(*): 44.29 MB/sec | |
- OverallThroughput: 15.62 MB/sec | |
- PeakMemoryUsage: 1.97 KB (2016) | |
- RowsReturned: 52 (52) | |
- SerializeBatchTime: 42.220us | |
- TransmitDataRPCTime: 41.340us | |
- UncompressedRowBatchSize: 5.23 KB (5353) | |
CodeGen:(Total: 124.678ms, non-child: 124.678ms, % non-child: 100.00%) | |
- CodegenTime: 858.552us | |
- CompileTime: 14.428ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 75.882ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 33.847ms | |
SORT_NODE (id=20):(Total: 13s761ms, non-child: 396.724us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 30.228us | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.03 MB (25194496) | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
- SortDataSize: 5.02 KB (5141) | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=19):(Total: 13s761ms, non-child: 179.456us, % non-child: 0.00%) | |
- EvaluationTime: 43.688us | |
- GetNewBlockTime: 2.436us | |
- PeakMemoryUsage: 8.03 MB (8417280) | |
- PinTime: 0.000ns | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=18):(Total: 13s760ms, non-child: 678.452us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 30.656us | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.03 MB (25194718) | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
- SortDataSize: 4.61 KB (4725) | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=39):(Total: 13s760ms, non-child: 11.348us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 2.00 KB (2046) | |
- ConvertRowBatchTime: 2.744us | |
- DeserializeRowBatchTimer: 21.812us | |
- FirstBatchArrivalWaitTime: 13s760ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Averaged Fragment F11:(Total: 13s889ms, non-child: 2.336ms, % non-child: 0.02%) | |
split sizes: min: 0, max: 0, avg: 0, stddev: 0 | |
completion times: min:13s890ms max:13s890ms mean: 13s890ms stddev:0.000ns | |
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec | |
num instances: 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 8.07 MB (8463866) | |
- PerHostPeakMemUsage: 1.81 GB (1939587581) | |
- RowsProduced: 52 (52) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 173.280us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 4 (4) | |
- TotalThreadsTotalWallClockTime: 13s864ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 92.000ms | |
- TotalThreadsVoluntaryContextSwitches: 33 (33) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 377.648us | |
- ExecTreeExecTime: 51.992us | |
- OpenTime: 13s863ms | |
- ExecTreeOpenTime: 13s773ms | |
- PrepareTime: 25.368ms | |
- ExecTreePrepareTime: 101.656us | |
DataStreamSender (dst_id=39):(Total: 115.820us, non-child: 115.820us, % non-child: 100.00%) | |
- BytesSent: 2.00 KB (2046) | |
- NetworkThroughput(*): 54.93 MB/sec | |
- OverallThroughput: 16.85 MB/sec | |
- PeakMemoryUsage: 4.41 KB (4512) | |
- RowsReturned: 52 (52) | |
- SerializeBatchTime: 47.444us | |
- TransmitDataRPCTime: 35.520us | |
- UncompressedRowBatchSize: 4.63 KB (4742) | |
CodeGen:(Total: 113.753ms, non-child: 113.753ms, % non-child: 100.00%) | |
- CodegenTime: 718.952us | |
- CompileTime: 15.517ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 59 (59) | |
- NumInstructions: 1.03K (1032) | |
- OptimizationTime: 74.029ms | |
- PeakMemoryUsage: 516.00 KB (528384) | |
- PrepareTime: 23.655ms | |
SELECT_NODE (id=17):(Total: 13s773ms, non-child: 44.280us, % non-child: 0.00%) | |
- PeakMemoryUsage: 24.00 KB (24576) | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
ANALYTIC_EVAL_NODE (id=16):(Total: 13s773ms, non-child: 170.736us, % non-child: 0.00%) | |
- EvaluationTime: 29.696us | |
- GetNewBlockTime: 3.000us | |
- PeakMemoryUsage: 8.03 MB (8421589) | |
- PinTime: 0.000ns | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=38):(Total: 13s773ms, non-child: 13s773ms, % non-child: 100.00%) | |
- BytesReceived: 1.80 KB (1839) | |
- ConvertRowBatchTime: 0.000ns | |
- DeserializeRowBatchTimer: 22.136us | |
- FirstBatchArrivalWaitTime: 13s773ms | |
- MergeGetNext: 6.024us | |
- MergeGetNextBatch: 1.304us | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Fragment F11: | |
Instance 514ee9ab39cdc507:ab (host=cdh1.net.cuberonlabs.com:22000):(Total: 13s889ms, non-child: 2.336ms, % non-child: 0.02%) | |
MemoryUsage(500.000ms): 24.41 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 8.07 MB (8463866) | |
- PerHostPeakMemUsage: 1.81 GB (1939587581) | |
- RowsProduced: 52 (52) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 173.280us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 4 (4) | |
- TotalThreadsTotalWallClockTime: 13s864ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 92.000ms | |
- TotalThreadsVoluntaryContextSwitches: 33 (33) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 377.648us | |
- ExecTreeExecTime: 51.992us | |
- OpenTime: 13s863ms | |
- ExecTreeOpenTime: 13s773ms | |
- PrepareTime: 25.368ms | |
- ExecTreePrepareTime: 101.656us | |
DataStreamSender (dst_id=39):(Total: 115.820us, non-child: 115.820us, % non-child: 100.00%) | |
- BytesSent: 2.00 KB (2046) | |
- NetworkThroughput(*): 54.93 MB/sec | |
- OverallThroughput: 16.85 MB/sec | |
- PeakMemoryUsage: 4.41 KB (4512) | |
- RowsReturned: 52 (52) | |
- SerializeBatchTime: 47.444us | |
- TransmitDataRPCTime: 35.520us | |
- UncompressedRowBatchSize: 4.63 KB (4742) | |
CodeGen:(Total: 113.753ms, non-child: 113.753ms, % non-child: 100.00%) | |
- CodegenTime: 718.952us | |
- CompileTime: 15.517ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 59 (59) | |
- NumInstructions: 1.03K (1032) | |
- OptimizationTime: 74.029ms | |
- PeakMemoryUsage: 516.00 KB (528384) | |
- PrepareTime: 23.655ms | |
SELECT_NODE (id=17):(Total: 13s773ms, non-child: 44.280us, % non-child: 0.00%) | |
- PeakMemoryUsage: 24.00 KB (24576) | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
ANALYTIC_EVAL_NODE (id=16):(Total: 13s773ms, non-child: 170.736us, % non-child: 0.00%) | |
- EvaluationTime: 29.696us | |
- GetNewBlockTime: 3.000us | |
- PeakMemoryUsage: 8.03 MB (8421589) | |
- PinTime: 0.000ns | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=38):(Total: 13s773ms, non-child: 41.420us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 1.80 KB (1839) | |
- ConvertRowBatchTime: 0.000ns | |
- DeserializeRowBatchTimer: 22.136us | |
- FirstBatchArrivalWaitTime: 13s773ms | |
- MergeGetNext: 6.024us | |
- MergeGetNextBatch: 1.304us | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Averaged Fragment F10:(Total: 13s887ms, non-child: 2.167ms, % non-child: 0.02%) | |
split sizes: min: 0, max: 0, avg: 0, stddev: 0 | |
completion times: min:13s887ms max:13s888ms mean: 13s888ms stddev:393.332us | |
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec | |
num instances: 17 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 48.90 MB (51272600) | |
- PerHostPeakMemUsage: 1.70 GB (1824024877) | |
- RowsProduced: 3 (3) | |
- TotalNetworkReceiveTime: 13s754ms | |
- TotalNetworkSendTime: 19.125us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s852ms | |
- TotalThreadsSysTime: 705.882us | |
- TotalThreadsUserTime: 98.823ms | |
- TotalThreadsVoluntaryContextSwitches: 14 (14) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 221.229us | |
- ExecTreeExecTime: 3.224us | |
- OpenTime: 13s852ms | |
- ExecTreeOpenTime: 13s755ms | |
- PrepareTime: 34.406ms | |
- ExecTreePrepareTime: 162.475us | |
BlockMgr: | |
- BlockWritesOutstanding: 0 (0) | |
- BlocksCreated: 404 (404) | |
- BlocksRecycled: 297 (297) | |
- BufferedPins: 0 (0) | |
- BytesWritten: 0 | |
- MaxBlockSize: 8.00 MB (8388608) | |
- MemoryLimit: 48.00 GB (51539607552) | |
- PeakMemoryUsage: 1.25 GB (1346116160) | |
- ScratchFileUsedBytes: 0 | |
- TotalBufferWaitTime: 0.000ns | |
- TotalEncryptionTime: 0.000ns | |
- TotalReadBlockTime: 0.000ns | |
DataStreamSender (dst_id=38):(Total: 21.176us, non-child: 21.176us, % non-child: 100.00%) | |
- BytesSent: 108.00 B (108) | |
- NetworkThroughput(*): 2.25 MB/sec | |
- OverallThroughput: 1.07 MB/sec | |
- PeakMemoryUsage: 2.61 KB (2672) | |
- RowsReturned: 3 (3) | |
- SerializeBatchTime: 2.069us | |
- TransmitDataRPCTime: 2.698us | |
- UncompressedRowBatchSize: 265.00 B (265) | |
CodeGen:(Total: 129.471ms, non-child: 129.471ms, % non-child: 100.00%) | |
- CodegenTime: 1.222ms | |
- CompileTime: 15.791ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 80.046ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 32.833ms | |
SORT_NODE (id=15):(Total: 13s755ms, non-child: 101.031us, % non-child: 0.00%) | |
- InMemorySortTime: 1.352us | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.02 MB (25182930) | |
- RowsReturned: 3 (3) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 253.00 B (253) | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=14):(Total: 13s755ms, non-child: 192.790us, % non-child: 0.00%) | |
- EvaluationTime: 3.068us | |
- GetNewBlockTime: 3.910us | |
- PeakMemoryUsage: 8.02 MB (8413424) | |
- PinTime: 0.000ns | |
- RowsReturned: 3 (3) | |
- RowsReturnedRate: 0 | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=13):(Total: 13s755ms, non-child: 221.656us, % non-child: 0.00%) | |
- InMemorySortTime: 1.817us | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.01 MB (25178593) | |
- RowsReturned: 3 (3) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 229.00 B (229) | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=37):(Total: 13s754ms, non-child: 13s754ms, % non-child: 100.00%) | |
- BytesReceived: 154.00 B (154) | |
- ConvertRowBatchTime: 1.851us | |
- DeserializeRowBatchTimer: 6.043us | |
- FirstBatchArrivalWaitTime: 13s754ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 3 (3) | |
- RowsReturnedRate: 0 | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Fragment F10: | |
Instance 514ee9ab39cdc507:a1 (host=cdh2.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.266ms, % non-child: 0.02%) | |
MemoryUsage(500.000ms): 48.01 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 48.45 MB (50803312) | |
- PerHostPeakMemUsage: 1.74 GB (1866918022) | |
- RowsProduced: 0 (0) | |
- TotalNetworkReceiveTime: 13s754ms | |
- TotalNetworkSendTime: 244.000ns | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s852ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 100.000ms | |
- TotalThreadsVoluntaryContextSwitches: 14 (14) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 179.644us | |
- ExecTreeExecTime: 4.944us | |
- OpenTime: 13s852ms | |
- ExecTreeOpenTime: 13s755ms | |
- PrepareTime: 35.365ms | |
- ExecTreePrepareTime: 163.580us | |
BlockMgr: | |
- BlockWritesOutstanding: 0 (0) | |
- BlocksCreated: 399 (399) | |
- BlocksRecycled: 314 (314) | |
- BufferedPins: 0 (0) | |
- BytesWritten: 0 | |
- MaxBlockSize: 8.00 MB (8388608) | |
- MemoryLimit: 48.00 GB (51539607552) | |
- PeakMemoryUsage: 1.27 GB (1368162304) | |
- ScratchFileUsedBytes: 0 | |
- TotalBufferWaitTime: 0.000ns | |
- TotalEncryptionTime: 0.000ns | |
- TotalReadBlockTime: 0.000ns | |
DataStreamSender (dst_id=38):(Total: 15.112us, non-child: 15.112us, % non-child: 100.00%) | |
- BytesSent: 0 | |
- NetworkThroughput(*): 0.00 /sec | |
- OverallThroughput: 0.00 /sec | |
- PeakMemoryUsage: 2.61 KB (2672) | |
- RowsReturned: 0 (0) | |
- SerializeBatchTime: 0.000ns | |
- TransmitDataRPCTime: 0.000ns | |
- UncompressedRowBatchSize: 0 | |
CodeGen:(Total: 129.976ms, non-child: 129.976ms, % non-child: 100.00%) | |
- CodegenTime: 1.300ms | |
- CompileTime: 15.147ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 80.326ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 33.630ms | |
SORT_NODE (id=15):(Total: 13s755ms, non-child: 71.204us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 336.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.02 MB (25182208) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=14):(Total: 13s755ms, non-child: 529.572us, % non-child: 0.00%) | |
- EvaluationTime: 820.000ns | |
- GetNewBlockTime: 2.728us | |
- PeakMemoryUsage: 8.02 MB (8413184) | |
- PinTime: 0.000ns | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=13):(Total: 13s754ms, non-child: 108.228us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 732.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.01 MB (25174016) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=37):(Total: 13s754ms, non-child: 4.240us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 0 | |
- ConvertRowBatchTime: 752.000ns | |
- DeserializeRowBatchTimer: 0.000ns | |
- FirstBatchArrivalWaitTime: 13s754ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:a2 (host=cdh12.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.200ms, % non-child: 0.02%) | |
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 48.45 MB (50803312) | |
- PerHostPeakMemUsage: 1.12 GB (1201773720) | |
- RowsProduced: 0 (0) | |
- TotalNetworkReceiveTime: 13s761ms | |
- TotalNetworkSendTime: 255.000ns | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s855ms | |
- TotalThreadsSysTime: 4.000ms | |
- TotalThreadsUserTime: 92.000ms | |
- TotalThreadsVoluntaryContextSwitches: 16 (16) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 208.105us | |
- ExecTreeExecTime: 5.252us | |
- OpenTime: 13s855ms | |
- ExecTreeOpenTime: 13s761ms | |
- PrepareTime: 32.264ms | |
- ExecTreePrepareTime: 161.288us | |
BlockMgr: | |
- BlockWritesOutstanding: 0 (0) | |
- BlocksCreated: 383 (383) | |
- BlocksRecycled: 282 (282) | |
- BufferedPins: 0 (0) | |
- BytesWritten: 0 | |
- MaxBlockSize: 8.00 MB (8388608) | |
- MemoryLimit: 48.00 GB (51539607552) | |
- PeakMemoryUsage: 836.78 MB (877430784) | |
- ScratchFileUsedBytes: 0 | |
- TotalBufferWaitTime: 0.000ns | |
- TotalEncryptionTime: 0.000ns | |
- TotalReadBlockTime: 0.000ns | |
DataStreamSender (dst_id=38):(Total: 15.763us, non-child: 15.763us, % non-child: 100.00%) | |
- BytesSent: 0 | |
- NetworkThroughput(*): 0.00 /sec | |
- OverallThroughput: 0.00 /sec | |
- PeakMemoryUsage: 2.61 KB (2672) | |
- RowsReturned: 0 (0) | |
- SerializeBatchTime: 0.000ns | |
- TransmitDataRPCTime: 0.000ns | |
- UncompressedRowBatchSize: 0 | |
CodeGen:(Total: 123.540ms, non-child: 123.540ms, % non-child: 100.00%) | |
- CodegenTime: 1.298ms | |
- CompileTime: 14.842ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 76.833ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 31.052ms | |
SORT_NODE (id=15):(Total: 13s761ms, non-child: 275.998us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 298.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.02 MB (25182208) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=14):(Total: 13s761ms, non-child: 100.546us, % non-child: 0.00%) | |
- EvaluationTime: 643.000ns | |
- GetNewBlockTime: 5.634us | |
- PeakMemoryUsage: 8.02 MB (8413184) | |
- PinTime: 0.000ns | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=13):(Total: 13s761ms, non-child: 100.313us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 941.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.01 MB (25174016) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=37):(Total: 13s761ms, non-child: 4.675us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 0 | |
- ConvertRowBatchTime: 871.000ns | |
- DeserializeRowBatchTimer: 0.000ns | |
- FirstBatchArrivalWaitTime: 13s761ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:a0 (host=cdh17.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.229ms, % non-child: 0.02%) | |
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 48.45 MB (50803312) | |
- PerHostPeakMemUsage: 1.75 GB (1879028559) | |
- RowsProduced: 0 (0) | |
- TotalNetworkReceiveTime: 13s758ms | |
- TotalNetworkSendTime: 223.000ns | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s852ms | |
- TotalThreadsSysTime: 4.000ms | |
- TotalThreadsUserTime: 96.000ms | |
- TotalThreadsVoluntaryContextSwitches: 16 (16) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 314.273us | |
- ExecTreeExecTime: 2.460us | |
- OpenTime: 13s852ms | |
- ExecTreeOpenTime: 13s758ms | |
- PrepareTime: 34.559ms | |
- ExecTreePrepareTime: 178.652us | |
BlockMgr: | |
- BlockWritesOutstanding: 0 (0) | |
- BlocksCreated: 386 (386) | |
- BlocksRecycled: 311 (311) | |
- BufferedPins: 0 (0) | |
- BytesWritten: 0 | |
- MaxBlockSize: 8.00 MB (8388608) | |
- MemoryLimit: 48.00 GB (51539607552) | |
- PeakMemoryUsage: 1.31 GB (1410891776) | |
- ScratchFileUsedBytes: 0 | |
- TotalBufferWaitTime: 0.000ns | |
- TotalEncryptionTime: 0.000ns | |
- TotalReadBlockTime: 0.000ns | |
DataStreamSender (dst_id=38):(Total: 15.884us, non-child: 15.884us, % non-child: 100.00%) | |
- BytesSent: 0 | |
- NetworkThroughput(*): 0.00 /sec | |
- OverallThroughput: 0.00 /sec | |
- PeakMemoryUsage: 2.61 KB (2672) | |
- RowsReturned: 0 (0) | |
- SerializeBatchTime: 0.000ns | |
- TransmitDataRPCTime: 0.000ns | |
- UncompressedRowBatchSize: 0 | |
CodeGen:(Total: 126.143ms, non-child: 126.143ms, % non-child: 100.00%) | |
- CodegenTime: 1.183ms | |
- CompileTime: 15.014ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 77.520ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 32.831ms | |
SORT_NODE (id=15):(Total: 13s759ms, non-child: 72.300us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 177.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.02 MB (25182208) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=14):(Total: 13s759ms, non-child: 101.035us, % non-child: 0.00%) | |
- EvaluationTime: 1.051us | |
- GetNewBlockTime: 3.093us | |
- PeakMemoryUsage: 8.02 MB (8413184) | |
- PinTime: 0.000ns | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=13):(Total: 13s758ms, non-child: 208.052us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 790.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.01 MB (25174016) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=37):(Total: 13s758ms, non-child: 4.369us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 0 | |
- ConvertRowBatchTime: 606.000ns | |
- DeserializeRowBatchTimer: 0.000ns | |
- FirstBatchArrivalWaitTime: 13s758ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:aa (host=cdh10.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.186ms, % non-child: 0.02%) | |
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 48.45 MB (50803312) | |
- PerHostPeakMemUsage: 1.66 GB (1784016472) | |
- RowsProduced: 0 (0) | |
- TotalNetworkReceiveTime: 13s762ms | |
- TotalNetworkSendTime: 194.000ns | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s854ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 92.000ms | |
- TotalThreadsVoluntaryContextSwitches: 8 (8) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 152.558us | |
- ExecTreeExecTime: 1.819us | |
- OpenTime: 13s853ms | |
- ExecTreeOpenTime: 13s763ms | |
- PrepareTime: 33.271ms | |
- ExecTreePrepareTime: 165.076us | |
BlockMgr: | |
- BlockWritesOutstanding: 0 (0) | |
- BlocksCreated: 415 (415) | |
- BlocksRecycled: 282 (282) | |
- BufferedPins: 0 (0) | |
- BytesWritten: 0 | |
- MaxBlockSize: 8.00 MB (8388608) | |
- MemoryLimit: 48.00 GB (51539607552) | |
- PeakMemoryUsage: 1.22 GB (1310228480) | |
- ScratchFileUsedBytes: 0 | |
- TotalBufferWaitTime: 0.000ns | |
- TotalEncryptionTime: 0.000ns | |
- TotalReadBlockTime: 0.000ns | |
DataStreamSender (dst_id=38):(Total: 15.973us, non-child: 15.973us, % non-child: 100.00%) | |
- BytesSent: 0 | |
- NetworkThroughput(*): 0.00 /sec | |
- OverallThroughput: 0.00 /sec | |
- PeakMemoryUsage: 2.61 KB (2672) | |
- RowsReturned: 0 (0) | |
- SerializeBatchTime: 0.000ns | |
- TransmitDataRPCTime: 0.000ns | |
- UncompressedRowBatchSize: 0 | |
CodeGen:(Total: 121.919ms, non-child: 121.919ms, % non-child: 100.00%) | |
- CodegenTime: 1.295ms | |
- CompileTime: 14.713ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 74.836ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 31.531ms | |
SORT_NODE (id=15):(Total: 13s763ms, non-child: 73.640us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 317.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.02 MB (25182208) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=14):(Total: 13s763ms, non-child: 95.851us, % non-child: 0.00%) | |
- EvaluationTime: 921.000ns | |
- GetNewBlockTime: 3.329us | |
- PeakMemoryUsage: 8.02 MB (8413184) | |
- PinTime: 0.000ns | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=13):(Total: 13s763ms, non-child: 194.088us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 966.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.01 MB (25174016) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=37):(Total: 13s762ms, non-child: 4.634us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 0 | |
- ConvertRowBatchTime: 942.000ns | |
- DeserializeRowBatchTimer: 0.000ns | |
- FirstBatchArrivalWaitTime: 13s762ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:a4 (host=cdh1.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.259ms, % non-child: 0.02%) | |
MemoryUsage(500.000ms): 48.45 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 48.45 MB (50803312) | |
- PerHostPeakMemUsage: 1.81 GB (1939587581) | |
- RowsProduced: 0 (0) | |
- TotalNetworkReceiveTime: 13s743ms | |
- TotalNetworkSendTime: 284.000ns | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 1 (1) | |
- TotalThreadsTotalWallClockTime: 13s843ms | |
- TotalThreadsSysTime: 4.000ms | |
- TotalThreadsUserTime: 96.000ms | |
- TotalThreadsVoluntaryContextSwitches: 29 (29) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 132.636us | |
- ExecTreeExecTime: 3.000us | |
- OpenTime: 13s843ms | |
- ExecTreeOpenTime: 13s743ms | |
- PrepareTime: 43.870ms | |
- ExecTreePrepareTime: 95.856us | |
DataStreamSender (dst_id=38):(Total: 9.224us, non-child: 9.224us, % non-child: 100.00%) | |
- BytesSent: 0 | |
- NetworkThroughput(*): 0.00 /sec | |
- OverallThroughput: 0.00 /sec | |
- PeakMemoryUsage: 2.61 KB (2672) | |
- RowsReturned: 0 (0) | |
- SerializeBatchTime: 0.000ns | |
- TransmitDataRPCTime: 0.000ns | |
- UncompressedRowBatchSize: 0 | |
CodeGen:(Total: 141.340ms, non-child: 141.340ms, % non-child: 100.00%) | |
- CodegenTime: 1.584ms | |
- CompileTime: 14.899ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 82.845ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 42.681ms | |
SORT_NODE (id=15):(Total: 13s743ms, non-child: 107.248us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 196.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.02 MB (25182208) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=14):(Total: 13s743ms, non-child: 78.972us, % non-child: 0.00%) | |
- EvaluationTime: 876.000ns | |
- GetNewBlockTime: 3.268us | |
- PeakMemoryUsage: 8.02 MB (8413184) | |
- PinTime: 0.000ns | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=13):(Total: 13s743ms, non-child: 434.984us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 844.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.01 MB (25174016) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=37):(Total: 13s743ms, non-child: 5.576us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 0 | |
- ConvertRowBatchTime: 832.000ns | |
- DeserializeRowBatchTimer: 0.000ns | |
- FirstBatchArrivalWaitTime: 13s743ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:9f (host=cdh3.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.015ms, % non-child: 0.01%) | |
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 48.45 MB (50803312) | |
- PerHostPeakMemUsage: 2.16 GB (2318232477) | |
- RowsProduced: 0 (0) | |
- TotalNetworkReceiveTime: 13s731ms | |
- TotalNetworkSendTime: 192.000ns | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 2 (2) | |
- TotalThreadsTotalWallClockTime: 13s853ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 124.000ms | |
- TotalThreadsVoluntaryContextSwitches: 15 (15) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 172.296us | |
- ExecTreeExecTime: 2.400us | |
- OpenTime: 13s853ms | |
- ExecTreeOpenTime: 13s731ms | |
- PrepareTime: 33.753ms | |
- ExecTreePrepareTime: 202.768us | |
BlockMgr: | |
- BlockWritesOutstanding: 0 (0) | |
- BlocksCreated: 413 (413) | |
- BlocksRecycled: 316 (316) | |
- BufferedPins: 0 (0) | |
- BytesWritten: 0 | |
- MaxBlockSize: 8.00 MB (8388608) | |
- MemoryLimit: 48.00 GB (51539607552) | |
- PeakMemoryUsage: 1.60 GB (1720483840) | |
- ScratchFileUsedBytes: 0 | |
- TotalBufferWaitTime: 0.000ns | |
- TotalEncryptionTime: 0.000ns | |
- TotalReadBlockTime: 0.000ns | |
DataStreamSender (dst_id=38):(Total: 21.828us, non-child: 21.828us, % non-child: 100.00%) | |
- BytesSent: 0 | |
- NetworkThroughput(*): 0.00 /sec | |
- OverallThroughput: 0.00 /sec | |
- PeakMemoryUsage: 2.61 KB (2672) | |
- RowsReturned: 0 (0) | |
- SerializeBatchTime: 0.000ns | |
- TransmitDataRPCTime: 0.000ns | |
- UncompressedRowBatchSize: 0 | |
CodeGen:(Total: 153.101ms, non-child: 153.101ms, % non-child: 100.00%) | |
- CodegenTime: 1.044ms | |
- CompileTime: 20.172ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 99.970ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 32.286ms | |
SORT_NODE (id=15):(Total: 13s732ms, non-child: 77.284us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 176.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.02 MB (25182208) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=14):(Total: 13s732ms, non-child: 112.116us, % non-child: 0.00%) | |
- EvaluationTime: 656.000ns | |
- GetNewBlockTime: 2.832us | |
- PeakMemoryUsage: 8.02 MB (8413184) | |
- PinTime: 0.000ns | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=13):(Total: 13s731ms, non-child: 541.508us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 704.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.01 MB (25174016) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=37):(Total: 13s731ms, non-child: 4.988us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 0 | |
- ConvertRowBatchTime: 1.032us | |
- DeserializeRowBatchTimer: 0.000ns | |
- FirstBatchArrivalWaitTime: 13s731ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:a8 (host=cdh11.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.038ms, % non-child: 0.01%) | |
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 48.45 MB (50803312) | |
- PerHostPeakMemUsage: 1.48 GB (1591793359) | |
- RowsProduced: 0 (0) | |
- TotalNetworkReceiveTime: 13s762ms | |
- TotalNetworkSendTime: 237.000ns | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s854ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 92.000ms | |
- TotalThreadsVoluntaryContextSwitches: 13 (13) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 184.537us | |
- ExecTreeExecTime: 2.060us | |
- OpenTime: 13s854ms | |
- ExecTreeOpenTime: 13s762ms | |
- PrepareTime: 32.424ms | |
- ExecTreePrepareTime: 167.987us | |
BlockMgr: | |
- BlockWritesOutstanding: 0 (0) | |
- BlocksCreated: 399 (399) | |
- BlocksRecycled: 298 (298) | |
- BufferedPins: 0 (0) | |
- BytesWritten: 0 | |
- MaxBlockSize: 8.00 MB (8388608) | |
- MemoryLimit: 48.00 GB (51539607552) | |
- PeakMemoryUsage: 1.12 GB (1197277184) | |
- ScratchFileUsedBytes: 0 | |
- TotalBufferWaitTime: 0.000ns | |
- TotalEncryptionTime: 0.000ns | |
- TotalReadBlockTime: 0.000ns | |
DataStreamSender (dst_id=38):(Total: 15.001us, non-child: 15.001us, % non-child: 100.00%) | |
- BytesSent: 0 | |
- NetworkThroughput(*): 0.00 /sec | |
- OverallThroughput: 0.00 /sec | |
- PeakMemoryUsage: 2.61 KB (2672) | |
- RowsReturned: 0 (0) | |
- SerializeBatchTime: 0.000ns | |
- TransmitDataRPCTime: 0.000ns | |
- UncompressedRowBatchSize: 0 | |
CodeGen:(Total: 122.295ms, non-child: 122.295ms, % non-child: 100.00%) | |
- CodegenTime: 1.281ms | |
- CompileTime: 15.189ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 75.483ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 30.817ms | |
SORT_NODE (id=15):(Total: 13s762ms, non-child: 67.132us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 291.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.02 MB (25182208) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=14):(Total: 13s762ms, non-child: 98.045us, % non-child: 0.00%) | |
- EvaluationTime: 583.000ns | |
- GetNewBlockTime: 3.225us | |
- PeakMemoryUsage: 8.02 MB (8413184) | |
- PinTime: 0.000ns | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=13):(Total: 13s762ms, non-child: 413.389us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 554.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.01 MB (25174016) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=37):(Total: 13s762ms, non-child: 4.013us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 0 | |
- ConvertRowBatchTime: 754.000ns | |
- DeserializeRowBatchTimer: 0.000ns | |
- FirstBatchArrivalWaitTime: 13s762ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:9d (host=cdh6.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.369ms, % non-child: 0.02%) | |
MemoryUsage(500.000ms): 48.01 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 56.06 MB (58781221) | |
- PerHostPeakMemUsage: 1.67 GB (1794839264) | |
- RowsProduced: 52 (52) | |
- TotalNetworkReceiveTime: 13s757ms | |
- TotalNetworkSendTime: 321.380us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s852ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 96.000ms | |
- TotalThreadsVoluntaryContextSwitches: 30 (30) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 552.740us | |
- ExecTreeExecTime: 4.600us | |
- OpenTime: 13s852ms | |
- ExecTreeOpenTime: 13s758ms | |
- PrepareTime: 34.608ms | |
- ExecTreePrepareTime: 159.868us | |
BlockMgr: | |
- BlockWritesOutstanding: 0 (0) | |
- BlocksCreated: 399 (399) | |
- BlocksRecycled: 298 (298) | |
- BufferedPins: 0 (0) | |
- BytesWritten: 0 | |
- MaxBlockSize: 8.00 MB (8388608) | |
- MemoryLimit: 48.00 GB (51539607552) | |
- PeakMemoryUsage: 1.23 GB (1316126720) | |
- ScratchFileUsedBytes: 0 | |
- TotalBufferWaitTime: 0.000ns | |
- TotalEncryptionTime: 0.000ns | |
- TotalReadBlockTime: 0.000ns | |
DataStreamSender (dst_id=38):(Total: 96.696us, non-child: 96.696us, % non-child: 100.00%) | |
- BytesSent: 1.80 KB (1839) | |
- NetworkThroughput(*): 38.24 MB/sec | |
- OverallThroughput: 18.14 MB/sec | |
- PeakMemoryUsage: 2.61 KB (2672) | |
- RowsReturned: 52 (52) | |
- SerializeBatchTime: 35.176us | |
- TransmitDataRPCTime: 45.868us | |
- UncompressedRowBatchSize: 4.42 KB (4521) | |
CodeGen:(Total: 126.456ms, non-child: 126.456ms, % non-child: 100.00%) | |
- CodegenTime: 1.219ms | |
- CompileTime: 14.917ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 77.885ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 32.866ms | |
SORT_NODE (id=15):(Total: 13s758ms, non-child: 107.948us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 18.168us | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.03 MB (25194496) | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
- SortDataSize: 4.21 KB (4309) | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=14):(Total: 13s758ms, non-child: 130.644us, % non-child: 0.00%) | |
- EvaluationTime: 39.204us | |
- GetNewBlockTime: 2.752us | |
- PeakMemoryUsage: 8.03 MB (8417280) | |
- PinTime: 0.000ns | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=13):(Total: 13s758ms, non-child: 559.936us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 18.764us | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.08 MB (25251840) | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
- SortDataSize: 3.80 KB (3893) | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=37):(Total: 13s757ms, non-child: 135.244us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 2.57 KB (2630) | |
- ConvertRowBatchTime: 17.864us | |
- DeserializeRowBatchTimer: 102.740us | |
- FirstBatchArrivalWaitTime: 13s747ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 52 (52) | |
- RowsReturnedRate: 3.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:a7 (host=cdh8.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.148ms, % non-child: 0.02%) | |
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 48.45 MB (50803312) | |
- PerHostPeakMemUsage: 1.63 GB (1748411303) | |
- RowsProduced: 0 (0) | |
- TotalNetworkReceiveTime: 13s761ms | |
- TotalNetworkSendTime: 250.000ns | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s853ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 92.000ms | |
- TotalThreadsVoluntaryContextSwitches: 7 (7) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 220.069us | |
- ExecTreeExecTime: 3.457us | |
- OpenTime: 13s853ms | |
- ExecTreeOpenTime: 13s761ms | |
- PrepareTime: 33.111ms | |
- ExecTreePrepareTime: 167.440us | |
BlockMgr: | |
- BlockWritesOutstanding: 0 (0) | |
- BlocksCreated: 399 (399) | |
- BlocksRecycled: 298 (298) | |
- BufferedPins: 0 (0) | |
- BytesWritten: 0 | |
- MaxBlockSize: 8.00 MB (8388608) | |
- MemoryLimit: 48.00 GB (51539607552) | |
- PeakMemoryUsage: 1.22 GB (1309378560) | |
- ScratchFileUsedBytes: 0 | |
- TotalBufferWaitTime: 0.000ns | |
- TotalEncryptionTime: 0.000ns | |
- TotalReadBlockTime: 0.000ns | |
DataStreamSender (dst_id=38):(Total: 16.170us, non-child: 16.170us, % non-child: 100.00%) | |
- BytesSent: 0 | |
- NetworkThroughput(*): 0.00 /sec | |
- OverallThroughput: 0.00 /sec | |
- PeakMemoryUsage: 2.61 KB (2672) | |
- RowsReturned: 0 (0) | |
- SerializeBatchTime: 0.000ns | |
- TransmitDataRPCTime: 0.000ns | |
- UncompressedRowBatchSize: 0 | |
CodeGen:(Total: 123.349ms, non-child: 123.349ms, % non-child: 100.00%) | |
- CodegenTime: 1.340ms | |
- CompileTime: 14.830ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 76.406ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 31.310ms | |
SORT_NODE (id=15):(Total: 13s761ms, non-child: 84.438us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 524.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.02 MB (25182208) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=14):(Total: 13s761ms, non-child: 113.256us, % non-child: 0.00%) | |
- EvaluationTime: 978.000ns | |
- GetNewBlockTime: 4.260us | |
- PeakMemoryUsage: 8.02 MB (8413184) | |
- PinTime: 0.000ns | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=13):(Total: 13s761ms, non-child: 118.594us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 890.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.01 MB (25174016) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=37):(Total: 13s761ms, non-child: 4.757us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 0 | |
- ConvertRowBatchTime: 873.000ns | |
- DeserializeRowBatchTimer: 0.000ns | |
- FirstBatchArrivalWaitTime: 13s761ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:a9 (host=cdh9.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.060ms, % non-child: 0.01%) | |
MemoryUsage(500.000ms): 48.01 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 48.45 MB (50803312) | |
- PerHostPeakMemUsage: 1.69 GB (1813107104) | |
- RowsProduced: 0 (0) | |
- TotalNetworkReceiveTime: 13s760ms | |
- TotalNetworkSendTime: 228.000ns | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s853ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 96.000ms | |
- TotalThreadsVoluntaryContextSwitches: 6 (6) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 177.665us | |
- ExecTreeExecTime: 2.862us | |
- OpenTime: 13s853ms | |
- ExecTreeOpenTime: 13s760ms | |
- PrepareTime: 33.537ms | |
- ExecTreePrepareTime: 182.250us | |
BlockMgr: | |
- BlockWritesOutstanding: 0 (0) | |
- BlocksCreated: 415 (415) | |
- BlocksRecycled: 282 (282) | |
- BufferedPins: 0 (0) | |
- BytesWritten: 0 | |
- MaxBlockSize: 8.00 MB (8388608) | |
- MemoryLimit: 48.00 GB (51539607552) | |
- PeakMemoryUsage: 1.23 GB (1316128768) | |
- ScratchFileUsedBytes: 0 | |
- TotalBufferWaitTime: 0.000ns | |
- TotalEncryptionTime: 0.000ns | |
- TotalReadBlockTime: 0.000ns | |
DataStreamSender (dst_id=38):(Total: 15.120us, non-child: 15.120us, % non-child: 100.00%) | |
- BytesSent: 0 | |
- NetworkThroughput(*): 0.00 /sec | |
- OverallThroughput: 0.00 /sec | |
- PeakMemoryUsage: 2.61 KB (2672) | |
- RowsReturned: 0 (0) | |
- SerializeBatchTime: 0.000ns | |
- TransmitDataRPCTime: 0.000ns | |
- UncompressedRowBatchSize: 0 | |
CodeGen:(Total: 123.926ms, non-child: 123.926ms, % non-child: 100.00%) | |
- CodegenTime: 1.204ms | |
- CompileTime: 14.804ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 76.515ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 31.813ms | |
SORT_NODE (id=15):(Total: 13s761ms, non-child: 68.091us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 492.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.02 MB (25182208) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=14):(Total: 13s760ms, non-child: 113.028us, % non-child: 0.00%) | |
- EvaluationTime: 597.000ns | |
- GetNewBlockTime: 2.732us | |
- PeakMemoryUsage: 8.02 MB (8413184) | |
- PinTime: 0.000ns | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=13):(Total: 13s760ms, non-child: 116.665us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 785.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.01 MB (25174016) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=37):(Total: 13s760ms, non-child: 5.428us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 0 | |
- ConvertRowBatchTime: 633.000ns | |
- DeserializeRowBatchTimer: 0.000ns | |
- FirstBatchArrivalWaitTime: 13s760ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:a5 (host=cdh5.net.cuberonlabs.com:22000):(Total: 13s886ms, non-child: 2.233ms, % non-child: 0.02%) | |
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 48.45 MB (50803312) | |
- PerHostPeakMemUsage: 2.15 GB (2303708143) | |
- RowsProduced: 0 (0) | |
- TotalNetworkReceiveTime: 13s752ms | |
- TotalNetworkSendTime: 240.000ns | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s852ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 104.000ms | |
- TotalThreadsVoluntaryContextSwitches: 8 (8) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 214.404us | |
- ExecTreeExecTime: 2.344us | |
- OpenTime: 13s852ms | |
- ExecTreeOpenTime: 13s752ms | |
- PrepareTime: 34.475ms | |
- ExecTreePrepareTime: 167.700us | |
BlockMgr: | |
- BlockWritesOutstanding: 0 (0) | |
- BlocksCreated: 415 (415) | |
- BlocksRecycled: 314 (314) | |
- BufferedPins: 0 (0) | |
- BytesWritten: 0 | |
- MaxBlockSize: 8.00 MB (8388608) | |
- MemoryLimit: 48.00 GB (51539607552) | |
- PeakMemoryUsage: 1.60 GB (1713143808) | |
- ScratchFileUsedBytes: 0 | |
- TotalBufferWaitTime: 0.000ns | |
- TotalEncryptionTime: 0.000ns | |
- TotalReadBlockTime: 0.000ns | |
DataStreamSender (dst_id=38):(Total: 14.668us, non-child: 14.668us, % non-child: 100.00%) | |
- BytesSent: 0 | |
- NetworkThroughput(*): 0.00 /sec | |
- OverallThroughput: 0.00 /sec | |
- PeakMemoryUsage: 2.61 KB (2672) | |
- RowsReturned: 0 (0) | |
- SerializeBatchTime: 0.000ns | |
- TransmitDataRPCTime: 0.000ns | |
- UncompressedRowBatchSize: 0 | |
CodeGen:(Total: 131.972ms, non-child: 131.972ms, % non-child: 100.00%) | |
- CodegenTime: 1.361ms | |
- CompileTime: 15.902ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 82.465ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 32.746ms | |
SORT_NODE (id=15):(Total: 13s752ms, non-child: 71.460us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 280.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.02 MB (25182208) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=14):(Total: 13s752ms, non-child: 344.756us, % non-child: 0.00%) | |
- EvaluationTime: 784.000ns | |
- GetNewBlockTime: 5.432us | |
- PeakMemoryUsage: 8.02 MB (8413184) | |
- PinTime: 0.000ns | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=13):(Total: 13s752ms, non-child: 101.388us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 568.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.01 MB (25174016) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=37):(Total: 13s752ms, non-child: 4.088us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 0 | |
- ConvertRowBatchTime: 664.000ns | |
- DeserializeRowBatchTimer: 0.000ns | |
- FirstBatchArrivalWaitTime: 13s752ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:a3 (host=cdh14.net.cuberonlabs.com:22000):(Total: 13s886ms, non-child: 2.484ms, % non-child: 0.02%) | |
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 48.45 MB (50803312) | |
- PerHostPeakMemUsage: 1.44 GB (1548652528) | |
- RowsProduced: 0 (0) | |
- TotalNetworkReceiveTime: 13s760ms | |
- TotalNetworkSendTime: 246.000ns | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s851ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 92.000ms | |
- TotalThreadsVoluntaryContextSwitches: 19 (19) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 181.521us | |
- ExecTreeExecTime: 2.643us | |
- OpenTime: 13s851ms | |
- ExecTreeOpenTime: 13s760ms | |
- PrepareTime: 35.477ms | |
- ExecTreePrepareTime: 160.178us | |
BlockMgr: | |
- BlockWritesOutstanding: 0 (0) | |
- BlocksCreated: 415 (415) | |
- BlocksRecycled: 282 (282) | |
- BufferedPins: 0 (0) | |
- BytesWritten: 0 | |
- MaxBlockSize: 8.00 MB (8388608) | |
- MemoryLimit: 48.00 GB (51539607552) | |
- PeakMemoryUsage: 1.07 GB (1154154496) | |
- ScratchFileUsedBytes: 0 | |
- TotalBufferWaitTime: 0.000ns | |
- TotalEncryptionTime: 0.000ns | |
- TotalReadBlockTime: 0.000ns | |
DataStreamSender (dst_id=38):(Total: 22.010us, non-child: 22.010us, % non-child: 100.00%) | |
- BytesSent: 0 | |
- NetworkThroughput(*): 0.00 /sec | |
- OverallThroughput: 0.00 /sec | |
- PeakMemoryUsage: 2.61 KB (2672) | |
- RowsReturned: 0 (0) | |
- SerializeBatchTime: 0.000ns | |
- TransmitDataRPCTime: 0.000ns | |
- UncompressedRowBatchSize: 0 | |
CodeGen:(Total: 123.324ms, non-child: 123.324ms, % non-child: 100.00%) | |
- CodegenTime: 1.250ms | |
- CompileTime: 14.369ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 74.413ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 33.813ms | |
SORT_NODE (id=15):(Total: 13s761ms, non-child: 67.178us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 378.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.02 MB (25182208) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=14):(Total: 13s760ms, non-child: 421.495us, % non-child: 0.00%) | |
- EvaluationTime: 839.000ns | |
- GetNewBlockTime: 6.321us | |
- PeakMemoryUsage: 8.02 MB (8413184) | |
- PinTime: 0.000ns | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=13):(Total: 13s760ms, non-child: 101.616us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 533.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.01 MB (25174016) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=37):(Total: 13s760ms, non-child: 4.541us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 0 | |
- ConvertRowBatchTime: 892.000ns | |
- DeserializeRowBatchTimer: 0.000ns | |
- FirstBatchArrivalWaitTime: 13s760ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:9e (host=cdh15.net.cuberonlabs.com:22000):(Total: 13s886ms, non-child: 2.041ms, % non-child: 0.01%) | |
MemoryUsage(500.000ms): 48.45 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 48.45 MB (50803312) | |
- PerHostPeakMemUsage: 1.57 GB (1688553772) | |
- RowsProduced: 0 (0) | |
- TotalNetworkReceiveTime: 13s759ms | |
- TotalNetworkSendTime: 253.000ns | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s853ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 92.000ms | |
- TotalThreadsVoluntaryContextSwitches: 13 (13) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 194.577us | |
- ExecTreeExecTime: 2.257us | |
- OpenTime: 13s853ms | |
- ExecTreeOpenTime: 13s760ms | |
- PrepareTime: 33.126ms | |
- ExecTreePrepareTime: 160.916us | |
BlockMgr: | |
- BlockWritesOutstanding: 0 (0) | |
- BlocksCreated: 415 (415) | |
- BlocksRecycled: 282 (282) | |
- BufferedPins: 0 (0) | |
- BytesWritten: 0 | |
- MaxBlockSize: 8.00 MB (8388608) | |
- MemoryLimit: 48.00 GB (51539607552) | |
- PeakMemoryUsage: 1.16 GB (1245904896) | |
- ScratchFileUsedBytes: 0 | |
- TotalBufferWaitTime: 0.000ns | |
- TotalEncryptionTime: 0.000ns | |
- TotalReadBlockTime: 0.000ns | |
DataStreamSender (dst_id=38):(Total: 15.837us, non-child: 15.837us, % non-child: 100.00%) | |
- BytesSent: 0 | |
- NetworkThroughput(*): 0.00 /sec | |
- OverallThroughput: 0.00 /sec | |
- PeakMemoryUsage: 2.61 KB (2672) | |
- RowsReturned: 0 (0) | |
- SerializeBatchTime: 0.000ns | |
- TransmitDataRPCTime: 0.000ns | |
- UncompressedRowBatchSize: 0 | |
CodeGen:(Total: 124.408ms, non-child: 124.408ms, % non-child: 100.00%) | |
- CodegenTime: 1.124ms | |
- CompileTime: 15.157ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 76.979ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 31.422ms | |
SORT_NODE (id=15):(Total: 13s760ms, non-child: 68.256us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 313.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.02 MB (25182208) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=14):(Total: 13s760ms, non-child: 293.524us, % non-child: 0.00%) | |
- EvaluationTime: 1.020us | |
- GetNewBlockTime: 3.136us | |
- PeakMemoryUsage: 8.02 MB (8413184) | |
- PinTime: 0.000ns | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=13):(Total: 13s760ms, non-child: 100.639us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 780.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.01 MB (25174016) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=37):(Total: 13s759ms, non-child: 5.234us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 0 | |
- ConvertRowBatchTime: 1.107us | |
- DeserializeRowBatchTimer: 0.000ns | |
- FirstBatchArrivalWaitTime: 13s759ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:9c (host=cdh13.net.cuberonlabs.com:22000):(Total: 13s886ms, non-child: 2.054ms, % non-child: 0.01%) | |
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 48.45 MB (50803312) | |
- PerHostPeakMemUsage: 1.66 GB (1782381748) | |
- RowsProduced: 0 (0) | |
- TotalNetworkReceiveTime: 13s757ms | |
- TotalNetworkSendTime: 206.000ns | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s852ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 100.000ms | |
- TotalThreadsVoluntaryContextSwitches: 12 (12) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 205.436us | |
- ExecTreeExecTime: 6.160us | |
- OpenTime: 13s852ms | |
- ExecTreeOpenTime: 13s757ms | |
- PrepareTime: 34.197ms | |
- ExecTreePrepareTime: 158.355us | |
BlockMgr: | |
- BlockWritesOutstanding: 0 (0) | |
- BlocksCreated: 415 (415) | |
- BlocksRecycled: 282 (282) | |
- BufferedPins: 0 (0) | |
- BytesWritten: 0 | |
- MaxBlockSize: 8.00 MB (8388608) | |
- MemoryLimit: 48.00 GB (51539607552) | |
- PeakMemoryUsage: 1.22 GB (1308917760) | |
- ScratchFileUsedBytes: 0 | |
- TotalBufferWaitTime: 0.000ns | |
- TotalEncryptionTime: 0.000ns | |
- TotalReadBlockTime: 0.000ns | |
DataStreamSender (dst_id=38):(Total: 26.086us, non-child: 26.086us, % non-child: 100.00%) | |
- BytesSent: 0 | |
- NetworkThroughput(*): 0.00 /sec | |
- OverallThroughput: 0.00 /sec | |
- PeakMemoryUsage: 2.61 KB (2672) | |
- RowsReturned: 0 (0) | |
- SerializeBatchTime: 0.000ns | |
- TransmitDataRPCTime: 0.000ns | |
- UncompressedRowBatchSize: 0 | |
CodeGen:(Total: 126.891ms, non-child: 126.891ms, % non-child: 100.00%) | |
- CodegenTime: 1.199ms | |
- CompileTime: 15.256ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 78.210ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 32.655ms | |
SORT_NODE (id=15):(Total: 13s757ms, non-child: 287.881us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 219.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.02 MB (25182208) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=14):(Total: 13s757ms, non-child: 100.004us, % non-child: 0.00%) | |
- EvaluationTime: 834.000ns | |
- GetNewBlockTime: 3.136us | |
- PeakMemoryUsage: 8.02 MB (8413184) | |
- PinTime: 0.000ns | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=13):(Total: 13s757ms, non-child: 103.106us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 729.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.01 MB (25174016) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=37):(Total: 13s757ms, non-child: 4.783us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 0 | |
- ConvertRowBatchTime: 1.058us | |
- DeserializeRowBatchTimer: 0.000ns | |
- FirstBatchArrivalWaitTime: 13s757ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:a6 (host=cdh7.net.cuberonlabs.com:22000):(Total: 13s886ms, non-child: 2.144ms, % non-child: 0.02%) | |
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 48.45 MB (50803312) | |
- PerHostPeakMemUsage: 1.58 GB (1699637471) | |
- RowsProduced: 0 (0) | |
- TotalNetworkReceiveTime: 13s755ms | |
- TotalNetworkSendTime: 226.000ns | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 1 (1) | |
- TotalThreadsTotalWallClockTime: 13s850ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 96.000ms | |
- TotalThreadsVoluntaryContextSwitches: 10 (10) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 245.757us | |
- ExecTreeExecTime: 2.753us | |
- OpenTime: 13s850ms | |
- ExecTreeOpenTime: 13s755ms | |
- PrepareTime: 35.589ms | |
- ExecTreePrepareTime: 166.049us | |
BlockMgr: | |
- BlockWritesOutstanding: 0 (0) | |
- BlocksCreated: 383 (383) | |
- BlocksRecycled: 314 (314) | |
- BufferedPins: 0 (0) | |
- BytesWritten: 0 | |
- MaxBlockSize: 8.00 MB (8388608) | |
- MemoryLimit: 48.00 GB (51539607552) | |
- PeakMemoryUsage: 1.19 GB (1280214016) | |
- ScratchFileUsedBytes: 0 | |
- TotalBufferWaitTime: 0.000ns | |
- TotalEncryptionTime: 0.000ns | |
- TotalReadBlockTime: 0.000ns | |
DataStreamSender (dst_id=38):(Total: 15.738us, non-child: 15.738us, % non-child: 100.00%) | |
- BytesSent: 0 | |
- NetworkThroughput(*): 0.00 /sec | |
- OverallThroughput: 0.00 /sec | |
- PeakMemoryUsage: 2.61 KB (2672) | |
- RowsReturned: 0 (0) | |
- SerializeBatchTime: 0.000ns | |
- TransmitDataRPCTime: 0.000ns | |
- UncompressedRowBatchSize: 0 | |
CodeGen:(Total: 128.702ms, non-child: 128.702ms, % non-child: 100.00%) | |
- CodegenTime: 1.164ms | |
- CompileTime: 15.188ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 78.455ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 34.260ms | |
SORT_NODE (id=15):(Total: 13s755ms, non-child: 76.025us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 270.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.02 MB (25182208) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=14):(Total: 13s755ms, non-child: 97.360us, % non-child: 0.00%) | |
- EvaluationTime: 687.000ns | |
- GetNewBlockTime: 3.070us | |
- PeakMemoryUsage: 8.02 MB (8413184) | |
- PinTime: 0.000ns | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=13):(Total: 13s755ms, non-child: 109.671us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 1.040us | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.01 MB (25174016) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=37):(Total: 13s755ms, non-child: 9.185us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 0 | |
- ConvertRowBatchTime: 1.053us | |
- DeserializeRowBatchTimer: 0.000ns | |
- FirstBatchArrivalWaitTime: 13s755ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:9a (host=cdh4.net.cuberonlabs.com:22000):(Total: 13s886ms, non-child: 2.048ms, % non-child: 0.01%) | |
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 48.45 MB (50803312) | |
- PerHostPeakMemUsage: 2.13 GB (2284202661) | |
- RowsProduced: 0 (0) | |
- TotalNetworkReceiveTime: 13s744ms | |
- TotalNetworkSendTime: 224.000ns | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 7 (7) | |
- TotalThreadsTotalWallClockTime: 13s853ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 112.000ms | |
- TotalThreadsVoluntaryContextSwitches: 20 (20) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 230.344us | |
- ExecTreeExecTime: 3.068us | |
- OpenTime: 13s853ms | |
- ExecTreeOpenTime: 13s745ms | |
- PrepareTime: 32.891ms | |
- ExecTreePrepareTime: 142.416us | |
BlockMgr: | |
- BlockWritesOutstanding: 0 (0) | |
- BlocksCreated: 417 (417) | |
- BlocksRecycled: 312 (312) | |
- BufferedPins: 0 (0) | |
- BytesWritten: 0 | |
- MaxBlockSize: 8.00 MB (8388608) | |
- MemoryLimit: 48.00 GB (51539607552) | |
- PeakMemoryUsage: 1.58 GB (1692174336) | |
- ScratchFileUsedBytes: 0 | |
- TotalBufferWaitTime: 0.000ns | |
- TotalEncryptionTime: 0.000ns | |
- TotalReadBlockTime: 0.000ns | |
DataStreamSender (dst_id=38):(Total: 13.820us, non-child: 13.820us, % non-child: 100.00%) | |
- BytesSent: 0 | |
- NetworkThroughput(*): 0.00 /sec | |
- OverallThroughput: 0.00 /sec | |
- PeakMemoryUsage: 2.61 KB (2672) | |
- RowsReturned: 0 (0) | |
- SerializeBatchTime: 0.000ns | |
- TransmitDataRPCTime: 0.000ns | |
- UncompressedRowBatchSize: 0 | |
CodeGen:(Total: 138.774ms, non-child: 138.774ms, % non-child: 100.00%) | |
- CodegenTime: 1.143ms | |
- CompileTime: 21.751ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 84.782ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 31.256ms | |
SORT_NODE (id=15):(Total: 13s745ms, non-child: 77.932us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 260.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.02 MB (25182208) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=14):(Total: 13s745ms, non-child: 425.152us, % non-child: 0.00%) | |
- EvaluationTime: 888.000ns | |
- GetNewBlockTime: 5.936us | |
- PeakMemoryUsage: 8.02 MB (8413184) | |
- PinTime: 0.000ns | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=13):(Total: 13s745ms, non-child: 97.580us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 632.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.01 MB (25174016) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=37):(Total: 13s744ms, non-child: 4.672us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 0 | |
- ConvertRowBatchTime: 812.000ns | |
- DeserializeRowBatchTimer: 0.000ns | |
- FirstBatchArrivalWaitTime: 13s744ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:9b (host=cdh16.net.cuberonlabs.com:22000):(Total: 13s886ms, non-child: 2.066ms, % non-child: 0.01%) | |
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 48.45 MB (50803312) | |
- PerHostPeakMemUsage: 1.64 GB (1763578733) | |
- RowsProduced: 0 (0) | |
- TotalNetworkReceiveTime: 13s748ms | |
- TotalNetworkSendTime: 259.000ns | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 1 (1) | |
- TotalThreadsTotalWallClockTime: 13s853ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 108.000ms | |
- TotalThreadsVoluntaryContextSwitches: 12 (12) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 194.334us | |
- ExecTreeExecTime: 2.733us | |
- OpenTime: 13s853ms | |
- ExecTreeOpenTime: 13s749ms | |
- PrepareTime: 32.380ms | |
- ExecTreePrepareTime: 161.699us | |
BlockMgr: | |
- BlockWritesOutstanding: 0 (0) | |
- BlocksCreated: 399 (399) | |
- BlocksRecycled: 298 (298) | |
- BufferedPins: 0 (0) | |
- BytesWritten: 0 | |
- MaxBlockSize: 8.00 MB (8388608) | |
- MemoryLimit: 48.00 GB (51539607552) | |
- PeakMemoryUsage: 1.23 GB (1317240832) | |
- ScratchFileUsedBytes: 0 | |
- TotalBufferWaitTime: 0.000ns | |
- TotalEncryptionTime: 0.000ns | |
- TotalReadBlockTime: 0.000ns | |
DataStreamSender (dst_id=38):(Total: 15.074us, non-child: 15.074us, % non-child: 100.00%) | |
- BytesSent: 0 | |
- NetworkThroughput(*): 0.00 /sec | |
- OverallThroughput: 0.00 /sec | |
- PeakMemoryUsage: 2.61 KB (2672) | |
- RowsReturned: 0 (0) | |
- SerializeBatchTime: 0.000ns | |
- TransmitDataRPCTime: 0.000ns | |
- UncompressedRowBatchSize: 0 | |
CodeGen:(Total: 134.896ms, non-child: 134.896ms, % non-child: 100.00%) | |
- CodegenTime: 779.704us | |
- CompileTime: 16.301ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 46 (46) | |
- NumInstructions: 892 (892) | |
- OptimizationTime: 86.857ms | |
- PeakMemoryUsage: 446.00 KB (456704) | |
- PrepareTime: 31.199ms | |
SORT_NODE (id=15):(Total: 13s749ms, non-child: 63.516us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 301.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.02 MB (25182208) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
ANALYTIC_EVAL_NODE (id=14):(Total: 13s749ms, non-child: 122.081us, % non-child: 0.00%) | |
- EvaluationTime: 779.000ns | |
- GetNewBlockTime: 5.600us | |
- PeakMemoryUsage: 8.02 MB (8413184) | |
- PinTime: 0.000ns | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- UnpinTime: 0.000ns | |
SORT_NODE (id=13):(Total: 13s749ms, non-child: 358.391us, % non-child: 0.00%) | |
ExecOption: Codegen Enabled | |
- InMemorySortTime: 637.000ns | |
- InitialRunsCreated: 1 (1) | |
- PeakMemoryUsage: 24.01 MB (25174016) | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SortDataSize: 0 | |
- SpilledRuns: 0 (0) | |
- TotalMergesPerformed: 0 (0) | |
EXCHANGE_NODE (id=37):(Total: 13s748ms, non-child: 4.234us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 0 | |
- ConvertRowBatchTime: 737.000ns | |
- DeserializeRowBatchTimer: 0.000ns | |
- FirstBatchArrivalWaitTime: 13s748ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 0 (0) | |
- RowsReturnedRate: 0 | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Averaged Fragment F09:(Total: 13s880ms, non-child: 8.807ms, % non-child: 0.06%) | |
split sizes: min: 0, max: 0, avg: 0, stddev: 0 | |
completion times: min:13s878ms max:13s886ms mean: 13s882ms stddev:2.535ms | |
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec | |
num instances: 17 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 5.89 MB (6175198) | |
- PerHostPeakMemUsage: 1.70 GB (1824024877) | |
- RowsProduced: 3 (3) | |
- TotalNetworkReceiveTime: 13s589ms | |
- TotalNetworkSendTime: 248.386us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s842ms | |
- TotalThreadsSysTime: 5.411ms | |
- TotalThreadsUserTime: 244.705ms | |
- TotalThreadsVoluntaryContextSwitches: 100 (100) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 3.367ms | |
- ExecTreeExecTime: 160.482us | |
- OpenTime: 13s839ms | |
- ExecTreeOpenTime: 13s593ms | |
- PrepareTime: 37.924ms | |
- ExecTreePrepareTime: 1.258ms | |
DataStreamSender (dst_id=37):(Total: 97.659us, non-child: 97.659us, % non-child: 100.00%) | |
- BytesSent: 154.00 B (154) | |
- NetworkThroughput(*): 4.90 MB/sec | |
- OverallThroughput: 1.59 MB/sec | |
- PeakMemoryUsage: 56.99 KB (58360) | |
- RowsReturned: 3 (3) | |
- SerializeBatchTime: 20.743us | |
- TransmitDataRPCTime: 36.087us | |
- UncompressedRowBatchSize: 245.00 B (245) | |
CodeGen:(Total: 276.452ms, non-child: 276.452ms, % non-child: 100.00%) | |
- CodegenTime: 4.311ms | |
- CompileTime: 83.330ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.52K (1523) | |
- OptimizationTime: 160.782ms | |
- PeakMemoryUsage: 761.50 KB (779776) | |
- PrepareTime: 31.557ms | |
AGGREGATION_NODE (id=12):(Total: 13s595ms, non-child: 1.898ms, % non-child: 0.01%) | |
- BuildTime: 339.488us | |
- GetNewBlockTime: 164.748us | |
- GetResultsTime: 6.136us | |
- HTResizeTime: 26.735us | |
- HashBuckets: 2.95K (2951) | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.31 MB (2427008) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 3 (3) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 911.000ns | |
AGGREGATION_NODE (id=36):(Total: 13s593ms, non-child: 3.646ms, % non-child: 0.03%) | |
- BuildTime: 1.277ms | |
- GetNewBlockTime: 180.067us | |
- GetResultsTime: 176.689us | |
- HTResizeTime: 474.485us | |
- HashBuckets: 23.43K (23431) | |
- LargestPartitionPercent: 14 (14) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 3.00 MB (3146340) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.11K (2108) | |
- RowsReturnedRate: 154.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 998.000ns | |
EXCHANGE_NODE (id=35):(Total: 13s589ms, non-child: 13s589ms, % non-child: 100.00%) | |
- BytesReceived: 122.07 KB (124997) | |
- ConvertRowBatchTime: 64.458us | |
- DeserializeRowBatchTimer: 693.596us | |
- FirstBatchArrivalWaitTime: 13s575ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.11K (2108) | |
- RowsReturnedRate: 154.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Fragment F09: | |
Instance 514ee9ab39cdc507:98 (host=cdh9.net.cuberonlabs.com:22000):(Total: 13s885ms, non-child: 8.614ms, % non-child: 0.06%) | |
MemoryUsage(500.000ms): 5.40 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 5.40 MB (5660408) | |
- PerHostPeakMemUsage: 1.69 GB (1813107104) | |
- RowsProduced: 4 (4) | |
- TotalNetworkReceiveTime: 13s609ms | |
- TotalNetworkSendTime: 232.353us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s848ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 236.000ms | |
- TotalThreadsVoluntaryContextSwitches: 71 (71) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 3.826ms | |
- ExecTreeExecTime: 312.368us | |
- OpenTime: 13s844ms | |
- ExecTreeOpenTime: 13s614ms | |
- PrepareTime: 37.348ms | |
- ExecTreePrepareTime: 1.243ms | |
DataStreamSender (dst_id=37):(Total: 90.018us, non-child: 90.018us, % non-child: 100.00%) | |
- BytesSent: 190.00 B (190) | |
- NetworkThroughput(*): 6.56 MB/sec | |
- OverallThroughput: 2.01 MB/sec | |
- PeakMemoryUsage: 56.99 KB (58360) | |
- RowsReturned: 4 (4) | |
- SerializeBatchTime: 16.477us | |
- TransmitDataRPCTime: 27.613us | |
- UncompressedRowBatchSize: 310.00 B (310) | |
CodeGen:(Total: 261.175ms, non-child: 261.175ms, % non-child: 100.00%) | |
- CodegenTime: 4.163ms | |
- CompileTime: 72.410ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.52K (1523) | |
- OptimizationTime: 156.852ms | |
- PeakMemoryUsage: 761.50 KB (779776) | |
- PrepareTime: 31.200ms | |
AGGREGATION_NODE (id=12):(Total: 13s615ms, non-child: 3.467ms, % non-child: 0.03%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 257.464us | |
- GetNewBlockTime: 161.464us | |
- GetResultsTime: 11.696us | |
- HTResizeTime: 18.093us | |
- HashBuckets: 4.10K (4096) | |
- LargestPartitionPercent: 0 (0) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.30 MB (2410624) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 4 (4) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 916.000ns | |
AGGREGATION_NODE (id=36):(Total: 13s612ms, non-child: 2.864ms, % non-child: 0.02%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1.151ms | |
- GetNewBlockTime: 196.156us | |
- GetResultsTime: 147.690us | |
- HTResizeTime: 740.979us | |
- HashBuckets: 32.77K (32768) | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.69 MB (2823492) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.10K (1097) | |
- RowsReturnedRate: 80.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 996.000ns | |
EXCHANGE_NODE (id=35):(Total: 13s609ms, non-child: 190.273us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 69.51 KB (71181) | |
- ConvertRowBatchTime: 45.897us | |
- DeserializeRowBatchTimer: 392.699us | |
- FirstBatchArrivalWaitTime: 13s593ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 1.10K (1097) | |
- RowsReturnedRate: 80.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:90 (host=cdh2.net.cuberonlabs.com:22000):(Total: 13s883ms, non-child: 8.754ms, % non-child: 0.06%) | |
MemoryUsage(500.000ms): 5.40 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 13.74 MB (14411849) | |
- PerHostPeakMemUsage: 1.74 GB (1866918022) | |
- RowsProduced: 5 (5) | |
- TotalNetworkReceiveTime: 13s581ms | |
- TotalNetworkSendTime: 256.612us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 1 (1) | |
- TotalThreadsTotalWallClockTime: 13s845ms | |
- TotalThreadsSysTime: 4.000ms | |
- TotalThreadsUserTime: 252.000ms | |
- TotalThreadsVoluntaryContextSwitches: 161 (161) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 3.524ms | |
- ExecTreeExecTime: 244.544us | |
- OpenTime: 13s841ms | |
- ExecTreeOpenTime: 13s599ms | |
- PrepareTime: 37.722ms | |
- ExecTreePrepareTime: 1.112ms | |
DataStreamSender (dst_id=37):(Total: 107.180us, non-child: 107.180us, % non-child: 100.00%) | |
- BytesSent: 228.00 B (228) | |
- NetworkThroughput(*): 4.01 MB/sec | |
- OverallThroughput: 2.03 MB/sec | |
- PeakMemoryUsage: 56.99 KB (58360) | |
- RowsReturned: 5 (5) | |
- SerializeBatchTime: 16.596us | |
- TransmitDataRPCTime: 54.288us | |
- UncompressedRowBatchSize: 380.00 B (380) | |
CodeGen:(Total: 273.326ms, non-child: 273.326ms, % non-child: 100.00%) | |
- CodegenTime: 4.245ms | |
- CompileTime: 81.004ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.52K (1523) | |
- OptimizationTime: 160.043ms | |
- PeakMemoryUsage: 761.50 KB (779776) | |
- PrepareTime: 31.470ms | |
AGGREGATION_NODE (id=12):(Total: 13s600ms, non-child: 4.211ms, % non-child: 0.03%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 2.570ms | |
- GetNewBlockTime: 149.896us | |
- GetResultsTime: 8.644us | |
- HTResizeTime: 166.784us | |
- HashBuckets: 6.14K (6144) | |
- LargestPartitionPercent: 0 (0) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.56 MB (2689152) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 5 (5) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 892.000ns | |
AGGREGATION_NODE (id=36):(Total: 13s596ms, non-child: 14.411ms, % non-child: 0.11%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 11.368ms | |
- GetNewBlockTime: 189.796us | |
- GetResultsTime: 1.263ms | |
- HTResizeTime: 3.971ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 11.19 MB (11735748) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 21.13K (21130) | |
- RowsReturnedRate: 1.55 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 952.000ns | |
EXCHANGE_NODE (id=35):(Total: 13s582ms, non-child: 1.386ms, % non-child: 0.01%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 1.15 MB (1204724) | |
- ConvertRowBatchTime: 473.332us | |
- DeserializeRowBatchTimer: 5.090ms | |
- FirstBatchArrivalWaitTime: 13s572ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 21.13K (21130) | |
- RowsReturnedRate: 1.55 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:97 (host=cdh11.net.cuberonlabs.com:22000):(Total: 13s882ms, non-child: 8.696ms, % non-child: 0.06%) | |
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 5.40 MB (5660408) | |
- PerHostPeakMemUsage: 1.48 GB (1591793359) | |
- RowsProduced: 1 (1) | |
- TotalNetworkReceiveTime: 13s639ms | |
- TotalNetworkSendTime: 237.962us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s846ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 204.000ms | |
- TotalThreadsVoluntaryContextSwitches: 49 (49) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 3.533ms | |
- ExecTreeExecTime: 122.911us | |
- OpenTime: 13s843ms | |
- ExecTreeOpenTime: 13s641ms | |
- PrepareTime: 35.769ms | |
- ExecTreePrepareTime: 1.210ms | |
DataStreamSender (dst_id=37):(Total: 96.748us, non-child: 96.748us, % non-child: 100.00%) | |
- BytesSent: 67.00 B (67) | |
- NetworkThroughput(*): 2.32 MB/sec | |
- OverallThroughput: 676.29 KB/sec | |
- PeakMemoryUsage: 56.99 KB (58360) | |
- RowsReturned: 1 (1) | |
- SerializeBatchTime: 29.650us | |
- TransmitDataRPCTime: 27.487us | |
- UncompressedRowBatchSize: 85.00 B (85) | |
CodeGen:(Total: 230.816ms, non-child: 230.816ms, % non-child: 100.00%) | |
- CodegenTime: 2.510ms | |
- CompileTime: 71.216ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.52K (1523) | |
- OptimizationTime: 129.548ms | |
- PeakMemoryUsage: 761.50 KB (779776) | |
- PrepareTime: 29.599ms | |
AGGREGATION_NODE (id=12):(Total: 13s643ms, non-child: 1.498ms, % non-child: 0.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 17.327us | |
- GetNewBlockTime: 151.591us | |
- GetResultsTime: 3.034us | |
- HTResizeTime: 6.464us | |
- HashBuckets: 1.02K (1024) | |
- LargestPartitionPercent: 100 (100) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.30 MB (2410624) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1 (1) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 852.000ns | |
AGGREGATION_NODE (id=36):(Total: 13s641ms, non-child: 1.940ms, % non-child: 0.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 11.892us | |
- GetNewBlockTime: 156.314us | |
- GetResultsTime: 929.000ns | |
- HTResizeTime: 4.189us | |
- HashBuckets: 1.02K (1024) | |
- LargestPartitionPercent: 100 (100) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.32 MB (2428032) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1 (1) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.012us | |
EXCHANGE_NODE (id=35):(Total: 13s639ms, non-child: 9.593us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 107.00 B (107) | |
- ConvertRowBatchTime: 651.000ns | |
- DeserializeRowBatchTimer: 11.520us | |
- FirstBatchArrivalWaitTime: 13s639ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 1 (1) | |
- RowsReturnedRate: 0 | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:96 (host=cdh8.net.cuberonlabs.com:22000):(Total: 13s882ms, non-child: 8.217ms, % non-child: 0.06%) | |
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 5.40 MB (5660408) | |
- PerHostPeakMemUsage: 1.63 GB (1748411303) | |
- RowsProduced: 2 (2) | |
- TotalNetworkReceiveTime: 13s594ms | |
- TotalNetworkSendTime: 275.496us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 1 (1) | |
- TotalThreadsTotalWallClockTime: 13s841ms | |
- TotalThreadsSysTime: 8.000ms | |
- TotalThreadsUserTime: 236.000ms | |
- TotalThreadsVoluntaryContextSwitches: 118 (118) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 3.549ms | |
- ExecTreeExecTime: 81.407us | |
- OpenTime: 13s838ms | |
- ExecTreeOpenTime: 13s597ms | |
- PrepareTime: 40.819ms | |
- ExecTreePrepareTime: 1.187ms | |
DataStreamSender (dst_id=37):(Total: 95.612us, non-child: 95.612us, % non-child: 100.00%) | |
- BytesSent: 110.00 B (110) | |
- NetworkThroughput(*): 3.79 MB/sec | |
- OverallThroughput: 1.10 MB/sec | |
- PeakMemoryUsage: 56.99 KB (58360) | |
- RowsReturned: 2 (2) | |
- SerializeBatchTime: 19.118us | |
- TransmitDataRPCTime: 27.675us | |
- UncompressedRowBatchSize: 157.00 B (157) | |
CodeGen:(Total: 275.628ms, non-child: 275.628ms, % non-child: 100.00%) | |
- CodegenTime: 4.009ms | |
- CompileTime: 78.155ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.52K (1523) | |
- OptimizationTime: 161.456ms | |
- PeakMemoryUsage: 761.50 KB (779776) | |
- PrepareTime: 35.313ms | |
AGGREGATION_NODE (id=12):(Total: 13s598ms, non-child: 1.445ms, % non-child: 0.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 181.688us | |
- GetNewBlockTime: 151.726us | |
- GetResultsTime: 2.816us | |
- HTResizeTime: 18.660us | |
- HashBuckets: 2.05K (2048) | |
- LargestPartitionPercent: 0 (0) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.30 MB (2410624) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2 (2) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 917.000ns | |
AGGREGATION_NODE (id=36):(Total: 13s597ms, non-child: 2.253ms, % non-child: 0.02%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 467.935us | |
- GetNewBlockTime: 163.420us | |
- GetResultsTime: 91.996us | |
- HTResizeTime: 2.725us | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.40 MB (2516241) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 763 (763) | |
- RowsReturnedRate: 56.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 992.000ns | |
EXCHANGE_NODE (id=35):(Total: 13s595ms, non-child: 164.028us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 47.11 KB (48245) | |
- ConvertRowBatchTime: 39.573us | |
- DeserializeRowBatchTimer: 312.286us | |
- FirstBatchArrivalWaitTime: 13s579ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 763 (763) | |
- RowsReturnedRate: 56.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:99 (host=cdh10.net.cuberonlabs.com:22000):(Total: 13s882ms, non-child: 7.702ms, % non-child: 0.06%) | |
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 5.40 MB (5660408) | |
- PerHostPeakMemUsage: 1.66 GB (1784016472) | |
- RowsProduced: 3 (3) | |
- TotalNetworkReceiveTime: 13s506ms | |
- TotalNetworkSendTime: 190.386us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 1 (1) | |
- TotalThreadsTotalWallClockTime: 13s846ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 332.000ms | |
- TotalThreadsVoluntaryContextSwitches: 163 (163) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 3.185ms | |
- ExecTreeExecTime: 185.458us | |
- OpenTime: 13s843ms | |
- ExecTreeOpenTime: 13s507ms | |
- PrepareTime: 35.549ms | |
- ExecTreePrepareTime: 1.143ms | |
DataStreamSender (dst_id=37):(Total: 77.089us, non-child: 77.089us, % non-child: 100.00%) | |
- BytesSent: 147.00 B (147) | |
- NetworkThroughput(*): 6.22 MB/sec | |
- OverallThroughput: 1.82 MB/sec | |
- PeakMemoryUsage: 56.99 KB (58360) | |
- RowsReturned: 3 (3) | |
- SerializeBatchTime: 20.542us | |
- TransmitDataRPCTime: 22.544us | |
- UncompressedRowBatchSize: 242.00 B (242) | |
CodeGen:(Total: 365.398ms, non-child: 365.398ms, % non-child: 100.00%) | |
- CodegenTime: 4.171ms | |
- CompileTime: 138.960ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.52K (1523) | |
- OptimizationTime: 195.694ms | |
- PeakMemoryUsage: 761.50 KB (779776) | |
- PrepareTime: 30.004ms | |
AGGREGATION_NODE (id=12):(Total: 13s509ms, non-child: 1.265ms, % non-child: 0.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 34.961us | |
- GetNewBlockTime: 147.273us | |
- GetResultsTime: 7.885us | |
- HTResizeTime: 9.716us | |
- HashBuckets: 3.07K (3072) | |
- LargestPartitionPercent: 2 (2) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.30 MB (2410624) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 3 (3) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 860.000ns | |
AGGREGATION_NODE (id=36):(Total: 13s507ms, non-child: 1.398ms, % non-child: 0.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 30.200us | |
- GetNewBlockTime: 160.463us | |
- GetResultsTime: 23.751us | |
- HTResizeTime: 2.989us | |
- HashBuckets: 15.36K (15360) | |
- LargestPartitionPercent: 16 (16) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.37 MB (2485376) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 36 (36) | |
- RowsReturnedRate: 2.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 907.000ns | |
EXCHANGE_NODE (id=35):(Total: 13s506ms, non-child: 102.741us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 2.89 KB (2960) | |
- ConvertRowBatchTime: 15.733us | |
- DeserializeRowBatchTimer: 108.245us | |
- FirstBatchArrivalWaitTime: 13s490ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 36 (36) | |
- RowsReturnedRate: 2.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:91 (host=cdh12.net.cuberonlabs.com:22000):(Total: 13s881ms, non-child: 8.793ms, % non-child: 0.06%) | |
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 5.40 MB (5660408) | |
- PerHostPeakMemUsage: 1.12 GB (1201773720) | |
- RowsProduced: 4 (4) | |
- TotalNetworkReceiveTime: 13s572ms | |
- TotalNetworkSendTime: 216.962us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 1 (1) | |
- TotalThreadsTotalWallClockTime: 13s841ms | |
- TotalThreadsSysTime: 4.000ms | |
- TotalThreadsUserTime: 264.000ms | |
- TotalThreadsVoluntaryContextSwitches: 124 (124) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2.944ms | |
- ExecTreeExecTime: 168.248us | |
- OpenTime: 13s838ms | |
- ExecTreeOpenTime: 13s576ms | |
- PrepareTime: 40.011ms | |
- ExecTreePrepareTime: 1.182ms | |
DataStreamSender (dst_id=37):(Total: 80.692us, non-child: 80.692us, % non-child: 100.00%) | |
- BytesSent: 188.00 B (188) | |
- NetworkThroughput(*): 8.64 MB/sec | |
- OverallThroughput: 2.22 MB/sec | |
- PeakMemoryUsage: 56.99 KB (58360) | |
- RowsReturned: 4 (4) | |
- SerializeBatchTime: 19.497us | |
- TransmitDataRPCTime: 20.748us | |
- UncompressedRowBatchSize: 323.00 B (323) | |
CodeGen:(Total: 294.492ms, non-child: 294.492ms, % non-child: 100.00%) | |
- CodegenTime: 5.458ms | |
- CompileTime: 88.551ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.52K (1523) | |
- OptimizationTime: 171.669ms | |
- PeakMemoryUsage: 761.50 KB (779776) | |
- PrepareTime: 33.334ms | |
AGGREGATION_NODE (id=12):(Total: 13s578ms, non-child: 1.539ms, % non-child: 0.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 112.393us | |
- GetNewBlockTime: 160.937us | |
- GetResultsTime: 8.116us | |
- HTResizeTime: 17.632us | |
- HashBuckets: 4.10K (4096) | |
- LargestPartitionPercent: 0 (0) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.30 MB (2410624) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 4 (4) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 914.000ns | |
AGGREGATION_NODE (id=36):(Total: 13s576ms, non-child: 4.215ms, % non-child: 0.03%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 146.806us | |
- GetNewBlockTime: 159.658us | |
- GetResultsTime: 79.354us | |
- HTResizeTime: 3.427us | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 9 (9) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.38 MB (2493568) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 331 (331) | |
- RowsReturnedRate: 24.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 983.000ns | |
EXCHANGE_NODE (id=35):(Total: 13s572ms, non-child: 118.259us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 21.32 KB (21832) | |
- ConvertRowBatchTime: 26.232us | |
- DeserializeRowBatchTimer: 164.881us | |
- FirstBatchArrivalWaitTime: 13s556ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 331 (331) | |
- RowsReturnedRate: 24.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:92 (host=cdh14.net.cuberonlabs.com:22000):(Total: 13s881ms, non-child: 9.063ms, % non-child: 0.07%) | |
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.97 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 5.40 MB (5660408) | |
- PerHostPeakMemUsage: 1.44 GB (1548652528) | |
- RowsProduced: 1 (1) | |
- TotalNetworkReceiveTime: 13s550ms | |
- TotalNetworkSendTime: 286.486us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 3 (3) | |
- TotalThreadsTotalWallClockTime: 13s840ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 288.000ms | |
- TotalThreadsVoluntaryContextSwitches: 80 (80) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 3.424ms | |
- ExecTreeExecTime: 123.922us | |
- OpenTime: 13s837ms | |
- ExecTreeOpenTime: 13s555ms | |
- PrepareTime: 40.369ms | |
- ExecTreePrepareTime: 1.193ms | |
DataStreamSender (dst_id=37):(Total: 177.401us, non-child: 177.401us, % non-child: 100.00%) | |
- BytesSent: 64.00 B (64) | |
- NetworkThroughput(*): 537.57 KB/sec | |
- OverallThroughput: 352.31 KB/sec | |
- PeakMemoryUsage: 56.99 KB (58360) | |
- RowsReturned: 1 (1) | |
- SerializeBatchTime: 15.842us | |
- TransmitDataRPCTime: 116.264us | |
- UncompressedRowBatchSize: 83.00 B (83) | |
CodeGen:(Total: 315.092ms, non-child: 315.092ms, % non-child: 100.00%) | |
- CodegenTime: 5.020ms | |
- CompileTime: 110.489ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.52K (1523) | |
- OptimizationTime: 169.851ms | |
- PeakMemoryUsage: 761.50 KB (779776) | |
- PrepareTime: 33.917ms | |
AGGREGATION_NODE (id=12):(Total: 13s556ms, non-child: 2.310ms, % non-child: 0.02%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 680.135us | |
- GetNewBlockTime: 160.458us | |
- GetResultsTime: 2.003us | |
- HTResizeTime: 23.624us | |
- HashBuckets: 1.02K (1024) | |
- LargestPartitionPercent: 0 (0) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.30 MB (2410624) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1 (1) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 912.000ns | |
AGGREGATION_NODE (id=36):(Total: 13s554ms, non-child: 4.292ms, % non-child: 0.03%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 2.291ms | |
- GetNewBlockTime: 169.494us | |
- GetResultsTime: 283.952us | |
- HTResizeTime: 858.850us | |
- HashBuckets: 32.77K (32768) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.68 MB (2814600) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 3.68K (3678) | |
- RowsReturnedRate: 271.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 948.000ns | |
EXCHANGE_NODE (id=35):(Total: 13s550ms, non-child: 260.783us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 141.58 KB | |
- BytesReceived: 220.51 KB (225807) | |
- ConvertRowBatchTime: 101.429us | |
- DeserializeRowBatchTimer: 892.049us | |
- FirstBatchArrivalWaitTime: 13s536ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 3.68K (3678) | |
- RowsReturnedRate: 271.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:93 (host=cdh1.net.cuberonlabs.com:22000):(Total: 13s881ms, non-child: 16.344ms, % non-child: 0.12%) | |
MemoryUsage(500.000ms): 5.40 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 5.40 MB (5660408) | |
- PerHostPeakMemUsage: 1.81 GB (1939587581) | |
- RowsProduced: 6 (6) | |
- TotalNetworkReceiveTime: 13s574ms | |
- TotalNetworkSendTime: 243.892us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 2 (2) | |
- TotalThreadsTotalWallClockTime: 13s830ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 252.000ms | |
- TotalThreadsVoluntaryContextSwitches: 143 (143) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 3.211ms | |
- ExecTreeExecTime: 222.648us | |
- OpenTime: 13s827ms | |
- ExecTreeOpenTime: 13s579ms | |
- PrepareTime: 50.194ms | |
- ExecTreePrepareTime: 2.042ms | |
DataStreamSender (dst_id=37):(Total: 100.024us, non-child: 100.024us, % non-child: 100.00%) | |
- BytesSent: 255.00 B (255) | |
- NetworkThroughput(*): 7.74 MB/sec | |
- OverallThroughput: 2.43 MB/sec | |
- PeakMemoryUsage: 56.99 KB (58360) | |
- RowsReturned: 6 (6) | |
- SerializeBatchTime: 14.572us | |
- TransmitDataRPCTime: 31.416us | |
- UncompressedRowBatchSize: 466.00 B (466) | |
CodeGen:(Total: 283.316ms, non-child: 283.316ms, % non-child: 100.00%) | |
- CodegenTime: 6.212ms | |
- CompileTime: 78.461ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.52K (1523) | |
- OptimizationTime: 166.174ms | |
- PeakMemoryUsage: 761.50 KB (779776) | |
- PrepareTime: 37.370ms | |
AGGREGATION_NODE (id=12):(Total: 13s581ms, non-child: 2.573ms, % non-child: 0.02%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 666.564us | |
- GetNewBlockTime: 266.324us | |
- GetResultsTime: 11.796us | |
- HTResizeTime: 19.668us | |
- HashBuckets: 5.12K (5120) | |
- LargestPartitionPercent: 0 (0) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.30 MB (2410624) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 6 (6) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 948.000ns | |
AGGREGATION_NODE (id=36):(Total: 13s578ms, non-child: 4.202ms, % non-child: 0.03%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 2.095ms | |
- GetNewBlockTime: 392.116us | |
- GetResultsTime: 323.536us | |
- HTResizeTime: 497.768us | |
- HashBuckets: 32.77K (32768) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.69 MB (2818297) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 4.25K (4250) | |
- RowsReturnedRate: 312.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.016us | |
EXCHANGE_NODE (id=35):(Total: 13s574ms, non-child: 193.532us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 245.20 KB (251084) | |
- ConvertRowBatchTime: 100.500us | |
- DeserializeRowBatchTimer: 939.728us | |
- FirstBatchArrivalWaitTime: 13s560ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.25K (4250) | |
- RowsReturnedRate: 313.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:95 (host=cdh7.net.cuberonlabs.com:22000):(Total: 13s881ms, non-child: 7.566ms, % non-child: 0.05%) | |
MemoryUsage(500.000ms): 5.40 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 5.40 MB (5660408) | |
- PerHostPeakMemUsage: 1.58 GB (1699637471) | |
- RowsProduced: 3 (3) | |
- TotalNetworkReceiveTime: 13s622ms | |
- TotalNetworkSendTime: 248.472us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s846ms | |
- TotalThreadsSysTime: 8.000ms | |
- TotalThreadsUserTime: 216.000ms | |
- TotalThreadsVoluntaryContextSwitches: 77 (77) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 3.137ms | |
- ExecTreeExecTime: 136.549us | |
- OpenTime: 13s843ms | |
- ExecTreeOpenTime: 13s624ms | |
- PrepareTime: 34.345ms | |
- ExecTreePrepareTime: 1.126ms | |
DataStreamSender (dst_id=37):(Total: 90.547us, non-child: 90.547us, % non-child: 100.00%) | |
- BytesSent: 170.00 B (170) | |
- NetworkThroughput(*): 5.93 MB/sec | |
- OverallThroughput: 1.79 MB/sec | |
- PeakMemoryUsage: 56.99 KB (58360) | |
- RowsReturned: 3 (3) | |
- SerializeBatchTime: 18.963us | |
- TransmitDataRPCTime: 27.324us | |
- UncompressedRowBatchSize: 246.00 B (246) | |
CodeGen:(Total: 247.421ms, non-child: 247.421ms, % non-child: 100.00%) | |
- CodegenTime: 3.932ms | |
- CompileTime: 74.371ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.52K (1523) | |
- OptimizationTime: 143.416ms | |
- PeakMemoryUsage: 761.50 KB (779776) | |
- PrepareTime: 28.784ms | |
AGGREGATION_NODE (id=12):(Total: 13s625ms, non-child: 1.316ms, % non-child: 0.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 77.969us | |
- GetNewBlockTime: 144.905us | |
- GetResultsTime: 5.336us | |
- HTResizeTime: 19.932us | |
- HashBuckets: 3.07K (3072) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.30 MB (2410624) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 3 (3) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 855.000ns | |
AGGREGATION_NODE (id=36):(Total: 13s624ms, non-child: 1.816ms, % non-child: 0.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 44.147us | |
- GetNewBlockTime: 152.022us | |
- GetResultsTime: 62.466us | |
- HTResizeTime: 3.589us | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 9 (9) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.38 MB (2493568) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 62 (62) | |
- RowsReturnedRate: 4.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 906.000ns | |
EXCHANGE_NODE (id=35):(Total: 13s622ms, non-child: 102.849us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 5.15 KB (5272) | |
- ConvertRowBatchTime: 18.121us | |
- DeserializeRowBatchTimer: 128.354us | |
- FirstBatchArrivalWaitTime: 13s607ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 62 (62) | |
- RowsReturnedRate: 4.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:94 (host=cdh5.net.cuberonlabs.com:22000):(Total: 13s880ms, non-child: 6.809ms, % non-child: 0.05%) | |
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.71 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 5.40 MB (5660408) | |
- PerHostPeakMemUsage: 2.15 GB (2303708143) | |
- RowsProduced: 2 (2) | |
- TotalNetworkReceiveTime: 13s673ms | |
- TotalNetworkSendTime: 178.928us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s861ms | |
- TotalThreadsSysTime: 12.000ms | |
- TotalThreadsUserTime: 176.000ms | |
- TotalThreadsVoluntaryContextSwitches: 68 (68) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 3.226ms | |
- ExecTreeExecTime: 69.304us | |
- OpenTime: 13s858ms | |
- ExecTreeOpenTime: 13s675ms | |
- PrepareTime: 19.093ms | |
- ExecTreePrepareTime: 1.183ms | |
DataStreamSender (dst_id=37):(Total: 74.508us, non-child: 74.508us, % non-child: 100.00%) | |
- BytesSent: 127.00 B (127) | |
- NetworkThroughput(*): 4.30 MB/sec | |
- OverallThroughput: 1.63 MB/sec | |
- PeakMemoryUsage: 56.99 KB (58360) | |
- RowsReturned: 2 (2) | |
- SerializeBatchTime: 22.064us | |
- TransmitDataRPCTime: 28.184us | |
- UncompressedRowBatchSize: 173.00 B (173) | |
CodeGen:(Total: 197.430ms, non-child: 197.430ms, % non-child: 100.00%) | |
- CodegenTime: 2.370ms | |
- CompileTime: 62.005ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.52K (1523) | |
- OptimizationTime: 120.517ms | |
- PeakMemoryUsage: 761.50 KB (779776) | |
- PrepareTime: 14.422ms | |
AGGREGATION_NODE (id=12):(Total: 13s676ms, non-child: 1.251ms, % non-child: 0.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 62.580us | |
- GetNewBlockTime: 160.500us | |
- GetResultsTime: 2.232us | |
- HTResizeTime: 16.648us | |
- HashBuckets: 1.02K (1024) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.30 MB (2410624) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2 (2) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 988.000ns | |
AGGREGATION_NODE (id=36):(Total: 13s675ms, non-child: 1.975ms, % non-child: 0.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 59.964us | |
- GetNewBlockTime: 163.332us | |
- GetResultsTime: 46.120us | |
- HTResizeTime: 3.524us | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 11 (11) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.38 MB (2493568) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 126 (126) | |
- RowsReturnedRate: 9.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.024us | |
EXCHANGE_NODE (id=35):(Total: 13s673ms, non-child: 111.828us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.96 KB | |
- BytesReceived: 9.08 KB (9300) | |
- ConvertRowBatchTime: 20.876us | |
- DeserializeRowBatchTimer: 131.044us | |
- FirstBatchArrivalWaitTime: 13s657ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 126 (126) | |
- RowsReturnedRate: 9.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:89 (host=cdh4.net.cuberonlabs.com:22000):(Total: 13s880ms, non-child: 8.192ms, % non-child: 0.06%) | |
MemoryUsage(500.000ms): 4.65 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 5.40 MB (5660408) | |
- PerHostPeakMemUsage: 2.13 GB (2284202661) | |
- RowsProduced: 2 (2) | |
- TotalNetworkReceiveTime: 13s563ms | |
- TotalNetworkSendTime: 201.208us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s845ms | |
- TotalThreadsSysTime: 20.000ms | |
- TotalThreadsUserTime: 260.000ms | |
- TotalThreadsVoluntaryContextSwitches: 120 (120) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 3.667ms | |
- ExecTreeExecTime: 108.668us | |
- OpenTime: 13s841ms | |
- ExecTreeOpenTime: 13s571ms | |
- PrepareTime: 35.043ms | |
- ExecTreePrepareTime: 1.133ms | |
DataStreamSender (dst_id=37):(Total: 89.264us, non-child: 89.264us, % non-child: 100.00%) | |
- BytesSent: 113.00 B (113) | |
- NetworkThroughput(*): 3.91 MB/sec | |
- OverallThroughput: 1.21 MB/sec | |
- PeakMemoryUsage: 56.99 KB (58360) | |
- RowsReturned: 2 (2) | |
- SerializeBatchTime: 24.512us | |
- TransmitDataRPCTime: 27.560us | |
- UncompressedRowBatchSize: 159.00 B (159) | |
CodeGen:(Total: 299.754ms, non-child: 299.754ms, % non-child: 100.00%) | |
- CodegenTime: 3.957ms | |
- CompileTime: 86.357ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.52K (1523) | |
- OptimizationTime: 182.807ms | |
- PeakMemoryUsage: 761.50 KB (779776) | |
- PrepareTime: 29.826ms | |
AGGREGATION_NODE (id=12):(Total: 13s572ms, non-child: 1.771ms, % non-child: 0.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 353.928us | |
- GetNewBlockTime: 155.068us | |
- GetResultsTime: 2.836us | |
- HTResizeTime: 40.332us | |
- HashBuckets: 2.05K (2048) | |
- LargestPartitionPercent: 0 (0) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.30 MB (2410624) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2 (2) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 884.000ns | |
AGGREGATION_NODE (id=36):(Total: 13s570ms, non-child: 6.859ms, % non-child: 0.05%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1.255ms | |
- GetNewBlockTime: 158.952us | |
- GetResultsTime: 194.656us | |
- HTResizeTime: 564.256us | |
- HashBuckets: 32.77K (32768) | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.69 MB (2825783) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.46K (1455) | |
- RowsReturnedRate: 107.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 980.000ns | |
EXCHANGE_NODE (id=35):(Total: 13s563ms, non-child: 167.612us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 89.46 KB (91604) | |
- ConvertRowBatchTime: 62.008us | |
- DeserializeRowBatchTimer: 427.780us | |
- FirstBatchArrivalWaitTime: 13s548ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 1.46K (1455) | |
- RowsReturnedRate: 107.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:8d (host=cdh15.net.cuberonlabs.com:22000):(Total: 13s878ms, non-child: 8.438ms, % non-child: 0.06%) | |
MemoryUsage(500.000ms): 5.40 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 5.40 MB (5660408) | |
- PerHostPeakMemUsage: 1.57 GB (1688553772) | |
- RowsProduced: 4 (4) | |
- TotalNetworkReceiveTime: 13s613ms | |
- TotalNetworkSendTime: 284.353us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s843ms | |
- TotalThreadsSysTime: 12.000ms | |
- TotalThreadsUserTime: 216.000ms | |
- TotalThreadsVoluntaryContextSwitches: 89 (89) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 3.579ms | |
- ExecTreeExecTime: 127.782us | |
- OpenTime: 13s839ms | |
- ExecTreeOpenTime: 13s616ms | |
- PrepareTime: 35.455ms | |
- ExecTreePrepareTime: 1.220ms | |
DataStreamSender (dst_id=37):(Total: 104.800us, non-child: 104.800us, % non-child: 100.00%) | |
- BytesSent: 206.00 B (206) | |
- NetworkThroughput(*): 3.98 MB/sec | |
- OverallThroughput: 1.87 MB/sec | |
- PeakMemoryUsage: 56.99 KB (58360) | |
- RowsReturned: 4 (4) | |
- SerializeBatchTime: 16.090us | |
- TransmitDataRPCTime: 49.313us | |
- UncompressedRowBatchSize: 334.00 B (334) | |
CodeGen:(Total: 252.746ms, non-child: 252.746ms, % non-child: 100.00%) | |
- CodegenTime: 4.026ms | |
- CompileTime: 72.621ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.52K (1523) | |
- OptimizationTime: 149.796ms | |
- PeakMemoryUsage: 761.50 KB (779776) | |
- PrepareTime: 29.653ms | |
AGGREGATION_NODE (id=12):(Total: 13s617ms, non-child: 1.338ms, % non-child: 0.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 119.455us | |
- GetNewBlockTime: 143.159us | |
- GetResultsTime: 9.015us | |
- HTResizeTime: 18.597us | |
- HashBuckets: 3.07K (3072) | |
- LargestPartitionPercent: 0 (0) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.30 MB (2410624) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 4 (4) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 838.000ns | |
AGGREGATION_NODE (id=36):(Total: 13s616ms, non-child: 2.595ms, % non-child: 0.02%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 136.495us | |
- GetNewBlockTime: 158.426us | |
- GetResultsTime: 84.000us | |
- HTResizeTime: 2.738us | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 8 (8) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.38 MB (2493568) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 362 (362) | |
- RowsReturnedRate: 26.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.322us | |
EXCHANGE_NODE (id=35):(Total: 13s613ms, non-child: 122.236us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 24.04 KB (24613) | |
- ConvertRowBatchTime: 31.311us | |
- DeserializeRowBatchTimer: 199.540us | |
- FirstBatchArrivalWaitTime: 13s597ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 362 (362) | |
- RowsReturnedRate: 26.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:8f (host=cdh17.net.cuberonlabs.com:22000):(Total: 13s878ms, non-child: 8.312ms, % non-child: 0.06%) | |
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 5.40 MB (5660408) | |
- PerHostPeakMemUsage: 1.75 GB (1879028559) | |
- RowsProduced: 3 (3) | |
- TotalNetworkReceiveTime: 13s604ms | |
- TotalNetworkSendTime: 256.079us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s840ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 232.000ms | |
- TotalThreadsVoluntaryContextSwitches: 66 (66) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 3.402ms | |
- ExecTreeExecTime: 131.973us | |
- OpenTime: 13s837ms | |
- ExecTreeOpenTime: 13s606ms | |
- PrepareTime: 38.317ms | |
- ExecTreePrepareTime: 1.470ms | |
DataStreamSender (dst_id=37):(Total: 121.523us, non-child: 121.523us, % non-child: 100.00%) | |
- BytesSent: 149.00 B (149) | |
- NetworkThroughput(*): 2.80 MB/sec | |
- OverallThroughput: 1.17 MB/sec | |
- PeakMemoryUsage: 56.99 KB (58360) | |
- RowsReturned: 3 (3) | |
- SerializeBatchTime: 25.783us | |
- TransmitDataRPCTime: 50.734us | |
- UncompressedRowBatchSize: 247.00 B (247) | |
CodeGen:(Total: 261.866ms, non-child: 261.866ms, % non-child: 100.00%) | |
- CodegenTime: 4.491ms | |
- CompileTime: 69.562ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.52K (1523) | |
- OptimizationTime: 159.521ms | |
- PeakMemoryUsage: 761.50 KB (779776) | |
- PrepareTime: 32.042ms | |
AGGREGATION_NODE (id=12):(Total: 13s608ms, non-child: 1.663ms, % non-child: 0.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 162.576us | |
- GetNewBlockTime: 193.587us | |
- GetResultsTime: 8.575us | |
- HTResizeTime: 15.851us | |
- HashBuckets: 3.07K (3072) | |
- LargestPartitionPercent: 0 (0) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.30 MB (2410624) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 3 (3) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 909.000ns | |
AGGREGATION_NODE (id=36):(Total: 13s606ms, non-child: 2.609ms, % non-child: 0.02%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 973.775us | |
- GetNewBlockTime: 172.046us | |
- GetResultsTime: 105.891us | |
- HTResizeTime: 445.566us | |
- HashBuckets: 32.77K (32768) | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.68 MB (2809307) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 883 (883) | |
- RowsReturnedRate: 64.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 998.000ns | |
EXCHANGE_NODE (id=35):(Total: 13s604ms, non-child: 213.183us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 56.00 KB (57342) | |
- ConvertRowBatchTime: 55.169us | |
- DeserializeRowBatchTimer: 2.297ms | |
- FirstBatchArrivalWaitTime: 13s588ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 883 (883) | |
- RowsReturnedRate: 64.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:8c (host=cdh6.net.cuberonlabs.com:22000):(Total: 13s878ms, non-child: 7.805ms, % non-child: 0.06%) | |
MemoryUsage(500.000ms): 5.40 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 5.40 MB (5660408) | |
- PerHostPeakMemUsage: 1.67 GB (1794839264) | |
- RowsProduced: 2 (2) | |
- TotalNetworkReceiveTime: 13s573ms | |
- TotalNetworkSendTime: 162.608us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s840ms | |
- TotalThreadsSysTime: 4.000ms | |
- TotalThreadsUserTime: 264.000ms | |
- TotalThreadsVoluntaryContextSwitches: 75 (75) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2.785ms | |
- ExecTreeExecTime: 93.556us | |
- OpenTime: 13s838ms | |
- ExecTreeOpenTime: 13s576ms | |
- PrepareTime: 37.561ms | |
- ExecTreePrepareTime: 1.236ms | |
DataStreamSender (dst_id=37):(Total: 104.728us, non-child: 104.728us, % non-child: 100.00%) | |
- BytesSent: 123.00 B (123) | |
- NetworkThroughput(*): 3.53 MB/sec | |
- OverallThroughput: 1.12 MB/sec | |
- PeakMemoryUsage: 56.99 KB (58360) | |
- RowsReturned: 2 (2) | |
- SerializeBatchTime: 28.968us | |
- TransmitDataRPCTime: 33.184us | |
- UncompressedRowBatchSize: 169.00 B (169) | |
CodeGen:(Total: 292.623ms, non-child: 292.623ms, % non-child: 100.00%) | |
- CodegenTime: 4.257ms | |
- CompileTime: 91.739ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.52K (1523) | |
- OptimizationTime: 168.706ms | |
- PeakMemoryUsage: 761.50 KB (779776) | |
- PrepareTime: 31.378ms | |
AGGREGATION_NODE (id=12):(Total: 13s578ms, non-child: 1.463ms, % non-child: 0.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 66.856us | |
- GetNewBlockTime: 164.044us | |
- GetResultsTime: 2.896us | |
- HTResizeTime: 17.568us | |
- HashBuckets: 2.05K (2048) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.30 MB (2410624) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2 (2) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 984.000ns | |
AGGREGATION_NODE (id=36):(Total: 13s576ms, non-child: 3.369ms, % non-child: 0.02%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 58.984us | |
- GetNewBlockTime: 169.364us | |
- GetResultsTime: 60.196us | |
- HTResizeTime: 3.728us | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 11 (11) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.38 MB (2493568) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 98 (98) | |
- RowsReturnedRate: 7.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.008us | |
EXCHANGE_NODE (id=35):(Total: 13s573ms, non-child: 141.024us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 6.80 KB (6962) | |
- ConvertRowBatchTime: 20.588us | |
- DeserializeRowBatchTimer: 134.564us | |
- FirstBatchArrivalWaitTime: 13s557ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 98 (98) | |
- RowsReturnedRate: 7.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:8e (host=cdh3.net.cuberonlabs.com:22000):(Total: 13s878ms, non-child: 8.430ms, % non-child: 0.06%) | |
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.67 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 5.40 MB (5660408) | |
- PerHostPeakMemUsage: 2.16 GB (2318232477) | |
- RowsProduced: 1 (1) | |
- TotalNetworkReceiveTime: 13s570ms | |
- TotalNetworkSendTime: 311.624us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 2 (2) | |
- TotalThreadsTotalWallClockTime: 13s844ms | |
- TotalThreadsSysTime: 4.000ms | |
- TotalThreadsUserTime: 264.000ms | |
- TotalThreadsVoluntaryContextSwitches: 74 (74) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 3.517ms | |
- ExecTreeExecTime: 112.248us | |
- OpenTime: 13s840ms | |
- ExecTreeOpenTime: 13s573ms | |
- PrepareTime: 34.242ms | |
- ExecTreePrepareTime: 1.250ms | |
DataStreamSender (dst_id=37):(Total: 79.460us, non-child: 79.460us, % non-child: 100.00%) | |
- BytesSent: 71.00 B (71) | |
- NetworkThroughput(*): 4.04 MB/sec | |
- OverallThroughput: 872.59 KB/sec | |
- PeakMemoryUsage: 56.99 KB (58360) | |
- RowsReturned: 1 (1) | |
- SerializeBatchTime: 25.200us | |
- TransmitDataRPCTime: 16.776us | |
- UncompressedRowBatchSize: 87.00 B (87) | |
CodeGen:(Total: 295.347ms, non-child: 295.347ms, % non-child: 100.00%) | |
- CodegenTime: 4.187ms | |
- CompileTime: 89.712ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.52K (1523) | |
- OptimizationTime: 176.178ms | |
- PeakMemoryUsage: 761.50 KB (779776) | |
- PrepareTime: 28.739ms | |
AGGREGATION_NODE (id=12):(Total: 13s574ms, non-child: 1.784ms, % non-child: 0.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 20.980us | |
- GetNewBlockTime: 163.308us | |
- GetResultsTime: 2.660us | |
- HTResizeTime: 7.712us | |
- HashBuckets: 1.02K (1024) | |
- LargestPartitionPercent: 20 (20) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.30 MB (2410624) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1 (1) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 932.000ns | |
AGGREGATION_NODE (id=36):(Total: 13s572ms, non-child: 1.874ms, % non-child: 0.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 18.284us | |
- GetNewBlockTime: 163.352us | |
- GetResultsTime: 13.048us | |
- HTResizeTime: 3.492us | |
- HashBuckets: 5.12K (5120) | |
- LargestPartitionPercent: 20 (20) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.33 MB (2444416) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 5 (5) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.036us | |
EXCHANGE_NODE (id=35):(Total: 13s570ms, non-child: 39.772us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 111.00 B | |
- BytesReceived: 555.00 B (555) | |
- ConvertRowBatchTime: 5.684us | |
- DeserializeRowBatchTimer: 24.192us | |
- FirstBatchArrivalWaitTime: 13s557ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 5 (5) | |
- RowsReturnedRate: 0 | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:8b (host=cdh13.net.cuberonlabs.com:22000):(Total: 13s877ms, non-child: 8.107ms, % non-child: 0.06%) | |
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.78 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 5.40 MB (5660408) | |
- PerHostPeakMemUsage: 1.66 GB (1782381748) | |
- RowsProduced: 6 (6) | |
- TotalNetworkReceiveTime: 13s607ms | |
- TotalNetworkSendTime: 321.986us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 1 (1) | |
- TotalThreadsTotalWallClockTime: 13s841ms | |
- TotalThreadsSysTime: 8.000ms | |
- TotalThreadsUserTime: 224.000ms | |
- TotalThreadsVoluntaryContextSwitches: 81 (81) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 3.227ms | |
- ExecTreeExecTime: 245.903us | |
- OpenTime: 13s838ms | |
- ExecTreeOpenTime: 13s611ms | |
- PrepareTime: 35.911ms | |
- ExecTreePrepareTime: 1.237ms | |
DataStreamSender (dst_id=37):(Total: 82.623us, non-child: 82.623us, % non-child: 100.00%) | |
- BytesSent: 272.00 B (272) | |
- NetworkThroughput(*): 8.62 MB/sec | |
- OverallThroughput: 3.14 MB/sec | |
- PeakMemoryUsage: 56.99 KB (58360) | |
- RowsReturned: 6 (6) | |
- SerializeBatchTime: 17.147us | |
- TransmitDataRPCTime: 30.100us | |
- UncompressedRowBatchSize: 477.00 B (477) | |
CodeGen:(Total: 256.069ms, non-child: 256.069ms, % non-child: 100.00%) | |
- CodegenTime: 4.144ms | |
- CompileTime: 75.788ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.52K (1523) | |
- OptimizationTime: 149.689ms | |
- PeakMemoryUsage: 761.50 KB (779776) | |
- PrepareTime: 29.903ms | |
AGGREGATION_NODE (id=12):(Total: 13s612ms, non-child: 1.772ms, % non-child: 0.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 286.830us | |
- GetNewBlockTime: 163.400us | |
- GetResultsTime: 9.966us | |
- HTResizeTime: 17.858us | |
- HashBuckets: 5.12K (5120) | |
- LargestPartitionPercent: 0 (0) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.30 MB (2410624) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 6 (6) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 976.000ns | |
AGGREGATION_NODE (id=36):(Total: 13s611ms, non-child: 3.193ms, % non-child: 0.02%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1.506ms | |
- GetNewBlockTime: 158.182us | |
- GetResultsTime: 149.138us | |
- HTResizeTime: 953.867us | |
- HashBuckets: 32.77K (32768) | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.69 MB (2825090) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.37K (1367) | |
- RowsReturnedRate: 100.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 910.000ns | |
EXCHANGE_NODE (id=35):(Total: 13s607ms, non-child: 132.529us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 59.79 KB | |
- BytesReceived: 87.04 KB (89127) | |
- ConvertRowBatchTime: 53.813us | |
- DeserializeRowBatchTimer: 381.546us | |
- FirstBatchArrivalWaitTime: 13s593ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 1.37K (1367) | |
- RowsReturnedRate: 100.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:8a (host=cdh16.net.cuberonlabs.com:22000):(Total: 13s877ms, non-child: 9.872ms, % non-child: 0.07%) | |
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 5.40 MB (5660408) | |
- PerHostPeakMemUsage: 1.64 GB (1763578733) | |
- RowsProduced: 3 (3) | |
- TotalNetworkReceiveTime: 13s566ms | |
- TotalNetworkSendTime: 317.163us | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 13s820ms | |
- TotalThreadsSysTime: 8.000ms | |
- TotalThreadsUserTime: 244.000ms | |
- TotalThreadsVoluntaryContextSwitches: 151 (151) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 3.503ms | |
- ExecTreeExecTime: 240.713us | |
- OpenTime: 13s816ms | |
- ExecTreeOpenTime: 13s568ms | |
- PrepareTime: 56.961ms | |
- ExecTreePrepareTime: 1.219ms | |
DataStreamSender (dst_id=37):(Total: 87.999us, non-child: 87.999us, % non-child: 100.00%) | |
- BytesSent: 150.00 B (150) | |
- NetworkThroughput(*): 6.42 MB/sec | |
- OverallThroughput: 1.63 MB/sec | |
- PeakMemoryUsage: 56.99 KB (58360) | |
- RowsReturned: 3 (3) | |
- SerializeBatchTime: 21.613us | |
- TransmitDataRPCTime: 22.269us | |
- UncompressedRowBatchSize: 231.00 B (231) | |
CodeGen:(Total: 297.186ms, non-child: 297.186ms, % non-child: 100.00%) | |
- CodegenTime: 6.129ms | |
- CompileTime: 75.215ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.52K (1523) | |
- OptimizationTime: 171.379ms | |
- PeakMemoryUsage: 761.50 KB (779776) | |
- PrepareTime: 49.513ms | |
AGGREGATION_NODE (id=12):(Total: 13s569ms, non-child: 1.603ms, % non-child: 0.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 98.865us | |
- GetNewBlockTime: 163.088us | |
- GetResultsTime: 4.814us | |
- HTResizeTime: 19.364us | |
- HashBuckets: 3.07K (3072) | |
- LargestPartitionPercent: 0 (0) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.30 MB (2410624) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 3 (3) | |
- RowsReturnedRate: 0 | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 918.000ns | |
AGGREGATION_NODE (id=36):(Total: 13s568ms, non-child: 2.117ms, % non-child: 0.02%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 102.335us | |
- GetNewBlockTime: 178.047us | |
- GetResultsTime: 73.086us | |
- HTResizeTime: 3.082us | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 8 (8) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 2.38 MB (2493568) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 207 (207) | |
- RowsReturnedRate: 15.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 982.000ns | |
EXCHANGE_NODE (id=35):(Total: 13s566ms, non-child: 119.547us, % non-child: 0.00%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 13.91 KB (14242) | |
- ConvertRowBatchTime: 24.881us | |
- DeserializeRowBatchTimer: 155.148us | |
- FirstBatchArrivalWaitTime: 13s550ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 207 (207) | |
- RowsReturnedRate: 15.00 /sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Averaged Fragment F03:(Total: 13s868ms, non-child: 27.780ms, % non-child: 0.20%) | |
split sizes: min: 0, max: 0, avg: 0, stddev: 0 | |
completion times: min:13s865ms max:13s877ms mean: 13s870ms stddev:4.933ms | |
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec | |
num instances: 17 | |
- AverageThreadTokens: 1.93 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 599.33 MB (628440875) | |
- PerHostPeakMemUsage: 1.70 GB (1824024877) | |
- RowsProduced: 2.11K (2108) | |
- TotalNetworkReceiveTime: 16s844ms | |
- TotalNetworkSendTime: 6.175ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 28 (28) | |
- TotalThreadsTotalWallClockTime: 26s633ms | |
- TotalThreadsSysTime: 518.352ms | |
- TotalThreadsUserTime: 5s393ms | |
- TotalThreadsVoluntaryContextSwitches: 7.79K (7794) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s074ms | |
- ExecTreeExecTime: 2s062ms | |
- OpenTime: 11s739ms | |
- ExecTreeOpenTime: 10s800ms | |
- PrepareTime: 54.508ms | |
- ExecTreePrepareTime: 2.257ms | |
DataStreamSender (dst_id=35):(Total: 3.185ms, non-child: 3.185ms, % non-child: 100.00%) | |
- BytesSent: 122.07 KB (124997) | |
- NetworkThroughput(*): 135.20 MB/sec | |
- OverallThroughput: 42.46 MB/sec | |
- PeakMemoryUsage: 293.54 KB (300580) | |
- RowsReturned: 2.11K (2108) | |
- SerializeBatchTime: 1.662ms | |
- TransmitDataRPCTime: 1.472ms | |
- UncompressedRowBatchSize: 234.05 KB (239667) | |
CodeGen:(Total: 972.289ms, non-child: 972.289ms, % non-child: 100.00%) | |
- CodegenTime: 7.651ms | |
- CompileTime: 286.241ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 142 (142) | |
- NumInstructions: 7.08K (7077) | |
- OptimizationTime: 650.888ms | |
- PeakMemoryUsage: 3.46 MB (3623424) | |
- PrepareTime: 34.391ms | |
AGGREGATION_NODE (id=11):(Total: 12s865ms, non-child: 71.502ms, % non-child: 0.56%) | |
- GetNewBlockTime: 77.200us | |
- GetResultsTime: 149.285us | |
- HTResizeTime: 0.000ns | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 6 (6) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 9.42 MB (9877224) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 0.00 | |
- ReductionFactorThresholdToExpand: 0.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 2.11K (2108) | |
- RowsReturnedRate: 163.00 /sec | |
- StreamingTime: 68.405ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=10):(Total: 12s793ms, non-child: 342.957ms, % non-child: 2.68%) | |
- BuildRows: 1.05K (1054) | |
- BuildTime: 686.658us | |
- PeakMemoryUsage: 1.24 MB (1301756) | |
- ProbeRows: 2.55M (2548430) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 333.282ms | |
- RowsReturned: 2.11K (2108) | |
- RowsReturnedRate: 164.00 /sec | |
Hash Join Builder (join_node_id=10): | |
- BuildRowsPartitionTime: 210.852us | |
- BuildRowsPartitioned: 1.05K (1054) | |
- GetNewBlockTime: 233.832us | |
- HashBuckets: 2.08K (2081) | |
- HashCollisions: 0 (0) | |
- HashTablesBuildTime: 160.642us | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.06 MB (1111710) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=34):(Total: 2s019ms, non-child: 23.275ms, % non-child: 1.15%) | |
- BuildTime: 11.578ms | |
- GetNewBlockTime: 555.838us | |
- GetResultsTime: 8.696ms | |
- HTResizeTime: 1.448ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 20.07 MB (21041401) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.05K (1054) | |
- RowsReturnedRate: 522.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 973.000ns | |
EXCHANGE_NODE (id=33):(Total: 1s996ms, non-child: 1s996ms, % non-child: 100.00%) | |
- BytesReceived: 1.64 MB (1714946) | |
- ConvertRowBatchTime: 682.797us | |
- DeserializeRowBatchTimer: 6.380ms | |
- FirstBatchArrivalWaitTime: 1s950ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.48K (30477) | |
- RowsReturnedRate: 15.29 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
HASH_JOIN_NODE (id=9):(Total: 12s450ms, non-child: 1s671ms, % non-child: 13.42%) | |
- BuildRows: 2.46M (2456476) | |
- BuildTime: 771.770ms | |
- PeakMemoryUsage: 457.17 MB (479379495) | |
- ProbeRows: 2.55M (2548431) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 881.608ms | |
- RowsReturned: 2.55M (2548430) | |
- RowsReturnedRate: 204.69 K/sec | |
Hash Join Builder (join_node_id=9): | |
- BuildRowsPartitionTime: 604.332ms | |
- BuildRowsPartitioned: 2.46M (2456476) | |
- GetNewBlockTime: 402.924us | |
- HashBuckets: 4.19M (4194304) | |
- HashCollisions: 1.39K (1392) | |
- HashTablesBuildTime: 146.951ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 457.03 MB (479229056) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=27):(Total: 10s026ms, non-child: 2s587ms, % non-child: 25.81%) | |
- BuildTime: 1s957ms | |
- GetNewBlockTime: 1.130ms | |
- GetResultsTime: 543.198ms | |
- HTResizeTime: 159.775ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 530.12 MB (555876123) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.46M (2456476) | |
- RowsReturnedRate: 245.04 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.022us | |
EXCHANGE_NODE (id=26):(Total: 7s439ms, non-child: 7s439ms, % non-child: 100.00%) | |
- BytesReceived: 268.10 MB (281124560) | |
- ConvertRowBatchTime: 88.184ms | |
- DeserializeRowBatchTimer: 752.570ms | |
- FirstBatchArrivalWaitTime: 1s756ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.35M (4352060) | |
- RowsReturnedRate: 585.24 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=28):(Total: 7s560ms, non-child: 7s560ms, % non-child: 100.00%) | |
- BytesReceived: 122.13 MB (128060777) | |
- ConvertRowBatchTime: 46.682ms | |
- DeserializeRowBatchTimer: 466.461ms | |
- FirstBatchArrivalWaitTime: 6s807ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.55M (2548431) | |
- RowsReturnedRate: 337.36 K/sec | |
- SendersBlockedTimer: 3s923ms | |
- SendersBlockedTotalTimer(*): 58s885ms | |
Fragment F03: | |
Instance 514ee9ab39cdc507:86 (host=cdh11.net.cuberonlabs.com:22000):(Total: 13s875ms, non-child: 30.137ms, % non-child: 0.22%) | |
MemoryUsage(500.000ms): 25.48 MB, 22.06 MB, 22.06 MB, 22.06 MB, 22.06 MB, 45.36 MB, 67.31 MB, 112.51 MB, 160.30 MB, 246.73 MB, 305.67 MB, 346.67 MB, 387.86 MB, 428.67 MB, 465.80 MB, 516.03 MB, 544.90 MB, 550.90 MB, 554.97 MB, 557.03 MB, 591.33 MB, 542.60 MB, 477.75 MB, 492.18 MB, 493.40 MB, 497.90 MB, 492.58 MB | |
ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 2.00 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 599.33 MB (628440337) | |
- PerHostPeakMemUsage: 1.48 GB (1591793359) | |
- RowsProduced: 2.20K (2203) | |
- TotalNetworkReceiveTime: 16s716ms | |
- TotalNetworkSendTime: 8.271ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 41 (41) | |
- TotalThreadsTotalWallClockTime: 26s760ms | |
- TotalThreadsSysTime: 548.000ms | |
- TotalThreadsUserTime: 5s576ms | |
- TotalThreadsVoluntaryContextSwitches: 7.48K (7484) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s027ms | |
- ExecTreeExecTime: 2s013ms | |
- OpenTime: 11s792ms | |
- ExecTreeOpenTime: 10s886ms | |
- PrepareTime: 55.541ms | |
- ExecTreePrepareTime: 2.509ms | |
DataStreamSender (dst_id=35):(Total: 2.617ms, non-child: 2.617ms, % non-child: 100.00%) | |
- BytesSent: 127.15 KB (130201) | |
- NetworkThroughput(*): 169.79 MB/sec | |
- OverallThroughput: 47.44 MB/sec | |
- PeakMemoryUsage: 312.36 KB (319856) | |
- RowsReturned: 2.20K (2203) | |
- SerializeBatchTime: 1.843ms | |
- TransmitDataRPCTime: 731.315us | |
- UncompressedRowBatchSize: 244.40 KB (250261) | |
CodeGen:(Total: 940.925ms, non-child: 940.925ms, % non-child: 100.00%) | |
- CodegenTime: 7.385ms | |
- CompileTime: 283.468ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 142 (142) | |
- NumInstructions: 7.08K (7077) | |
- OptimizationTime: 621.226ms | |
- PeakMemoryUsage: 3.46 MB (3623424) | |
- PrepareTime: 35.425ms | |
AGGREGATION_NODE (id=11):(Total: 12s902ms, non-child: 70.781ms, % non-child: 0.55%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 81.439us | |
- GetResultsTime: 145.616us | |
- HTResizeTime: 0.000ns | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 6 (6) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 9.42 MB (9873877) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 0.00 | |
- ReductionFactorThresholdToExpand: 0.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 2.20K (2203) | |
- RowsReturnedRate: 170.00 /sec | |
- StreamingTime: 68.476ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=10):(Total: 12s831ms, non-child: 362.454ms, % non-child: 2.82%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 1.10K (1101) | |
- BuildTime: 417.754us | |
- PeakMemoryUsage: 1.24 MB (1299474) | |
- ProbeRows: 2.55M (2549124) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 351.627ms | |
- RowsReturned: 2.20K (2203) | |
- RowsReturnedRate: 171.00 /sec | |
Hash Join Builder (join_node_id=10): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
- BuildRowsPartitionTime: 170.674us | |
- BuildRowsPartitioned: 1.10K (1101) | |
- GetNewBlockTime: 46.126us | |
- HashBuckets: 2.05K (2048) | |
- HashCollisions: 0 (0) | |
- HashTablesBuildTime: 124.240us | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.06 MB (1111168) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=34):(Total: 2s055ms, non-child: 23.052ms, % non-child: 1.12%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 11.229ms | |
- GetNewBlockTime: 645.384us | |
- GetResultsTime: 8.804ms | |
- HTResizeTime: 844.363us | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 20.06 MB (21038912) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.10K (1101) | |
- RowsReturnedRate: 535.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.010us | |
EXCHANGE_NODE (id=33):(Total: 2s032ms, non-child: 1.661ms, % non-child: 0.08%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.54 MB | |
- BytesReceived: 1.64 MB (1717846) | |
- ConvertRowBatchTime: 699.950us | |
- DeserializeRowBatchTimer: 6.187ms | |
- FirstBatchArrivalWaitTime: 1s980ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.52K (30523) | |
- RowsReturnedRate: 15.02 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
HASH_JOIN_NODE (id=9):(Total: 12s467ms, non-child: 1s749ms, % non-child: 14.03%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 2.46M (2457112) | |
- BuildTime: 816.699ms | |
- PeakMemoryUsage: 457.17 MB (479379706) | |
- ProbeRows: 2.55M (2549124) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 914.461ms | |
- RowsReturned: 2.55M (2549124) | |
- RowsReturnedRate: 204.46 K/sec | |
Hash Join Builder (join_node_id=9): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 1 of 1 Runtime Filter Published | |
- BuildRowsPartitionTime: 648.987ms | |
- BuildRowsPartitioned: 2.46M (2457112) | |
- GetNewBlockTime: 211.111us | |
- HashBuckets: 4.19M (4194304) | |
- HashCollisions: 1.44K (1437) | |
- HashTablesBuildTime: 146.497ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 457.03 MB (479229056) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=27):(Total: 10s067ms, non-child: 2s717ms, % non-child: 26.99%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 2s081ms | |
- GetNewBlockTime: 3.151ms | |
- GetResultsTime: 546.092ms | |
- HTResizeTime: 165.843ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 530.10 MB (555847530) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.46M (2457112) | |
- RowsReturnedRate: 244.06 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 955.000ns | |
EXCHANGE_NODE (id=26):(Total: 7s350ms, non-child: 192.132ms, % non-child: 2.61%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.68 MB, 6.50 MB, 18.21 MB, 41.04 MB, 67.98 MB, 98.02 MB, 128.06 MB, 158.14 MB, 186.57 MB, 211.01 MB, 232.13 MB, 248.58 MB, 257.20 MB, 263.15 MB, 267.03 MB | |
- BytesReceived: 268.18 MB (281207629) | |
- ConvertRowBatchTime: 91.199ms | |
- DeserializeRowBatchTimer: 772.311ms | |
- FirstBatchArrivalWaitTime: 1s785ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.35M (4353676) | |
- RowsReturnedRate: 592.31 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=28):(Total: 7s490ms, non-child: 154.377ms, % non-child: 2.06%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.61 MB, 26.66 MB, 65.27 MB, 103.10 MB | |
- BytesReceived: 122.11 MB (128041068) | |
- ConvertRowBatchTime: 49.744ms | |
- DeserializeRowBatchTimer: 474.158ms | |
- FirstBatchArrivalWaitTime: 6s839ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.55M (2549124) | |
- RowsReturnedRate: 340.30 K/sec | |
- SendersBlockedTimer: 3s905ms | |
- SendersBlockedTotalTimer(*): 1m2s | |
Instance 514ee9ab39cdc507:85 (host=cdh8.net.cuberonlabs.com:22000):(Total: 13s875ms, non-child: 36.336ms, % non-child: 0.26%) | |
MemoryUsage(500.000ms): 25.48 MB, 22.03 MB, 22.06 MB, 22.06 MB, 22.06 MB, 37.81 MB, 66.39 MB, 111.42 MB, 159.17 MB, 228.17 MB, 302.30 MB, 345.74 MB, 386.80 MB, 426.67 MB, 463.73 MB, 516.03 MB, 544.96 MB, 550.90 MB, 554.90 MB, 556.90 MB, 591.33 MB, 518.36 MB, 469.51 MB, 491.96 MB, 496.72 MB, 492.99 MB, 496.40 MB | |
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.93 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 599.33 MB (628437982) | |
- PerHostPeakMemUsage: 1.63 GB (1748411303) | |
- RowsProduced: 2.13K (2129) | |
- TotalNetworkReceiveTime: 17s128ms | |
- TotalNetworkSendTime: 8.439ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 37 (37) | |
- TotalThreadsTotalWallClockTime: 26s467ms | |
- TotalThreadsSysTime: 492.000ms | |
- TotalThreadsUserTime: 5s140ms | |
- TotalThreadsVoluntaryContextSwitches: 7.44K (7439) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s260ms | |
- ExecTreeExecTime: 2s246ms | |
- OpenTime: 11s543ms | |
- ExecTreeOpenTime: 10s630ms | |
- PrepareTime: 71.068ms | |
- ExecTreePrepareTime: 2.582ms | |
DataStreamSender (dst_id=35):(Total: 5.414ms, non-child: 5.414ms, % non-child: 100.00%) | |
- BytesSent: 123.62 KB (126588) | |
- NetworkThroughput(*): 33.51 MB/sec | |
- OverallThroughput: 22.30 MB/sec | |
- PeakMemoryUsage: 312.36 KB (319856) | |
- RowsReturned: 2.13K (2129) | |
- SerializeBatchTime: 1.754ms | |
- TransmitDataRPCTime: 3.602ms | |
- UncompressedRowBatchSize: 236.23 KB (241896) | |
CodeGen:(Total: 954.458ms, non-child: 954.458ms, % non-child: 100.00%) | |
- CodegenTime: 11.292ms | |
- CompileTime: 274.953ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 142 (142) | |
- NumInstructions: 7.08K (7077) | |
- OptimizationTime: 636.280ms | |
- PeakMemoryUsage: 3.46 MB (3623424) | |
- PrepareTime: 42.111ms | |
AGGREGATION_NODE (id=11):(Total: 12s879ms, non-child: 78.469ms, % non-child: 0.61%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 97.847us | |
- GetResultsTime: 155.422us | |
- HTResizeTime: 0.000ns | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 7 (7) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 9.42 MB (9874124) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 0.00 | |
- ReductionFactorThresholdToExpand: 0.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 2.13K (2129) | |
- RowsReturnedRate: 165.00 /sec | |
- StreamingTime: 74.550ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=10):(Total: 12s800ms, non-child: 342.762ms, % non-child: 2.68%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 1.06K (1064) | |
- BuildTime: 528.403us | |
- PeakMemoryUsage: 1.25 MB (1307612) | |
- ProbeRows: 2.54M (2543404) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 332.311ms | |
- RowsReturned: 2.13K (2129) | |
- RowsReturnedRate: 166.00 /sec | |
Hash Join Builder (join_node_id=10): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
- BuildRowsPartitionTime: 181.079us | |
- BuildRowsPartitioned: 1.06K (1064) | |
- GetNewBlockTime: 81.823us | |
- HashBuckets: 2.18K (2176) | |
- HashCollisions: 0 (0) | |
- HashTablesBuildTime: 170.193us | |
- LargestPartitionPercent: 8 (8) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.06 MB (1113216) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=34):(Total: 2s034ms, non-child: 25.942ms, % non-child: 1.28%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 12.464ms | |
- GetNewBlockTime: 244.235us | |
- GetResultsTime: 10.374ms | |
- HTResizeTime: 1.303ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 20.07 MB (21047601) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.06K (1064) | |
- RowsReturnedRate: 523.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.398us | |
EXCHANGE_NODE (id=33):(Total: 2s008ms, non-child: 1.969ms, % non-child: 0.10%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 462.81 KB | |
- BytesReceived: 1.62 MB (1700254) | |
- ConvertRowBatchTime: 815.474us | |
- DeserializeRowBatchTimer: 5.198ms | |
- FirstBatchArrivalWaitTime: 1s958ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.22K (30219) | |
- RowsReturnedRate: 15.05 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
HASH_JOIN_NODE (id=9):(Total: 12s457ms, non-child: 1s604ms, % non-child: 12.88%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 2.45M (2452220) | |
- BuildTime: 706.359ms | |
- PeakMemoryUsage: 457.17 MB (479378844) | |
- ProbeRows: 2.54M (2543404) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 880.757ms | |
- RowsReturned: 2.54M (2543404) | |
- RowsReturnedRate: 204.17 K/sec | |
Hash Join Builder (join_node_id=9): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 1 of 1 Runtime Filter Published | |
- BuildRowsPartitionTime: 549.146ms | |
- BuildRowsPartitioned: 2.45M (2452220) | |
- GetNewBlockTime: 217.890us | |
- HashBuckets: 4.19M (4194304) | |
- HashCollisions: 1.38K (1380) | |
- HashTablesBuildTime: 138.693ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 457.03 MB (479229056) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=27):(Total: 9s921ms, non-child: 2s395ms, % non-child: 24.15%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s882ms | |
- GetNewBlockTime: 782.570us | |
- GetResultsTime: 442.122ms | |
- HTResizeTime: 155.854ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 530.11 MB (555856755) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.45M (2452220) | |
- RowsReturnedRate: 247.16 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.347us | |
EXCHANGE_NODE (id=26):(Total: 7s525ms, non-child: 208.158ms, % non-child: 2.77%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.43 MB, 6.00 MB, 17.08 MB, 38.88 MB, 65.79 MB, 95.50 MB, 125.29 MB, 155.35 MB, 184.03 MB, 208.69 MB, 229.91 MB, 246.91 MB, 255.94 MB, 262.16 MB, 266.14 MB | |
- BytesReceived: 267.48 MB (280477246) | |
- ConvertRowBatchTime: 87.770ms | |
- DeserializeRowBatchTimer: 720.920ms | |
- FirstBatchArrivalWaitTime: 1s763ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.34M (4341417) | |
- RowsReturnedRate: 576.87 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=28):(Total: 7s746ms, non-child: 168.274ms, % non-child: 2.17%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.46 MB, 23.69 MB, 62.31 MB, 100.38 MB | |
- BytesReceived: 121.89 MB (127805884) | |
- ConvertRowBatchTime: 47.952ms | |
- DeserializeRowBatchTimer: 461.153ms | |
- FirstBatchArrivalWaitTime: 6s815ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.54M (2543404) | |
- RowsReturnedRate: 328.31 K/sec | |
- SendersBlockedTimer: 3s672ms | |
- SendersBlockedTotalTimer(*): 55s039ms | |
Instance 514ee9ab39cdc507:87 (host=cdh9.net.cuberonlabs.com:22000):(Total: 13s874ms, non-child: 25.731ms, % non-child: 0.19%) | |
MemoryUsage(500.000ms): 25.48 MB, 25.48 MB, 22.06 MB, 22.06 MB, 22.06 MB, 22.06 MB, 45.56 MB, 80.03 MB, 127.11 MB, 178.92 MB, 265.73 MB, 316.33 MB, 360.07 MB, 396.73 MB, 437.06 MB, 473.07 MB, 517.97 MB, 546.97 MB, 551.97 MB, 554.90 MB, 556.90 MB, 567.09 MB, 518.36 MB, 461.51 MB, 492.22 MB, 500.25 MB, 496.10 MB, 499.91 MB | |
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.93 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 599.33 MB (628442328) | |
- PerHostPeakMemUsage: 1.69 GB (1813107104) | |
- RowsProduced: 2.15K (2146) | |
- TotalNetworkReceiveTime: 16s994ms | |
- TotalNetworkSendTime: 4.288ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 29 (29) | |
- TotalThreadsTotalWallClockTime: 26s761ms | |
- TotalThreadsSysTime: 496.000ms | |
- TotalThreadsUserTime: 5s356ms | |
- TotalThreadsVoluntaryContextSwitches: 7.94K (7936) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s045ms | |
- ExecTreeExecTime: 2s035ms | |
- OpenTime: 11s775ms | |
- ExecTreeOpenTime: 10s876ms | |
- PrepareTime: 53.861ms | |
- ExecTreePrepareTime: 2.212ms | |
DataStreamSender (dst_id=35):(Total: 2.326ms, non-child: 2.326ms, % non-child: 100.00%) | |
- BytesSent: 125.20 KB (128204) | |
- NetworkThroughput(*): 189.50 MB/sec | |
- OverallThroughput: 52.56 MB/sec | |
- PeakMemoryUsage: 296.36 KB (303472) | |
- RowsReturned: 2.15K (2146) | |
- SerializeBatchTime: 1.636ms | |
- TransmitDataRPCTime: 645.203us | |
- UncompressedRowBatchSize: 238.41 KB (244127) | |
CodeGen:(Total: 932.990ms, non-child: 932.990ms, % non-child: 100.00%) | |
- CodegenTime: 7.061ms | |
- CompileTime: 282.450ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 142 (142) | |
- NumInstructions: 7.08K (7077) | |
- OptimizationTime: 615.438ms | |
- PeakMemoryUsage: 3.46 MB (3623424) | |
- PrepareTime: 34.324ms | |
AGGREGATION_NODE (id=11):(Total: 12s913ms, non-child: 68.140ms, % non-child: 0.53%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 83.546us | |
- GetResultsTime: 170.126us | |
- HTResizeTime: 0.000ns | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 7 (7) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 9.44 MB (9895006) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 0.00 | |
- ReductionFactorThresholdToExpand: 0.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 2.15K (2146) | |
- RowsReturnedRate: 166.00 /sec | |
- StreamingTime: 64.728ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=10):(Total: 12s845ms, non-child: 294.551ms, % non-child: 2.29%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 1.07K (1073) | |
- BuildTime: 537.066us | |
- PeakMemoryUsage: 1.25 MB (1312956) | |
- ProbeRows: 2.55M (2550338) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 285.979ms | |
- RowsReturned: 2.15K (2146) | |
- RowsReturnedRate: 167.00 /sec | |
Hash Join Builder (join_node_id=10): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
- BuildRowsPartitionTime: 227.441us | |
- BuildRowsPartitioned: 1.07K (1073) | |
- GetNewBlockTime: 54.327us | |
- HashBuckets: 2.18K (2176) | |
- HashCollisions: 0 (0) | |
- HashTablesBuildTime: 144.273us | |
- LargestPartitionPercent: 8 (8) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.06 MB (1113216) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=34):(Total: 2s065ms, non-child: 21.247ms, % non-child: 1.03%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 9.786ms | |
- GetNewBlockTime: 202.766us | |
- GetResultsTime: 9.136ms | |
- HTResizeTime: 652.839us | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 20.07 MB (21042589) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.07K (1073) | |
- RowsReturnedRate: 519.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.038us | |
EXCHANGE_NODE (id=33):(Total: 2s044ms, non-child: 1.466ms, % non-child: 0.07%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 1.64 MB (1723545) | |
- ConvertRowBatchTime: 537.923us | |
- DeserializeRowBatchTimer: 4.360ms | |
- FirstBatchArrivalWaitTime: 1s989ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.64K (30639) | |
- RowsReturnedRate: 14.99 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
HASH_JOIN_NODE (id=9):(Total: 12s550ms, non-child: 1s615ms, % non-child: 12.87%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 2.46M (2458152) | |
- BuildTime: 788.426ms | |
- PeakMemoryUsage: 457.17 MB (479379341) | |
- ProbeRows: 2.55M (2550338) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 807.848ms | |
- RowsReturned: 2.55M (2550338) | |
- RowsReturnedRate: 203.20 K/sec | |
Hash Join Builder (join_node_id=9): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 1 of 1 Runtime Filter Published | |
- BuildRowsPartitionTime: 634.577ms | |
- BuildRowsPartitioned: 2.46M (2458152) | |
- GetNewBlockTime: 266.138us | |
- HashBuckets: 4.19M (4194304) | |
- HashCollisions: 1.34K (1340) | |
- HashTablesBuildTime: 132.708ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 457.03 MB (479229056) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=27):(Total: 10s085ms, non-child: 2s680ms, % non-child: 26.58%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 2s036ms | |
- GetNewBlockTime: 678.520us | |
- GetResultsTime: 549.141ms | |
- HTResizeTime: 162.483ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 530.16 MB (555914780) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.46M (2458152) | |
- RowsReturnedRate: 243.74 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.050us | |
EXCHANGE_NODE (id=26):(Total: 7s404ms, non-child: 191.244ms, % non-child: 2.58%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.74 MB, 8.44 MB, 22.87 MB, 47.84 MB, 75.28 MB, 105.77 MB, 136.44 MB, 165.85 MB, 193.19 MB, 216.64 MB, 236.94 MB, 251.70 MB, 259.23 MB, 264.62 MB, 267.82 MB | |
- BytesReceived: 268.57 MB (281619247) | |
- ConvertRowBatchTime: 94.307ms | |
- DeserializeRowBatchTimer: 694.065ms | |
- FirstBatchArrivalWaitTime: 1s793ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.36M (4358139) | |
- RowsReturnedRate: 588.59 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=28):(Total: 7s697ms, non-child: 133.979ms, % non-child: 1.74%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.37 MB, 10.64 MB, 36.19 MB, 74.62 MB, 112.95 MB | |
- BytesReceived: 122.31 MB (128246800) | |
- ConvertRowBatchTime: 41.476ms | |
- DeserializeRowBatchTimer: 450.692ms | |
- FirstBatchArrivalWaitTime: 6s847ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.55M (2550338) | |
- RowsReturnedRate: 331.31 K/sec | |
- SendersBlockedTimer: 3s889ms | |
- SendersBlockedTotalTimer(*): 55s034ms | |
Instance 514ee9ab39cdc507:84 (host=cdh7.net.cuberonlabs.com:22000):(Total: 13s874ms, non-child: 28.167ms, % non-child: 0.20%) | |
MemoryUsage(500.000ms): 25.48 MB, 25.48 MB, 22.06 MB, 22.06 MB, 22.06 MB, 22.06 MB, 45.48 MB, 81.09 MB, 127.67 MB, 181.49 MB, 266.67 MB, 313.79 MB, 362.20 MB, 397.80 MB, 437.80 MB, 473.26 MB, 524.24 MB, 546.98 MB, 551.91 MB, 555.98 MB, 556.91 MB, 567.10 MB, 534.49 MB, 485.77 MB, 492.11 MB, 493.72 MB, 497.59 MB, 493.43 MB | |
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.93 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 599.34 MB (628454356) | |
- PerHostPeakMemUsage: 1.58 GB (1699637471) | |
- RowsProduced: 2.08K (2078) | |
- TotalNetworkReceiveTime: 16s542ms | |
- TotalNetworkSendTime: 7.845ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 29 (29) | |
- TotalThreadsTotalWallClockTime: 26s749ms | |
- TotalThreadsSysTime: 512.000ms | |
- TotalThreadsUserTime: 5s640ms | |
- TotalThreadsVoluntaryContextSwitches: 7.46K (7461) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s896ms | |
- ExecTreeExecTime: 1s883ms | |
- OpenTime: 11s921ms | |
- ExecTreeOpenTime: 10s945ms | |
- PrepareTime: 56.280ms | |
- ExecTreePrepareTime: 1.948ms | |
DataStreamSender (dst_id=35):(Total: 4.618ms, non-child: 4.618ms, % non-child: 100.00%) | |
- BytesSent: 119.78 KB (122653) | |
- NetworkThroughput(*): 40.10 MB/sec | |
- OverallThroughput: 25.33 MB/sec | |
- PeakMemoryUsage: 288.36 KB (295280) | |
- RowsReturned: 2.08K (2078) | |
- SerializeBatchTime: 1.655ms | |
- TransmitDataRPCTime: 2.916ms | |
- UncompressedRowBatchSize: 230.81 KB (236348) | |
CodeGen:(Total: 1s010ms, non-child: 1s010ms, % non-child: 100.00%) | |
- CodegenTime: 7.784ms | |
- CompileTime: 352.717ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 142 (142) | |
- NumInstructions: 7.08K (7077) | |
- OptimizationTime: 621.239ms | |
- PeakMemoryUsage: 3.46 MB (3623424) | |
- PrepareTime: 35.963ms | |
AGGREGATION_NODE (id=11):(Total: 12s831ms, non-child: 72.983ms, % non-child: 0.57%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 104.392us | |
- GetResultsTime: 106.570us | |
- HTResizeTime: 0.000ns | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 7 (7) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 9.42 MB (9882439) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 0.00 | |
- ReductionFactorThresholdToExpand: 0.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 2.08K (2078) | |
- RowsReturnedRate: 161.00 /sec | |
- StreamingTime: 68.843ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=10):(Total: 12s758ms, non-child: 299.173ms, % non-child: 2.34%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 1.04K (1039) | |
- BuildTime: 553.488us | |
- PeakMemoryUsage: 1.24 MB (1299160) | |
- ProbeRows: 2.55M (2548097) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 290.307ms | |
- RowsReturned: 2.08K (2078) | |
- RowsReturnedRate: 162.00 /sec | |
Hash Join Builder (join_node_id=10): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
- BuildRowsPartitionTime: 248.856us | |
- BuildRowsPartitioned: 1.04K (1039) | |
- GetNewBlockTime: 74.674us | |
- HashBuckets: 2.11K (2112) | |
- HashCollisions: 3 (3) | |
- HashTablesBuildTime: 145.855us | |
- LargestPartitionPercent: 8 (8) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.06 MB (1112192) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=34):(Total: 1s987ms, non-child: 27.444ms, % non-child: 1.38%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 13.062ms | |
- GetNewBlockTime: 1.801ms | |
- GetResultsTime: 9.487ms | |
- HTResizeTime: 1.119ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 20.07 MB (21049741) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.04K (1039) | |
- RowsReturnedRate: 522.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 900.000ns | |
EXCHANGE_NODE (id=33):(Total: 1s959ms, non-child: 2.469ms, % non-child: 0.13%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 1.64 MB (1716186) | |
- ConvertRowBatchTime: 805.893us | |
- DeserializeRowBatchTimer: 5.658ms | |
- FirstBatchArrivalWaitTime: 1s913ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.49K (30492) | |
- RowsReturnedRate: 15.56 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
HASH_JOIN_NODE (id=9):(Total: 12s458ms, non-child: 1s717ms, % non-child: 13.79%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 2.46M (2456036) | |
- BuildTime: 842.804ms | |
- PeakMemoryUsage: 457.17 MB (479379897) | |
- ProbeRows: 2.55M (2548097) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 858.191ms | |
- RowsReturned: 2.55M (2548097) | |
- RowsReturnedRate: 204.53 K/sec | |
Hash Join Builder (join_node_id=9): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 1 of 1 Runtime Filter Published | |
- BuildRowsPartitionTime: 668.746ms | |
- BuildRowsPartitioned: 2.46M (2456036) | |
- GetNewBlockTime: 249.693us | |
- HashBuckets: 4.19M (4194304) | |
- HashCollisions: 1.35K (1351) | |
- HashTablesBuildTime: 152.507ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 457.03 MB (479229056) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=27):(Total: 10s100ms, non-child: 2s777ms, % non-child: 27.50%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 2s038ms | |
- GetNewBlockTime: 800.709us | |
- GetResultsTime: 641.708ms | |
- HTResizeTime: 164.929ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 530.10 MB (555849270) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.46M (2456036) | |
- RowsReturnedRate: 243.17 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 966.000ns | |
EXCHANGE_NODE (id=26):(Total: 7s322ms, non-child: 221.423ms, % non-child: 3.02%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.87 MB, 8.71 MB, 23.51 MB, 48.88 MB, 76.20 MB, 106.43 MB, 137.19 MB, 166.61 MB, 193.70 MB, 217.10 MB, 237.12 MB, 251.49 MB, 259.02 MB, 264.35 MB, 267.55 MB | |
- BytesReceived: 268.23 MB (281257036) | |
- ConvertRowBatchTime: 90.362ms | |
- DeserializeRowBatchTimer: 759.823ms | |
- FirstBatchArrivalWaitTime: 1s716ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.35M (4353326) | |
- RowsReturnedRate: 594.52 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=28):(Total: 7s407ms, non-child: 170.999ms, % non-child: 2.31%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.38 MB, 10.59 MB, 37.25 MB, 75.56 MB, 113.80 MB | |
- BytesReceived: 122.15 MB (128087416) | |
- ConvertRowBatchTime: 41.176ms | |
- DeserializeRowBatchTimer: 479.423ms | |
- FirstBatchArrivalWaitTime: 6s767ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.55M (2548097) | |
- RowsReturnedRate: 343.97 K/sec | |
- SendersBlockedTimer: 4s037ms | |
- SendersBlockedTotalTimer(*): 57s028ms | |
Instance 514ee9ab39cdc507:82 (host=cdh1.net.cuberonlabs.com:22000):(Total: 13s874ms, non-child: 34.109ms, % non-child: 0.25%) | |
MemoryUsage(500.000ms): 25.48 MB, 25.48 MB, 22.06 MB, 22.06 MB, 22.06 MB, 22.06 MB, 45.48 MB, 72.07 MB, 126.98 MB, 178.66 MB, 265.79 MB, 311.93 MB, 351.67 MB, 394.67 MB, 433.99 MB, 468.67 MB, 517.97 MB, 546.91 MB, 551.91 MB, 554.97 MB, 556.91 MB, 567.09 MB, 534.49 MB, 485.76 MB, 492.21 MB, 498.91 MB, 494.67 MB, 498.44 MB | |
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.93 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 599.33 MB (628446093) | |
- PerHostPeakMemUsage: 1.81 GB (1939587581) | |
- RowsProduced: 2.08K (2076) | |
- TotalNetworkReceiveTime: 16s519ms | |
- TotalNetworkSendTime: 7.864ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 43 (43) | |
- TotalThreadsTotalWallClockTime: 26s765ms | |
- TotalThreadsSysTime: 608.000ms | |
- TotalThreadsUserTime: 5s600ms | |
- TotalThreadsVoluntaryContextSwitches: 7.71K (7705) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s916ms | |
- ExecTreeExecTime: 1s902ms | |
- OpenTime: 11s900ms | |
- ExecTreeOpenTime: 10s946ms | |
- PrepareTime: 57.688ms | |
- ExecTreePrepareTime: 3.704ms | |
DataStreamSender (dst_id=35):(Total: 4.590ms, non-child: 4.590ms, % non-child: 100.00%) | |
- BytesSent: 119.63 KB (122500) | |
- NetworkThroughput(*): 40.24 MB/sec | |
- OverallThroughput: 25.45 MB/sec | |
- PeakMemoryUsage: 280.36 KB (287088) | |
- RowsReturned: 2.08K (2076) | |
- SerializeBatchTime: 1.646ms | |
- TransmitDataRPCTime: 2.902ms | |
- UncompressedRowBatchSize: 230.25 KB (235778) | |
CodeGen:(Total: 983.089ms, non-child: 983.089ms, % non-child: 100.00%) | |
- CodegenTime: 11.500ms | |
- CompileTime: 304.235ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 142 (142) | |
- NumInstructions: 7.08K (7077) | |
- OptimizationTime: 647.488ms | |
- PeakMemoryUsage: 3.46 MB (3623424) | |
- PrepareTime: 30.731ms | |
AGGREGATION_NODE (id=11):(Total: 12s852ms, non-child: 79.960ms, % non-child: 0.62%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 46.128us | |
- GetResultsTime: 155.840us | |
- HTResizeTime: 0.000ns | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 7 (7) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 9.41 MB (9864024) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 0.00 | |
- ReductionFactorThresholdToExpand: 0.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 2.08K (2076) | |
- RowsReturnedRate: 161.00 /sec | |
- StreamingTime: 76.743ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=10):(Total: 12s772ms, non-child: 358.771ms, % non-child: 2.81%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 1.04K (1038) | |
- BuildTime: 448.304us | |
- PeakMemoryUsage: 1.28 MB (1345396) | |
- ProbeRows: 2.55M (2547701) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 346.473ms | |
- RowsReturned: 2.08K (2076) | |
- RowsReturnedRate: 162.00 /sec | |
Hash Join Builder (join_node_id=10): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
- BuildRowsPartitionTime: 186.700us | |
- BuildRowsPartitioned: 1.04K (1038) | |
- GetNewBlockTime: 35.128us | |
- HashBuckets: 2.05K (2048) | |
- HashCollisions: 1 (1) | |
- HashTablesBuildTime: 157.372us | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.06 MB (1111168) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=34):(Total: 2s004ms, non-child: 22.477ms, % non-child: 1.12%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 9.153ms | |
- GetNewBlockTime: 714.276us | |
- GetResultsTime: 8.838ms | |
- HTResizeTime: 848.720us | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 20.06 MB (21029694) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.04K (1038) | |
- RowsReturnedRate: 517.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.012us | |
EXCHANGE_NODE (id=33):(Total: 1s982ms, non-child: 1.443ms, % non-child: 0.07%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 1.62 MB (1697477) | |
- ConvertRowBatchTime: 565.368us | |
- DeserializeRowBatchTimer: 5.560ms | |
- FirstBatchArrivalWaitTime: 1s932ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.18K (30176) | |
- RowsReturnedRate: 15.22 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
HASH_JOIN_NODE (id=9):(Total: 12s411ms, non-child: 1s809ms, % non-child: 14.58%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 2.46M (2455964) | |
- BuildTime: 859.088ms | |
- PeakMemoryUsage: 457.17 MB (479378907) | |
- ProbeRows: 2.55M (2547701) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 930.683ms | |
- RowsReturned: 2.55M (2547701) | |
- RowsReturnedRate: 205.27 K/sec | |
Hash Join Builder (join_node_id=9): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 1 of 1 Runtime Filter Published | |
- BuildRowsPartitionTime: 659.011ms | |
- BuildRowsPartitioned: 2.46M (2455964) | |
- GetNewBlockTime: 290.796us | |
- HashBuckets: 4.19M (4194304) | |
- HashCollisions: 1.43K (1432) | |
- HashTablesBuildTime: 178.992ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 457.03 MB (479229056) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=27):(Total: 10s084ms, non-child: 2s700ms, % non-child: 26.78%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s994ms | |
- GetNewBlockTime: 616.900us | |
- GetResultsTime: 609.114ms | |
- HTResizeTime: 165.669ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 530.10 MB (555848576) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.46M (2455964) | |
- RowsReturnedRate: 243.53 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.172us | |
EXCHANGE_NODE (id=26):(Total: 7s384ms, non-child: 197.641ms, % non-child: 2.68%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.68 MB, 8.27 MB, 22.40 MB, 47.20 MB, 74.43 MB, 104.91 MB, 135.31 MB, 164.79 MB, 192.12 MB, 215.69 MB, 235.91 MB, 250.87 MB, 258.42 MB, 263.91 MB, 267.11 MB | |
- BytesReceived: 267.91 MB (280921803) | |
- ConvertRowBatchTime: 90.014ms | |
- DeserializeRowBatchTimer: 731.674ms | |
- FirstBatchArrivalWaitTime: 1s737ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.35M (4350001) | |
- RowsReturnedRate: 589.09 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=28):(Total: 7s306ms, non-child: 166.089ms, % non-child: 2.27%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.37 MB, 10.60 MB, 35.26 MB, 73.50 MB, 111.85 MB | |
- BytesReceived: 122.06 MB (127989053) | |
- ConvertRowBatchTime: 47.108ms | |
- DeserializeRowBatchTimer: 470.253ms | |
- FirstBatchArrivalWaitTime: 6s789ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.55M (2547701) | |
- RowsReturnedRate: 348.68 K/sec | |
- SendersBlockedTimer: 4s019ms | |
- SendersBlockedTotalTimer(*): 57s235ms | |
Instance 514ee9ab39cdc507:88 (host=cdh10.net.cuberonlabs.com:22000):(Total: 13s874ms, non-child: 25.836ms, % non-child: 0.19%) | |
MemoryUsage(500.000ms): 25.48 MB, 22.03 MB, 22.06 MB, 22.06 MB, 22.06 MB, 35.56 MB, 66.47 MB, 111.39 MB, 159.23 MB, 230.63 MB, 302.37 MB, 345.74 MB, 385.67 MB, 425.86 MB, 463.61 MB, 514.89 MB, 545.96 MB, 550.97 MB, 554.90 MB, 556.96 MB, 583.32 MB, 526.47 MB, 461.50 MB, 492.10 MB, 496.20 MB, 492.55 MB, 496.08 MB | |
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.93 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 599.32 MB (628433302) | |
- PerHostPeakMemUsage: 1.66 GB (1784016472) | |
- RowsProduced: 2.09K (2094) | |
- TotalNetworkReceiveTime: 17s095ms | |
- TotalNetworkSendTime: 7.469ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 27 (27) | |
- TotalThreadsTotalWallClockTime: 26s566ms | |
- TotalThreadsSysTime: 520.000ms | |
- TotalThreadsUserTime: 5s228ms | |
- TotalThreadsVoluntaryContextSwitches: 7.51K (7506) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s230ms | |
- ExecTreeExecTime: 2s217ms | |
- OpenTime: 11s588ms | |
- ExecTreeOpenTime: 10s687ms | |
- PrepareTime: 55.231ms | |
- ExecTreePrepareTime: 1.885ms | |
DataStreamSender (dst_id=35):(Total: 6.559ms, non-child: 6.559ms, % non-child: 100.00%) | |
- BytesSent: 120.75 KB (123650) | |
- NetworkThroughput(*): 23.50 MB/sec | |
- OverallThroughput: 17.98 MB/sec | |
- PeakMemoryUsage: 252.36 KB (258416) | |
- RowsReturned: 2.09K (2094) | |
- SerializeBatchTime: 1.494ms | |
- TransmitDataRPCTime: 5.018ms | |
- UncompressedRowBatchSize: 232.48 KB (238062) | |
CodeGen:(Total: 935.062ms, non-child: 935.062ms, % non-child: 100.00%) | |
- CodegenTime: 7.678ms | |
- CompileTime: 259.095ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 142 (142) | |
- NumInstructions: 7.08K (7077) | |
- OptimizationTime: 640.706ms | |
- PeakMemoryUsage: 3.46 MB (3623424) | |
- PrepareTime: 34.466ms | |
AGGREGATION_NODE (id=11):(Total: 12s906ms, non-child: 79.948ms, % non-child: 0.62%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 77.107us | |
- GetResultsTime: 129.997us | |
- HTResizeTime: 0.000ns | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 7 (7) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 9.42 MB (9881298) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 0.00 | |
- ReductionFactorThresholdToExpand: 0.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 2.09K (2094) | |
- RowsReturnedRate: 162.00 /sec | |
- StreamingTime: 75.016ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=10):(Total: 12s827ms, non-child: 342.423ms, % non-child: 2.67%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 1.05K (1048) | |
- BuildTime: 1.413ms | |
- PeakMemoryUsage: 1.21 MB (1273910) | |
- ProbeRows: 2.55M (2548865) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 332.448ms | |
- RowsReturned: 2.09K (2094) | |
- RowsReturnedRate: 163.00 /sec | |
Hash Join Builder (join_node_id=10): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
- BuildRowsPartitionTime: 232.335us | |
- BuildRowsPartitioned: 1.05K (1048) | |
- GetNewBlockTime: 923.424us | |
- HashBuckets: 2.05K (2048) | |
- HashCollisions: 0 (0) | |
- HashTablesBuildTime: 159.762us | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.06 MB (1111168) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=34):(Total: 2s060ms, non-child: 20.154ms, % non-child: 0.98%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 9.958ms | |
- GetNewBlockTime: 227.629us | |
- GetResultsTime: 8.014ms | |
- HTResizeTime: 1.011ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 20.06 MB (21038543) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.05K (1048) | |
- RowsReturnedRate: 508.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 972.000ns | |
EXCHANGE_NODE (id=33):(Total: 2s040ms, non-child: 2.056ms, % non-child: 0.10%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 217.44 KB | |
- BytesReceived: 1.63 MB (1710714) | |
- ConvertRowBatchTime: 640.230us | |
- DeserializeRowBatchTimer: 5.694ms | |
- FirstBatchArrivalWaitTime: 1s985ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.40K (30397) | |
- RowsReturnedRate: 14.89 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
HASH_JOIN_NODE (id=9):(Total: 12s484ms, non-child: 1s496ms, % non-child: 11.98%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 2.46M (2457221) | |
- BuildTime: 674.887ms | |
- PeakMemoryUsage: 457.17 MB (479379510) | |
- ProbeRows: 2.55M (2548865) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 804.670ms | |
- RowsReturned: 2.55M (2548865) | |
- RowsReturnedRate: 204.17 K/sec | |
Hash Join Builder (join_node_id=9): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 1 of 1 Runtime Filter Published | |
- BuildRowsPartitionTime: 524.303ms | |
- BuildRowsPartitioned: 2.46M (2457221) | |
- GetNewBlockTime: 223.984us | |
- HashBuckets: 4.19M (4194304) | |
- HashCollisions: 1.31K (1308) | |
- HashTablesBuildTime: 131.465ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 457.03 MB (479229056) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=27):(Total: 10s009ms, non-child: 2s613ms, % non-child: 26.12%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 2s042ms | |
- GetNewBlockTime: 805.026us | |
- GetResultsTime: 489.253ms | |
- HTResizeTime: 169.180ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 530.16 MB (555909662) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.46M (2457221) | |
- RowsReturnedRate: 245.49 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.008us | |
EXCHANGE_NODE (id=26):(Total: 7s395ms, non-child: 216.878ms, % non-child: 2.93%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.43 MB, 5.98 MB, 17.09 MB, 38.88 MB, 65.69 MB, 95.23 MB, 125.28 MB, 155.31 MB, 184.11 MB, 208.73 MB, 229.84 MB, 247.01 MB, 256.15 MB, 262.42 MB, 266.44 MB | |
- BytesReceived: 267.80 MB (280805267) | |
- ConvertRowBatchTime: 96.023ms | |
- DeserializeRowBatchTimer: 766.879ms | |
- FirstBatchArrivalWaitTime: 1s793ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.35M (4347516) | |
- RowsReturnedRate: 587.87 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=28):(Total: 7s821ms, non-child: 177.626ms, % non-child: 2.27%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.55 MB, 23.31 MB, 62.11 MB, 100.28 MB | |
- BytesReceived: 122.16 MB (128093107) | |
- ConvertRowBatchTime: 48.038ms | |
- DeserializeRowBatchTimer: 478.045ms | |
- FirstBatchArrivalWaitTime: 6s842ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.55M (2548865) | |
- RowsReturnedRate: 325.89 K/sec | |
- SendersBlockedTimer: 3s703ms | |
- SendersBlockedTotalTimer(*): 1m2s | |
Instance 514ee9ab39cdc507:80 (host=cdh12.net.cuberonlabs.com:22000):(Total: 13s868ms, non-child: 19.368ms, % non-child: 0.14%) | |
MemoryUsage(500.000ms): 25.48 MB, 22.03 MB, 22.06 MB, 22.06 MB, 22.06 MB, 25.52 MB, 64.15 MB, 94.73 MB, 144.49 MB, 205.61 MB, 288.81 MB, 323.73 MB, 367.61 MB, 408.87 MB, 453.61 MB, 482.15 MB, 527.98 MB, 549.92 MB, 552.98 MB, 555.91 MB, 557.98 MB, 550.86 MB, 518.25 MB, 452.91 MB, 496.85 MB, 493.95 MB, 497.06 MB, 498.27 MB | |
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.93 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 599.34 MB (628453865) | |
- PerHostPeakMemUsage: 1.12 GB (1201773720) | |
- RowsProduced: 2.19K (2186) | |
- TotalNetworkReceiveTime: 16s542ms | |
- TotalNetworkSendTime: 4.774ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 23 (23) | |
- TotalThreadsTotalWallClockTime: 26s928ms | |
- TotalThreadsSysTime: 528.000ms | |
- TotalThreadsUserTime: 5s816ms | |
- TotalThreadsVoluntaryContextSwitches: 7.45K (7453) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s888ms | |
- ExecTreeExecTime: 1s877ms | |
- OpenTime: 11s947ms | |
- ExecTreeOpenTime: 11s028ms | |
- PrepareTime: 33.110ms | |
- ExecTreePrepareTime: 1.588ms | |
DataStreamSender (dst_id=35):(Total: 2.630ms, non-child: 2.630ms, % non-child: 100.00%) | |
- BytesSent: 126.59 KB (129625) | |
- NetworkThroughput(*): 139.98 MB/sec | |
- OverallThroughput: 47.00 MB/sec | |
- PeakMemoryUsage: 312.36 KB (319856) | |
- RowsReturned: 2.19K (2186) | |
- SerializeBatchTime: 1.716ms | |
- TransmitDataRPCTime: 883.104us | |
- UncompressedRowBatchSize: 242.57 KB (248396) | |
CodeGen:(Total: 938.778ms, non-child: 938.778ms, % non-child: 100.00%) | |
- CodegenTime: 4.548ms | |
- CompileTime: 296.734ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 142 (142) | |
- NumInstructions: 7.08K (7077) | |
- OptimizationTime: 620.695ms | |
- PeakMemoryUsage: 3.46 MB (3623424) | |
- PrepareTime: 20.881ms | |
AGGREGATION_NODE (id=11):(Total: 12s907ms, non-child: 69.431ms, % non-child: 0.54%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 52.142us | |
- GetResultsTime: 162.524us | |
- HTResizeTime: 0.000ns | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 7 (7) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 9.41 MB (9862845) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 0.00 | |
- ReductionFactorThresholdToExpand: 0.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 2.19K (2186) | |
- RowsReturnedRate: 169.00 /sec | |
- StreamingTime: 65.804ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=10):(Total: 12s838ms, non-child: 351.565ms, % non-child: 2.74%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 1.09K (1092) | |
- BuildTime: 625.825us | |
- PeakMemoryUsage: 1.22 MB (1277664) | |
- ProbeRows: 2.55M (2549251) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 343.088ms | |
- RowsReturned: 2.19K (2186) | |
- RowsReturnedRate: 170.00 /sec | |
Hash Join Builder (join_node_id=10): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
- BuildRowsPartitionTime: 239.227us | |
- BuildRowsPartitioned: 1.09K (1092) | |
- GetNewBlockTime: 83.416us | |
- HashBuckets: 2.18K (2176) | |
- HashCollisions: 0 (0) | |
- HashTablesBuildTime: 209.905us | |
- LargestPartitionPercent: 8 (8) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.06 MB (1113216) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=34):(Total: 2s065ms, non-child: 27.250ms, % non-child: 1.32%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 11.425ms | |
- GetNewBlockTime: 164.961us | |
- GetResultsTime: 9.479ms | |
- HTResizeTime: 2.529ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 20.07 MB (21041169) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.09K (1092) | |
- RowsReturnedRate: 528.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 441.000ns | |
EXCHANGE_NODE (id=33):(Total: 2s038ms, non-child: 5.782ms, % non-child: 0.28%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 1.62 MB (1703730) | |
- ConvertRowBatchTime: 596.745us | |
- DeserializeRowBatchTimer: 9.345ms | |
- FirstBatchArrivalWaitTime: 1s992ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.27K (30272) | |
- RowsReturnedRate: 14.85 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
HASH_JOIN_NODE (id=9):(Total: 12s486ms, non-child: 1s807ms, % non-child: 14.48%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 2.46M (2457325) | |
- BuildTime: 861.372ms | |
- PeakMemoryUsage: 457.17 MB (479379734) | |
- ProbeRows: 2.55M (2549251) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 927.097ms | |
- RowsReturned: 2.55M (2549251) | |
- RowsReturnedRate: 204.16 K/sec | |
Hash Join Builder (join_node_id=9): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 1 of 1 Runtime Filter Published | |
- BuildRowsPartitionTime: 682.159ms | |
- BuildRowsPartitioned: 2.46M (2457325) | |
- GetNewBlockTime: 353.148us | |
- HashBuckets: 4.19M (4194304) | |
- HashCollisions: 1.45K (1447) | |
- HashTablesBuildTime: 157.639ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 457.03 MB (479229056) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=27):(Total: 10s164ms, non-child: 2s868ms, % non-child: 28.22%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 2s141ms | |
- GetNewBlockTime: 487.600us | |
- GetResultsTime: 626.696ms | |
- HTResizeTime: 163.520ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 530.16 MB (555913420) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.46M (2457325) | |
- RowsReturnedRate: 241.75 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 505.000ns | |
EXCHANGE_NODE (id=26):(Total: 7s296ms, non-child: 207.746ms, % non-child: 2.85%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 686.04 KB, 4.57 MB, 12.89 MB, 32.67 MB, 58.98 MB, 88.31 MB, 118.64 MB, 148.74 MB, 177.94 MB, 203.60 MB, 225.50 MB, 243.69 MB, 254.67 MB, 261.28 MB, 265.61 MB, 267.70 MB | |
- BytesReceived: 267.81 MB (280820208) | |
- ConvertRowBatchTime: 91.598ms | |
- DeserializeRowBatchTimer: 796.908ms | |
- FirstBatchArrivalWaitTime: 1s796ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.35M (4350242) | |
- RowsReturnedRate: 596.20 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=28):(Total: 7s362ms, non-child: 146.639ms, % non-child: 1.99%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.40 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.42 MB, 13.56 MB, 52.71 MB, 90.55 MB, 122.10 MB | |
- BytesReceived: 122.12 MB (128047318) | |
- ConvertRowBatchTime: 48.066ms | |
- DeserializeRowBatchTimer: 464.441ms | |
- FirstBatchArrivalWaitTime: 6s849ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.55M (2549251) | |
- RowsReturnedRate: 346.23 K/sec | |
- SendersBlockedTimer: 4s041ms | |
- SendersBlockedTotalTimer(*): 1m4s | |
Instance 514ee9ab39cdc507:83 (host=cdh5.net.cuberonlabs.com:22000):(Total: 13s867ms, non-child: 21.241ms, % non-child: 0.15%) | |
MemoryUsage(500.000ms): 25.48 MB, 22.03 MB, 22.06 MB, 22.06 MB, 22.06 MB, 34.02 MB, 64.45 MB, 106.20 MB, 145.85 MB, 206.91 MB, 289.61 MB, 333.67 MB, 370.19 MB, 417.61 MB, 455.60 MB, 495.51 MB, 535.94 MB, 550.95 MB, 555.07 MB, 556.00 MB, 557.88 MB, 534.58 MB, 469.61 MB, 492.11 MB, 492.89 MB, 499.20 MB, 494.30 MB | |
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.93 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 599.31 MB (628417860) | |
- PerHostPeakMemUsage: 2.15 GB (2303708143) | |
- RowsProduced: 2.07K (2073) | |
- TotalNetworkReceiveTime: 17s343ms | |
- TotalNetworkSendTime: 5.401ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 23 (23) | |
- TotalThreadsTotalWallClockTime: 26s575ms | |
- TotalThreadsSysTime: 572.000ms | |
- TotalThreadsUserTime: 4s956ms | |
- TotalThreadsVoluntaryContextSwitches: 8.26K (8258) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s255ms | |
- ExecTreeExecTime: 2s243ms | |
- OpenTime: 11s574ms | |
- ExecTreeOpenTime: 10s673ms | |
- PrepareTime: 37.732ms | |
- ExecTreePrepareTime: 2.167ms | |
DataStreamSender (dst_id=35):(Total: 2.608ms, non-child: 2.608ms, % non-child: 100.00%) | |
- BytesSent: 120.24 KB (123124) | |
- NetworkThroughput(*): 155.51 MB/sec | |
- OverallThroughput: 45.02 MB/sec | |
- PeakMemoryUsage: 268.36 KB (274800) | |
- RowsReturned: 2.07K (2073) | |
- SerializeBatchTime: 1.784ms | |
- TransmitDataRPCTime: 755.080us | |
- UncompressedRowBatchSize: 230.03 KB (235555) | |
CodeGen:(Total: 923.949ms, non-child: 923.949ms, % non-child: 100.00%) | |
- CodegenTime: 4.665ms | |
- CompileTime: 291.484ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 142 (142) | |
- NumInstructions: 7.08K (7077) | |
- OptimizationTime: 608.204ms | |
- PeakMemoryUsage: 3.46 MB (3623424) | |
- PrepareTime: 23.759ms | |
AGGREGATION_NODE (id=11):(Total: 12s919ms, non-child: 71.566ms, % non-child: 0.55%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 72.848us | |
- GetResultsTime: 145.432us | |
- HTResizeTime: 0.000ns | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 6 (6) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 9.41 MB (9868017) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 0.00 | |
- ReductionFactorThresholdToExpand: 0.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 2.07K (2073) | |
- RowsReturnedRate: 160.00 /sec | |
- StreamingTime: 69.080ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=10):(Total: 12s848ms, non-child: 356.252ms, % non-child: 2.77%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 1.04K (1036) | |
- BuildTime: 369.836us | |
- PeakMemoryUsage: 1.21 MB (1273570) | |
- ProbeRows: 2.55M (2549973) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 346.939ms | |
- RowsReturned: 2.07K (2073) | |
- RowsReturnedRate: 161.00 /sec | |
Hash Join Builder (join_node_id=10): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
- BuildRowsPartitionTime: 136.252us | |
- BuildRowsPartitioned: 1.04K (1036) | |
- GetNewBlockTime: 67.288us | |
- HashBuckets: 2.05K (2048) | |
- HashCollisions: 0 (0) | |
- HashTablesBuildTime: 108.652us | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.06 MB (1111168) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=34):(Total: 2s073ms, non-child: 24.719ms, % non-child: 1.19%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 16.440ms | |
- GetNewBlockTime: 2.436ms | |
- GetResultsTime: 6.133ms | |
- HTResizeTime: 5.761ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 20.06 MB (21034997) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.04K (1036) | |
- RowsReturnedRate: 499.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.004us | |
EXCHANGE_NODE (id=33):(Total: 2s048ms, non-child: 1.737ms, % non-child: 0.08%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 1.64 MB (1719100) | |
- ConvertRowBatchTime: 585.116us | |
- DeserializeRowBatchTimer: 8.125ms | |
- FirstBatchArrivalWaitTime: 2s005ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.56K (30557) | |
- RowsReturnedRate: 14.91 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
HASH_JOIN_NODE (id=9):(Total: 12s491ms, non-child: 1s530ms, % non-child: 12.25%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 2.46M (2457678) | |
- BuildTime: 687.007ms | |
- PeakMemoryUsage: 457.17 MB (479379170) | |
- ProbeRows: 2.55M (2549973) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 824.659ms | |
- RowsReturned: 2.55M (2549973) | |
- RowsReturnedRate: 204.14 K/sec | |
Hash Join Builder (join_node_id=9): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 1 of 1 Runtime Filter Published | |
- BuildRowsPartitionTime: 535.131ms | |
- BuildRowsPartitioned: 2.46M (2457678) | |
- GetNewBlockTime: 214.616us | |
- HashBuckets: 4.19M (4194304) | |
- HashCollisions: 1.45K (1452) | |
- HashTablesBuildTime: 131.859ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 457.03 MB (479229056) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=27):(Total: 9s984ms, non-child: 2s382ms, % non-child: 23.86%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s851ms | |
- GetNewBlockTime: 965.408us | |
- GetResultsTime: 451.765ms | |
- HTResizeTime: 160.273ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 530.16 MB (555908250) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.46M (2457678) | |
- RowsReturnedRate: 246.15 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.020us | |
EXCHANGE_NODE (id=26):(Total: 7s602ms, non-child: 189.640ms, % non-child: 2.49%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 996.99 KB, 5.06 MB, 14.12 MB, 34.63 MB, 61.09 MB, 90.02 MB, 120.66 MB, 150.80 MB, 179.96 MB, 205.18 MB, 227.17 MB, 245.10 MB, 255.53 MB, 262.01 MB, 266.25 MB, 268.10 MB | |
- BytesReceived: 268.12 MB (281145244) | |
- ConvertRowBatchTime: 81.700ms | |
- DeserializeRowBatchTimer: 720.942ms | |
- FirstBatchArrivalWaitTime: 1s811ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.35M (4354770) | |
- RowsReturnedRate: 572.81 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=28):(Total: 7s837ms, non-child: 154.478ms, % non-child: 1.97%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.92 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.56 MB, 16.20 MB, 56.11 MB, 93.93 MB | |
- BytesReceived: 122.17 MB (128102898) | |
- ConvertRowBatchTime: 47.284ms | |
- DeserializeRowBatchTimer: 487.288ms | |
- FirstBatchArrivalWaitTime: 6s861ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.55M (2549973) | |
- RowsReturnedRate: 325.35 K/sec | |
- SendersBlockedTimer: 3s671ms | |
- SendersBlockedTotalTimer(*): 55s016ms | |
Instance 514ee9ab39cdc507:7c (host=cdh15.net.cuberonlabs.com:22000):(Total: 13s866ms, non-child: 28.888ms, % non-child: 0.21%) | |
MemoryUsage(500.000ms): 22.03 MB, 25.48 MB, 22.06 MB, 22.06 MB, 22.06 MB, 22.06 MB, 43.98 MB, 69.98 MB, 123.58 MB, 178.00 MB, 251.92 MB, 307.10 MB, 349.60 MB, 392.73 MB, 429.60 MB, 467.73 MB, 518.03 MB, 547.04 MB, 551.97 MB, 554.97 MB, 556.97 MB, 575.21 MB, 526.48 MB, 485.76 MB, 492.22 MB, 493.70 MB, 497.62 MB, 492.20 MB | |
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.93 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 599.33 MB (628444782) | |
- PerHostPeakMemUsage: 1.57 GB (1688553772) | |
- RowsProduced: 2.09K (2094) | |
- TotalNetworkReceiveTime: 16s748ms | |
- TotalNetworkSendTime: 5.074ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 14 (14) | |
- TotalThreadsTotalWallClockTime: 26s713ms | |
- TotalThreadsSysTime: 480.000ms | |
- TotalThreadsUserTime: 5s536ms | |
- TotalThreadsVoluntaryContextSwitches: 7.85K (7847) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s017ms | |
- ExecTreeExecTime: 2s006ms | |
- OpenTime: 11s791ms | |
- ExecTreeOpenTime: 10s873ms | |
- PrepareTime: 58.206ms | |
- ExecTreePrepareTime: 2.242ms | |
DataStreamSender (dst_id=35):(Total: 2.759ms, non-child: 2.759ms, % non-child: 100.00%) | |
- BytesSent: 121.07 KB (123973) | |
- NetworkThroughput(*): 150.97 MB/sec | |
- OverallThroughput: 42.84 MB/sec | |
- PeakMemoryUsage: 300.36 KB (307568) | |
- RowsReturned: 2.09K (2094) | |
- SerializeBatchTime: 1.931ms | |
- TransmitDataRPCTime: 783.128us | |
- UncompressedRowBatchSize: 232.48 KB (238056) | |
CodeGen:(Total: 953.009ms, non-child: 953.009ms, % non-child: 100.00%) | |
- CodegenTime: 8.333ms | |
- CompileTime: 272.713ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 142 (142) | |
- NumInstructions: 7.08K (7077) | |
- OptimizationTime: 643.108ms | |
- PeakMemoryUsage: 3.46 MB (3623424) | |
- PrepareTime: 36.332ms | |
AGGREGATION_NODE (id=11):(Total: 12s882ms, non-child: 67.898ms, % non-child: 0.53%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 81.204us | |
- GetResultsTime: 163.828us | |
- HTResizeTime: 0.000ns | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 7 (7) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 9.43 MB (9890721) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 0.00 | |
- ReductionFactorThresholdToExpand: 0.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 2.09K (2094) | |
- RowsReturnedRate: 162.00 /sec | |
- StreamingTime: 64.761ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=10):(Total: 12s814ms, non-child: 345.785ms, % non-child: 2.70%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 1.05K (1047) | |
- BuildTime: 552.359us | |
- PeakMemoryUsage: 1.25 MB (1310297) | |
- ProbeRows: 2.55M (2545548) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 336.867ms | |
- RowsReturned: 2.09K (2094) | |
- RowsReturnedRate: 163.00 /sec | |
Hash Join Builder (join_node_id=10): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
- BuildRowsPartitionTime: 184.494us | |
- BuildRowsPartitioned: 1.05K (1047) | |
- GetNewBlockTime: 60.860us | |
- HashBuckets: 2.05K (2048) | |
- HashCollisions: 0 (0) | |
- HashTablesBuildTime: 233.097us | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.06 MB (1111168) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=34):(Total: 2s031ms, non-child: 22.230ms, % non-child: 1.09%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 11.686ms | |
- GetNewBlockTime: 1.065ms | |
- GetResultsTime: 8.183ms | |
- HTResizeTime: 1.129ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 20.06 MB (21039609) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.05K (1047) | |
- RowsReturnedRate: 515.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 978.000ns | |
EXCHANGE_NODE (id=33):(Total: 2s009ms, non-child: 1.858ms, % non-child: 0.09%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 1.64 MB (1720365) | |
- ConvertRowBatchTime: 600.698us | |
- DeserializeRowBatchTimer: 5.615ms | |
- FirstBatchArrivalWaitTime: 1s967ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.58K (30583) | |
- RowsReturnedRate: 15.22 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
HASH_JOIN_NODE (id=9):(Total: 12s467ms, non-child: 1s749ms, % non-child: 14.03%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 2.45M (2453766) | |
- BuildTime: 820.989ms | |
- PeakMemoryUsage: 457.17 MB (479379261) | |
- ProbeRows: 2.55M (2545549) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 908.479ms | |
- RowsReturned: 2.55M (2545548) | |
- RowsReturnedRate: 204.17 K/sec | |
Hash Join Builder (join_node_id=9): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 1 of 1 Runtime Filter Published | |
- BuildRowsPartitionTime: 667.101ms | |
- BuildRowsPartitioned: 2.45M (2453766) | |
- GetNewBlockTime: 248.424us | |
- HashBuckets: 4.19M (4194304) | |
- HashCollisions: 1.44K (1439) | |
- HashTablesBuildTime: 133.855ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 457.03 MB (479229056) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=27):(Total: 10s050ms, non-child: 2s653ms, % non-child: 26.40%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 2s016ms | |
- GetNewBlockTime: 568.576us | |
- GetResultsTime: 560.883ms | |
- HTResizeTime: 155.158ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 530.12 MB (555876161) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.45M (2453766) | |
- RowsReturnedRate: 244.15 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.032us | |
EXCHANGE_NODE (id=26):(Total: 7s396ms, non-child: 195.902ms, % non-child: 2.65%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.25 MB, 7.35 MB, 20.71 MB, 44.38 MB, 71.61 MB, 102.12 MB, 132.29 MB, 162.17 MB, 190.06 MB, 214.00 MB, 234.44 MB, 250.01 MB, 257.92 MB, 263.57 MB, 266.99 MB | |
- BytesReceived: 268.01 MB (281026310) | |
- ConvertRowBatchTime: 89.516ms | |
- DeserializeRowBatchTimer: 797.379ms | |
- FirstBatchArrivalWaitTime: 1s775ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.35M (4349728) | |
- RowsReturnedRate: 588.07 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=28):(Total: 7s494ms, non-child: 129.272ms, % non-child: 1.72%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.64 MB, 32.00 MB, 70.37 MB, 108.03 MB | |
- BytesReceived: 122.01 MB (127934534) | |
- ConvertRowBatchTime: 46.915ms | |
- DeserializeRowBatchTimer: 441.577ms | |
- FirstBatchArrivalWaitTime: 6s826ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.55M (2545549) | |
- RowsReturnedRate: 339.65 K/sec | |
- SendersBlockedTimer: 3s908ms | |
- SendersBlockedTotalTimer(*): 55s331ms | |
Instance 514ee9ab39cdc507:7b (host=cdh6.net.cuberonlabs.com:22000):(Total: 13s865ms, non-child: 27.117ms, % non-child: 0.20%) | |
MemoryUsage(500.000ms): 25.48 MB, 25.48 MB, 22.06 MB, 22.06 MB, 22.06 MB, 22.06 MB, 45.37 MB, 81.00 MB, 127.18 MB, 179.11 MB, 266.67 MB, 312.73 MB, 357.20 MB, 396.80 MB, 440.27 MB, 469.73 MB, 522.10 MB, 546.97 MB, 552.04 MB, 555.97 MB, 556.91 MB, 567.09 MB, 518.36 MB, 469.64 MB, 492.22 MB, 492.28 MB, 496.13 MB, 500.02 MB | |
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.93 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 599.33 MB (628446184) | |
- PerHostPeakMemUsage: 1.67 GB (1794839264) | |
- RowsProduced: 2.05K (2053) | |
- TotalNetworkReceiveTime: 16s761ms | |
- TotalNetworkSendTime: 4.961ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 23 (23) | |
- TotalThreadsTotalWallClockTime: 26s744ms | |
- TotalThreadsSysTime: 452.000ms | |
- TotalThreadsUserTime: 5s536ms | |
- TotalThreadsVoluntaryContextSwitches: 8.11K (8106) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s955ms | |
- ExecTreeExecTime: 1s945ms | |
- OpenTime: 11s854ms | |
- ExecTreeOpenTime: 10s918ms | |
- PrepareTime: 55.408ms | |
- ExecTreePrepareTime: 1.913ms | |
DataStreamSender (dst_id=35):(Total: 2.608ms, non-child: 2.608ms, % non-child: 100.00%) | |
- BytesSent: 118.70 KB (121546) | |
- NetworkThroughput(*): 149.80 MB/sec | |
- OverallThroughput: 44.44 MB/sec | |
- PeakMemoryUsage: 300.36 KB (307568) | |
- RowsReturned: 2.05K (2053) | |
- SerializeBatchTime: 1.788ms | |
- TransmitDataRPCTime: 773.776us | |
- UncompressedRowBatchSize: 227.70 KB (233163) | |
CodeGen:(Total: 970.174ms, non-child: 970.174ms, % non-child: 100.00%) | |
- CodegenTime: 7.585ms | |
- CompileTime: 260.359ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 142 (142) | |
- NumInstructions: 7.08K (7077) | |
- OptimizationTime: 673.860ms | |
- PeakMemoryUsage: 3.46 MB (3623424) | |
- PrepareTime: 35.151ms | |
AGGREGATION_NODE (id=11):(Total: 12s865ms, non-child: 63.641ms, % non-child: 0.49%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 77.692us | |
- GetResultsTime: 161.224us | |
- HTResizeTime: 0.000ns | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 7 (7) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 9.41 MB (9869973) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 0.00 | |
- ReductionFactorThresholdToExpand: 0.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 2.05K (2053) | |
- RowsReturnedRate: 159.00 /sec | |
- StreamingTime: 60.294ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=10):(Total: 12s802ms, non-child: 330.547ms, % non-child: 2.58%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 1.03K (1027) | |
- BuildTime: 764.052us | |
- PeakMemoryUsage: 1.25 MB (1310260) | |
- ProbeRows: 2.55M (2549383) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 321.238ms | |
- RowsReturned: 2.05K (2053) | |
- RowsReturnedRate: 160.00 /sec | |
Hash Join Builder (join_node_id=10): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
- BuildRowsPartitionTime: 404.704us | |
- BuildRowsPartitioned: 1.03K (1027) | |
- GetNewBlockTime: 105.108us | |
- HashBuckets: 2.05K (2048) | |
- HashCollisions: 0 (0) | |
- HashTablesBuildTime: 157.400us | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.06 MB (1111168) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=34):(Total: 2s016ms, non-child: 22.717ms, % non-child: 1.13%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 12.190ms | |
- GetNewBlockTime: 180.956us | |
- GetResultsTime: 8.220ms | |
- HTResizeTime: 1.248ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 20.06 MB (21035388) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.03K (1027) | |
- RowsReturnedRate: 509.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 948.000ns | |
EXCHANGE_NODE (id=33):(Total: 1s993ms, non-child: 2.019ms, % non-child: 0.10%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 1.63 MB (1707637) | |
- ConvertRowBatchTime: 756.240us | |
- DeserializeRowBatchTimer: 5.908ms | |
- FirstBatchArrivalWaitTime: 1s952ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.35K (30348) | |
- RowsReturnedRate: 15.22 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
HASH_JOIN_NODE (id=9):(Total: 12s471ms, non-child: 1s651ms, % non-child: 13.24%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 2.46M (2458183) | |
- BuildTime: 768.362ms | |
- PeakMemoryUsage: 457.17 MB (479380600) | |
- ProbeRows: 2.55M (2549383) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 864.032ms | |
- RowsReturned: 2.55M (2549383) | |
- RowsReturnedRate: 204.42 K/sec | |
Hash Join Builder (join_node_id=9): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 1 of 1 Runtime Filter Published | |
- BuildRowsPartitionTime: 592.109ms | |
- BuildRowsPartitioned: 2.46M (2458183) | |
- GetNewBlockTime: 252.924us | |
- HashBuckets: 4.19M (4194304) | |
- HashCollisions: 1.35K (1349) | |
- HashTablesBuildTime: 156.327ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 457.03 MB (479229056) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=27):(Total: 10s148ms, non-child: 2s714ms, % non-child: 26.75%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s963ms | |
- GetNewBlockTime: 1.182ms | |
- GetResultsTime: 658.587ms | |
- HTResizeTime: 154.319ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 530.10 MB (555847584) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.46M (2458183) | |
- RowsReturnedRate: 242.23 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.004us | |
EXCHANGE_NODE (id=26):(Total: 7s433ms, non-child: 187.637ms, % non-child: 2.52%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.72 MB, 8.37 MB, 22.90 MB, 47.88 MB, 75.12 MB, 105.39 MB, 136.07 MB, 165.49 MB, 192.56 MB, 216.05 MB, 236.27 MB, 250.90 MB, 258.55 MB, 263.95 MB, 267.15 MB | |
- BytesReceived: 267.89 MB (280906071) | |
- ConvertRowBatchTime: 88.572ms | |
- DeserializeRowBatchTimer: 731.500ms | |
- FirstBatchArrivalWaitTime: 1s761ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.35M (4348148) | |
- RowsReturnedRate: 584.95 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=28):(Total: 7s482ms, non-child: 123.805ms, % non-child: 1.65%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.60 MB, 36.20 MB, 74.59 MB, 112.87 MB | |
- BytesReceived: 122.12 MB (128057344) | |
- ConvertRowBatchTime: 43.406ms | |
- DeserializeRowBatchTimer: 436.316ms | |
- FirstBatchArrivalWaitTime: 6s810ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.55M (2549383) | |
- RowsReturnedRate: 340.69 K/sec | |
- SendersBlockedTimer: 3s968ms | |
- SendersBlockedTotalTimer(*): 56s263ms | |
Instance 514ee9ab39cdc507:78 (host=cdh4.net.cuberonlabs.com:22000):(Total: 13s865ms, non-child: 27.196ms, % non-child: 0.20%) | |
MemoryUsage(500.000ms): 25.48 MB, 25.48 MB, 22.06 MB, 22.06 MB, 22.06 MB, 22.20 MB, 55.40 MB, 93.08 MB, 133.36 MB, 202.74 MB, 274.80 MB, 321.67 MB, 363.67 MB, 406.80 MB, 444.74 MB, 477.80 MB, 526.97 MB, 548.91 MB, 551.97 MB, 555.97 MB, 557.97 MB, 542.73 MB, 501.88 MB, 491.99 MB, 492.21 MB, 494.58 MB, 497.64 MB, 497.25 MB | |
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.89 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 599.33 MB (628445051) | |
- PerHostPeakMemUsage: 2.13 GB (2284202661) | |
- RowsProduced: 2.16K (2163) | |
- TotalNetworkReceiveTime: 16s767ms | |
- TotalNetworkSendTime: 6.691ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 25 (25) | |
- TotalThreadsTotalWallClockTime: 26s257ms | |
- TotalThreadsSysTime: 592.000ms | |
- TotalThreadsUserTime: 5s260ms | |
- TotalThreadsVoluntaryContextSwitches: 7.47K (7467) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s284ms | |
- ExecTreeExecTime: 2s271ms | |
- OpenTime: 11s528ms | |
- ExecTreeOpenTime: 10s511ms | |
- PrepareTime: 53.296ms | |
- ExecTreePrepareTime: 2.176ms | |
DataStreamSender (dst_id=35):(Total: 3.960ms, non-child: 3.960ms, % non-child: 100.00%) | |
- BytesSent: 125.57 KB (128585) | |
- NetworkThroughput(*): 54.83 MB/sec | |
- OverallThroughput: 30.96 MB/sec | |
- PeakMemoryUsage: 316.36 KB (323952) | |
- RowsReturned: 2.16K (2163) | |
- SerializeBatchTime: 1.682ms | |
- TransmitDataRPCTime: 2.236ms | |
- UncompressedRowBatchSize: 240.04 KB (245798) | |
CodeGen:(Total: 1s049ms, non-child: 1s049ms, % non-child: 100.00%) | |
- CodegenTime: 7.265ms | |
- CompileTime: 292.919ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 142 (142) | |
- NumInstructions: 7.08K (7077) | |
- OptimizationTime: 722.168ms | |
- PeakMemoryUsage: 3.46 MB (3623424) | |
- PrepareTime: 33.722ms | |
AGGREGATION_NODE (id=11):(Total: 12s784ms, non-child: 80.600ms, % non-child: 0.63%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 76.820us | |
- GetResultsTime: 159.344us | |
- HTResizeTime: 0.000ns | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 6 (6) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 9.42 MB (9878493) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 0.00 | |
- ReductionFactorThresholdToExpand: 0.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 2.16K (2163) | |
- RowsReturnedRate: 169.00 /sec | |
- StreamingTime: 76.608ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=10):(Total: 12s704ms, non-child: 363.359ms, % non-child: 2.86%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 1.08K (1081) | |
- BuildTime: 455.708us | |
- PeakMemoryUsage: 1.24 MB (1300947) | |
- ProbeRows: 2.55M (2551133) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 353.774ms | |
- RowsReturned: 2.16K (2163) | |
- RowsReturnedRate: 170.00 /sec | |
Hash Join Builder (join_node_id=10): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
- BuildRowsPartitionTime: 189.520us | |
- BuildRowsPartitioned: 1.08K (1081) | |
- GetNewBlockTime: 43.268us | |
- HashBuckets: 2.18K (2176) | |
- HashCollisions: 0 (0) | |
- HashTablesBuildTime: 155.952us | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.06 MB (1113216) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=34):(Total: 1s935ms, non-child: 21.425ms, % non-child: 1.11%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 10.187ms | |
- GetNewBlockTime: 223.688us | |
- GetResultsTime: 8.643ms | |
- HTResizeTime: 919.172us | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 20.08 MB (21050280) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.08K (1081) | |
- RowsReturnedRate: 558.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 964.000ns | |
EXCHANGE_NODE (id=33):(Total: 1s913ms, non-child: 1.857ms, % non-child: 0.10%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 1.64 MB (1724541) | |
- ConvertRowBatchTime: 715.220us | |
- DeserializeRowBatchTimer: 8.704ms | |
- FirstBatchArrivalWaitTime: 1s876ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.63K (30633) | |
- RowsReturnedRate: 16.01 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
HASH_JOIN_NODE (id=9):(Total: 12s340ms, non-child: 1s548ms, % non-child: 12.55%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 2.46M (2458732) | |
- BuildTime: 679.854ms | |
- PeakMemoryUsage: 457.17 MB (479380240) | |
- ProbeRows: 2.55M (2551133) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 851.796ms | |
- RowsReturned: 2.55M (2551133) | |
- RowsReturnedRate: 206.73 K/sec | |
Hash Join Builder (join_node_id=9): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 1 of 1 Runtime Filter Published | |
- BuildRowsPartitionTime: 527.995ms | |
- BuildRowsPartitioned: 2.46M (2458732) | |
- GetNewBlockTime: 224.384us | |
- HashBuckets: 4.19M (4194304) | |
- HashCollisions: 1.36K (1363) | |
- HashTablesBuildTime: 131.905ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 457.03 MB (479229056) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=27):(Total: 9s829ms, non-child: 2s507ms, % non-child: 25.51%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s993ms | |
- GetNewBlockTime: 1.693ms | |
- GetResultsTime: 443.601ms | |
- HTResizeTime: 172.432ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 530.10 MB (555853396) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.46M (2458732) | |
- RowsReturnedRate: 250.14 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.032us | |
EXCHANGE_NODE (id=26):(Total: 7s321ms, non-child: 222.558ms, % non-child: 3.04%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 63.44 KB, 3.96 MB, 11.53 MB, 29.45 MB, 55.45 MB, 84.40 MB, 114.35 MB, 144.96 MB, 174.75 MB, 201.19 MB, 223.51 MB, 242.28 MB, 254.39 MB, 261.23 MB, 265.89 MB, 268.42 MB | |
- BytesReceived: 268.72 MB (281777063) | |
- ConvertRowBatchTime: 94.226ms | |
- DeserializeRowBatchTimer: 772.667ms | |
- FirstBatchArrivalWaitTime: 1s682ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.36M (4361857) | |
- RowsReturnedRate: 595.75 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=28):(Total: 7s694ms, non-child: 162.326ms, % non-child: 2.11%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.49 MB, 10.63 MB, 48.02 MB, 85.92 MB, 121.46 MB | |
- BytesReceived: 122.26 MB (128196375) | |
- ConvertRowBatchTime: 48.651ms | |
- DeserializeRowBatchTimer: 476.452ms | |
- FirstBatchArrivalWaitTime: 6s732ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.55M (2551133) | |
- RowsReturnedRate: 331.56 K/sec | |
- SendersBlockedTimer: 3s640ms | |
- SendersBlockedTotalTimer(*): 1m1s | |
Instance 514ee9ab39cdc507:7f (host=cdh2.net.cuberonlabs.com:22000):(Total: 13s865ms, non-child: 27.345ms, % non-child: 0.20%) | |
MemoryUsage(500.000ms): 25.48 MB, 25.48 MB, 22.06 MB, 22.06 MB, 22.06 MB, 22.06 MB, 45.46 MB, 81.03 MB, 127.23 MB, 179.85 MB, 265.67 MB, 316.93 MB, 356.33 MB, 396.73 MB, 433.80 MB, 471.00 MB, 519.95 MB, 546.89 MB, 552.01 MB, 554.95 MB, 556.95 MB, 575.07 MB, 510.10 MB, 508.76 MB, 492.07 MB, 492.38 MB, 496.58 MB, 492.26 MB | |
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.89 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 599.31 MB (628424536) | |
- PerHostPeakMemUsage: 1.74 GB (1866918022) | |
- RowsProduced: 2.01K (2008) | |
- TotalNetworkReceiveTime: 17s177ms | |
- TotalNetworkSendTime: 4.342ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 40 (40) | |
- TotalThreadsTotalWallClockTime: 26s468ms | |
- TotalThreadsSysTime: 536.000ms | |
- TotalThreadsUserTime: 5s128ms | |
- TotalThreadsVoluntaryContextSwitches: 7.84K (7845) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s294ms | |
- ExecTreeExecTime: 2s283ms | |
- OpenTime: 11s514ms | |
- ExecTreeOpenTime: 10s611ms | |
- PrepareTime: 56.262ms | |
- ExecTreePrepareTime: 2.220ms | |
DataStreamSender (dst_id=35):(Total: 2.390ms, non-child: 2.390ms, % non-child: 100.00%) | |
- BytesSent: 116.46 KB (119259) | |
- NetworkThroughput(*): 183.00 MB/sec | |
- OverallThroughput: 47.58 MB/sec | |
- PeakMemoryUsage: 256.36 KB (262512) | |
- RowsReturned: 2.01K (2008) | |
- SerializeBatchTime: 1.723ms | |
- TransmitDataRPCTime: 621.508us | |
- UncompressedRowBatchSize: 222.91 KB (228262) | |
CodeGen:(Total: 938.516ms, non-child: 938.516ms, % non-child: 100.00%) | |
- CodegenTime: 7.644ms | |
- CompileTime: 257.087ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 142 (142) | |
- NumInstructions: 7.08K (7077) | |
- OptimizationTime: 644.413ms | |
- PeakMemoryUsage: 3.46 MB (3623424) | |
- PrepareTime: 36.227ms | |
AGGREGATION_NODE (id=11):(Total: 12s896ms, non-child: 70.683ms, % non-child: 0.55%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 66.372us | |
- GetResultsTime: 180.968us | |
- HTResizeTime: 0.000ns | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 7 (7) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 9.42 MB (9876237) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 0.00 | |
- ReductionFactorThresholdToExpand: 0.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 2.01K (2008) | |
- RowsReturnedRate: 155.00 /sec | |
- StreamingTime: 67.650ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=10):(Total: 12s826ms, non-child: 377.603ms, % non-child: 2.94%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 1.00K (1003) | |
- BuildTime: 448.568us | |
- PeakMemoryUsage: 1.25 MB (1311792) | |
- ProbeRows: 2.55M (2548486) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 366.772ms | |
- RowsReturned: 2.01K (2008) | |
- RowsReturnedRate: 156.00 /sec | |
Hash Join Builder (join_node_id=10): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
- BuildRowsPartitionTime: 168.164us | |
- BuildRowsPartitioned: 1.00K (1003) | |
- GetNewBlockTime: 64.331us | |
- HashBuckets: 2.05K (2048) | |
- HashCollisions: 2 (2) | |
- HashTablesBuildTime: 147.156us | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.06 MB (1111168) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=34):(Total: 2s050ms, non-child: 20.484ms, % non-child: 1.00%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 11.236ms | |
- GetNewBlockTime: 235.232us | |
- GetResultsTime: 7.089ms | |
- HTResizeTime: 943.804us | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 20.05 MB (21027602) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.00K (1003) | |
- RowsReturnedRate: 489.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.040us | |
EXCHANGE_NODE (id=33):(Total: 2s029ms, non-child: 1.920ms, % non-child: 0.09%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 1.64 MB (1717014) | |
- ConvertRowBatchTime: 690.552us | |
- DeserializeRowBatchTimer: 5.847ms | |
- FirstBatchArrivalWaitTime: 1s984ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.51K (30514) | |
- RowsReturnedRate: 15.03 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
HASH_JOIN_NODE (id=9):(Total: 12s447ms, non-child: 1s524ms, % non-child: 12.24%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 2.46M (2456009) | |
- BuildTime: 665.258ms | |
- PeakMemoryUsage: 457.17 MB (479379789) | |
- ProbeRows: 2.55M (2548486) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 840.595ms | |
- RowsReturned: 2.55M (2548486) | |
- RowsReturnedRate: 204.73 K/sec | |
Hash Join Builder (join_node_id=9): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 1 of 1 Runtime Filter Published | |
- BuildRowsPartitionTime: 510.127ms | |
- BuildRowsPartitioned: 2.46M (2456009) | |
- GetNewBlockTime: 214.024us | |
- HashBuckets: 4.19M (4194304) | |
- HashCollisions: 1.41K (1410) | |
- HashTablesBuildTime: 136.052ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 457.03 MB (479229056) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=27):(Total: 9s943ms, non-child: 2s456ms, % non-child: 24.70%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s941ms | |
- GetNewBlockTime: 667.948us | |
- GetResultsTime: 442.045ms | |
- HTResizeTime: 173.507ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 530.10 MB (555846876) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.46M (2456009) | |
- RowsReturnedRate: 247.00 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.104us | |
EXCHANGE_NODE (id=26):(Total: 7s487ms, non-child: 205.633ms, % non-child: 2.75%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.77 MB, 8.54 MB, 23.04 MB, 48.14 MB, 75.44 MB, 105.71 MB, 136.44 MB, 165.82 MB, 193.03 MB, 216.39 MB, 236.67 MB, 251.26 MB, 258.81 MB, 264.18 MB, 267.39 MB | |
- BytesReceived: 268.12 MB (281144206) | |
- ConvertRowBatchTime: 91.322ms | |
- DeserializeRowBatchTimer: 754.514ms | |
- FirstBatchArrivalWaitTime: 1s789ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.35M (4353561) | |
- RowsReturnedRate: 581.47 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=28):(Total: 7s820ms, non-child: 154.210ms, % non-child: 1.97%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.36 MB, 10.53 MB, 36.35 MB, 74.86 MB, 113.07 MB | |
- BytesReceived: 122.12 MB (128053775) | |
- ConvertRowBatchTime: 50.666ms | |
- DeserializeRowBatchTimer: 486.582ms | |
- FirstBatchArrivalWaitTime: 6s839ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.55M (2548486) | |
- RowsReturnedRate: 325.88 K/sec | |
- SendersBlockedTimer: 3s628ms | |
- SendersBlockedTotalTimer(*): 50s752ms | |
Instance 514ee9ab39cdc507:81 (host=cdh14.net.cuberonlabs.com:22000):(Total: 13s864ms, non-child: 26.592ms, % non-child: 0.19%) | |
MemoryUsage(500.000ms): 25.48 MB, 22.03 MB, 22.06 MB, 22.06 MB, 22.06 MB, 33.77 MB, 64.40 MB, 105.17 MB, 145.85 MB, 206.92 MB, 289.67 MB, 333.60 MB, 377.61 MB, 416.74 MB, 455.67 MB, 494.96 MB, 536.01 MB, 550.95 MB, 552.88 MB, 555.95 MB, 557.88 MB, 542.70 MB, 493.98 MB, 500.88 MB, 492.46 MB, 498.66 MB, 493.68 MB | |
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 | |
- AverageThreadTokens: 1.96 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 599.31 MB (628421213) | |
- PerHostPeakMemUsage: 1.44 GB (1548652528) | |
- RowsProduced: 2.19K (2191) | |
- TotalNetworkReceiveTime: 17s247ms | |
- TotalNetworkSendTime: 4.728ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 18 (18) | |
- TotalThreadsTotalWallClockTime: 26s922ms | |
- TotalThreadsSysTime: 396.000ms | |
- TotalThreadsUserTime: 5s296ms | |
- TotalThreadsVoluntaryContextSwitches: 8.18K (8178) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s974ms | |
- ExecTreeExecTime: 1s963ms | |
- OpenTime: 11s834ms | |
- ExecTreeOpenTime: 10s995ms | |
- PrepareTime: 54.882ms | |
- ExecTreePrepareTime: 2.340ms | |
DataStreamSender (dst_id=35):(Total: 2.232ms, non-child: 2.232ms, % non-child: 100.00%) | |
- BytesSent: 126.76 KB (129807) | |
- NetworkThroughput(*): 262.98 MB/sec | |
- OverallThroughput: 55.46 MB/sec | |
- PeakMemoryUsage: 324.36 KB (332144) | |
- RowsReturned: 2.19K (2191) | |
- SerializeBatchTime: 1.710ms | |
- TransmitDataRPCTime: 470.730us | |
- UncompressedRowBatchSize: 243.13 KB (248964) | |
CodeGen:(Total: 873.970ms, non-child: 873.970ms, % non-child: 100.00%) | |
- CodegenTime: 7.510ms | |
- CompileTime: 254.196ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 142 (142) | |
- NumInstructions: 7.08K (7077) | |
- OptimizationTime: 583.487ms | |
- PeakMemoryUsage: 3.46 MB (3623424) | |
- PrepareTime: 35.522ms | |
AGGREGATION_NODE (id=11):(Total: 12s961ms, non-child: 62.986ms, % non-child: 0.49%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 72.869us | |
- GetResultsTime: 174.335us | |
- HTResizeTime: 0.000ns | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 6 (6) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 9.42 MB (9880671) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 0.00 | |
- ReductionFactorThresholdToExpand: 0.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 2.19K (2191) | |
- RowsReturnedRate: 169.00 /sec | |
- StreamingTime: 60.677ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=10):(Total: 12s898ms, non-child: 353.551ms, % non-child: 2.74%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 1.09K (1095) | |
- BuildTime: 518.756us | |
- PeakMemoryUsage: 1.25 MB (1310664) | |
- ProbeRows: 2.55M (2547420) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 343.718ms | |
- RowsReturned: 2.19K (2191) | |
- RowsReturnedRate: 169.00 /sec | |
Hash Join Builder (join_node_id=10): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
- BuildRowsPartitionTime: 198.234us | |
- BuildRowsPartitioned: 1.09K (1095) | |
- GetNewBlockTime: 109.928us | |
- HashBuckets: 2.05K (2048) | |
- HashCollisions: 0 (0) | |
- HashTablesBuildTime: 135.552us | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.06 MB (1111168) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=34):(Total: 2s119ms, non-child: 21.327ms, % non-child: 1.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 10.793ms | |
- GetNewBlockTime: 206.518us | |
- GetResultsTime: 8.152ms | |
- HTResizeTime: 1.232ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 20.08 MB (21052345) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.09K (1095) | |
- RowsReturnedRate: 516.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 968.000ns | |
EXCHANGE_NODE (id=33):(Total: 2s097ms, non-child: 1.753ms, % non-child: 0.08%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 1.64 MB (1717744) | |
- ConvertRowBatchTime: 751.977us | |
- DeserializeRowBatchTimer: 6.137ms | |
- FirstBatchArrivalWaitTime: 2s048ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.54K (30536) | |
- RowsReturnedRate: 14.56 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
HASH_JOIN_NODE (id=9):(Total: 12s544ms, non-child: 1s609ms, % non-child: 12.83%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 2.46M (2455417) | |
- BuildTime: 748.806ms | |
- PeakMemoryUsage: 457.17 MB (479379847) | |
- ProbeRows: 2.55M (2547420) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 845.172ms | |
- RowsReturned: 2.55M (2547420) | |
- RowsReturnedRate: 203.07 K/sec | |
Hash Join Builder (join_node_id=9): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 1 of 1 Runtime Filter Published | |
- BuildRowsPartitionTime: 574.657ms | |
- BuildRowsPartitioned: 2.46M (2455417) | |
- GetNewBlockTime: 188.132us | |
- HashBuckets: 4.19M (4194304) | |
- HashCollisions: 1.34K (1342) | |
- HashTablesBuildTime: 156.125ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 457.03 MB (479229056) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=27):(Total: 10s244ms, non-child: 2s547ms, % non-child: 24.87%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s802ms | |
- GetNewBlockTime: 639.923us | |
- GetResultsTime: 652.004ms | |
- HTResizeTime: 141.768ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 530.16 MB (555910742) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.46M (2455417) | |
- RowsReturnedRate: 239.68 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.075us | |
EXCHANGE_NODE (id=26):(Total: 7s697ms, non-child: 190.388ms, % non-child: 2.47%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 940.15 KB, 4.98 MB, 13.96 MB, 34.39 MB, 61.00 MB, 89.80 MB, 120.58 MB, 150.66 MB, 179.86 MB, 205.14 MB, 227.04 MB, 244.95 MB, 255.48 MB, 261.95 MB, 266.29 MB, 268.14 MB | |
- BytesReceived: 268.17 MB (281193674) | |
- ConvertRowBatchTime: 81.594ms | |
- DeserializeRowBatchTimer: 808.094ms | |
- FirstBatchArrivalWaitTime: 1s856ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.35M (4351888) | |
- RowsReturnedRate: 565.39 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=28):(Total: 7s596ms, non-child: 134.553ms, % non-child: 1.77%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.64 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.41 MB, 15.88 MB, 55.64 MB, 93.53 MB | |
- BytesReceived: 122.10 MB (128030436) | |
- ConvertRowBatchTime: 47.535ms | |
- DeserializeRowBatchTimer: 455.165ms | |
- FirstBatchArrivalWaitTime: 6s906ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.55M (2547420) | |
- RowsReturnedRate: 335.35 K/sec | |
- SendersBlockedTimer: 3s948ms | |
- SendersBlockedTotalTimer(*): 56s061ms | |
Instance 514ee9ab39cdc507:7d (host=cdh3.net.cuberonlabs.com:22000):(Total: 13s863ms, non-child: 35.325ms, % non-child: 0.25%) | |
MemoryUsage(500.000ms): 25.48 MB, 22.03 MB, 22.06 MB, 22.06 MB, 22.06 MB, 33.65 MB, 64.32 MB, 97.04 MB, 144.79 MB, 206.86 MB, 289.67 MB, 333.60 MB, 377.80 MB, 416.67 MB, 455.73 MB, 492.95 MB, 535.91 MB, 550.91 MB, 552.91 MB, 555.91 MB, 557.91 MB, 534.61 MB, 485.76 MB, 491.99 MB, 499.49 MB, 497.60 MB, 500.75 MB, 16.17 MB | |
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.89 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 599.33 MB (628445182) | |
- PerHostPeakMemUsage: 2.16 GB (2318232477) | |
- RowsProduced: 2.17K (2170) | |
- TotalNetworkReceiveTime: 16s498ms | |
- TotalNetworkSendTime: 6.220ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 39 (39) | |
- TotalThreadsTotalWallClockTime: 26s101ms | |
- TotalThreadsSysTime: 596.000ms | |
- TotalThreadsUserTime: 5s252ms | |
- TotalThreadsVoluntaryContextSwitches: 8.03K (8033) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s199ms | |
- ExecTreeExecTime: 2s186ms | |
- OpenTime: 11s597ms | |
- ExecTreeOpenTime: 10s481ms | |
- PrepareTime: 67.328ms | |
- ExecTreePrepareTime: 2.259ms | |
DataStreamSender (dst_id=35):(Total: 2.303ms, non-child: 2.303ms, % non-child: 100.00%) | |
- BytesSent: 125.85 KB (128867) | |
- NetworkThroughput(*): 187.37 MB/sec | |
- OverallThroughput: 53.35 MB/sec | |
- PeakMemoryUsage: 328.36 KB (336240) | |
- RowsReturned: 2.17K (2170) | |
- SerializeBatchTime: 1.594ms | |
- TransmitDataRPCTime: 655.916us | |
- UncompressedRowBatchSize: 240.96 KB (246741) | |
CodeGen:(Total: 1s155ms, non-child: 1s155ms, % non-child: 100.00%) | |
- CodegenTime: 10.886ms | |
- CompileTime: 360.241ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 142 (142) | |
- NumInstructions: 7.08K (7077) | |
- OptimizationTime: 752.649ms | |
- PeakMemoryUsage: 3.46 MB (3623424) | |
- PrepareTime: 41.962ms | |
AGGREGATION_NODE (id=11):(Total: 12s670ms, non-child: 76.125ms, % non-child: 0.60%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 81.880us | |
- GetResultsTime: 161.068us | |
- HTResizeTime: 0.000ns | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 6 (6) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 9.43 MB (9889062) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 0.00 | |
- ReductionFactorThresholdToExpand: 0.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 2.17K (2170) | |
- RowsReturnedRate: 171.00 /sec | |
- StreamingTime: 74.128ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=10):(Total: 12s594ms, non-child: 354.637ms, % non-child: 2.82%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 1.08K (1085) | |
- BuildTime: 505.468us | |
- PeakMemoryUsage: 1.25 MB (1305910) | |
- ProbeRows: 2.55M (2550342) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 344.518ms | |
- RowsReturned: 2.17K (2170) | |
- RowsReturnedRate: 172.00 /sec | |
Hash Join Builder (join_node_id=10): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
- BuildRowsPartitionTime: 205.156us | |
- BuildRowsPartitioned: 1.08K (1085) | |
- GetNewBlockTime: 81.928us | |
- HashBuckets: 2.05K (2048) | |
- HashCollisions: 3 (3) | |
- HashTablesBuildTime: 129.440us | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.06 MB (1111168) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=34):(Total: 1s824ms, non-child: 21.307ms, % non-child: 1.17%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 11.480ms | |
- GetNewBlockTime: 247.480us | |
- GetResultsTime: 7.417ms | |
- HTResizeTime: 1.417ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 20.07 MB (21041393) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.08K (1085) | |
- RowsReturnedRate: 594.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1000.000ns | |
EXCHANGE_NODE (id=33):(Total: 1s803ms, non-child: 1.512ms, % non-child: 0.08%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 1.64 MB (1724321) | |
- ConvertRowBatchTime: 681.196us | |
- DeserializeRowBatchTimer: 5.169ms | |
- FirstBatchArrivalWaitTime: 1s761ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.64K (30643) | |
- RowsReturnedRate: 16.99 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
HASH_JOIN_NODE (id=9):(Total: 12s238ms, non-child: 1s690ms, % non-child: 13.81%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 2.46M (2458211) | |
- BuildTime: 736.275ms | |
- PeakMemoryUsage: 457.17 MB (479379055) | |
- ProbeRows: 2.55M (2550342) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 938.161ms | |
- RowsReturned: 2.55M (2550342) | |
- RowsReturnedRate: 208.38 K/sec | |
Hash Join Builder (join_node_id=9): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 1 of 1 Runtime Filter Published | |
- BuildRowsPartitionTime: 566.600ms | |
- BuildRowsPartitioned: 2.46M (2458211) | |
- GetNewBlockTime: 2.988ms | |
- HashBuckets: 4.19M (4194304) | |
- HashCollisions: 1.50K (1501) | |
- HashTablesBuildTime: 148.388ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 457.03 MB (479229056) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=27):(Total: 9s742ms, non-child: 2s327ms, % non-child: 23.89%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s790ms | |
- GetNewBlockTime: 1.211ms | |
- GetResultsTime: 456.278ms | |
- HTResizeTime: 148.069ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 530.16 MB (555910716) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.46M (2458211) | |
- RowsReturnedRate: 252.31 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.048us | |
EXCHANGE_NODE (id=26):(Total: 7s415ms, non-child: 167.831ms, % non-child: 2.26%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 880.08 KB, 4.86 MB, 13.69 MB, 34.06 MB, 60.55 MB, 89.46 MB, 120.30 MB, 150.38 MB, 179.62 MB, 204.99 MB, 227.07 MB, 244.94 MB, 255.74 MB, 262.17 MB, 266.52 MB, 268.48 MB | |
- BytesReceived: 268.50 MB (281543378) | |
- ConvertRowBatchTime: 77.471ms | |
- DeserializeRowBatchTimer: 633.982ms | |
- FirstBatchArrivalWaitTime: 1s565ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.36M (4355774) | |
- RowsReturnedRate: 587.39 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=28):(Total: 7s422ms, non-child: 135.595ms, % non-child: 1.83%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.00 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.50 MB, 15.28 MB, 54.98 MB, 92.84 MB | |
- BytesReceived: 122.23 MB (128167552) | |
- ConvertRowBatchTime: 47.972ms | |
- DeserializeRowBatchTimer: 438.822ms | |
- FirstBatchArrivalWaitTime: 6s616ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.55M (2550342) | |
- RowsReturnedRate: 343.61 K/sec | |
- SendersBlockedTimer: 3s722ms | |
- SendersBlockedTotalTimer(*): 59s505ms | |
Instance 514ee9ab39cdc507:7a (host=cdh13.net.cuberonlabs.com:22000):(Total: 13s863ms, non-child: 29.045ms, % non-child: 0.21%) | |
MemoryUsage(500.000ms): 25.48 MB, 22.03 MB, 22.06 MB, 22.06 MB, 22.06 MB, 33.77 MB, 64.46 MB, 97.10 MB, 144.80 MB, 206.86 MB, 289.60 MB, 333.67 MB, 377.93 MB, 417.67 MB, 454.67 MB, 493.63 MB, 535.98 MB, 550.98 MB, 553.04 MB, 556.05 MB, 557.92 MB, 534.62 MB, 485.77 MB, 491.95 MB, 492.21 MB, 498.47 MB, 493.48 MB | |
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.93 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 599.34 MB (628455845) | |
- PerHostPeakMemUsage: 1.66 GB (1782381748) | |
- RowsProduced: 2.12K (2125) | |
- TotalNetworkReceiveTime: 17s461ms | |
- TotalNetworkSendTime: 4.764ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 10 (10) | |
- TotalThreadsTotalWallClockTime: 26s586ms | |
- TotalThreadsSysTime: 424.000ms | |
- TotalThreadsUserTime: 4s936ms | |
- TotalThreadsVoluntaryContextSwitches: 8.31K (8312) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s191ms | |
- ExecTreeExecTime: 2s178ms | |
- OpenTime: 11s617ms | |
- ExecTreeOpenTime: 10s722ms | |
- PrepareTime: 54.859ms | |
- ExecTreePrepareTime: 2.114ms | |
DataStreamSender (dst_id=35):(Total: 2.629ms, non-child: 2.629ms, % non-child: 100.00%) | |
- BytesSent: 122.77 KB (125714) | |
- NetworkThroughput(*): 163.65 MB/sec | |
- OverallThroughput: 45.59 MB/sec | |
- PeakMemoryUsage: 312.36 KB (319856) | |
- RowsReturned: 2.12K (2125) | |
- SerializeBatchTime: 1.788ms | |
- TransmitDataRPCTime: 732.597us | |
- UncompressedRowBatchSize: 235.52 KB (241168) | |
CodeGen:(Total: 929.721ms, non-child: 929.721ms, % non-child: 100.00%) | |
- CodegenTime: 7.247ms | |
- CompileTime: 272.979ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 142 (142) | |
- NumInstructions: 7.08K (7077) | |
- OptimizationTime: 620.886ms | |
- PeakMemoryUsage: 3.46 MB (3623424) | |
- PrepareTime: 35.066ms | |
AGGREGATION_NODE (id=11):(Total: 12s902ms, non-child: 65.188ms, % non-child: 0.51%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 76.895us | |
- GetResultsTime: 141.050us | |
- HTResizeTime: 0.000ns | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 7 (7) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 9.40 MB (9857229) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 0.00 | |
- ReductionFactorThresholdToExpand: 0.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 2.12K (2125) | |
- RowsReturnedRate: 164.00 /sec | |
- StreamingTime: 62.627ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=10):(Total: 12s837ms, non-child: 321.034ms, % non-child: 2.50%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 1.06K (1062) | |
- BuildTime: 2.352ms | |
- PeakMemoryUsage: 1.21 MB (1273383) | |
- ProbeRows: 2.55M (2549900) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 312.815ms | |
- RowsReturned: 2.12K (2125) | |
- RowsReturnedRate: 165.00 /sec | |
Hash Join Builder (join_node_id=10): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
- BuildRowsPartitionTime: 155.906us | |
- BuildRowsPartitioned: 1.06K (1062) | |
- GetNewBlockTime: 1.996ms | |
- HashBuckets: 2.05K (2048) | |
- HashCollisions: 1 (1) | |
- HashTablesBuildTime: 132.733us | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.06 MB (1111168) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=34):(Total: 2s054ms, non-child: 20.733ms, % non-child: 1.01%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 10.637ms | |
- GetNewBlockTime: 221.485us | |
- GetResultsTime: 7.667ms | |
- HTResizeTime: 971.813us | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 20.06 MB (21035254) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.06K (1062) | |
- RowsReturnedRate: 516.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 987.000ns | |
EXCHANGE_NODE (id=33):(Total: 2s034ms, non-child: 1.536ms, % non-child: 0.08%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 1.63 MB (1713684) | |
- ConvertRowBatchTime: 686.907us | |
- DeserializeRowBatchTimer: 5.361ms | |
- FirstBatchArrivalWaitTime: 1s996ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.47K (30466) | |
- RowsReturnedRate: 14.98 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
HASH_JOIN_NODE (id=9):(Total: 12s515ms, non-child: 1s628ms, % non-child: 13.01%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 2.46M (2457753) | |
- BuildTime: 737.735ms | |
- PeakMemoryUsage: 457.17 MB (479378983) | |
- ProbeRows: 2.55M (2549900) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 875.252ms | |
- RowsReturned: 2.55M (2549900) | |
- RowsReturnedRate: 203.74 K/sec | |
Hash Join Builder (join_node_id=9): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 1 of 1 Runtime Filter Published | |
- BuildRowsPartitionTime: 572.101ms | |
- BuildRowsPartitioned: 2.46M (2457753) | |
- GetNewBlockTime: 203.562us | |
- HashBuckets: 4.19M (4194304) | |
- HashCollisions: 1.37K (1370) | |
- HashTablesBuildTime: 146.459ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 457.03 MB (479229056) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=27):(Total: 9s982ms, non-child: 2s182ms, % non-child: 21.86%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s639ms | |
- GetNewBlockTime: 744.612us | |
- GetResultsTime: 476.627ms | |
- HTResizeTime: 121.088ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 530.10 MB (555847006) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.46M (2457753) | |
- RowsReturnedRate: 246.21 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.084us | |
EXCHANGE_NODE (id=26):(Total: 7s799ms, non-child: 171.067ms, % non-child: 2.19%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 939.45 KB, 5.01 MB, 13.91 MB, 34.39 MB, 60.82 MB, 89.82 MB, 120.67 MB, 150.77 MB, 179.93 MB, 205.18 MB, 227.15 MB, 245.02 MB, 255.65 MB, 262.12 MB, 266.46 MB, 268.35 MB | |
- BytesReceived: 268.37 MB (281409782) | |
- ConvertRowBatchTime: 72.198ms | |
- DeserializeRowBatchTimer: 733.777ms | |
- FirstBatchArrivalWaitTime: 1s800ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.36M (4356599) | |
- RowsReturnedRate: 558.56 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=28):(Total: 7s757ms, non-child: 136.069ms, % non-child: 1.75%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.42 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.45 MB, 15.70 MB, 55.58 MB, 93.42 MB | |
- BytesReceived: 122.22 MB (128158512) | |
- ConvertRowBatchTime: 43.275ms | |
- DeserializeRowBatchTimer: 468.428ms | |
- FirstBatchArrivalWaitTime: 6s852ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.55M (2549900) | |
- RowsReturnedRate: 328.70 K/sec | |
- SendersBlockedTimer: 3s730ms | |
- SendersBlockedTotalTimer(*): 52s255ms | |
Instance 514ee9ab39cdc507:79 (host=cdh16.net.cuberonlabs.com:22000):(Total: 13s863ms, non-child: 28.465ms, % non-child: 0.21%) | |
MemoryUsage(500.000ms): 25.48 MB, 22.03 MB, 22.06 MB, 22.06 MB, 22.06 MB, 46.81 MB, 67.37 MB, 112.65 MB, 160.35 MB, 238.67 MB, 305.74 MB, 347.73 MB, 387.67 MB, 428.79 MB, 465.61 MB, 515.94 MB, 545.94 MB, 551.01 MB, 554.94 MB, 556.94 MB, 591.30 MB, 521.83 MB, 448.87 MB, 492.14 MB, 501.68 MB, 497.56 MB, 492.67 MB | |
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.93 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 599.30 MB (628415300) | |
- PerHostPeakMemUsage: 1.64 GB (1763578733) | |
- RowsProduced: 2.03K (2032) | |
- TotalNetworkReceiveTime: 16s468ms | |
- TotalNetworkSendTime: 7.077ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 30 (30) | |
- TotalThreadsTotalWallClockTime: 26s243ms | |
- TotalThreadsSysTime: 536.000ms | |
- TotalThreadsUserTime: 5s516ms | |
- TotalThreadsVoluntaryContextSwitches: 7.51K (7512) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s241ms | |
- ExecTreeExecTime: 2s228ms | |
- OpenTime: 11s551ms | |
- ExecTreeOpenTime: 10s533ms | |
- PrepareTime: 71.181ms | |
- ExecTreePrepareTime: 2.793ms | |
DataStreamSender (dst_id=35):(Total: 2.133ms, non-child: 2.133ms, % non-child: 100.00%) | |
- BytesSent: 117.66 KB (120483) | |
- NetworkThroughput(*): 162.57 MB/sec | |
- OverallThroughput: 53.86 MB/sec | |
- PeakMemoryUsage: 248.36 KB (254320) | |
- RowsReturned: 2.03K (2032) | |
- SerializeBatchTime: 1.376ms | |
- TransmitDataRPCTime: 706.772us | |
- UncompressedRowBatchSize: 225.61 KB (231024) | |
CodeGen:(Total: 1s067ms, non-child: 1s067ms, % non-child: 100.00%) | |
- CodegenTime: 6.900ms | |
- CompileTime: 272.413ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 142 (142) | |
- NumInstructions: 7.08K (7077) | |
- OptimizationTime: 743.491ms | |
- PeakMemoryUsage: 3.46 MB (3623424) | |
- PrepareTime: 51.080ms | |
AGGREGATION_NODE (id=11):(Total: 12s765ms, non-child: 71.256ms, % non-child: 0.56%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 109.874us | |
- GetResultsTime: 135.072us | |
- HTResizeTime: 0.000ns | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 7 (7) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 9.43 MB (9889395) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 0.00 | |
- ReductionFactorThresholdToExpand: 0.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 2.03K (2032) | |
- RowsReturnedRate: 159.00 /sec | |
- StreamingTime: 68.962ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=10):(Total: 12s694ms, non-child: 337.990ms, % non-child: 2.66%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 1.02K (1016) | |
- BuildTime: 518.958us | |
- PeakMemoryUsage: 1.28 MB (1343333) | |
- ProbeRows: 2.55M (2547567) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 328.702ms | |
- RowsReturned: 2.03K (2032) | |
- RowsReturnedRate: 160.00 /sec | |
Hash Join Builder (join_node_id=10): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
- BuildRowsPartitionTime: 210.439us | |
- BuildRowsPartitioned: 1.02K (1016) | |
- GetNewBlockTime: 70.706us | |
- HashBuckets: 2.05K (2048) | |
- HashCollisions: 0 (0) | |
- HashTablesBuildTime: 168.096us | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.06 MB (1111168) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=34):(Total: 1s918ms, non-child: 25.742ms, % non-child: 1.34%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 12.470ms | |
- GetNewBlockTime: 308.928us | |
- GetResultsTime: 10.217ms | |
- HTResizeTime: 1.209ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 20.07 MB (21046178) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.02K (1016) | |
- RowsReturnedRate: 529.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.422us | |
EXCHANGE_NODE (id=33):(Total: 1s893ms, non-child: 1.903ms, % non-child: 0.10%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0 | |
- BytesReceived: 1.64 MB (1715662) | |
- ConvertRowBatchTime: 733.758us | |
- DeserializeRowBatchTimer: 7.496ms | |
- FirstBatchArrivalWaitTime: 1s855ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.48K (30484) | |
- RowsReturnedRate: 16.10 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
HASH_JOIN_NODE (id=9):(Total: 12s355ms, non-child: 1s669ms, % non-child: 13.51%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 2.46M (2455776) | |
- BuildTime: 692.651ms | |
- PeakMemoryUsage: 457.17 MB (479379398) | |
- ProbeRows: 2.55M (2547567) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 959.383ms | |
- RowsReturned: 2.55M (2547567) | |
- RowsReturnedRate: 206.19 K/sec | |
Hash Join Builder (join_node_id=9): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 1 of 1 Runtime Filter Published | |
- BuildRowsPartitionTime: 544.056ms | |
- BuildRowsPartitioned: 2.46M (2455776) | |
- GetNewBlockTime: 258.603us | |
- HashBuckets: 4.19M (4194304) | |
- HashCollisions: 1.38K (1383) | |
- HashTablesBuildTime: 128.655ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 457.03 MB (479229056) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=27):(Total: 9s838ms, non-child: 2s670ms, % non-child: 27.14%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 2s129ms | |
- GetNewBlockTime: 3.409ms | |
- GetResultsTime: 466.938ms | |
- HTResizeTime: 176.324ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 530.15 MB (555906614) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.46M (2455776) | |
- RowsReturnedRate: 249.61 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.493us | |
EXCHANGE_NODE (id=26):(Total: 7s168ms, non-child: 194.698ms, % non-child: 2.72%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.70 MB, 6.53 MB, 18.35 MB, 41.09 MB, 67.99 MB, 97.91 MB, 127.85 MB, 157.80 MB, 186.27 MB, 210.77 MB, 231.84 MB, 248.34 MB, 256.97 MB, 262.90 MB, 266.81 MB | |
- BytesReceived: 267.96 MB (280976170) | |
- ConvertRowBatchTime: 89.923ms | |
- DeserializeRowBatchTimer: 762.906ms | |
- FirstBatchArrivalWaitTime: 1s661ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.35M (4348908) | |
- RowsReturnedRate: 606.70 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=28):(Total: 7s560ms, non-child: 144.668ms, % non-child: 1.91%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.62 MB, 26.83 MB, 65.38 MB, 103.28 MB | |
- BytesReceived: 122.13 MB (128065338) | |
- ConvertRowBatchTime: 46.951ms | |
- DeserializeRowBatchTimer: 486.020ms | |
- FirstBatchArrivalWaitTime: 6s712ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.55M (2547567) | |
- RowsReturnedRate: 336.98 K/sec | |
- SendersBlockedTimer: 3s681ms | |
- SendersBlockedTotalTimer(*): 58s830ms | |
Instance 514ee9ab39cdc507:7e (host=cdh17.net.cuberonlabs.com:22000):(Total: 13s863ms, non-child: 21.360ms, % non-child: 0.15%) | |
MemoryUsage(500.000ms): 25.48 MB, 22.03 MB, 22.06 MB, 22.06 MB, 22.06 MB, 23.31 MB, 55.53 MB, 94.17 MB, 142.54 MB, 203.73 MB, 274.73 MB, 321.67 MB, 364.67 MB, 405.73 MB, 441.86 MB, 478.73 MB, 526.99 MB, 548.05 MB, 551.93 MB, 555.93 MB, 557.99 MB, 558.99 MB, 542.51 MB, 469.78 MB, 509.99 MB, 514.00 MB, 516.60 MB, 506.28 MB | |
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.93 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 599.36 MB (628470660) | |
- PerHostPeakMemUsage: 1.75 GB (1879028559) | |
- RowsProduced: 2.03K (2030) | |
- TotalNetworkReceiveTime: 16s336ms | |
- TotalNetworkSendTime: 6.776ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 28 (28) | |
- TotalThreadsTotalWallClockTime: 27s151ms | |
- TotalThreadsSysTime: 524.000ms | |
- TotalThreadsUserTime: 5s912ms | |
- TotalThreadsVoluntaryContextSwitches: 7.96K (7956) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s588ms | |
- ExecTreeExecTime: 1s577ms | |
- OpenTime: 12s240ms | |
- ExecTreeOpenTime: 11s291ms | |
- PrepareTime: 34.698ms | |
- ExecTreePrepareTime: 1.720ms | |
DataStreamSender (dst_id=35):(Total: 1.770ms, non-child: 1.770ms, % non-child: 100.00%) | |
- BytesSent: 117.36 KB (120178) | |
- NetworkThroughput(*): 191.14 MB/sec | |
- OverallThroughput: 64.73 MB/sec | |
- PeakMemoryUsage: 280.36 KB (287088) | |
- RowsReturned: 2.03K (2030) | |
- SerializeBatchTime: 1.141ms | |
- TransmitDataRPCTime: 599.609us | |
- UncompressedRowBatchSize: 225.35 KB (230756) | |
CodeGen:(Total: 970.251ms, non-child: 970.251ms, % non-child: 100.00%) | |
- CodegenTime: 4.791ms | |
- CompileTime: 278.054ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 142 (142) | |
- NumInstructions: 7.08K (7077) | |
- OptimizationTime: 669.759ms | |
- PeakMemoryUsage: 3.46 MB (3623424) | |
- PrepareTime: 21.917ms | |
AGGREGATION_NODE (id=11):(Total: 12s870ms, non-child: 65.883ms, % non-child: 0.51%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 53.360us | |
- GetResultsTime: 89.435us | |
- HTResizeTime: 0.000ns | |
- HashBuckets: 16.38K (16384) | |
- LargestPartitionPercent: 6 (6) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 9.42 MB (9879405) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 0.00 | |
- ReductionFactorThresholdToExpand: 0.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 2.03K (2030) | |
- RowsReturnedRate: 157.00 /sec | |
- StreamingTime: 63.940ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=10):(Total: 12s804ms, non-child: 337.820ms, % non-child: 2.64%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 1.01K (1015) | |
- BuildTime: 662.624us | |
- PeakMemoryUsage: 1.21 MB (1273535) | |
- ProbeRows: 2.55M (2546794) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 328.229ms | |
- RowsReturned: 2.03K (2030) | |
- RowsReturnedRate: 158.00 /sec | |
Hash Join Builder (join_node_id=10): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
- BuildRowsPartitionTime: 245.315us | |
- BuildRowsPartitioned: 1.01K (1015) | |
- GetNewBlockTime: 76.283us | |
- HashBuckets: 2.05K (2048) | |
- HashCollisions: 0 (0) | |
- HashTablesBuildTime: 251.251us | |
- LargestPartitionPercent: 7 (7) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.06 MB (1111168) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=34):(Total: 2s032ms, non-child: 27.423ms, % non-child: 1.35%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 12.637ms | |
- GetNewBlockTime: 321.457us | |
- GetResultsTime: 11.976ms | |
- HTResizeTime: 1.473ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 20.08 MB (21052529) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 1.01K (1015) | |
- RowsReturnedRate: 499.00 /sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 466.000ns | |
EXCHANGE_NODE (id=33):(Total: 2s004ms, non-child: 1.938ms, % non-child: 0.10%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0 | |
- BytesReceived: 1.64 MB (1724264) | |
- ConvertRowBatchTime: 744.314us | |
- DeserializeRowBatchTimer: 8.095ms | |
- FirstBatchArrivalWaitTime: 1s960ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.64K (30641) | |
- RowsReturnedRate: 15.28 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
HASH_JOIN_NODE (id=9):(Total: 12s466ms, non-child: 2s004ms, % non-child: 16.08%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 2.45M (2454541) | |
- BuildTime: 1s033ms | |
- PeakMemoryUsage: 457.17 MB (479379135) | |
- ProbeRows: 2.55M (2546794) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 956.100ms | |
- RowsReturned: 2.55M (2546794) | |
- RowsReturnedRate: 204.30 K/sec | |
Hash Join Builder (join_node_id=9): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 1 of 1 Runtime Filter Published | |
- BuildRowsPartitionTime: 816.837ms | |
- BuildRowsPartitioned: 2.45M (2454541) | |
- GetNewBlockTime: 244.241us | |
- HashBuckets: 4.19M (4194304) | |
- HashCollisions: 1.37K (1368) | |
- HashTablesBuildTime: 190.045ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 457.03 MB (479229056) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
AGGREGATION_NODE (id=27):(Total: 10s255ms, non-child: 2s788ms, % non-child: 27.19%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s939ms | |
- GetNewBlockTime: 814.766us | |
- GetResultsTime: 721.507ms | |
- HTResizeTime: 165.754ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 530.10 MB (555846758) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.45M (2454541) | |
- RowsReturnedRate: 239.34 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 509.000ns | |
EXCHANGE_NODE (id=26):(Total: 7s466ms, non-child: 209.541ms, % non-child: 2.81%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 217.32 KB, 4.06 MB, 11.78 MB, 30.29 MB, 56.28 MB, 85.18 MB, 115.14 MB, 145.68 MB, 175.24 MB, 201.48 MB, 223.56 MB, 242.12 MB, 253.89 MB, 260.69 MB, 265.22 MB, 267.63 MB | |
- BytesReceived: 267.87 MB (280887188) | |
- ConvertRowBatchTime: 91.336ms | |
- DeserializeRowBatchTimer: 835.341ms | |
- FirstBatchArrivalWaitTime: 1s764ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.35M (4349479) | |
- RowsReturnedRate: 582.55 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=28):(Total: 7s022ms, non-child: 206.050ms, % non-child: 2.93%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.41 MB, 10.88 MB, 49.40 MB, 86.92 MB, 121.54 MB | |
- BytesReceived: 122.03 MB (127955815) | |
- ConvertRowBatchTime: 47.378ms | |
- DeserializeRowBatchTimer: 475.027ms | |
- FirstBatchArrivalWaitTime: 6s816ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.55M (2546794) | |
- RowsReturnedRate: 362.66 K/sec | |
- SendersBlockedTimer: 5s527ms | |
- SendersBlockedTotalTimer(*): 1m20s | |
Averaged Fragment F02:(Total: 8s042ms, non-child: 722.514ms, % non-child: 8.98%) | |
split sizes: min: 1.81 GB, max: 3.59 GB, avg: 2.76 GB, stddev: 468.16 MB | |
completion times: min:5s537ms max:10s399ms mean: 8s044ms stddev:1s249ms | |
execution rates: min:297.29 MB/sec max:397.72 MB/sec mean:351.49 MB/sec stddev:29.51 MB/sec | |
num instances: 17 | |
- AverageThreadTokens: 4.21 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 916.04 MB (960537167) | |
- PerHostPeakMemUsage: 1.70 GB (1824024877) | |
- RowsProduced: 4.35M (4352060) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 8.995ms | |
- TotalStorageWaitTime: 22.462ms | |
- TotalThreadsInvoluntaryContextSwitches: 34 (34) | |
- TotalThreadsTotalWallClockTime: 33s997ms | |
- TotalThreadsSysTime: 884.705ms | |
- TotalThreadsUserTime: 8s881ms | |
- TotalThreadsVoluntaryContextSwitches: 12.39K (12391) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 7s844ms | |
- ExecTreeExecTime: 5s522ms | |
- OpenTime: 158.619ms | |
- ExecTreeOpenTime: 41.856us | |
- PrepareTime: 39.314ms | |
- ExecTreePrepareTime: 790.149us | |
DataStreamSender (dst_id=26):(Total: 1s607ms, non-child: 1s607ms, % non-child: 100.00%) | |
- BytesSent: 268.10 MB (281124560) | |
- NetworkThroughput(*): 635.27 MB/sec | |
- OverallThroughput: 168.85 MB/sec | |
- PeakMemoryUsage: 2.03 MB (2128225) | |
- RowsReturned: 4.35M (4352060) | |
- SerializeBatchTime: 1s147ms | |
- TransmitDataRPCTime: 458.944ms | |
- UncompressedRowBatchSize: 569.17 MB (596812778) | |
CodeGen:(Total: 192.096ms, non-child: 192.096ms, % non-child: 100.00%) | |
- CodegenTime: 4.272ms | |
- CompileTime: 38.533ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 61 (61) | |
- NumInstructions: 1.14K (1136) | |
- OptimizationTime: 118.583ms | |
- PeakMemoryUsage: 568.00 KB (581632) | |
- PrepareTime: 34.137ms | |
AGGREGATION_NODE (id=1):(Total: 5s520ms, non-child: 5s439ms, % non-child: 98.53%) | |
- GetNewBlockTime: 1.787ms | |
- GetResultsTime: 1s265ms | |
- HTResizeTime: 200.480ms | |
- HashBuckets: 8.14M (8141884) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 906.58 MB (950622860) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 39.03 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.35M (4352060) | |
- RowsReturnedRate: 795.56 K/sec | |
- StreamingTime: 3s697ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=0):(Total: 80.893ms, non-child: 80.893ms, % non-child: 100.00%) | |
- AverageHdfsReadThreadConcurrency: 0.01 | |
- AverageScannerThreadConcurrency: 6.85 | |
- BytesRead: 353.32 MB (370479642) | |
- BytesReadDataNodeCache: 344.19 MB (360909235) | |
- BytesReadLocal: 353.32 MB (370479642) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 353.32 MB (370479642) | |
- DecompressionTime: 826.122ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 1 (1) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 29 (29) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 24.26 MB (25442666) | |
- PerReadThreadRawHdfsThroughput: 33.00 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 27.130ms | |
- RowBatchQueuePutWaitTime: 24s001ms | |
- RowsRead: 11.56M (11559184) | |
- RowsReturned: 11.56M (11559184) | |
- RowsReturnedRate: 147.32 M/sec | |
- ScanRangesComplete: 29 (29) | |
- ScannerThreadsInvoluntaryContextSwitches: 20 (20) | |
- ScannerThreadsTotalWallClockTime: 25s994ms | |
- MaterializeTupleTime(*): 388.420ms | |
- ScannerThreadsSysTime: 192.705ms | |
- ScannerThreadsUserTime: 1s631ms | |
- ScannerThreadsVoluntaryContextSwitches: 11.74K (11741) | |
- TotalRawHdfsReadTime(*): 10.545ms | |
- TotalReadThroughput: 90.22 MB/sec | |
Fragment F02: | |
Instance 514ee9ab39cdc507:6 (host=cdh3.net.cuberonlabs.com:22000):(Total: 10s397ms, non-child: 1s039ms, % non-child: 10.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.39 GB | |
MemoryUsage(500.000ms): 35.58 MB, 236.55 MB, 316.52 MB, 508.75 MB, 557.21 MB, 600.09 MB, 685.82 MB, 860.35 MB, 892.84 MB, 923.72 MB, 950.86 MB, 1.02 GB, 946.95 MB, 811.77 MB, 744.16 MB, 609.03 MB, 473.70 MB, 406.28 MB, 271.27 MB, 136.02 MB, 27.84 MB | |
ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 5, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 4.52 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 1.06 GB (1138074612) | |
- PerHostPeakMemUsage: 2.16 GB (2318232477) | |
- RowsProduced: 5.03M (5032625) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 8.924ms | |
- TotalStorageWaitTime: 50.227ms | |
- TotalThreadsInvoluntaryContextSwitches: 50 (50) | |
- TotalThreadsTotalWallClockTime: 45s756ms | |
- TotalThreadsSysTime: 1s092ms | |
- TotalThreadsUserTime: 11s380ms | |
- TotalThreadsVoluntaryContextSwitches: 15.35K (15345) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 10s154ms | |
- ExecTreeExecTime: 7s252ms | |
- OpenTime: 202.177ms | |
- ExecTreeOpenTime: 64.480us | |
- PrepareTime: 41.468ms | |
- ExecTreePrepareTime: 679.356us | |
DataStreamSender (dst_id=26):(Total: 1s872ms, non-child: 1s872ms, % non-child: 100.00%) | |
- BytesSent: 308.21 MB (323179035) | |
- NetworkThroughput(*): 722.72 MB/sec | |
- OverallThroughput: 164.59 MB/sec | |
- PeakMemoryUsage: 2.06 MB (2160512) | |
- RowsReturned: 5.03M (5032625) | |
- SerializeBatchTime: 1s445ms | |
- TransmitDataRPCTime: 426.457ms | |
- UncompressedRowBatchSize: 654.99 MB (686805201) | |
CodeGen:(Total: 236.255ms, non-child: 236.255ms, % non-child: 100.00%) | |
- CodegenTime: 6.093ms | |
- CompileTime: 58.023ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 61 (61) | |
- NumInstructions: 1.14K (1136) | |
- OptimizationTime: 141.744ms | |
- PeakMemoryUsage: 568.00 KB (581632) | |
- PrepareTime: 35.406ms | |
AGGREGATION_NODE (id=1):(Total: 7s249ms, non-child: 7s140ms, % non-child: 98.50%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 1.911ms | |
- GetResultsTime: 1s436ms | |
- HTResizeTime: 228.270ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.06 GB (1135617555) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 38.40 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 5.03M (5032625) | |
- RowsReturnedRate: 694.23 K/sec | |
- StreamingTime: 5s153ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=0):(Total: 109.099ms, non-child: 109.099ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.39 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:35 | |
BytesRead(500.000ms): 73.80 MB, 100.67 MB, 109.64 MB, 175.06 MB, 198.24 MB, 262.05 MB, 288.69 MB, 354.31 MB, 378.79 MB, 431.49 MB, 431.49 MB | |
- FooterProcessingTime: (Avg: 8.624ms ; Min: 2.894ms ; Max: 43.545ms ; Number of samples: 35) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.73 | |
- BytesRead: 431.49 MB (452453563) | |
- BytesReadDataNodeCache: 420.69 MB (441128504) | |
- BytesReadLocal: 431.49 MB (452453563) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 431.49 MB (452453563) | |
- DecompressionTime: 932.507ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 1 (1) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 35 (35) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 23.24 MB (24368009) | |
- PerReadThreadRawHdfsThroughput: 32.66 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 33.260ms | |
- RowBatchQueuePutWaitTime: 33s048ms | |
- RowsRead: 14.44M (14439291) | |
- RowsReturned: 14.44M (14439291) | |
- RowsReturnedRate: 132.35 M/sec | |
- ScanRangesComplete: 35 (35) | |
- ScannerThreadsInvoluntaryContextSwitches: 35 (35) | |
- ScannerThreadsTotalWallClockTime: 35s400ms | |
- MaterializeTupleTime(*): 489.876ms | |
- ScannerThreadsSysTime: 260.000ms | |
- ScannerThreadsUserTime: 1s912ms | |
- ScannerThreadsVoluntaryContextSwitches: 14.74K (14740) | |
- TotalRawHdfsReadTime(*): 12.900ms | |
- TotalReadThroughput: 78.45 MB/sec | |
Instance 514ee9ab39cdc507:c (host=cdh5.net.cuberonlabs.com:22000):(Total: 9s921ms, non-child: 886.272ms, % non-child: 8.93%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.36 GB | |
MemoryUsage(500.000ms): 195.21 MB, 287.49 MB, 365.74 MB, 559.11 MB, 592.05 MB, 674.99 MB, 851.33 MB, 893.52 MB, 943.05 MB, 1.07 GB, 1.01 GB, 960.78 MB, 823.63 MB, 755.19 MB, 617.96 MB, 549.25 MB, 412.64 MB, 275.28 MB, 138.06 MB, 69.37 MB | |
ThreadUsage(500.000ms): 8, 9, 9, 9, 9, 9, 9, 9, 9, 5, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 4.75 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 1.08 GB (1162495743) | |
- PerHostPeakMemUsage: 2.15 GB (2303708143) | |
- RowsProduced: 5.19M (5191617) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 8.682ms | |
- TotalStorageWaitTime: 15.389ms | |
- TotalThreadsInvoluntaryContextSwitches: 30 (30) | |
- TotalThreadsTotalWallClockTime: 46s408ms | |
- TotalThreadsSysTime: 1s060ms | |
- TotalThreadsUserTime: 11s120ms | |
- TotalThreadsVoluntaryContextSwitches: 15.12K (15122) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 9s744ms | |
- ExecTreeExecTime: 6s870ms | |
- OpenTime: 140.751ms | |
- ExecTreeOpenTime: 39.876us | |
- PrepareTime: 36.978ms | |
- ExecTreePrepareTime: 783.064us | |
DataStreamSender (dst_id=26):(Total: 1s995ms, non-child: 1s995ms, % non-child: 100.00%) | |
- BytesSent: 322.34 MB (337995400) | |
- NetworkThroughput(*): 552.51 MB/sec | |
- OverallThroughput: 161.57 MB/sec | |
- PeakMemoryUsage: 2.06 MB (2160512) | |
- RowsReturned: 5.19M (5191617) | |
- SerializeBatchTime: 1s410ms | |
- TransmitDataRPCTime: 583.407ms | |
- UncompressedRowBatchSize: 686.26 MB (719597467) | |
CodeGen:(Total: 172.197ms, non-child: 172.197ms, % non-child: 100.00%) | |
- CodegenTime: 3.758ms | |
- CompileTime: 33.814ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 61 (61) | |
- NumInstructions: 1.14K (1136) | |
- OptimizationTime: 105.559ms | |
- PeakMemoryUsage: 568.00 KB (581632) | |
- PrepareTime: 31.906ms | |
AGGREGATION_NODE (id=1):(Total: 6s868ms, non-child: 6s777ms, % non-child: 98.68%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 2.040ms | |
- GetResultsTime: 1s469ms | |
- HTResizeTime: 226.065ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.07 GB (1152428072) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 36.13 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 5.19M (5191617) | |
- RowsReturnedRate: 755.87 K/sec | |
- StreamingTime: 4s730ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=0):(Total: 90.722ms, non-child: 90.722ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.36 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:35 | |
BytesRead(500.000ms): 91.05 MB, 104.56 MB, 184.09 MB, 197.68 MB, 224.56 MB, 299.78 MB, 313.12 MB, 378.80 MB, 432.23 MB, 433.15 MB | |
- FooterProcessingTime: (Avg: 9.210ms ; Min: 3.479ms ; Max: 45.485ms ; Number of samples: 35) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.50 | |
- BytesRead: 433.15 MB (454191043) | |
- BytesReadDataNodeCache: 422.35 MB (442869728) | |
- BytesReadLocal: 433.15 MB (454191043) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 433.15 MB (454191043) | |
- DecompressionTime: 1s123ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 1 (1) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 35 (35) | |
- NumScannerThreadsStarted: 8 (8) | |
- PeakMemoryUsage: 26.76 MB (28064098) | |
- PerReadThreadRawHdfsThroughput: 33.71 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 20.862ms | |
- RowBatchQueuePutWaitTime: 33s940ms | |
- RowsRead: 13.95M (13952334) | |
- RowsReturned: 13.95M (13952334) | |
- RowsReturnedRate: 153.79 M/sec | |
- ScanRangesComplete: 35 (35) | |
- ScannerThreadsInvoluntaryContextSwitches: 17 (17) | |
- ScannerThreadsTotalWallClockTime: 36s523ms | |
- MaterializeTupleTime(*): 505.447ms | |
- ScannerThreadsSysTime: 272.000ms | |
- ScannerThreadsUserTime: 2s108ms | |
- ScannerThreadsVoluntaryContextSwitches: 14.11K (14108) | |
- TotalRawHdfsReadTime(*): 12.548ms | |
- TotalReadThroughput: 86.63 MB/sec | |
Instance 514ee9ab39cdc507:1 (host=cdh4.net.cuberonlabs.com:22000):(Total: 9s415ms, non-child: 622.549ms, % non-child: 6.61%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:40/3.59 GB | |
MemoryUsage(500.000ms): 35.91 MB, 268.64 MB, 314.76 MB, 540.64 MB, 588.18 MB, 685.85 MB, 860.01 MB, 909.49 MB, 939.55 MB, 1.07 GB, 1.07 GB, 960.59 MB, 823.71 MB, 686.57 MB, 577.58 MB, 480.74 MB, 343.97 MB, 206.44 MB, 69.61 MB | |
ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 4.63 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 1.09 GB (1169194720) | |
- PerHostPeakMemUsage: 2.13 GB (2284202661) | |
- RowsProduced: 5.40M (5395957) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 9.968ms | |
- TotalStorageWaitTime: 12.018ms | |
- TotalThreadsInvoluntaryContextSwitches: 43 (43) | |
- TotalThreadsTotalWallClockTime: 42s143ms | |
- TotalThreadsSysTime: 1s052ms | |
- TotalThreadsUserTime: 10s796ms | |
- TotalThreadsVoluntaryContextSwitches: 15.84K (15836) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 9s224ms | |
- ExecTreeExecTime: 6s654ms | |
- OpenTime: 151.997ms | |
- ExecTreeOpenTime: 40.624us | |
- PrepareTime: 38.476ms | |
- ExecTreePrepareTime: 853.460us | |
DataStreamSender (dst_id=26):(Total: 1s955ms, non-child: 1s955ms, % non-child: 100.00%) | |
- BytesSent: 330.06 MB (346095116) | |
- NetworkThroughput(*): 488.15 MB/sec | |
- OverallThroughput: 168.80 MB/sec | |
- PeakMemoryUsage: 1.94 MB (2037632) | |
- RowsReturned: 5.40M (5395957) | |
- SerializeBatchTime: 1s278ms | |
- TransmitDataRPCTime: 676.151ms | |
- UncompressedRowBatchSize: 702.82 MB (736960845) | |
CodeGen:(Total: 184.735ms, non-child: 184.735ms, % non-child: 100.00%) | |
- CodegenTime: 4.025ms | |
- CompileTime: 36.702ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 61 (61) | |
- NumInstructions: 1.14K (1136) | |
- OptimizationTime: 114.048ms | |
- PeakMemoryUsage: 568.00 KB (581632) | |
- PrepareTime: 33.223ms | |
AGGREGATION_NODE (id=1):(Total: 6s652ms, non-child: 6s547ms, % non-child: 98.42%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 1.387ms | |
- GetResultsTime: 1s329ms | |
- HTResizeTime: 194.594ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 1.07 GB (1152451065) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 37.19 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 5.40M (5395957) | |
- RowsReturnedRate: 811.12 K/sec | |
- StreamingTime: 4s694ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=0):(Total: 104.998ms, non-child: 104.998ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:40/3.59 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 40 out of 40 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:40 | |
BytesRead(500.000ms): 75.05 MB, 98.28 MB, 149.28 MB, 194.32 MB, 270.85 MB, 281.46 MB, 348.14 MB, 374.51 MB, 446.38 MB, 459.20 MB | |
- FooterProcessingTime: (Avg: 8.559ms ; Min: 3.065ms ; Max: 33.227ms ; Number of samples: 40) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.90 | |
- BytesRead: 459.20 MB (481508738) | |
- BytesReadDataNodeCache: 446.86 MB (468570610) | |
- BytesReadLocal: 459.20 MB (481508738) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 459.20 MB (481508738) | |
- DecompressionTime: 1s088ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 1 (1) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 40 (40) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 23.16 MB (24282212) | |
- PerReadThreadRawHdfsThroughput: 32.44 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 27.110ms | |
- RowBatchQueuePutWaitTime: 30s158ms | |
- RowsRead: 15.04M (15041855) | |
- RowsReturned: 15.04M (15041855) | |
- RowsReturnedRate: 143.26 M/sec | |
- ScanRangesComplete: 40 (40) | |
- ScannerThreadsInvoluntaryContextSwitches: 29 (29) | |
- ScannerThreadsTotalWallClockTime: 32s767ms | |
- MaterializeTupleTime(*): 496.995ms | |
- ScannerThreadsSysTime: 264.000ms | |
- ScannerThreadsUserTime: 2s264ms | |
- ScannerThreadsVoluntaryContextSwitches: 15.20K (15201) | |
- TotalRawHdfsReadTime(*): 13.823ms | |
- TotalReadThroughput: 91.84 MB/sec | |
Instance 514ee9ab39cdc507:7 (host=cdh17.net.cuberonlabs.com:22000):(Total: 8s889ms, non-child: 834.575ms, % non-child: 9.39%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.58 GB | |
MemoryUsage(500.000ms): 174.32 MB, 239.17 MB, 318.88 MB, 510.34 MB, 559.26 MB, 591.22 MB, 669.60 MB, 846.87 MB, 874.50 MB, 819.26 MB, 764.71 MB, 655.64 MB, 546.73 MB, 492.19 MB, 382.77 MB, 273.57 MB, 164.65 MB, 55.62 MB | |
ThreadUsage(500.000ms): 8, 9, 9, 9, 9, 9, 9, 9, 7, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 4.83 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 886.37 MB (929430134) | |
- PerHostPeakMemUsage: 1.75 GB (1879028559) | |
- RowsProduced: 4.13M (4128370) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 8.360ms | |
- TotalStorageWaitTime: 18.132ms | |
- TotalThreadsInvoluntaryContextSwitches: 28 (28) | |
- TotalThreadsTotalWallClockTime: 41s512ms | |
- TotalThreadsSysTime: 904.000ms | |
- TotalThreadsUserTime: 9s720ms | |
- TotalThreadsVoluntaryContextSwitches: 11.37K (11365) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 8s731ms | |
- ExecTreeExecTime: 6s319ms | |
- OpenTime: 127.071ms | |
- ExecTreeOpenTime: 37.924us | |
- PrepareTime: 30.108ms | |
- ExecTreePrepareTime: 585.343us | |
DataStreamSender (dst_id=26):(Total: 1s583ms, non-child: 1s583ms, % non-child: 100.00%) | |
- BytesSent: 254.70 MB (267076759) | |
- NetworkThroughput(*): 647.72 MB/sec | |
- OverallThroughput: 160.83 MB/sec | |
- PeakMemoryUsage: 1.94 MB (2037632) | |
- RowsReturned: 4.13M (4128370) | |
- SerializeBatchTime: 1s189ms | |
- TransmitDataRPCTime: 393.230ms | |
- UncompressedRowBatchSize: 539.72 MB (565933834) | |
CodeGen:(Total: 152.840ms, non-child: 152.840ms, % non-child: 100.00%) | |
- CodegenTime: 3.087ms | |
- CompileTime: 34.399ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 61 (61) | |
- NumInstructions: 1.14K (1136) | |
- OptimizationTime: 91.456ms | |
- PeakMemoryUsage: 568.00 KB (581632) | |
- PrepareTime: 26.326ms | |
AGGREGATION_NODE (id=1):(Total: 6s317ms, non-child: 6s255ms, % non-child: 99.01%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 1.682ms | |
- GetResultsTime: 1s473ms | |
- HTResizeTime: 247.588ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 874.96 MB (917459737) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 37.51 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.13M (4128370) | |
- RowsReturnedRate: 653.44 K/sec | |
- StreamingTime: 4s226ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=0):(Total: 62.533ms, non-child: 62.533ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.58 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 26 out of 26 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:26 | |
BytesRead(500.000ms): 93.52 MB, 106.60 MB, 119.63 MB, 195.12 MB, 205.30 MB, 223.99 MB, 317.23 MB, 330.40 MB, 330.40 MB | |
- FooterProcessingTime: (Avg: 6.142ms ; Min: 3.323ms ; Max: 15.676ms ; Number of samples: 26) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.67 | |
- BytesRead: 330.40 MB (346453211) | |
- BytesReadDataNodeCache: 322.38 MB (338038438) | |
- BytesReadLocal: 330.40 MB (346453211) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 330.40 MB (346453211) | |
- DecompressionTime: 855.040ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 1 (1) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 26 (26) | |
- NumScannerThreadsStarted: 8 (8) | |
- PeakMemoryUsage: 25.99 MB (27254128) | |
- PerReadThreadRawHdfsThroughput: 35.94 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 16.266ms | |
- RowBatchQueuePutWaitTime: 30s783ms | |
- RowsRead: 10.92M (10919165) | |
- RowsReturned: 10.92M (10919165) | |
- RowsReturnedRate: 174.61 M/sec | |
- ScanRangesComplete: 26 (26) | |
- ScannerThreadsInvoluntaryContextSwitches: 16 (16) | |
- ScannerThreadsTotalWallClockTime: 32s653ms | |
- MaterializeTupleTime(*): 411.726ms | |
- ScannerThreadsSysTime: 132.000ms | |
- ScannerThreadsUserTime: 1s672ms | |
- ScannerThreadsVoluntaryContextSwitches: 10.97K (10966) | |
- TotalRawHdfsReadTime(*): 8.978ms | |
- TotalReadThroughput: 73.42 MB/sec | |
Instance 514ee9ab39cdc507:8 (host=cdh2.net.cuberonlabs.com:22000):(Total: 8s652ms, non-child: 959.568ms, % non-child: 11.09%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/3.00 GB | |
MemoryUsage(500.000ms): 1.90 MB, 237.26 MB, 300.59 MB, 509.19 MB, 561.61 MB, 622.14 MB, 844.83 MB, 892.92 MB, 924.24 MB, 864.23 MB, 749.26 MB, 634.15 MB, 576.40 MB, 461.26 MB, 346.22 MB, 256.35 MB, 173.72 MB, 58.31 MB | |
ThreadUsage(500.000ms): 1, 8, 8, 8, 8, 8, 8, 8, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 3.83 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 930.31 MB (975497574) | |
- PerHostPeakMemUsage: 1.74 GB (1866918022) | |
- RowsProduced: 4.68M (4682424) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 8.402ms | |
- TotalStorageWaitTime: 24.077ms | |
- TotalThreadsInvoluntaryContextSwitches: 35 (35) | |
- TotalThreadsTotalWallClockTime: 35s164ms | |
- TotalThreadsSysTime: 976.000ms | |
- TotalThreadsUserTime: 9s544ms | |
- TotalThreadsVoluntaryContextSwitches: 13.50K (13500) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 8s453ms | |
- ExecTreeExecTime: 5s763ms | |
- OpenTime: 150.652ms | |
- ExecTreeOpenTime: 38.912us | |
- PrepareTime: 48.797ms | |
- ExecTreePrepareTime: 746.536us | |
DataStreamSender (dst_id=26):(Total: 1s738ms, non-child: 1s738ms, % non-child: 100.00%) | |
- BytesSent: 287.56 MB (301527079) | |
- NetworkThroughput(*): 758.74 MB/sec | |
- OverallThroughput: 165.45 MB/sec | |
- PeakMemoryUsage: 2.06 MB (2160512) | |
- RowsReturned: 4.68M (4682424) | |
- SerializeBatchTime: 1s358ms | |
- TransmitDataRPCTime: 378.992ms | |
- UncompressedRowBatchSize: 610.83 MB (640500454) | |
CodeGen:(Total: 193.108ms, non-child: 193.108ms, % non-child: 100.00%) | |
- CodegenTime: 6.098ms | |
- CompileTime: 36.267ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 61 (61) | |
- NumInstructions: 1.14K (1136) | |
- OptimizationTime: 112.578ms | |
- PeakMemoryUsage: 568.00 KB (581632) | |
- PrepareTime: 43.232ms | |
AGGREGATION_NODE (id=1):(Total: 5s761ms, non-child: 5s674ms, % non-child: 98.49%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 755.156us | |
- GetResultsTime: 1s312ms | |
- HTResizeTime: 199.435ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 922.91 MB (967738275) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 37.30 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.68M (4682424) | |
- RowsReturnedRate: 812.67 K/sec | |
- StreamingTime: 3s878ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=0):(Total: 87.062ms, non-child: 87.062ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/3.00 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:32 | |
BytesRead(500.000ms): 0, 85.73 MB, 117.11 MB, 181.41 MB, 205.88 MB, 270.84 MB, 311.08 MB, 357.92 MB, 384.06 MB | |
- FooterProcessingTime: (Avg: 7.899ms ; Min: 3.033ms ; Max: 29.805ms ; Number of samples: 32) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.38 | |
- BytesRead: 384.06 MB (402711533) | |
- BytesReadDataNodeCache: 374.18 MB (392358247) | |
- BytesReadLocal: 384.06 MB (402711533) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 384.06 MB (402711533) | |
- DecompressionTime: 879.952ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 1 (1) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 32 (32) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 23.78 MB (24937978) | |
- PerReadThreadRawHdfsThroughput: 31.68 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 26.962ms | |
- RowBatchQueuePutWaitTime: 24s456ms | |
- RowsRead: 12.59M (12593336) | |
- RowsReturned: 12.59M (12593336) | |
- RowsReturnedRate: 144.65 M/sec | |
- ScanRangesComplete: 32 (32) | |
- ScannerThreadsInvoluntaryContextSwitches: 22 (22) | |
- ScannerThreadsTotalWallClockTime: 26s560ms | |
- MaterializeTupleTime(*): 421.765ms | |
- ScannerThreadsSysTime: 240.000ms | |
- ScannerThreadsUserTime: 1s728ms | |
- ScannerThreadsVoluntaryContextSwitches: 12.84K (12842) | |
- TotalRawHdfsReadTime(*): 11.840ms | |
- TotalReadThroughput: 85.35 MB/sec | |
Instance 514ee9ab39cdc507:e (host=cdh8.net.cuberonlabs.com:22000):(Total: 8s561ms, non-child: 578.525ms, % non-child: 6.76%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.70 GB | |
MemoryUsage(500.000ms): 196.96 MB, 284.77 MB, 365.30 MB, 541.48 MB, 588.15 MB, 684.95 MB, 861.42 MB, 873.67 MB, 764.74 MB, 710.23 MB, 601.25 MB, 546.66 MB, 437.47 MB, 328.64 MB, 241.33 MB, 164.68 MB, 55.53 MB | |
ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 8, 8, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 3.88 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 887.07 MB (930159200) | |
- PerHostPeakMemUsage: 1.63 GB (1748411303) | |
- RowsProduced: 4.19M (4194750) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 11.720ms | |
- TotalStorageWaitTime: 8.427ms | |
- TotalThreadsInvoluntaryContextSwitches: 36 (36) | |
- TotalThreadsTotalWallClockTime: 32s894ms | |
- TotalThreadsSysTime: 996.000ms | |
- TotalThreadsUserTime: 9s264ms | |
- TotalThreadsVoluntaryContextSwitches: 12.19K (12193) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 8s374ms | |
- ExecTreeExecTime: 5s655ms | |
- OpenTime: 147.050ms | |
- ExecTreeOpenTime: 39.802us | |
- PrepareTime: 39.798ms | |
- ExecTreePrepareTime: 987.720us | |
DataStreamSender (dst_id=26):(Total: 2s148ms, non-child: 2s148ms, % non-child: 100.00%) | |
- BytesSent: 256.90 MB (269377139) | |
- NetworkThroughput(*): 306.85 MB/sec | |
- OverallThroughput: 119.59 MB/sec | |
- PeakMemoryUsage: 2.06 MB (2160512) | |
- RowsReturned: 4.19M (4194750) | |
- SerializeBatchTime: 1s309ms | |
- TransmitDataRPCTime: 837.202ms | |
- UncompressedRowBatchSize: 545.61 MB (572113510) | |
CodeGen:(Total: 180.924ms, non-child: 180.924ms, % non-child: 100.00%) | |
- CodegenTime: 3.765ms | |
- CompileTime: 33.172ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 61 (61) | |
- NumInstructions: 1.14K (1136) | |
- OptimizationTime: 112.378ms | |
- PeakMemoryUsage: 568.00 KB (581632) | |
- PrepareTime: 34.490ms | |
AGGREGATION_NODE (id=1):(Total: 5s653ms, non-child: 5s579ms, % non-child: 98.68%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 1.296ms | |
- GetResultsTime: 1s493ms | |
- HTResizeTime: 213.329ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 875.22 MB (917732884) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 37.20 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.19M (4194750) | |
- RowsReturnedRate: 741.92 K/sec | |
- StreamingTime: 3s519ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=0):(Total: 74.773ms, non-child: 74.773ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.70 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:28 | |
BytesRead(500.000ms): 92.58 MB, 92.99 MB, 180.41 MB, 193.57 MB, 251.93 MB, 291.60 MB, 344.86 MB | |
- FooterProcessingTime: (Avg: 9.267ms ; Min: 3.212ms ; Max: 40.424ms ; Number of samples: 28) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.00 | |
- BytesRead: 344.86 MB (361616139) | |
- BytesReadDataNodeCache: 336.23 MB (352562700) | |
- BytesReadLocal: 344.86 MB (361616139) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 344.86 MB (361616139) | |
- DecompressionTime: 850.125ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 1 (1) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 28 (28) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 23.35 MB (24482151) | |
- PerReadThreadRawHdfsThroughput: 38.12 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 20.697ms | |
- RowBatchQueuePutWaitTime: 22s420ms | |
- RowsRead: 11.39M (11388046) | |
- RowsReturned: 11.39M (11388046) | |
- RowsReturnedRate: 152.30 M/sec | |
- ScanRangesComplete: 28 (28) | |
- ScannerThreadsInvoluntaryContextSwitches: 22 (22) | |
- ScannerThreadsTotalWallClockTime: 24s372ms | |
- MaterializeTupleTime(*): 391.356ms | |
- ScannerThreadsSysTime: 208.000ms | |
- ScannerThreadsUserTime: 1s604ms | |
- ScannerThreadsVoluntaryContextSwitches: 11.58K (11578) | |
- TotalRawHdfsReadTime(*): 8.833ms | |
- TotalReadThroughput: 98.53 MB/sec | |
Instance 514ee9ab39cdc507:3 (host=cdh13.net.cuberonlabs.com:22000):(Total: 8s454ms, non-child: 912.990ms, % non-child: 10.80%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/2.80 GB | |
MemoryUsage(500.000ms): 195.79 MB, 301.57 MB, 508.51 MB, 556.38 MB, 605.52 MB, 844.37 MB, 892.86 MB, 905.80 MB, 849.37 MB, 736.16 MB, 623.01 MB, 534.10 MB, 453.36 MB, 340.08 MB, 226.97 MB, 138.30 MB, 57.45 MB | |
ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 8, 8, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 3.88 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 919.03 MB (963677514) | |
- PerHostPeakMemUsage: 1.66 GB (1782381748) | |
- RowsProduced: 4.47M (4471844) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 8.373ms | |
- TotalStorageWaitTime: 15.552ms | |
- TotalThreadsInvoluntaryContextSwitches: 20 (20) | |
- TotalThreadsTotalWallClockTime: 32s870ms | |
- TotalThreadsSysTime: 984.000ms | |
- TotalThreadsUserTime: 9s220ms | |
- TotalThreadsVoluntaryContextSwitches: 12.40K (12401) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 8s268ms | |
- ExecTreeExecTime: 5s732ms | |
- OpenTime: 147.745ms | |
- ExecTreeOpenTime: 35.125us | |
- PrepareTime: 37.780ms | |
- ExecTreePrepareTime: 793.784us | |
DataStreamSender (dst_id=26):(Total: 1s631ms, non-child: 1s631ms, % non-child: 100.00%) | |
- BytesSent: 276.91 MB (290357905) | |
- NetworkThroughput(*): 734.40 MB/sec | |
- OverallThroughput: 169.76 MB/sec | |
- PeakMemoryUsage: 2.06 MB (2160512) | |
- RowsReturned: 4.47M (4471844) | |
- SerializeBatchTime: 1s253ms | |
- TransmitDataRPCTime: 377.049ms | |
- UncompressedRowBatchSize: 588.13 MB (616695202) | |
CodeGen:(Total: 180.025ms, non-child: 180.025ms, % non-child: 100.00%) | |
- CodegenTime: 4.123ms | |
- CompileTime: 35.375ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 61 (61) | |
- NumInstructions: 1.14K (1136) | |
- OptimizationTime: 111.072ms | |
- PeakMemoryUsage: 568.00 KB (581632) | |
- PrepareTime: 32.832ms | |
AGGREGATION_NODE (id=1):(Total: 5s730ms, non-child: 5s662ms, % non-child: 98.81%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 524.014us | |
- GetResultsTime: 1s546ms | |
- HTResizeTime: 194.043ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 907.09 MB (951156314) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 36.83 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.47M (4471844) | |
- RowsReturnedRate: 780.38 K/sec | |
- StreamingTime: 3s528ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=0):(Total: 68.296ms, non-child: 68.296ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/2.80 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:31 | |
BytesRead(500.000ms): 85.93 MB, 90.23 MB, 185.48 MB, 199.58 MB, 276.22 MB, 302.55 MB, 360.06 MB | |
- FooterProcessingTime: (Avg: 8.709ms ; Min: 2.373ms ; Max: 39.726ms ; Number of samples: 31) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.00 | |
- BytesRead: 360.06 MB (377552261) | |
- BytesReadDataNodeCache: 350.50 MB (367530199) | |
- BytesReadLocal: 360.06 MB (377552261) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 360.06 MB (377552261) | |
- DecompressionTime: 821.310ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 1 (1) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 31 (31) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 23.45 MB (24587476) | |
- PerReadThreadRawHdfsThroughput: 34.52 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 19.831ms | |
- RowBatchQueuePutWaitTime: 22s510ms | |
- RowsRead: 11.68M (11677391) | |
- RowsReturned: 11.68M (11677391) | |
- RowsReturnedRate: 170.98 M/sec | |
- ScanRangesComplete: 31 (31) | |
- ScannerThreadsInvoluntaryContextSwitches: 11 (11) | |
- ScannerThreadsTotalWallClockTime: 24s454ms | |
- MaterializeTupleTime(*): 383.257ms | |
- ScannerThreadsSysTime: 212.000ms | |
- ScannerThreadsUserTime: 1s612ms | |
- ScannerThreadsVoluntaryContextSwitches: 11.77K (11767) | |
- TotalRawHdfsReadTime(*): 10.184ms | |
- TotalReadThroughput: 102.87 MB/sec | |
Instance 514ee9ab39cdc507:10 (host=cdh9.net.cuberonlabs.com:22000):(Total: 8s410ms, non-child: 833.751ms, % non-child: 9.91%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/3.02 GB | |
MemoryUsage(500.000ms): 1.90 MB, 236.88 MB, 330.18 MB, 540.62 MB, 571.55 MB, 645.92 MB, 844.38 MB, 893.16 MB, 929.90 MB, 864.48 MB, 749.04 MB, 691.83 MB, 576.70 MB, 461.55 MB, 346.42 MB, 231.17 MB, 116.26 MB | |
ThreadUsage(500.000ms): 1, 8, 8, 8, 8, 8, 8, 8, 2, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 3.94 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 930.38 MB (975570334) | |
- PerHostPeakMemUsage: 1.69 GB (1813107104) | |
- RowsProduced: 4.68M (4677809) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 7.647ms | |
- TotalStorageWaitTime: 23.652ms | |
- TotalThreadsInvoluntaryContextSwitches: 17 (17) | |
- TotalThreadsTotalWallClockTime: 34s442ms | |
- TotalThreadsSysTime: 868.000ms | |
- TotalThreadsUserTime: 9s276ms | |
- TotalThreadsVoluntaryContextSwitches: 13.65K (13647) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 8s168ms | |
- ExecTreeExecTime: 5s768ms | |
- OpenTime: 197.137ms | |
- ExecTreeOpenTime: 43.207us | |
- PrepareTime: 44.481ms | |
- ExecTreePrepareTime: 719.817us | |
DataStreamSender (dst_id=26):(Total: 1s573ms, non-child: 1s573ms, % non-child: 100.00%) | |
- BytesSent: 288.14 MB (302137057) | |
- NetworkThroughput(*): 781.23 MB/sec | |
- OverallThroughput: 183.10 MB/sec | |
- PeakMemoryUsage: 1.94 MB (2037632) | |
- RowsReturned: 4.68M (4677809) | |
- SerializeBatchTime: 1s203ms | |
- TransmitDataRPCTime: 368.829ms | |
- UncompressedRowBatchSize: 612.07 MB (641798913) | |
CodeGen:(Total: 235.964ms, non-child: 235.964ms, % non-child: 100.00%) | |
- CodegenTime: 4.722ms | |
- CompileTime: 43.825ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 61 (61) | |
- NumInstructions: 1.14K (1136) | |
- OptimizationTime: 151.663ms | |
- PeakMemoryUsage: 568.00 KB (581632) | |
- PrepareTime: 39.428ms | |
AGGREGATION_NODE (id=1):(Total: 5s766ms, non-child: 5s700ms, % non-child: 98.85%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 1.107ms | |
- GetResultsTime: 1s373ms | |
- HTResizeTime: 188.437ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 923.11 MB (967947247) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 37.49 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.68M (4677809) | |
- RowsReturnedRate: 811.18 K/sec | |
- StreamingTime: 3s816ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=0):(Total: 66.312ms, non-child: 66.312ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/3.02 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:31 | |
BytesRead(500.000ms): 0, 88.16 MB, 178.11 MB, 178.11 MB, 267.20 MB, 267.20 MB, 333.80 MB, 360.96 MB, 386.75 MB | |
- FooterProcessingTime: (Avg: 6.881ms ; Min: 2.773ms ; Max: 23.083ms ; Number of samples: 31) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.25 | |
- BytesRead: 386.75 MB (405532185) | |
- BytesReadDataNodeCache: 377.18 MB (395504782) | |
- BytesReadLocal: 386.75 MB (405532185) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 386.75 MB (405532185) | |
- DecompressionTime: 851.102ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 1 (1) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 31 (31) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 24.80 MB (26004005) | |
- PerReadThreadRawHdfsThroughput: 33.79 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 18.685ms | |
- RowBatchQueuePutWaitTime: 24s152ms | |
- RowsRead: 12.71M (12711965) | |
- RowsReturned: 12.71M (12711965) | |
- RowsReturnedRate: 191.70 M/sec | |
- ScanRangesComplete: 31 (31) | |
- ScannerThreadsInvoluntaryContextSwitches: 7 (7) | |
- ScannerThreadsTotalWallClockTime: 26s077ms | |
- MaterializeTupleTime(*): 395.181ms | |
- ScannerThreadsSysTime: 176.000ms | |
- ScannerThreadsUserTime: 1s640ms | |
- ScannerThreadsVoluntaryContextSwitches: 13.04K (13036) | |
- TotalRawHdfsReadTime(*): 11.177ms | |
- TotalReadThroughput: 85.94 MB/sec | |
Instance 514ee9ab39cdc507:11 (host=cdh10.net.cuberonlabs.com:22000):(Total: 8s269ms, non-child: 516.904ms, % non-child: 6.25%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.75 GB | |
MemoryUsage(500.000ms): 196.80 MB, 286.47 MB, 510.54 MB, 558.68 MB, 606.61 MB, 847.20 MB, 877.73 MB, 905.66 MB, 849.45 MB, 736.20 MB, 623.20 MB, 510.12 MB, 421.01 MB, 307.64 MB, 227.22 MB, 114.10 MB | |
ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 8, 7, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 4.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 916.47 MB (960991926) | |
- PerHostPeakMemUsage: 1.66 GB (1784016472) | |
- RowsProduced: 4.43M (4425508) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 10.681ms | |
- TotalStorageWaitTime: 24.456ms | |
- TotalThreadsInvoluntaryContextSwitches: 72 (72) | |
- TotalThreadsTotalWallClockTime: 32s693ms | |
- TotalThreadsSysTime: 964.000ms | |
- TotalThreadsUserTime: 8s896ms | |
- TotalThreadsVoluntaryContextSwitches: 12.59K (12594) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 8s073ms | |
- ExecTreeExecTime: 5s747ms | |
- OpenTime: 150.812ms | |
- ExecTreeOpenTime: 41.373us | |
- PrepareTime: 45.084ms | |
- ExecTreePrepareTime: 817.662us | |
DataStreamSender (dst_id=26):(Total: 1s815ms, non-child: 1s815ms, % non-child: 100.00%) | |
- BytesSent: 273.57 MB (286860434) | |
- NetworkThroughput(*): 377.07 MB/sec | |
- OverallThroughput: 150.67 MB/sec | |
- PeakMemoryUsage: 2.12 MB (2226048) | |
- RowsReturned: 4.43M (4425508) | |
- SerializeBatchTime: 1s089ms | |
- TransmitDataRPCTime: 725.523ms | |
- UncompressedRowBatchSize: 581.02 MB (609248552) | |
CodeGen:(Total: 190.336ms, non-child: 190.336ms, % non-child: 100.00%) | |
- CodegenTime: 3.867ms | |
- CompileTime: 36.775ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 61 (61) | |
- NumInstructions: 1.14K (1136) | |
- OptimizationTime: 112.697ms | |
- PeakMemoryUsage: 568.00 KB (581632) | |
- PrepareTime: 40.089ms | |
AGGREGATION_NODE (id=1):(Total: 5s746ms, non-child: 5s664ms, % non-child: 98.59%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 3.590ms | |
- GetResultsTime: 1s469ms | |
- HTResizeTime: 191.673ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 907.05 MB (951111449) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 37.23 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.43M (4425508) | |
- RowsReturnedRate: 770.15 K/sec | |
- StreamingTime: 3s617ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=0):(Total: 81.291ms, non-child: 81.291ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.75 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
File Formats: PARQUET/SNAPPY:30 | |
BytesRead(500.000ms): 86.90 MB, 106.56 MB, 182.45 MB, 205.93 MB, 273.35 MB, 299.23 MB, 353.50 MB | |
- FooterProcessingTime: (Avg: 12.704ms ; Min: 2.661ms ; Max: 59.732ms ; Number of samples: 30) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.86 | |
- BytesRead: 353.50 MB (370670701) | |
- BytesReadDataNodeCache: 344.24 MB (360966202) | |
- BytesReadLocal: 353.50 MB (370670701) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 353.50 MB (370670701) | |
- DecompressionTime: 792.979ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 1 (1) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 30 (30) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 26.09 MB (27362478) | |
- PerReadThreadRawHdfsThroughput: 37.29 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 26.485ms | |
- RowBatchQueuePutWaitTime: 22s431ms | |
- RowsRead: 11.46M (11459388) | |
- RowsReturned: 11.46M (11459388) | |
- RowsReturnedRate: 140.97 M/sec | |
- ScanRangesComplete: 30 (30) | |
- ScannerThreadsInvoluntaryContextSwitches: 48 (48) | |
- ScannerThreadsTotalWallClockTime: 24s469ms | |
- MaterializeTupleTime(*): 362.713ms | |
- ScannerThreadsSysTime: 224.000ms | |
- ScannerThreadsUserTime: 1s500ms | |
- ScannerThreadsVoluntaryContextSwitches: 11.74K (11742) | |
- TotalRawHdfsReadTime(*): 9.256ms | |
- TotalReadThroughput: 101.00 MB/sec | |
Instance 514ee9ab39cdc507:b (host=cdh1.net.cuberonlabs.com:22000):(Total: 8s011ms, non-child: 724.430ms, % non-child: 9.04%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/2.99 GB | |
MemoryUsage(500.000ms): 1.90 MB, 234.84 MB, 315.00 MB, 507.79 MB, 552.22 MB, 602.26 MB, 769.44 MB, 874.63 MB, 920.68 MB, 857.50 MB, 742.15 MB, 628.12 MB, 514.13 MB, 400.01 MB, 254.29 MB, 115.06 MB | |
ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 7, 7, 5, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 3.88 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 920.68 MB (965399238) | |
- PerHostPeakMemUsage: 1.81 GB (1939587581) | |
- RowsProduced: 4.62M (4622415) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 8.061ms | |
- TotalStorageWaitTime: 29.624ms | |
- TotalThreadsInvoluntaryContextSwitches: 48 (48) | |
- TotalThreadsTotalWallClockTime: 31s737ms | |
- TotalThreadsSysTime: 1s000ms | |
- TotalThreadsUserTime: 8s992ms | |
- TotalThreadsVoluntaryContextSwitches: 13.48K (13480) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 7s826ms | |
- ExecTreeExecTime: 5s651ms | |
- OpenTime: 153.542ms | |
- ExecTreeOpenTime: 45.388us | |
- PrepareTime: 31.684ms | |
- ExecTreePrepareTime: 920.168us | |
DataStreamSender (dst_id=26):(Total: 1s460ms, non-child: 1s460ms, % non-child: 100.00%) | |
- BytesSent: 283.71 MB (297494080) | |
- NetworkThroughput(*): 745.94 MB/sec | |
- OverallThroughput: 194.23 MB/sec | |
- PeakMemoryUsage: 2.12 MB (2226048) | |
- RowsReturned: 4.62M (4622415) | |
- SerializeBatchTime: 1s079ms | |
- TransmitDataRPCTime: 380.340ms | |
- UncompressedRowBatchSize: 602.49 MB (631760477) | |
CodeGen:(Total: 176.298ms, non-child: 176.298ms, % non-child: 100.00%) | |
- CodegenTime: 3.870ms | |
- CompileTime: 35.464ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 61 (61) | |
- NumInstructions: 1.14K (1136) | |
- OptimizationTime: 115.965ms | |
- PeakMemoryUsage: 568.00 KB (581632) | |
- PrepareTime: 24.165ms | |
AGGREGATION_NODE (id=1):(Total: 5s650ms, non-child: 5s562ms, % non-child: 98.44%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 681.640us | |
- GetResultsTime: 1s153ms | |
- HTResizeTime: 229.148ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 914.91 MB (959353038) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 37.82 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.62M (4622415) | |
- RowsReturnedRate: 818.11 K/sec | |
- StreamingTime: 3s980ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=0):(Total: 88.063ms, non-child: 88.063ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/2.99 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:35 | |
BytesRead(500.000ms): 0, 87.42 MB, 137.28 MB, 174.40 MB, 219.84 MB, 258.57 MB, 312.01 MB, 341.77 MB, 383.02 MB | |
- FooterProcessingTime: (Avg: 7.965ms ; Min: 3.214ms ; Max: 25.064ms ; Number of samples: 35) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 5.75 | |
- BytesRead: 383.02 MB (401624666) | |
- BytesReadDataNodeCache: 372.23 MB (390306397) | |
- BytesReadLocal: 383.02 MB (401624666) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 383.02 MB (401624666) | |
- DecompressionTime: 886.275ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 1 (1) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 35 (35) | |
- NumScannerThreadsStarted: 6 (6) | |
- PeakMemoryUsage: 20.70 MB (21706639) | |
- PerReadThreadRawHdfsThroughput: 29.32 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 23.897ms | |
- RowBatchQueuePutWaitTime: 21s585ms | |
- RowsRead: 12.55M (12550697) | |
- RowsReturned: 12.55M (12550697) | |
- RowsReturnedRate: 142.52 M/sec | |
- ScanRangesComplete: 35 (35) | |
- ScannerThreadsInvoluntaryContextSwitches: 25 (25) | |
- ScannerThreadsTotalWallClockTime: 23s758ms | |
- MaterializeTupleTime(*): 431.481ms | |
- ScannerThreadsSysTime: 244.000ms | |
- ScannerThreadsUserTime: 1s820ms | |
- ScannerThreadsVoluntaryContextSwitches: 12.84K (12842) | |
- TotalRawHdfsReadTime(*): 12.757ms | |
- TotalReadThroughput: 85.12 MB/sec | |
Instance 514ee9ab39cdc507:4 (host=cdh6.net.cuberonlabs.com:22000):(Total: 7s777ms, non-child: 701.380ms, % non-child: 9.02%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/2.89 GB | |
MemoryUsage(500.000ms): 1.90 MB, 236.50 MB, 315.80 MB, 516.39 MB, 556.74 MB, 605.03 MB, 829.37 MB, 876.41 MB, 905.94 MB, 792.87 MB, 679.75 MB, 566.78 MB, 453.35 MB, 340.36 MB, 170.74 MB, 57.58 MB | |
ThreadUsage(500.000ms): 1, 8, 8, 8, 8, 8, 8, 7, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 4.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 918.52 MB (963133620) | |
- PerHostPeakMemUsage: 1.67 GB (1794839264) | |
- RowsProduced: 4.50M (4499298) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 8.311ms | |
- TotalStorageWaitTime: 19.551ms | |
- TotalThreadsInvoluntaryContextSwitches: 29 (29) | |
- TotalThreadsTotalWallClockTime: 33s872ms | |
- TotalThreadsSysTime: 832.000ms | |
- TotalThreadsUserTime: 8s628ms | |
- TotalThreadsVoluntaryContextSwitches: 12.94K (12937) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 7s606ms | |
- ExecTreeExecTime: 5s490ms | |
- OpenTime: 132.894ms | |
- ExecTreeOpenTime: 36.728us | |
- PrepareTime: 37.972ms | |
- ExecTreePrepareTime: 803.900us | |
DataStreamSender (dst_id=26):(Total: 1s422ms, non-child: 1s422ms, % non-child: 100.00%) | |
- BytesSent: 276.96 MB (290417254) | |
- NetworkThroughput(*): 757.02 MB/sec | |
- OverallThroughput: 194.69 MB/sec | |
- PeakMemoryUsage: 1.94 MB (2029440) | |
- RowsReturned: 4.50M (4499298) | |
- SerializeBatchTime: 1s056ms | |
- TransmitDataRPCTime: 365.861ms | |
- UncompressedRowBatchSize: 587.82 MB (616378366) | |
CodeGen:(Total: 165.347ms, non-child: 165.347ms, % non-child: 100.00%) | |
- CodegenTime: 4.346ms | |
- CompileTime: 34.084ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 61 (61) | |
- NumInstructions: 1.14K (1136) | |
- OptimizationTime: 97.141ms | |
- PeakMemoryUsage: 568.00 KB (581632) | |
- PrepareTime: 33.317ms | |
AGGREGATION_NODE (id=1):(Total: 5s488ms, non-child: 5s341ms, % non-child: 97.32%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 973.192us | |
- GetResultsTime: 1s173ms | |
- HTResizeTime: 186.294ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 907.04 MB (951101755) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 37.13 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.50M (4499298) | |
- RowsReturnedRate: 819.80 K/sec | |
- StreamingTime: 3s726ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=0):(Total: 146.873ms, non-child: 146.873ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/2.89 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:32 | |
BytesRead(500.000ms): 0, 78.30 MB, 142.41 MB, 170.01 MB, 223.32 MB, 263.74 MB, 304.71 MB, 371.24 MB | |
- FooterProcessingTime: (Avg: 8.393ms ; Min: 2.917ms ; Max: 83.208ms ; Number of samples: 32) | |
- AverageHdfsReadThreadConcurrency: 0.14 | |
- AverageScannerThreadConcurrency: 6.86 | |
- BytesRead: 371.24 MB (389277893) | |
- BytesReadDataNodeCache: 361.37 MB (378927166) | |
- BytesReadLocal: 371.24 MB (389277893) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 371.24 MB (389277893) | |
- DecompressionTime: 839.129ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 1 (1) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 32 (32) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 22.22 MB (23303732) | |
- PerReadThreadRawHdfsThroughput: 36.14 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 91.533ms | |
- RowBatchQueuePutWaitTime: 23s736ms | |
- RowsRead: 12.15M (12150960) | |
- RowsReturned: 12.15M (12150960) | |
- RowsReturnedRate: 82.73 M/sec | |
- ScanRangesComplete: 32 (32) | |
- ScannerThreadsInvoluntaryContextSwitches: 17 (17) | |
- ScannerThreadsTotalWallClockTime: 26s133ms | |
- MaterializeTupleTime(*): 393.822ms | |
- ScannerThreadsSysTime: 188.000ms | |
- ScannerThreadsUserTime: 1s648ms | |
- ScannerThreadsVoluntaryContextSwitches: 12.29K (12287) | |
- TotalRawHdfsReadTime(*): 10.032ms | |
- TotalReadThroughput: 92.81 MB/sec | |
Instance 514ee9ab39cdc507:d (host=cdh7.net.cuberonlabs.com:22000):(Total: 7s336ms, non-child: 421.549ms, % non-child: 5.75%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:27/2.46 GB | |
MemoryUsage(500.000ms): 1.90 MB, 238.99 MB, 302.55 MB, 511.33 MB, 559.89 MB, 607.70 MB, 692.27 MB, 858.52 MB, 804.35 MB, 697.04 MB, 590.08 MB, 482.89 MB, 343.29 MB, 215.59 MB, 75.39 MB | |
ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 10, 7, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 4.67 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 874.58 MB (917064013) | |
- PerHostPeakMemUsage: 1.58 GB (1699637471) | |
- RowsProduced: 4.01M (4009348) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 10.534ms | |
- TotalStorageWaitTime: 16.151ms | |
- TotalThreadsInvoluntaryContextSwitches: 53 (53) | |
- TotalThreadsTotalWallClockTime: 35s321ms | |
- TotalThreadsSysTime: 820.000ms | |
- TotalThreadsUserTime: 8s148ms | |
- TotalThreadsVoluntaryContextSwitches: 11.12K (11124) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 7s158ms | |
- ExecTreeExecTime: 5s104ms | |
- OpenTime: 143.282ms | |
- ExecTreeOpenTime: 42.075us | |
- PrepareTime: 34.931ms | |
- ExecTreePrepareTime: 663.698us | |
DataStreamSender (dst_id=26):(Total: 1s638ms, non-child: 1s638ms, % non-child: 100.00%) | |
- BytesSent: 246.34 MB (258306556) | |
- NetworkThroughput(*): 367.57 MB/sec | |
- OverallThroughput: 150.30 MB/sec | |
- PeakMemoryUsage: 2.06 MB (2160512) | |
- RowsReturned: 4.01M (4009348) | |
- SerializeBatchTime: 968.204ms | |
- TransmitDataRPCTime: 670.177ms | |
- UncompressedRowBatchSize: 522.07 MB (547432694) | |
CodeGen:(Total: 173.001ms, non-child: 173.001ms, % non-child: 100.00%) | |
- CodegenTime: 3.962ms | |
- CompileTime: 34.944ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 61 (61) | |
- NumInstructions: 1.14K (1136) | |
- OptimizationTime: 107.257ms | |
- PeakMemoryUsage: 568.00 KB (581632) | |
- PrepareTime: 29.965ms | |
AGGREGATION_NODE (id=1):(Total: 5s102ms, non-child: 5s032ms, % non-child: 98.63%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 2.822ms | |
- GetResultsTime: 1s088ms | |
- HTResizeTime: 218.390ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 858.99 MB (900719081) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 36.43 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.01M (4009348) | |
- RowsReturnedRate: 785.72 K/sec | |
- StreamingTime: 3s559ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=0):(Total: 70.079ms, non-child: 70.079ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:27/2.46 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 27 out of 27 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:27 | |
BytesRead(500.000ms): 0, 88.90 MB, 121.42 MB, 201.89 MB, 201.89 MB, 274.87 MB, 314.43 MB, 314.43 MB | |
- FooterProcessingTime: (Avg: 9.811ms ; Min: 3.240ms ; Max: 40.813ms ; Number of samples: 27) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.86 | |
- BytesRead: 314.43 MB (329708824) | |
- BytesReadDataNodeCache: 306.11 MB (320983394) | |
- BytesReadLocal: 314.43 MB (329708824) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 314.43 MB (329708824) | |
- DecompressionTime: 798.207ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 1 (1) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 27 (27) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 27.62 MB (28959987) | |
- PerReadThreadRawHdfsThroughput: 33.52 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 18.898ms | |
- RowBatchQueuePutWaitTime: 26s113ms | |
- RowsRead: 10.29M (10293228) | |
- RowsReturned: 10.29M (10293228) | |
- RowsReturnedRate: 146.88 M/sec | |
- ScanRangesComplete: 27 (27) | |
- ScannerThreadsInvoluntaryContextSwitches: 44 (44) | |
- ScannerThreadsTotalWallClockTime: 28s020ms | |
- MaterializeTupleTime(*): 376.312ms | |
- ScannerThreadsSysTime: 140.000ms | |
- ScannerThreadsUserTime: 1s596ms | |
- ScannerThreadsVoluntaryContextSwitches: 10.45K (10446) | |
- TotalRawHdfsReadTime(*): 9.159ms | |
- TotalReadThroughput: 78.61 MB/sec | |
Instance 514ee9ab39cdc507:5 (host=cdh15.net.cuberonlabs.com:22000):(Total: 7s244ms, non-child: 705.627ms, % non-child: 9.74%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.66 GB | |
MemoryUsage(500.000ms): 1.34 MB, 220.78 MB, 312.90 MB, 510.60 MB, 574.57 MB, 623.05 MB, 862.69 MB, 890.95 MB, 778.88 MB, 667.76 MB, 556.51 MB, 445.47 MB, 334.21 MB, 190.56 MB, 56.72 MB | |
ThreadUsage(500.000ms): 1, 8, 9, 9, 9, 9, 9, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 4.13 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 900.09 MB (943817303) | |
- PerHostPeakMemUsage: 1.57 GB (1688553772) | |
- RowsProduced: 4.26M (4264338) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 8.585ms | |
- TotalStorageWaitTime: 21.626ms | |
- TotalThreadsInvoluntaryContextSwitches: 24 (24) | |
- TotalThreadsTotalWallClockTime: 31s600ms | |
- TotalThreadsSysTime: 840.000ms | |
- TotalThreadsUserTime: 7s920ms | |
- TotalThreadsVoluntaryContextSwitches: 12.21K (12214) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 6s985ms | |
- ExecTreeExecTime: 4s864ms | |
- OpenTime: 206.475ms | |
- ExecTreeOpenTime: 43.371us | |
- PrepareTime: 52.447ms | |
- ExecTreePrepareTime: 739.688us | |
DataStreamSender (dst_id=26):(Total: 1s422ms, non-child: 1s422ms, % non-child: 100.00%) | |
- BytesSent: 264.18 MB (277017219) | |
- NetworkThroughput(*): 737.14 MB/sec | |
- OverallThroughput: 185.68 MB/sec | |
- PeakMemoryUsage: 2.01 MB (2103168) | |
- RowsReturned: 4.26M (4264338) | |
- SerializeBatchTime: 1s063ms | |
- TransmitDataRPCTime: 358.389ms | |
- UncompressedRowBatchSize: 560.56 MB (587785096) | |
CodeGen:(Total: 252.858ms, non-child: 252.858ms, % non-child: 100.00%) | |
- CodegenTime: 5.440ms | |
- CompileTime: 45.724ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 61 (61) | |
- NumInstructions: 1.14K (1136) | |
- OptimizationTime: 159.145ms | |
- PeakMemoryUsage: 568.00 KB (581632) | |
- PrepareTime: 46.994ms | |
AGGREGATION_NODE (id=1):(Total: 4s862ms, non-child: 4s796ms, % non-child: 98.64%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 1.651ms | |
- GetResultsTime: 1s147ms | |
- HTResizeTime: 182.996ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 891.07 MB (934354560) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 37.68 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.26M (4264338) | |
- RowsReturnedRate: 876.93 K/sec | |
- StreamingTime: 3s212ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=0):(Total: 66.123ms, non-child: 66.123ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.66 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:30 | |
BytesRead(500.000ms): 0, 83.55 MB, 133.66 MB, 170.04 MB, 236.55 MB, 288.81 MB, 341.91 MB, 341.91 MB | |
- FooterProcessingTime: (Avg: 6.848ms ; Min: 2.723ms ; Max: 20.857ms ; Number of samples: 30) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.71 | |
- BytesRead: 341.91 MB (358518861) | |
- BytesReadDataNodeCache: 332.65 MB (348813550) | |
- BytesReadLocal: 341.91 MB (358518861) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 341.91 MB (358518861) | |
- DecompressionTime: 719.576ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 1 (1) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 30 (30) | |
- NumScannerThreadsStarted: 8 (8) | |
- PeakMemoryUsage: 25.51 MB (26746433) | |
- PerReadThreadRawHdfsThroughput: 27.89 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 18.606ms | |
- RowBatchQueuePutWaitTime: 22s692ms | |
- RowsRead: 11.11M (11113210) | |
- RowsReturned: 11.11M (11113210) | |
- RowsReturnedRate: 168.07 M/sec | |
- ScanRangesComplete: 30 (30) | |
- ScannerThreadsInvoluntaryContextSwitches: 15 (15) | |
- ScannerThreadsTotalWallClockTime: 24s408ms | |
- MaterializeTupleTime(*): 352.323ms | |
- ScannerThreadsSysTime: 192.000ms | |
- ScannerThreadsUserTime: 1s420ms | |
- ScannerThreadsVoluntaryContextSwitches: 11.44K (11441) | |
- TotalRawHdfsReadTime(*): 11.973ms | |
- TotalReadThroughput: 85.48 MB/sec | |
Instance 514ee9ab39cdc507:f (host=cdh11.net.cuberonlabs.com:22000):(Total: 6s842ms, non-child: 713.592ms, % non-child: 10.43%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:21/2.18 GB | |
MemoryUsage(500.000ms): 223.03 MB, 302.24 MB, 510.28 MB, 558.22 MB, 606.48 MB, 751.05 MB, 842.24 MB, 683.97 MB, 579.01 MB, 421.48 MB, 316.39 MB, 211.28 MB, 106.31 MB | |
ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 8, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 4.23 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 853.94 MB (895418488) | |
- PerHostPeakMemUsage: 1.48 GB (1591793359) | |
- RowsProduced: 3.65M (3647743) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 8.444ms | |
- TotalStorageWaitTime: 14.284ms | |
- TotalThreadsInvoluntaryContextSwitches: 26 (26) | |
- TotalThreadsTotalWallClockTime: 28s118ms | |
- TotalThreadsSysTime: 684.000ms | |
- TotalThreadsUserTime: 7s440ms | |
- TotalThreadsVoluntaryContextSwitches: 9.48K (9480) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 6s666ms | |
- ExecTreeExecTime: 4s631ms | |
- OpenTime: 140.860ms | |
- ExecTreeOpenTime: 38.673us | |
- PrepareTime: 34.947ms | |
- ExecTreePrepareTime: 807.890us | |
DataStreamSender (dst_id=26):(Total: 1s327ms, non-child: 1s327ms, % non-child: 100.00%) | |
- BytesSent: 226.79 MB (237809909) | |
- NetworkThroughput(*): 733.81 MB/sec | |
- OverallThroughput: 170.80 MB/sec | |
- PeakMemoryUsage: 2.00 MB (2094976) | |
- RowsReturned: 3.65M (3647743) | |
- SerializeBatchTime: 1s018ms | |
- TransmitDataRPCTime: 309.062ms | |
- UncompressedRowBatchSize: 480.34 MB (503673659) | |
CodeGen:(Total: 170.626ms, non-child: 170.626ms, % non-child: 100.00%) | |
- CodegenTime: 3.655ms | |
- CompileTime: 35.020ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 61 (61) | |
- NumInstructions: 1.14K (1136) | |
- OptimizationTime: 104.745ms | |
- PeakMemoryUsage: 568.00 KB (581632) | |
- PrepareTime: 30.106ms | |
AGGREGATION_NODE (id=1):(Total: 4s630ms, non-child: 4s567ms, % non-child: 98.64%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 2.324ms | |
- GetResultsTime: 1s110ms | |
- HTResizeTime: 218.593ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 843.15 MB (884106972) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 36.34 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 3.65M (3647743) | |
- RowsReturnedRate: 787.73 K/sec | |
- StreamingTime: 3s038ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=0):(Total: 63.034ms, non-child: 63.034ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:21/2.18 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 21 out of 21 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
File Formats: PARQUET/SNAPPY:21 | |
BytesRead(500.000ms): 94.40 MB, 107.82 MB, 187.60 MB, 187.60 MB, 280.52 MB, 280.52 MB | |
- FooterProcessingTime: (Avg: 12.273ms ; Min: 2.943ms ; Max: 45.347ms ; Number of samples: 21) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.00 | |
- BytesRead: 280.52 MB (294151608) | |
- BytesReadDataNodeCache: 274.04 MB (287356214) | |
- BytesReadLocal: 280.52 MB (294151608) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 280.52 MB (294151608) | |
- DecompressionTime: 640.142ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 1 (1) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 21 (21) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 24.27 MB (25451362) | |
- PerReadThreadRawHdfsThroughput: 36.43 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 24.091ms | |
- RowBatchQueuePutWaitTime: 19s780ms | |
- RowsRead: 8.99M (8989956) | |
- RowsReturned: 8.99M (8989956) | |
- RowsReturnedRate: 142.62 M/sec | |
- ScanRangesComplete: 21 (21) | |
- ScannerThreadsInvoluntaryContextSwitches: 13 (13) | |
- ScannerThreadsTotalWallClockTime: 21s310ms | |
- MaterializeTupleTime(*): 289.478ms | |
- ScannerThreadsSysTime: 116.000ms | |
- ScannerThreadsUserTime: 1s252ms | |
- ScannerThreadsVoluntaryContextSwitches: 9.00K (8996) | |
- TotalRawHdfsReadTime(*): 7.519ms | |
- TotalReadThroughput: 93.51 MB/sec | |
Instance 514ee9ab39cdc507:2 (host=cdh16.net.cuberonlabs.com:22000):(Total: 6s797ms, non-child: 620.421ms, % non-child: 9.13%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.64 GB | |
MemoryUsage(500.000ms): 202.44 MB, 301.15 MB, 508.97 MB, 556.67 MB, 608.05 MB, 844.20 MB, 887.85 MB, 778.83 MB, 667.64 MB, 501.19 MB, 390.10 MB, 222.85 MB, 112.17 MB | |
ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 8, 4, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 4.46 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 897.24 MB (940825028) | |
- PerHostPeakMemUsage: 1.64 GB (1763578733) | |
- RowsProduced: 4.24M (4235020) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 9.226ms | |
- TotalStorageWaitTime: 19.494ms | |
- TotalThreadsInvoluntaryContextSwitches: 23 (23) | |
- TotalThreadsTotalWallClockTime: 28s676ms | |
- TotalThreadsSysTime: 716.000ms | |
- TotalThreadsUserTime: 7s844ms | |
- TotalThreadsVoluntaryContextSwitches: 11.83K (11833) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 6s596ms | |
- ExecTreeExecTime: 4s643ms | |
- OpenTime: 163.870ms | |
- ExecTreeOpenTime: 33.295us | |
- PrepareTime: 36.623ms | |
- ExecTreePrepareTime: 1.160ms | |
DataStreamSender (dst_id=26):(Total: 1s339ms, non-child: 1s339ms, % non-child: 100.00%) | |
- BytesSent: 261.14 MB (273825491) | |
- NetworkThroughput(*): 742.48 MB/sec | |
- OverallThroughput: 194.90 MB/sec | |
- PeakMemoryUsage: 2.01 MB (2103168) | |
- RowsReturned: 4.24M (4235020) | |
- SerializeBatchTime: 987.286ms | |
- TransmitDataRPCTime: 351.712ms | |
- UncompressedRowBatchSize: 554.20 MB (581121446) | |
CodeGen:(Total: 194.797ms, non-child: 194.797ms, % non-child: 100.00%) | |
- CodegenTime: 3.620ms | |
- CompileTime: 37.106ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 61 (61) | |
- NumInstructions: 1.14K (1136) | |
- OptimizationTime: 125.333ms | |
- PeakMemoryUsage: 568.00 KB (581632) | |
- PrepareTime: 31.593ms | |
AGGREGATION_NODE (id=1):(Total: 4s642ms, non-child: 4s566ms, % non-child: 98.37%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 3.155ms | |
- GetResultsTime: 969.958ms | |
- HTResizeTime: 193.184ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 891.19 MB (934477432) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 37.30 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.24M (4235020) | |
- RowsReturnedRate: 912.25 K/sec | |
- StreamingTime: 3s241ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=0):(Total: 75.856ms, non-child: 75.856ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.64 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:28 | |
BytesRead(500.000ms): 83.82 MB, 101.45 MB, 177.31 MB, 204.51 MB, 284.13 MB, 311.16 MB, 337.87 MB | |
- FooterProcessingTime: (Avg: 9.426ms ; Min: 3.022ms ; Max: 34.360ms ; Number of samples: 28) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.43 | |
- BytesRead: 337.87 MB (354285165) | |
- BytesReadDataNodeCache: 329.24 MB (345228228) | |
- BytesReadLocal: 337.87 MB (354285165) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 337.87 MB (354285165) | |
- DecompressionTime: 849.925ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 1 (1) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 28 (28) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 22.51 MB (23601579) | |
- PerReadThreadRawHdfsThroughput: 26.38 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 28.324ms | |
- RowBatchQueuePutWaitTime: 19s917ms | |
- RowsRead: 11.05M (11051815) | |
- RowsReturned: 11.05M (11051815) | |
- RowsReturnedRate: 145.69 M/sec | |
- ScanRangesComplete: 28 (28) | |
- ScannerThreadsInvoluntaryContextSwitches: 12 (12) | |
- ScannerThreadsTotalWallClockTime: 21s915ms | |
- MaterializeTupleTime(*): 407.267ms | |
- ScannerThreadsSysTime: 184.000ms | |
- ScannerThreadsUserTime: 1s672ms | |
- ScannerThreadsVoluntaryContextSwitches: 11.09K (11093) | |
- TotalRawHdfsReadTime(*): 12.509ms | |
- TotalReadThroughput: 96.54 MB/sec | |
Instance 514ee9ab39cdc507:9 (host=cdh12.net.cuberonlabs.com:22000):(Total: 6s204ms, non-child: 664.855ms, % non-child: 10.72%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:20/1.81 GB | |
MemoryUsage(500.000ms): 36.88 MB, 259.20 MB, 317.62 MB, 526.06 MB, 574.16 MB, 601.89 MB, 526.56 MB, 414.37 MB, 339.03 MB, 263.89 MB, 168.46 MB, 76.13 MB | |
ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 3.92 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 603.84 MB (633173165) | |
- PerHostPeakMemUsage: 1.12 GB (1201773720) | |
- RowsProduced: 3.08M (3081902) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 8.981ms | |
- TotalStorageWaitTime: 44.796ms | |
- TotalThreadsInvoluntaryContextSwitches: 45 (45) | |
- TotalThreadsTotalWallClockTime: 22s457ms | |
- TotalThreadsSysTime: 600.000ms | |
- TotalThreadsUserTime: 6s724ms | |
- TotalThreadsVoluntaryContextSwitches: 8.53K (8532) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s973ms | |
- ExecTreeExecTime: 4s042ms | |
- OpenTime: 193.221ms | |
- ExecTreeOpenTime: 50.038us | |
- PrepareTime: 38.327ms | |
- ExecTreePrepareTime: 597.137us | |
DataStreamSender (dst_id=26):(Total: 1s271ms, non-child: 1s271ms, % non-child: 100.00%) | |
- BytesSent: 189.79 MB (199013583) | |
- NetworkThroughput(*): 591.57 MB/sec | |
- OverallThroughput: 149.21 MB/sec | |
- PeakMemoryUsage: 2.06 MB (2160512) | |
- RowsReturned: 3.08M (3081902) | |
- SerializeBatchTime: 950.550ms | |
- TransmitDataRPCTime: 320.829ms | |
- UncompressedRowBatchSize: 401.16 MB (420646138) | |
CodeGen:(Total: 226.403ms, non-child: 226.403ms, % non-child: 100.00%) | |
- CodegenTime: 4.175ms | |
- CompileTime: 49.544ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 61 (61) | |
- NumInstructions: 1.14K (1136) | |
- OptimizationTime: 142.261ms | |
- PeakMemoryUsage: 568.00 KB (581632) | |
- PrepareTime: 33.804ms | |
AGGREGATION_NODE (id=1):(Total: 4s041ms, non-child: 3s977ms, % non-child: 98.42%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 3.521ms | |
- GetResultsTime: 1s129ms | |
- HTResizeTime: 112.241ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 603.03 MB (632327306) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 68.86 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 3.08M (3081902) | |
- RowsReturnedRate: 762.55 K/sec | |
- StreamingTime: 2s426ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=0):(Total: 63.761ms, non-child: 63.761ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:20/1.81 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 20 out of 20 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
File Formats: PARQUET/SNAPPY:20 | |
BytesRead(500.000ms): 81.29 MB, 94.48 MB, 151.99 MB, 191.93 MB, 231.94 MB | |
- FooterProcessingTime: (Avg: 8.643ms ; Min: 3.553ms ; Max: 25.891ms ; Number of samples: 20) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.00 | |
- BytesRead: 231.94 MB (243208286) | |
- BytesReadDataNodeCache: 225.77 MB (236739599) | |
- BytesReadLocal: 231.94 MB (243208286) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 231.94 MB (243208286) | |
- DecompressionTime: 537.122ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 1 (1) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 20 (20) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 25.09 MB (26308726) | |
- PerReadThreadRawHdfsThroughput: 28.90 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 22.834ms | |
- RowBatchQueuePutWaitTime: 14s940ms | |
- RowsRead: 7.62M (7619211) | |
- RowsReturned: 7.62M (7619211) | |
- RowsReturnedRate: 119.50 M/sec | |
- ScanRangesComplete: 20 (20) | |
- ScannerThreadsInvoluntaryContextSwitches: 13 (13) | |
- ScannerThreadsTotalWallClockTime: 16s291ms | |
- MaterializeTupleTime(*): 244.923ms | |
- ScannerThreadsSysTime: 112.000ms | |
- ScannerThreadsUserTime: 1s120ms | |
- ScannerThreadsVoluntaryContextSwitches: 7.90K (7897) | |
- TotalRawHdfsReadTime(*): 7.836ms | |
- TotalReadThroughput: 92.78 MB/sec | |
Instance 514ee9ab39cdc507:a (host=cdh14.net.cuberonlabs.com:22000):(Total: 5s535ms, non-child: 545.901ms, % non-child: 9.86%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:22/2.04 GB | |
MemoryUsage(500.000ms): 194.65 MB, 285.42 MB, 509.51 MB, 575.28 MB, 617.00 MB, 810.01 MB, 658.19 MB, 506.96 MB, 354.90 MB, 203.14 MB, 51.53 MB | |
ThreadUsage(500.000ms): 8, 8, 8, 8, 6, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 4.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 825.13 MB (865209229) | |
- PerHostPeakMemUsage: 1.44 GB (1548652528) | |
- RowsProduced: 3.42M (3424061) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 8.017ms | |
- TotalStorageWaitTime: 24.394ms | |
- TotalThreadsInvoluntaryContextSwitches: 10 (10) | |
- TotalThreadsTotalWallClockTime: 22s284ms | |
- TotalThreadsSysTime: 652.000ms | |
- TotalThreadsUserTime: 6s076ms | |
- TotalThreadsVoluntaryContextSwitches: 9.05K (9046) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s350ms | |
- ExecTreeExecTime: 3s680ms | |
- OpenTime: 146.984ms | |
- ExecTreeOpenTime: 40.674us | |
- PrepareTime: 38.442ms | |
- ExecTreePrepareTime: 772.667us | |
DataStreamSender (dst_id=26):(Total: 1s130ms, non-child: 1s130ms, % non-child: 100.00%) | |
- BytesSent: 210.41 MB (220627506) | |
- NetworkThroughput(*): 754.58 MB/sec | |
- OverallThroughput: 186.19 MB/sec | |
- PeakMemoryUsage: 2.06 MB (2160512) | |
- RowsReturned: 3.42M (3424061) | |
- SerializeBatchTime: 850.720ms | |
- TransmitDataRPCTime: 278.838ms | |
- UncompressedRowBatchSize: 445.71 MB (467365383) | |
CodeGen:(Total: 179.914ms, non-child: 179.914ms, % non-child: 100.00%) | |
- CodegenTime: 4.023ms | |
- CompileTime: 34.829ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 61 (61) | |
- NumInstructions: 1.14K (1136) | |
- OptimizationTime: 110.872ms | |
- PeakMemoryUsage: 568.00 KB (581632) | |
- PrepareTime: 33.453ms | |
AGGREGATION_NODE (id=1):(Total: 3s680ms, non-child: 3s623ms, % non-child: 98.47%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 960.062us | |
- GetResultsTime: 827.189ms | |
- HTResizeTime: 183.887ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 811.11 MB (850505881) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 36.60 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 3.42M (3424061) | |
- RowsReturnedRate: 930.44 K/sec | |
- StreamingTime: 2s502ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=0):(Total: 56.314ms, non-child: 56.314ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:22/2.04 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 22 out of 22 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:22 | |
BytesRead(500.000ms): 87.26 MB, 99.83 MB, 170.40 MB, 198.03 MB, 261.96 MB | |
- FooterProcessingTime: (Avg: 11.487ms ; Min: 3.426ms ; Max: 31.722ms ; Number of samples: 22) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.60 | |
- BytesRead: 261.96 MB (274689241) | |
- BytesReadDataNodeCache: 255.18 MB (267573052) | |
- BytesReadLocal: 261.96 MB (274689241) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 261.96 MB (274689241) | |
- DecompressionTime: 578.864ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 1 (1) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 22 (22) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 23.94 MB (25104339) | |
- PerReadThreadRawHdfsThroughput: 32.21 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 22.869ms | |
- RowBatchQueuePutWaitTime: 15s356ms | |
- RowsRead: 8.55M (8554292) | |
- RowsReturned: 8.55M (8554292) | |
- RowsReturnedRate: 151.90 M/sec | |
- ScanRangesComplete: 22 (22) | |
- ScannerThreadsInvoluntaryContextSwitches: 4 (4) | |
- ScannerThreadsTotalWallClockTime: 16s787ms | |
- MaterializeTupleTime(*): 249.220ms | |
- ScannerThreadsSysTime: 112.000ms | |
- ScannerThreadsUserTime: 1s160ms | |
- ScannerThreadsVoluntaryContextSwitches: 8.62K (8624) | |
- TotalRawHdfsReadTime(*): 7.943ms | |
- TotalReadThroughput: 104.79 MB/sec | |
Averaged Fragment F01:(Total: 13s726ms, non-child: 4s969ms, % non-child: 36.21%) | |
split sizes: min: 0, max: 0, avg: 0, stddev: 0 | |
completion times: min:13s624ms max:13s834ms mean: 13s727ms stddev:56.614ms | |
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec | |
num instances: 17 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 331.11 MB (347191915) | |
- PerHostPeakMemUsage: 1.70 GB (1824024877) | |
- RowsProduced: 2.55M (2548431) | |
- TotalNetworkReceiveTime: 6s061ms | |
- TotalNetworkSendTime: 4s491ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 19 (19) | |
- TotalThreadsTotalWallClockTime: 13s689ms | |
- TotalThreadsSysTime: 234.588ms | |
- TotalThreadsUserTime: 2s992ms | |
- TotalThreadsVoluntaryContextSwitches: 5.85K (5854) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s939ms | |
- ExecTreeExecTime: 85.276ms | |
- OpenTime: 7s749ms | |
- ExecTreeOpenTime: 7s621ms | |
- PrepareTime: 37.593ms | |
- ExecTreePrepareTime: 775.004us | |
DataStreamSender (dst_id=28):(Total: 889.222ms, non-child: 889.222ms, % non-child: 100.00%) | |
- BytesSent: 122.13 MB (128060777) | |
- NetworkThroughput(*): 534.40 MB/sec | |
- OverallThroughput: 138.88 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 2.55M (2548431) | |
- SerializeBatchTime: 641.970ms | |
- TransmitDataRPCTime: 246.651ms | |
- UncompressedRowBatchSize: 201.24 MB (211012369) | |
CodeGen:(Total: 161.085ms, non-child: 161.085ms, % non-child: 100.00%) | |
- CodegenTime: 2.801ms | |
- CompileTime: 34.656ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 43 (43) | |
- NumInstructions: 836 (836) | |
- OptimizationTime: 92.213ms | |
- PeakMemoryUsage: 418.00 KB (428032) | |
- PrepareTime: 33.443ms | |
AGGREGATION_NODE (id=25):(Total: 7s706ms, non-child: 1s544ms, % non-child: 20.04%) | |
- BuildTime: 1s451ms | |
- GetNewBlockTime: 949.679us | |
- GetResultsTime: 73.484ms | |
- HTResizeTime: 163.056ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 330.17 MB (346203611) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.55M (2548431) | |
- RowsReturnedRate: 330.69 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.031us | |
EXCHANGE_NODE (id=24):(Total: 6s162ms, non-child: 6s162ms, % non-child: 100.00%) | |
- BytesReceived: 239.28 MB (250900204) | |
- ConvertRowBatchTime: 89.411ms | |
- DeserializeRowBatchTimer: 593.271ms | |
- FirstBatchArrivalWaitTime: 2s703ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.51M (4509900) | |
- RowsReturnedRate: 732.05 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Fragment F01: | |
Instance 514ee9ab39cdc507:25 (host=cdh13.net.cuberonlabs.com:22000):(Total: 13s834ms, non-child: 5s062ms, % non-child: 36.60%) | |
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 43.45 MB, 116.74 MB, 170.28 MB, 212.29 MB, 254.20 MB, 294.24 MB, 322.20 MB, 330.16 MB, 330.16 MB, 330.41 MB, 309.91 MB, 309.91 MB, 309.91 MB, 309.91 MB, 309.91 MB, 309.91 MB, 309.91 MB, 309.91 MB, 289.30 MB, 190.56 MB, 103.79 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 331.11 MB (347191915) | |
- PerHostPeakMemUsage: 1.66 GB (1782381748) | |
- RowsProduced: 2.55M (2545858) | |
- TotalNetworkReceiveTime: 6s165ms | |
- TotalNetworkSendTime: 4s457ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 9 (9) | |
- TotalThreadsTotalWallClockTime: 13s793ms | |
- TotalThreadsSysTime: 224.000ms | |
- TotalThreadsUserTime: 3s028ms | |
- TotalThreadsVoluntaryContextSwitches: 6.18K (6184) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 6s049ms | |
- ExecTreeExecTime: 94.365ms | |
- OpenTime: 7s744ms | |
- ExecTreeOpenTime: 7s629ms | |
- PrepareTime: 41.090ms | |
- ExecTreePrepareTime: 598.355us | |
DataStreamSender (dst_id=28):(Total: 897.509ms, non-child: 897.509ms, % non-child: 100.00%) | |
- BytesSent: 122.05 MB (127983603) | |
- NetworkThroughput(*): 619.07 MB/sec | |
- OverallThroughput: 135.99 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 2.55M (2545858) | |
- SerializeBatchTime: 699.668ms | |
- TransmitDataRPCTime: 197.159ms | |
- UncompressedRowBatchSize: 201.09 MB (210857238) | |
CodeGen:(Total: 151.213ms, non-child: 151.213ms, % non-child: 100.00%) | |
- CodegenTime: 3.965ms | |
- CompileTime: 30.895ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 43 (43) | |
- NumInstructions: 836 (836) | |
- OptimizationTime: 82.451ms | |
- PeakMemoryUsage: 418.00 KB (428032) | |
- PrepareTime: 36.841ms | |
AGGREGATION_NODE (id=25):(Total: 7s723ms, non-child: 1s460ms, % non-child: 18.90%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s358ms | |
- GetNewBlockTime: 688.695us | |
- GetResultsTime: 81.743ms | |
- HTResizeTime: 152.101ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 330.17 MB (346204015) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.55M (2545858) | |
- RowsReturnedRate: 329.63 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 982.000ns | |
EXCHANGE_NODE (id=24):(Total: 6s263ms, non-child: 195.667ms, % non-child: 3.12%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 6.09 MB, 26.90 MB, 66.69 MB, 111.87 MB, 153.46 MB, 190.92 MB, 214.04 MB, 228.12 MB, 236.42 MB | |
- BytesReceived: 239.42 MB (251054598) | |
- ConvertRowBatchTime: 86.491ms | |
- DeserializeRowBatchTimer: 620.925ms | |
- FirstBatchArrivalWaitTime: 2s716ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.51M (4510403) | |
- RowsReturnedRate: 720.14 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:29 (host=cdh17.net.cuberonlabs.com:22000):(Total: 13s817ms, non-child: 5s037ms, % non-child: 36.46%) | |
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 34.26 MB, 100.37 MB, 162.63 MB, 206.42 MB, 248.16 MB, 282.20 MB, 322.16 MB, 330.24 MB, 330.21 MB, 330.20 MB, 310.30 MB, 310.30 MB, 310.30 MB, 310.30 MB, 310.30 MB, 310.30 MB, 310.30 MB, 309.93 MB, 309.87 MB, 206.96 MB, 124.34 MB, 21.36 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 331.11 MB (347191915) | |
- PerHostPeakMemUsage: 1.75 GB (1879028559) | |
- RowsProduced: 2.55M (2545751) | |
- TotalNetworkReceiveTime: 5s822ms | |
- TotalNetworkSendTime: 4s454ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 18 (18) | |
- TotalThreadsTotalWallClockTime: 13s782ms | |
- TotalThreadsSysTime: 332.000ms | |
- TotalThreadsUserTime: 3s256ms | |
- TotalThreadsVoluntaryContextSwitches: 5.14K (5138) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 6s031ms | |
- ExecTreeExecTime: 92.666ms | |
- OpenTime: 7s751ms | |
- ExecTreeOpenTime: 7s634ms | |
- PrepareTime: 34.269ms | |
- ExecTreePrepareTime: 656.903us | |
DataStreamSender (dst_id=28):(Total: 906.236ms, non-child: 906.236ms, % non-child: 100.00%) | |
- BytesSent: 121.93 MB (127852534) | |
- NetworkThroughput(*): 584.58 MB/sec | |
- OverallThroughput: 134.55 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 2.55M (2545751) | |
- SerializeBatchTime: 697.040ms | |
- TransmitDataRPCTime: 208.577ms | |
- UncompressedRowBatchSize: 200.93 MB (210685957) | |
CodeGen:(Total: 147.198ms, non-child: 147.198ms, % non-child: 100.00%) | |
- CodegenTime: 2.501ms | |
- CompileTime: 32.034ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 43 (43) | |
- NumInstructions: 836 (836) | |
- OptimizationTime: 84.094ms | |
- PeakMemoryUsage: 418.00 KB (428032) | |
- PrepareTime: 30.362ms | |
AGGREGATION_NODE (id=25):(Total: 7s726ms, non-child: 1s796ms, % non-child: 23.26%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s697ms | |
- GetNewBlockTime: 1.533ms | |
- GetResultsTime: 80.040ms | |
- HTResizeTime: 186.796ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 330.16 MB (346203091) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.55M (2545751) | |
- RowsReturnedRate: 329.49 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.020us | |
EXCHANGE_NODE (id=24):(Total: 5s929ms, non-child: 208.399ms, % non-child: 3.51%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 4.76 MB, 21.92 MB, 59.55 MB, 105.02 MB, 147.13 MB, 185.51 MB, 210.99 MB, 226.34 MB, 235.14 MB, 239.21 MB | |
- BytesReceived: 239.27 MB (250896243) | |
- ConvertRowBatchTime: 94.801ms | |
- DeserializeRowBatchTimer: 636.433ms | |
- FirstBatchArrivalWaitTime: 2s718ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.51M (4511526) | |
- RowsReturnedRate: 760.86 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:2e (host=cdh5.net.cuberonlabs.com:22000):(Total: 13s777ms, non-child: 4s984ms, % non-child: 36.18%) | |
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 43.49 MB, 108.83 MB, 170.29 MB, 212.28 MB, 254.20 MB, 294.16 MB, 322.28 MB, 330.24 MB, 330.16 MB, 330.55 MB, 310.19 MB, 310.19 MB, 310.19 MB, 310.19 MB, 310.19 MB, 310.19 MB, 310.19 MB, 309.99 MB, 289.33 MB, 186.30 MB, 83.11 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 331.11 MB (347191915) | |
- PerHostPeakMemUsage: 2.15 GB (2303708143) | |
- RowsProduced: 2.55M (2547960) | |
- TotalNetworkReceiveTime: 6s126ms | |
- TotalNetworkSendTime: 4s439ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 27 (27) | |
- TotalThreadsTotalWallClockTime: 13s737ms | |
- TotalThreadsSysTime: 316.000ms | |
- TotalThreadsUserTime: 2s944ms | |
- TotalThreadsVoluntaryContextSwitches: 5.63K (5628) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s988ms | |
- ExecTreeExecTime: 93.192ms | |
- OpenTime: 7s749ms | |
- ExecTreeOpenTime: 7s633ms | |
- PrepareTime: 39.938ms | |
- ExecTreePrepareTime: 741.056us | |
DataStreamSender (dst_id=28):(Total: 916.697ms, non-child: 916.697ms, % non-child: 100.00%) | |
- BytesSent: 122.13 MB (128058591) | |
- NetworkThroughput(*): 603.69 MB/sec | |
- OverallThroughput: 133.22 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 2.55M (2547960) | |
- SerializeBatchTime: 713.704ms | |
- TransmitDataRPCTime: 202.300ms | |
- UncompressedRowBatchSize: 201.24 MB (211019463) | |
CodeGen:(Total: 150.845ms, non-child: 150.845ms, % non-child: 100.00%) | |
- CodegenTime: 3.465ms | |
- CompileTime: 31.038ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 43 (43) | |
- NumInstructions: 836 (836) | |
- OptimizationTime: 83.358ms | |
- PeakMemoryUsage: 418.00 KB (428032) | |
- PrepareTime: 35.518ms | |
AGGREGATION_NODE (id=25):(Total: 7s725ms, non-child: 1s501ms, % non-child: 19.44%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s401ms | |
- GetNewBlockTime: 2.578ms | |
- GetResultsTime: 81.372ms | |
- HTResizeTime: 162.506ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 330.17 MB (346203427) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.55M (2547960) | |
- RowsReturnedRate: 329.80 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.064us | |
EXCHANGE_NODE (id=24):(Total: 6s223ms, non-child: 210.557ms, % non-child: 3.38%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 6.22 MB, 27.40 MB, 67.26 MB, 112.32 MB, 153.87 MB, 191.24 MB, 214.12 MB, 228.08 MB, 236.30 MB | |
- BytesReceived: 239.15 MB (250768424) | |
- ConvertRowBatchTime: 86.755ms | |
- DeserializeRowBatchTimer: 564.807ms | |
- FirstBatchArrivalWaitTime: 2s712ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.51M (4506249) | |
- RowsReturnedRate: 724.03 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:30 (host=cdh8.net.cuberonlabs.com:22000):(Total: 13s770ms, non-child: 4s814ms, % non-child: 34.96%) | |
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 12.77 MB, 52.42 MB, 136.49 MB, 186.63 MB, 222.16 MB, 254.20 MB, 294.20 MB, 330.16 MB, 330.20 MB, 330.16 MB, 310.01 MB, 310.01 MB, 310.01 MB, 310.01 MB, 310.01 MB, 310.01 MB, 310.01 MB, 310.01 MB, 309.90 MB, 289.33 MB, 186.34 MB, 83.33 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 331.11 MB (347191915) | |
- PerHostPeakMemUsage: 1.63 GB (1748411303) | |
- RowsProduced: 2.55M (2547991) | |
- TotalNetworkReceiveTime: 6s140ms | |
- TotalNetworkSendTime: 4s475ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 39 (39) | |
- TotalThreadsTotalWallClockTime: 13s731ms | |
- TotalThreadsSysTime: 192.000ms | |
- TotalThreadsUserTime: 3s016ms | |
- TotalThreadsVoluntaryContextSwitches: 5.63K (5630) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s980ms | |
- ExecTreeExecTime: 84.672ms | |
- OpenTime: 7s750ms | |
- ExecTreeOpenTime: 7s590ms | |
- PrepareTime: 39.418ms | |
- ExecTreePrepareTime: 674.265us | |
DataStreamSender (dst_id=28):(Total: 1s086ms, non-child: 1s086ms, % non-child: 100.00%) | |
- BytesSent: 122.10 MB (128026679) | |
- NetworkThroughput(*): 296.83 MB/sec | |
- OverallThroughput: 112.34 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 2.55M (2547991) | |
- SerializeBatchTime: 674.942ms | |
- TransmitDataRPCTime: 411.325ms | |
- UncompressedRowBatchSize: 201.23 MB (211004361) | |
CodeGen:(Total: 194.824ms, non-child: 194.824ms, % non-child: 100.00%) | |
- CodegenTime: 2.688ms | |
- CompileTime: 48.121ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 43 (43) | |
- NumInstructions: 836 (836) | |
- OptimizationTime: 110.837ms | |
- PeakMemoryUsage: 418.00 KB (428032) | |
- PrepareTime: 35.069ms | |
AGGREGATION_NODE (id=25):(Total: 7s674ms, non-child: 1s435ms, % non-child: 18.70%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s344ms | |
- GetNewBlockTime: 736.416us | |
- GetResultsTime: 74.292ms | |
- HTResizeTime: 146.047ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 330.17 MB (346203373) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.55M (2547991) | |
- RowsReturnedRate: 332.02 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 979.000ns | |
EXCHANGE_NODE (id=24):(Total: 6s238ms, non-child: 212.358ms, % non-child: 3.40%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 779.70 KB, 8.15 MB, 33.79 MB, 74.82 MB, 120.09 MB, 160.69 MB, 196.19 MB, 217.09 MB, 229.50 MB, 236.89 MB | |
- BytesReceived: 238.87 MB (250468708) | |
- ConvertRowBatchTime: 86.847ms | |
- DeserializeRowBatchTimer: 554.125ms | |
- FirstBatchArrivalWaitTime: 2s668ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.50M (4502256) | |
- RowsReturnedRate: 721.66 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:33 (host=cdh10.net.cuberonlabs.com:22000):(Total: 13s763ms, non-child: 4s829ms, % non-child: 35.09%) | |
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 4.44 MB, 52.42 MB, 136.45 MB, 182.33 MB, 222.29 MB, 254.29 MB, 294.20 MB, 330.16 MB, 330.24 MB, 330.16 MB, 310.11 MB, 310.11 MB, 310.11 MB, 310.11 MB, 310.11 MB, 310.11 MB, 310.11 MB, 310.11 MB, 309.89 MB, 289.48 MB, 186.33 MB, 83.11 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 331.11 MB (347191915) | |
- PerHostPeakMemUsage: 1.66 GB (1784016472) | |
- RowsProduced: 2.55M (2546423) | |
- TotalNetworkReceiveTime: 6s083ms | |
- TotalNetworkSendTime: 4s500ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 27 (27) | |
- TotalThreadsTotalWallClockTime: 13s727ms | |
- TotalThreadsSysTime: 272.000ms | |
- TotalThreadsUserTime: 2s964ms | |
- TotalThreadsVoluntaryContextSwitches: 5.52K (5516) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s972ms | |
- ExecTreeExecTime: 88.216ms | |
- OpenTime: 7s755ms | |
- ExecTreeOpenTime: 7s634ms | |
- PrepareTime: 35.800ms | |
- ExecTreePrepareTime: 619.232us | |
DataStreamSender (dst_id=28):(Total: 1s059ms, non-child: 1s059ms, % non-child: 100.00%) | |
- BytesSent: 121.96 MB (127882212) | |
- NetworkThroughput(*): 312.02 MB/sec | |
- OverallThroughput: 115.11 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 2.55M (2546423) | |
- SerializeBatchTime: 668.096ms | |
- TransmitDataRPCTime: 390.860ms | |
- UncompressedRowBatchSize: 200.98 MB (210747941) | |
CodeGen:(Total: 153.389ms, non-child: 153.389ms, % non-child: 100.00%) | |
- CodegenTime: 2.617ms | |
- CompileTime: 33.456ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 43 (43) | |
- NumInstructions: 836 (836) | |
- OptimizationTime: 87.213ms | |
- PeakMemoryUsage: 418.00 KB (428032) | |
- PrepareTime: 31.984ms | |
AGGREGATION_NODE (id=25):(Total: 7s721ms, non-child: 1s535ms, % non-child: 19.88%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s439ms | |
- GetNewBlockTime: 830.669us | |
- GetResultsTime: 74.471ms | |
- HTResizeTime: 165.796ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 330.17 MB (346204008) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.55M (2546423) | |
- RowsReturnedRate: 329.77 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 906.000ns | |
EXCHANGE_NODE (id=24):(Total: 6s186ms, non-child: 223.785ms, % non-child: 3.62%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 724.09 KB, 8.04 MB, 33.39 MB, 74.49 MB, 119.60 MB, 160.26 MB, 195.87 MB, 216.88 MB, 229.47 MB, 236.90 MB | |
- BytesReceived: 238.93 MB (250540557) | |
- ConvertRowBatchTime: 91.709ms | |
- DeserializeRowBatchTimer: 597.168ms | |
- FirstBatchArrivalWaitTime: 2s711ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.50M (4504253) | |
- RowsReturnedRate: 728.07 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:32 (host=cdh9.net.cuberonlabs.com:22000):(Total: 13s756ms, non-child: 5s055ms, % non-child: 36.75%) | |
MemoryUsage(500.000ms): 2.77 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 22.80 MB, 63.49 MB, 154.20 MB, 201.66 MB, 238.25 MB, 266.28 MB, 306.21 MB, 330.16 MB, 330.20 MB, 330.20 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.14 MB, 248.02 MB, 145.08 MB, 41.96 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 331.11 MB (347191915) | |
- PerHostPeakMemUsage: 1.69 GB (1813107104) | |
- RowsProduced: 2.55M (2546435) | |
- TotalNetworkReceiveTime: 6s145ms | |
- TotalNetworkSendTime: 4s488ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 16 (16) | |
- TotalThreadsTotalWallClockTime: 13s714ms | |
- TotalThreadsSysTime: 212.000ms | |
- TotalThreadsUserTime: 2s944ms | |
- TotalThreadsVoluntaryContextSwitches: 6.30K (6303) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s966ms | |
- ExecTreeExecTime: 86.882ms | |
- OpenTime: 7s748ms | |
- ExecTreeOpenTime: 7s576ms | |
- PrepareTime: 41.653ms | |
- ExecTreePrepareTime: 591.149us | |
DataStreamSender (dst_id=28):(Total: 828.389ms, non-child: 828.389ms, % non-child: 100.00%) | |
- BytesSent: 122.06 MB (127991044) | |
- NetworkThroughput(*): 656.44 MB/sec | |
- OverallThroughput: 147.35 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 2.55M (2546435) | |
- SerializeBatchTime: 641.861ms | |
- TransmitDataRPCTime: 185.946ms | |
- UncompressedRowBatchSize: 201.09 MB (210862375) | |
CodeGen:(Total: 208.899ms, non-child: 208.899ms, % non-child: 100.00%) | |
- CodegenTime: 3.285ms | |
- CompileTime: 50.097ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 43 (43) | |
- NumInstructions: 836 (836) | |
- OptimizationTime: 120.196ms | |
- PeakMemoryUsage: 418.00 KB (428032) | |
- PrepareTime: 37.724ms | |
AGGREGATION_NODE (id=25):(Total: 7s662ms, non-child: 1s425ms, % non-child: 18.60%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s332ms | |
- GetNewBlockTime: 570.191us | |
- GetResultsTime: 74.496ms | |
- HTResizeTime: 144.974ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 330.17 MB (346204270) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.55M (2546435) | |
- RowsReturnedRate: 332.30 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 868.000ns | |
EXCHANGE_NODE (id=24):(Total: 6s237ms, non-child: 174.852ms, % non-child: 2.80%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.22 MB, 12.92 MB, 45.84 MB, 89.50 MB, 134.24 MB, 173.76 MB, 204.70 MB, 222.59 MB, 232.54 MB, 238.46 MB | |
- BytesReceived: 239.41 MB (251041676) | |
- ConvertRowBatchTime: 82.587ms | |
- DeserializeRowBatchTimer: 557.356ms | |
- FirstBatchArrivalWaitTime: 2s655ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.51M (4510936) | |
- RowsReturnedRate: 723.17 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:2f (host=cdh7.net.cuberonlabs.com:22000):(Total: 13s755ms, non-child: 4s856ms, % non-child: 35.31%) | |
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 22.66 MB, 72.16 MB, 154.20 MB, 201.75 MB, 238.29 MB, 266.20 MB, 306.28 MB, 330.20 MB, 330.20 MB, 330.20 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 309.98 MB, 227.61 MB, 145.06 MB, 41.95 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 331.11 MB (347191915) | |
- PerHostPeakMemUsage: 1.58 GB (1699637471) | |
- RowsProduced: 2.55M (2549555) | |
- TotalNetworkReceiveTime: 5s995ms | |
- TotalNetworkSendTime: 4s497ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 19 (19) | |
- TotalThreadsTotalWallClockTime: 13s721ms | |
- TotalThreadsSysTime: 252.000ms | |
- TotalThreadsUserTime: 3s076ms | |
- TotalThreadsVoluntaryContextSwitches: 5.32K (5318) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s965ms | |
- ExecTreeExecTime: 85.357ms | |
- OpenTime: 7s756ms | |
- ExecTreeOpenTime: 7s644ms | |
- PrepareTime: 33.089ms | |
- ExecTreePrepareTime: 637.794us | |
DataStreamSender (dst_id=28):(Total: 1s028ms, non-child: 1s028ms, % non-child: 100.00%) | |
- BytesSent: 122.20 MB (128136545) | |
- NetworkThroughput(*): 316.94 MB/sec | |
- OverallThroughput: 118.79 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 2.55M (2549555) | |
- SerializeBatchTime: 642.603ms | |
- TransmitDataRPCTime: 385.566ms | |
- UncompressedRowBatchSize: 201.32 MB (211096033) | |
CodeGen:(Total: 140.736ms, non-child: 140.736ms, % non-child: 100.00%) | |
- CodegenTime: 2.287ms | |
- CompileTime: 30.755ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 43 (43) | |
- NumInstructions: 836 (836) | |
- OptimizationTime: 80.056ms | |
- PeakMemoryUsage: 418.00 KB (428032) | |
- PrepareTime: 29.253ms | |
AGGREGATION_NODE (id=25):(Total: 7s729ms, non-child: 1s627ms, % non-child: 21.06%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s534ms | |
- GetNewBlockTime: 621.812us | |
- GetResultsTime: 73.021ms | |
- HTResizeTime: 171.976ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 330.17 MB (346203524) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.55M (2549555) | |
- RowsReturnedRate: 329.87 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 984.000ns | |
EXCHANGE_NODE (id=24):(Total: 6s101ms, non-child: 234.085ms, % non-child: 3.84%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.40 MB, 13.58 MB, 46.98 MB, 90.92 MB, 135.47 MB, 175.03 MB, 205.56 MB, 223.33 MB, 233.02 MB, 238.72 MB | |
- BytesReceived: 239.57 MB (251205496) | |
- ConvertRowBatchTime: 94.868ms | |
- DeserializeRowBatchTimer: 615.295ms | |
- FirstBatchArrivalWaitTime: 2s723ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.52M (4516222) | |
- RowsReturnedRate: 740.18 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:2d (host=cdh1.net.cuberonlabs.com:22000):(Total: 13s734ms, non-child: 4s924ms, % non-child: 35.85%) | |
MemoryUsage(500.000ms): 2.77 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 22.67 MB, 62.92 MB, 154.16 MB, 201.70 MB, 238.24 MB, 266.20 MB, 306.20 MB, 330.20 MB, 330.20 MB, 330.20 MB, 310.02 MB, 310.02 MB, 310.02 MB, 310.02 MB, 310.02 MB, 310.02 MB, 310.02 MB, 310.02 MB, 309.90 MB, 248.31 MB, 145.18 MB, 41.95 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 331.11 MB (347191915) | |
- PerHostPeakMemUsage: 1.81 GB (1939587581) | |
- RowsProduced: 2.55M (2550846) | |
- TotalNetworkReceiveTime: 6s128ms | |
- TotalNetworkSendTime: 4s485ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 28 (28) | |
- TotalThreadsTotalWallClockTime: 13s695ms | |
- TotalThreadsSysTime: 256.000ms | |
- TotalThreadsUserTime: 2s924ms | |
- TotalThreadsVoluntaryContextSwitches: 6.12K (6123) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s945ms | |
- ExecTreeExecTime: 84.059ms | |
- OpenTime: 7s749ms | |
- ExecTreeOpenTime: 7s652ms | |
- PrepareTime: 39.111ms | |
- ExecTreePrepareTime: 1.009ms | |
DataStreamSender (dst_id=28):(Total: 944.396ms, non-child: 944.396ms, % non-child: 100.00%) | |
- BytesSent: 122.27 MB (128208569) | |
- NetworkThroughput(*): 422.12 MB/sec | |
- OverallThroughput: 129.47 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 2.55M (2550846) | |
- SerializeBatchTime: 654.152ms | |
- TransmitDataRPCTime: 289.653ms | |
- UncompressedRowBatchSize: 201.46 MB (211243517) | |
CodeGen:(Total: 129.455ms, non-child: 129.455ms, % non-child: 100.00%) | |
- CodegenTime: 2.459ms | |
- CompileTime: 28.860ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 43 (43) | |
- NumInstructions: 836 (836) | |
- OptimizationTime: 66.480ms | |
- PeakMemoryUsage: 418.00 KB (428032) | |
- PrepareTime: 33.510ms | |
AGGREGATION_NODE (id=25):(Total: 7s736ms, non-child: 1s507ms, % non-child: 19.48%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s415ms | |
- GetNewBlockTime: 1.134ms | |
- GetResultsTime: 72.969ms | |
- HTResizeTime: 161.097ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 330.17 MB (346203486) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.55M (2550846) | |
- RowsReturnedRate: 329.73 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 880.000ns | |
EXCHANGE_NODE (id=24):(Total: 6s228ms, non-child: 198.522ms, % non-child: 3.19%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.10 MB, 12.43 MB, 45.11 MB, 88.42 MB, 133.36 MB, 173.10 MB, 204.50 MB, 222.56 MB, 232.77 MB, 238.78 MB | |
- BytesReceived: 239.80 MB (251444005) | |
- ConvertRowBatchTime: 89.013ms | |
- DeserializeRowBatchTimer: 579.985ms | |
- FirstBatchArrivalWaitTime: 2s732ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.52M (4518297) | |
- RowsReturnedRate: 725.37 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:24 (host=cdh16.net.cuberonlabs.com:22000):(Total: 13s730ms, non-child: 5s009ms, % non-child: 36.49%) | |
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 12.57 MB, 53.12 MB, 144.83 MB, 184.25 MB, 222.20 MB, 258.33 MB, 298.37 MB, 330.20 MB, 330.28 MB, 330.16 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.04 MB, 268.90 MB, 165.66 MB, 62.76 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 331.11 MB (347191915) | |
- PerHostPeakMemUsage: 1.64 GB (1763578733) | |
- RowsProduced: 2.55M (2547411) | |
- TotalNetworkReceiveTime: 6s000ms | |
- TotalNetworkSendTime: 4s456ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 15 (15) | |
- TotalThreadsTotalWallClockTime: 13s693ms | |
- TotalThreadsSysTime: 220.000ms | |
- TotalThreadsUserTime: 3s100ms | |
- TotalThreadsVoluntaryContextSwitches: 5.77K (5769) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s944ms | |
- ExecTreeExecTime: 87.174ms | |
- OpenTime: 7s748ms | |
- ExecTreeOpenTime: 7s626ms | |
- PrepareTime: 37.147ms | |
- ExecTreePrepareTime: 672.650us | |
DataStreamSender (dst_id=28):(Total: 853.243ms, non-child: 853.243ms, % non-child: 100.00%) | |
- BytesSent: 122.03 MB (127953529) | |
- NetworkThroughput(*): 591.59 MB/sec | |
- OverallThroughput: 143.01 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 2.55M (2547411) | |
- SerializeBatchTime: 646.327ms | |
- TransmitDataRPCTime: 206.269ms | |
- UncompressedRowBatchSize: 201.11 MB (210876135) | |
CodeGen:(Total: 154.041ms, non-child: 154.041ms, % non-child: 100.00%) | |
- CodegenTime: 2.886ms | |
- CompileTime: 32.717ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 43 (43) | |
- NumInstructions: 836 (836) | |
- OptimizationTime: 87.551ms | |
- PeakMemoryUsage: 418.00 KB (428032) | |
- PrepareTime: 32.990ms | |
AGGREGATION_NODE (id=25):(Total: 7s713ms, non-child: 1s608ms, % non-child: 20.86%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s514ms | |
- GetNewBlockTime: 783.956us | |
- GetResultsTime: 74.871ms | |
- HTResizeTime: 172.970ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 330.17 MB (346203584) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.55M (2547411) | |
- RowsReturnedRate: 330.25 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.030us | |
EXCHANGE_NODE (id=24):(Total: 6s104ms, non-child: 195.056ms, % non-child: 3.20%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.05 MB, 9.05 MB, 36.55 MB, 78.11 MB, 123.44 MB, 163.76 MB, 198.42 MB, 218.41 MB, 230.31 MB, 237.49 MB | |
- BytesReceived: 239.08 MB (250691253) | |
- ConvertRowBatchTime: 93.131ms | |
- DeserializeRowBatchTimer: 597.085ms | |
- FirstBatchArrivalWaitTime: 2s713ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.51M (4508418) | |
- RowsReturnedRate: 738.50 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:27 (host=cdh15.net.cuberonlabs.com:22000):(Total: 13s705ms, non-child: 5s001ms, % non-child: 36.49%) | |
MemoryUsage(500.000ms): 2.35 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 13.73 MB, 54.39 MB, 154.00 MB, 201.24 MB, 230.29 MB, 258.21 MB, 298.20 MB, 330.24 MB, 330.20 MB, 330.24 MB, 310.05 MB, 310.05 MB, 310.05 MB, 310.05 MB, 310.05 MB, 310.05 MB, 310.05 MB, 310.05 MB, 310.22 MB, 248.03 MB, 145.02 MB, 41.80 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 331.11 MB (347191915) | |
- PerHostPeakMemUsage: 1.57 GB (1688553772) | |
- RowsProduced: 2.55M (2548467) | |
- TotalNetworkReceiveTime: 6s038ms | |
- TotalNetworkSendTime: 4s473ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 7 (7) | |
- TotalThreadsTotalWallClockTime: 13s655ms | |
- TotalThreadsSysTime: 168.000ms | |
- TotalThreadsUserTime: 3s052ms | |
- TotalThreadsVoluntaryContextSwitches: 6.13K (6129) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s920ms | |
- ExecTreeExecTime: 88.673ms | |
- OpenTime: 7s735ms | |
- ExecTreeOpenTime: 7s559ms | |
- PrepareTime: 49.981ms | |
- ExecTreePrepareTime: 839.692us | |
DataStreamSender (dst_id=28):(Total: 835.568ms, non-child: 835.568ms, % non-child: 100.00%) | |
- BytesSent: 122.15 MB (128082129) | |
- NetworkThroughput(*): 611.50 MB/sec | |
- OverallThroughput: 146.19 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 2.55M (2548467) | |
- SerializeBatchTime: 635.228ms | |
- TransmitDataRPCTime: 199.751ms | |
- UncompressedRowBatchSize: 201.25 MB (211029213) | |
CodeGen:(Total: 221.075ms, non-child: 221.075ms, % non-child: 100.00%) | |
- CodegenTime: 3.385ms | |
- CompileTime: 49.583ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 43 (43) | |
- NumInstructions: 836 (836) | |
- OptimizationTime: 125.028ms | |
- PeakMemoryUsage: 418.00 KB (428032) | |
- PrepareTime: 45.481ms | |
AGGREGATION_NODE (id=25):(Total: 7s647ms, non-child: 1s510ms, % non-child: 19.75%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s415ms | |
- GetNewBlockTime: 591.406us | |
- GetResultsTime: 76.710ms | |
- HTResizeTime: 153.288ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 330.17 MB (346204095) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.55M (2548467) | |
- RowsReturnedRate: 333.24 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.365us | |
EXCHANGE_NODE (id=24):(Total: 6s137ms, non-child: 190.923ms, % non-child: 3.11%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 1.60 MB, 10.80 MB, 41.47 MB, 83.95 MB, 129.05 MB, 168.85 MB, 201.56 MB, 220.43 MB, 231.31 MB, 237.81 MB | |
- BytesReceived: 239.04 MB (250655156) | |
- ConvertRowBatchTime: 88.193ms | |
- DeserializeRowBatchTimer: 613.579ms | |
- FirstBatchArrivalWaitTime: 2s643ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.51M (4506480) | |
- RowsReturnedRate: 734.31 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:26 (host=cdh6.net.cuberonlabs.com:22000):(Total: 13s702ms, non-child: 5s032ms, % non-child: 36.72%) | |
MemoryUsage(500.000ms): 2.77 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 22.80 MB, 63.96 MB, 154.16 MB, 201.70 MB, 238.20 MB, 266.21 MB, 306.20 MB, 330.20 MB, 330.20 MB, 330.16 MB, 310.14 MB, 310.14 MB, 310.14 MB, 310.14 MB, 310.14 MB, 310.14 MB, 310.14 MB, 310.14 MB, 310.12 MB, 227.64 MB, 124.36 MB, 21.27 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 331.11 MB (347191915) | |
- PerHostPeakMemUsage: 1.67 GB (1794839264) | |
- RowsProduced: 2.55M (2552581) | |
- TotalNetworkReceiveTime: 6s141ms | |
- TotalNetworkSendTime: 4s528ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 10 (10) | |
- TotalThreadsTotalWallClockTime: 13s670ms | |
- TotalThreadsSysTime: 180.000ms | |
- TotalThreadsUserTime: 2s904ms | |
- TotalThreadsVoluntaryContextSwitches: 6.34K (6337) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s917ms | |
- ExecTreeExecTime: 84.563ms | |
- OpenTime: 7s752ms | |
- ExecTreeOpenTime: 7s620ms | |
- PrepareTime: 31.960ms | |
- ExecTreePrepareTime: 683.048us | |
DataStreamSender (dst_id=28):(Total: 805.509ms, non-child: 805.509ms, % non-child: 100.00%) | |
- BytesSent: 122.35 MB (128292617) | |
- NetworkThroughput(*): 627.66 MB/sec | |
- OverallThroughput: 151.89 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 2.55M (2552581) | |
- SerializeBatchTime: 610.043ms | |
- TransmitDataRPCTime: 194.929ms | |
- UncompressedRowBatchSize: 201.61 MB (211400848) | |
CodeGen:(Total: 160.350ms, non-child: 160.350ms, % non-child: 100.00%) | |
- CodegenTime: 2.124ms | |
- CompileTime: 31.211ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 43 (43) | |
- NumInstructions: 836 (836) | |
- OptimizationTime: 99.871ms | |
- PeakMemoryUsage: 418.00 KB (428032) | |
- PrepareTime: 28.807ms | |
AGGREGATION_NODE (id=25):(Total: 7s704ms, non-child: 1s467ms, % non-child: 19.05%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s377ms | |
- GetNewBlockTime: 833.012us | |
- GetResultsTime: 72.171ms | |
- HTResizeTime: 149.208ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 330.17 MB (346203265) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.55M (2552581) | |
- RowsReturnedRate: 331.31 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.032us | |
EXCHANGE_NODE (id=24):(Total: 6s236ms, non-child: 186.348ms, % non-child: 2.99%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.26 MB, 13.01 MB, 46.07 MB, 89.58 MB, 134.08 MB, 173.66 MB, 204.69 MB, 222.60 MB, 232.57 MB, 238.45 MB | |
- BytesReceived: 239.38 MB (251012894) | |
- ConvertRowBatchTime: 84.169ms | |
- DeserializeRowBatchTimer: 586.345ms | |
- FirstBatchArrivalWaitTime: 2s706ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.51M (4511103) | |
- RowsReturnedRate: 723.28 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:2b (host=cdh12.net.cuberonlabs.com:22000):(Total: 13s698ms, non-child: 5s004ms, % non-child: 36.53%) | |
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 43.20 MB, 108.37 MB, 169.29 MB, 210.76 MB, 256.93 MB, 290.29 MB, 322.29 MB, 330.20 MB, 330.24 MB, 330.80 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.03 MB, 309.94 MB, 186.36 MB, 83.06 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 331.11 MB (347191915) | |
- PerHostPeakMemUsage: 1.12 GB (1201773720) | |
- RowsProduced: 2.55M (2551617) | |
- TotalNetworkReceiveTime: 5s884ms | |
- TotalNetworkSendTime: 4s480ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 18 (18) | |
- TotalThreadsTotalWallClockTime: 13s659ms | |
- TotalThreadsSysTime: 196.000ms | |
- TotalThreadsUserTime: 3s204ms | |
- TotalThreadsVoluntaryContextSwitches: 5.45K (5449) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s911ms | |
- ExecTreeExecTime: 84.686ms | |
- OpenTime: 7s748ms | |
- ExecTreeOpenTime: 7s625ms | |
- PrepareTime: 38.915ms | |
- ExecTreePrepareTime: 636.341us | |
DataStreamSender (dst_id=28):(Total: 827.509ms, non-child: 827.509ms, % non-child: 100.00%) | |
- BytesSent: 122.23 MB (128169834) | |
- NetworkThroughput(*): 562.91 MB/sec | |
- OverallThroughput: 147.71 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 2.55M (2551617) | |
- SerializeBatchTime: 609.767ms | |
- TransmitDataRPCTime: 217.142ms | |
- UncompressedRowBatchSize: 201.45 MB (211239434) | |
CodeGen:(Total: 156.778ms, non-child: 156.778ms, % non-child: 100.00%) | |
- CodegenTime: 2.896ms | |
- CompileTime: 32.303ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 43 (43) | |
- NumInstructions: 836 (836) | |
- OptimizationTime: 88.773ms | |
- PeakMemoryUsage: 418.00 KB (428032) | |
- PrepareTime: 34.787ms | |
AGGREGATION_NODE (id=25):(Total: 7s710ms, non-child: 1s722ms, % non-child: 22.34%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s630ms | |
- GetNewBlockTime: 381.838us | |
- GetResultsTime: 72.126ms | |
- HTResizeTime: 186.183ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 330.17 MB (346203548) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.55M (2551617) | |
- RowsReturnedRate: 330.94 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 960.000ns | |
EXCHANGE_NODE (id=24):(Total: 5s988ms, non-child: 203.740ms, % non-child: 3.40%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 5.59 MB, 24.76 MB, 63.91 MB, 109.20 MB, 151.07 MB, 188.95 MB, 213.06 MB, 227.68 MB, 236.29 MB | |
- BytesReceived: 239.66 MB (251297912) | |
- ConvertRowBatchTime: 93.150ms | |
- DeserializeRowBatchTimer: 622.513ms | |
- FirstBatchArrivalWaitTime: 2s707ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.52M (4517374) | |
- RowsReturnedRate: 754.39 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:28 (host=cdh3.net.cuberonlabs.com:22000):(Total: 13s689ms, non-child: 5s008ms, % non-child: 36.59%) | |
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 43.49 MB, 108.75 MB, 170.29 MB, 212.33 MB, 254.28 MB, 294.20 MB, 322.16 MB, 330.20 MB, 330.20 MB, 330.61 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 289.47 MB, 186.42 MB, 83.11 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 331.11 MB (347191915) | |
- PerHostPeakMemUsage: 2.16 GB (2318232477) | |
- RowsProduced: 2.55M (2548818) | |
- TotalNetworkReceiveTime: 6s243ms | |
- TotalNetworkSendTime: 4s534ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 26 (26) | |
- TotalThreadsTotalWallClockTime: 13s654ms | |
- TotalThreadsSysTime: 252.000ms | |
- TotalThreadsUserTime: 2s712ms | |
- TotalThreadsVoluntaryContextSwitches: 6.35K (6352) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s904ms | |
- ExecTreeExecTime: 79.721ms | |
- OpenTime: 7s750ms | |
- ExecTreeOpenTime: 7s606ms | |
- PrepareTime: 35.183ms | |
- ExecTreePrepareTime: 1.562ms | |
DataStreamSender (dst_id=28):(Total: 820.942ms, non-child: 820.942ms, % non-child: 100.00%) | |
- BytesSent: 122.16 MB (128098416) | |
- NetworkThroughput(*): 601.79 MB/sec | |
- OverallThroughput: 148.81 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 2.55M (2548818) | |
- SerializeBatchTime: 617.366ms | |
- TransmitDataRPCTime: 203.002ms | |
- UncompressedRowBatchSize: 201.28 MB (211056917) | |
CodeGen:(Total: 173.606ms, non-child: 173.606ms, % non-child: 100.00%) | |
- CodegenTime: 3.085ms | |
- CompileTime: 30.896ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 43 (43) | |
- NumInstructions: 836 (836) | |
- OptimizationTime: 111.172ms | |
- PeakMemoryUsage: 418.00 KB (428032) | |
- PrepareTime: 30.833ms | |
AGGREGATION_NODE (id=25):(Total: 7s686ms, non-child: 1s360ms, % non-child: 17.71%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s274ms | |
- GetNewBlockTime: 1.363ms | |
- GetResultsTime: 67.094ms | |
- HTResizeTime: 138.914ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 330.17 MB (346203781) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.55M (2548818) | |
- RowsReturnedRate: 331.60 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.472us | |
EXCHANGE_NODE (id=24):(Total: 6s325ms, non-child: 157.532ms, % non-child: 2.49%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 5.93 MB, 26.27 MB, 66.03 MB, 111.32 MB, 152.85 MB, 190.32 MB, 213.58 MB, 227.78 MB, 236.13 MB | |
- BytesReceived: 239.16 MB (250775482) | |
- ConvertRowBatchTime: 73.218ms | |
- DeserializeRowBatchTimer: 469.698ms | |
- FirstBatchArrivalWaitTime: 2s691ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.51M (4508285) | |
- RowsReturnedRate: 712.71 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:23 (host=cdh4.net.cuberonlabs.com:22000):(Total: 13s688ms, non-child: 4s858ms, % non-child: 35.49%) | |
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 33.27 MB, 99.83 MB, 161.02 MB, 206.33 MB, 248.37 MB, 282.33 MB, 322.24 MB, 330.16 MB, 330.20 MB, 330.16 MB, 310.28 MB, 310.28 MB, 310.28 MB, 310.28 MB, 310.28 MB, 310.28 MB, 310.28 MB, 309.88 MB, 309.84 MB, 206.84 MB, 103.88 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 331.11 MB (347191915) | |
- PerHostPeakMemUsage: 2.13 GB (2284202661) | |
- RowsProduced: 2.55M (2546375) | |
- TotalNetworkReceiveTime: 5s962ms | |
- TotalNetworkSendTime: 4s478ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 15 (15) | |
- TotalThreadsTotalWallClockTime: 13s653ms | |
- TotalThreadsSysTime: 248.000ms | |
- TotalThreadsUserTime: 3s064ms | |
- TotalThreadsVoluntaryContextSwitches: 5.53K (5534) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s903ms | |
- ExecTreeExecTime: 85.221ms | |
- OpenTime: 7s750ms | |
- ExecTreeOpenTime: 7s633ms | |
- PrepareTime: 35.051ms | |
- ExecTreePrepareTime: 803.072us | |
DataStreamSender (dst_id=28):(Total: 964.585ms, non-child: 964.585ms, % non-child: 100.00%) | |
- BytesSent: 122.03 MB (127953851) | |
- NetworkThroughput(*): 381.71 MB/sec | |
- OverallThroughput: 126.51 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 2.55M (2546375) | |
- SerializeBatchTime: 644.323ms | |
- TransmitDataRPCTime: 319.681ms | |
- UncompressedRowBatchSize: 201.09 MB (210856957) | |
CodeGen:(Total: 147.457ms, non-child: 147.457ms, % non-child: 100.00%) | |
- CodegenTime: 2.560ms | |
- CompileTime: 30.305ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 43 (43) | |
- NumInstructions: 836 (836) | |
- OptimizationTime: 85.336ms | |
- PeakMemoryUsage: 418.00 KB (428032) | |
- PrepareTime: 31.114ms | |
AGGREGATION_NODE (id=25):(Total: 7s718ms, non-child: 1s649ms, % non-child: 21.38%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s557ms | |
- GetNewBlockTime: 1.342ms | |
- GetResultsTime: 74.234ms | |
- HTResizeTime: 178.671ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 330.17 MB (346203099) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.55M (2546375) | |
- RowsReturnedRate: 329.91 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.028us | |
EXCHANGE_NODE (id=24):(Total: 6s068ms, non-child: 231.788ms, % non-child: 3.82%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 4.45 MB, 20.83 MB, 57.67 MB, 102.90 MB, 145.39 MB, 183.95 MB, 209.84 MB, 225.56 MB, 234.43 MB, 238.69 MB | |
- BytesReceived: 238.84 MB (250441784) | |
- ConvertRowBatchTime: 93.699ms | |
- DeserializeRowBatchTimer: 638.986ms | |
- FirstBatchArrivalWaitTime: 2s721ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.50M (4500412) | |
- RowsReturnedRate: 741.59 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:2c (host=cdh14.net.cuberonlabs.com:22000):(Total: 13s676ms, non-child: 5s015ms, % non-child: 36.67%) | |
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 43.45 MB, 116.66 MB, 170.20 MB, 212.24 MB, 254.24 MB, 294.29 MB, 322.24 MB, 330.16 MB, 330.16 MB, 330.62 MB, 310.15 MB, 310.15 MB, 310.15 MB, 310.15 MB, 310.15 MB, 310.15 MB, 310.15 MB, 310.12 MB, 289.42 MB, 186.21 MB, 83.06 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 331.11 MB (347191915) | |
- PerHostPeakMemUsage: 1.44 GB (1548652528) | |
- RowsProduced: 2.55M (2548397) | |
- TotalNetworkReceiveTime: 6s064ms | |
- TotalNetworkSendTime: 4s531ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 17 (17) | |
- TotalThreadsTotalWallClockTime: 13s641ms | |
- TotalThreadsSysTime: 176.000ms | |
- TotalThreadsUserTime: 2s972ms | |
- TotalThreadsVoluntaryContextSwitches: 6.02K (6019) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s888ms | |
- ExecTreeExecTime: 77.863ms | |
- OpenTime: 7s752ms | |
- ExecTreeOpenTime: 7s636ms | |
- PrepareTime: 35.307ms | |
- ExecTreePrepareTime: 1.046ms | |
DataStreamSender (dst_id=28):(Total: 799.627ms, non-child: 799.627ms, % non-child: 100.00%) | |
- BytesSent: 122.17 MB (128108692) | |
- NetworkThroughput(*): 661.76 MB/sec | |
- OverallThroughput: 152.79 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 2.55M (2548397) | |
- SerializeBatchTime: 614.414ms | |
- TransmitDataRPCTime: 184.620ms | |
- UncompressedRowBatchSize: 201.27 MB (211042173) | |
CodeGen:(Total: 147.248ms, non-child: 147.248ms, % non-child: 100.00%) | |
- CodegenTime: 2.375ms | |
- CompileTime: 31.789ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 43 (43) | |
- NumInstructions: 836 (836) | |
- OptimizationTime: 83.486ms | |
- PeakMemoryUsage: 418.00 KB (428032) | |
- PrepareTime: 31.240ms | |
AGGREGATION_NODE (id=25):(Total: 7s714ms, non-child: 1s539ms, % non-child: 19.96%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s453ms | |
- GetNewBlockTime: 683.634us | |
- GetResultsTime: 69.148ms | |
- HTResizeTime: 169.028ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 330.17 MB (346203860) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.55M (2548397) | |
- RowsReturnedRate: 330.36 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 992.000ns | |
EXCHANGE_NODE (id=24):(Total: 6s174ms, non-child: 211.191ms, % non-child: 3.42%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 6.12 MB, 27.08 MB, 66.89 MB, 112.17 MB, 153.70 MB, 191.14 MB, 214.22 MB, 228.29 MB, 236.59 MB | |
- BytesReceived: 239.55 MB (251181428) | |
- ConvertRowBatchTime: 98.747ms | |
- DeserializeRowBatchTimer: 630.323ms | |
- FirstBatchArrivalWaitTime: 2s716ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.52M (4515321) | |
- RowsReturnedRate: 731.30 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:2a (host=cdh2.net.cuberonlabs.com:22000):(Total: 13s629ms, non-child: 4s987ms, % non-child: 36.59%) | |
MemoryUsage(500.000ms): 2.77 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 22.83 MB, 64.12 MB, 154.24 MB, 201.74 MB, 238.24 MB, 266.25 MB, 306.20 MB, 330.16 MB, 330.16 MB, 330.16 MB, 310.21 MB, 310.21 MB, 310.21 MB, 310.21 MB, 310.21 MB, 310.21 MB, 310.21 MB, 310.21 MB, 309.94 MB, 248.15 MB, 124.45 MB, 21.32 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 331.11 MB (347191915) | |
- PerHostPeakMemUsage: 1.74 GB (1866918022) | |
- RowsProduced: 2.55M (2550057) | |
- TotalNetworkReceiveTime: 6s143ms | |
- TotalNetworkSendTime: 4s534ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 22 (22) | |
- TotalThreadsTotalWallClockTime: 13s595ms | |
- TotalThreadsSysTime: 268.000ms | |
- TotalThreadsUserTime: 2s748ms | |
- TotalThreadsVoluntaryContextSwitches: 6.19K (6193) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s843ms | |
- ExecTreeExecTime: 75.667ms | |
- OpenTime: 7s752ms | |
- ExecTreeOpenTime: 7s634ms | |
- PrepareTime: 33.912ms | |
- ExecTreePrepareTime: 772.228us | |
DataStreamSender (dst_id=28):(Total: 784.991ms, non-child: 784.991ms, % non-child: 100.00%) | |
- BytesSent: 122.20 MB (128140946) | |
- NetworkThroughput(*): 634.40 MB/sec | |
- OverallThroughput: 155.68 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 2.55M (2550057) | |
- SerializeBatchTime: 591.776ms | |
- TransmitDataRPCTime: 192.631ms | |
- UncompressedRowBatchSize: 201.35 MB (211126503) | |
CodeGen:(Total: 147.341ms, non-child: 147.341ms, % non-child: 100.00%) | |
- CodegenTime: 2.418ms | |
- CompileTime: 32.270ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 43 (43) | |
- NumInstructions: 836 (836) | |
- OptimizationTime: 84.397ms | |
- PeakMemoryUsage: 418.00 KB (428032) | |
- PrepareTime: 29.966ms | |
AGGREGATION_NODE (id=25):(Total: 7s709ms, non-child: 1s467ms, % non-child: 19.03%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s384ms | |
- GetNewBlockTime: 1.004ms | |
- GetResultsTime: 66.117ms | |
- HTResizeTime: 155.483ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 330.17 MB (346203484) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.55M (2550057) | |
- RowsReturnedRate: 330.75 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.048us | |
EXCHANGE_NODE (id=24):(Total: 6s242ms, non-child: 195.485ms, % non-child: 3.13%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.26 MB, 13.12 MB, 46.17 MB, 89.86 MB, 134.43 MB, 174.08 MB, 205.04 MB, 222.91 MB, 232.80 MB, 238.60 MB | |
- BytesReceived: 239.54 MB (251177476) | |
- ConvertRowBatchTime: 87.435ms | |
- DeserializeRowBatchTimer: 587.089ms | |
- FirstBatchArrivalWaitTime: 2s718ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.52M (4515451) | |
- RowsReturnedRate: 723.36 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:31 (host=cdh11.net.cuberonlabs.com:22000):(Total: 13s623ms, non-child: 5s005ms, % non-child: 36.74%) | |
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 12.61 MB, 53.08 MB, 144.74 MB, 184.20 MB, 222.24 MB, 258.24 MB, 298.33 MB, 330.16 MB, 330.20 MB, 330.20 MB, 310.25 MB, 310.25 MB, 310.25 MB, 310.25 MB, 310.25 MB, 310.25 MB, 310.25 MB, 310.25 MB, 310.25 MB, 269.02 MB, 145.13 MB, 42.02 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 331.11 MB (347191915) | |
- PerHostPeakMemUsage: 1.48 GB (1591793359) | |
- RowsProduced: 2.55M (2548785) | |
- TotalNetworkReceiveTime: 5s966ms | |
- TotalNetworkSendTime: 4s532ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 23 (23) | |
- TotalThreadsTotalWallClockTime: 13s586ms | |
- TotalThreadsSysTime: 224.000ms | |
- TotalThreadsUserTime: 2s964ms | |
- TotalThreadsVoluntaryContextSwitches: 5.90K (5901) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s833ms | |
- ExecTreeExecTime: 76.720ms | |
- OpenTime: 7s752ms | |
- ExecTreeOpenTime: 7s631ms | |
- PrepareTime: 37.250ms | |
- ExecTreePrepareTime: 630.577us | |
DataStreamSender (dst_id=28):(Total: 756.435ms, non-child: 756.435ms, % non-child: 100.00%) | |
- BytesSent: 122.16 MB (128093434) | |
- NetworkThroughput(*): 599.80 MB/sec | |
- OverallThroughput: 161.49 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 2.55M (2548785) | |
- SerializeBatchTime: 552.184ms | |
- TransmitDataRPCTime: 203.665ms | |
- UncompressedRowBatchSize: 201.29 MB (211065211) | |
CodeGen:(Total: 153.998ms, non-child: 153.998ms, % non-child: 100.00%) | |
- CodegenTime: 2.615ms | |
- CompileTime: 32.813ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 43 (43) | |
- NumInstructions: 836 (836) | |
- OptimizationTime: 87.322ms | |
- PeakMemoryUsage: 418.00 KB (428032) | |
- PrepareTime: 33.057ms | |
AGGREGATION_NODE (id=25):(Total: 7s707ms, non-child: 1s635ms, % non-child: 21.22%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 1s551ms | |
- GetNewBlockTime: 466.567us | |
- GetResultsTime: 64.356ms | |
- HTResizeTime: 176.922ms | |
- HashBuckets: 4.19M (4194304) | |
- LargestPartitionPercent: 3 (3) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 330.17 MB (346203485) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 2.55M (2548785) | |
- RowsReturnedRate: 330.69 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 931.000ns | |
EXCHANGE_NODE (id=24):(Total: 6s071ms, non-child: 204.685ms, % non-child: 3.37%) | |
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.03 MB, 8.97 MB, 36.29 MB, 77.87 MB, 123.29 MB, 163.55 MB, 198.35 MB, 218.28 MB, 230.25 MB, 237.43 MB | |
- BytesReceived: 239.04 MB (250650384) | |
- ConvertRowBatchTime: 95.177ms | |
- DeserializeRowBatchTimer: 613.898ms | |
- FirstBatchArrivalWaitTime: 2s711ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 4.51M (4505321) | |
- RowsReturnedRate: 742.01 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Averaged Fragment F00:(Total: 6s196ms, non-child: 1s035ms, % non-child: 16.71%) | |
split sizes: min: 1.81 GB, max: 3.59 GB, avg: 2.76 GB, stddev: 468.16 MB | |
completion times: min:4s756ms max:7s784ms mean: 6s197ms stddev:841.626ms | |
execution rates: min:372.54 MB/sec max:516.93 MB/sec mean:454.68 MB/sec stddev:37.63 MB/sec | |
num instances: 17 | |
- AverageThreadTokens: 5.10 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 568.45 MB (596067042) | |
- PerHostPeakMemUsage: 1.70 GB (1824024877) | |
- RowsProduced: 4.51M (4509900) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 7.478ms | |
- TotalStorageWaitTime: 85.969ms | |
- TotalThreadsInvoluntaryContextSwitches: 33 (33) | |
- TotalThreadsTotalWallClockTime: 31s528ms | |
- TotalThreadsSysTime: 570.823ms | |
- TotalThreadsUserTime: 6s735ms | |
- TotalThreadsVoluntaryContextSwitches: 12.32K (12324) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s998ms | |
- ExecTreeExecTime: 3s583ms | |
- OpenTime: 159.762ms | |
- ExecTreeOpenTime: 41.715us | |
- PrepareTime: 37.798ms | |
- ExecTreePrepareTime: 1.252ms | |
DataStreamSender (dst_id=24):(Total: 1s387ms, non-child: 1s387ms, % non-child: 100.00%) | |
- BytesSent: 239.28 MB (250900204) | |
- NetworkThroughput(*): 627.94 MB/sec | |
- OverallThroughput: 174.07 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 4.51M (4509900) | |
- SerializeBatchTime: 976.652ms | |
- TransmitDataRPCTime: 410.108ms | |
- UncompressedRowBatchSize: 376.11 MB (394378759) | |
CodeGen:(Total: 191.156ms, non-child: 191.156ms, % non-child: 100.00%) | |
- CodegenTime: 3.877ms | |
- CompileTime: 43.500ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 73 (73) | |
- NumInstructions: 1.41K (1412) | |
- OptimizationTime: 114.890ms | |
- PeakMemoryUsage: 706.00 KB (722944) | |
- PrepareTime: 31.994ms | |
AGGREGATION_NODE (id=3):(Total: 3s582ms, non-child: 2s677ms, % non-child: 74.72%) | |
- GetNewBlockTime: 1.217ms | |
- GetResultsTime: 112.945ms | |
- HTResizeTime: 199.209ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 539.35 MB (565545308) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 36.19 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.51M (4509900) | |
- RowsReturnedRate: 1.26 M/sec | |
- StreamingTime: 2s538ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=2):(Total: 905.576ms, non-child: 905.576ms, % non-child: 100.00%) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.29 | |
- BytesRead: 353.91 MB (371101408) | |
- BytesReadDataNodeCache: 344.78 MB (361531001) | |
- BytesReadLocal: 353.91 MB (371101408) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 353.91 MB (371101408) | |
- DecompressionTime: 801.406ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 2 (2) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 29 (29) | |
- NumScannerThreadsStarted: 8 (8) | |
- PeakMemoryUsage: 37.74 MB (39577983) | |
- PerReadThreadRawHdfsThroughput: 33.32 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 36.395ms | |
- RowBatchQueuePutWaitTime: 19s573ms | |
- RowsRead: 11.56M (11559184) | |
- RowsReturned: 11.56M (11559184) | |
- RowsReturnedRate: 12.76 M/sec | |
- ScanRangesComplete: 29 (29) | |
- ScannerThreadsInvoluntaryContextSwitches: 24 (24) | |
- ScannerThreadsTotalWallClockTime: 25s369ms | |
- MaterializeTupleTime(*): 625.976ms | |
- ScannerThreadsSysTime: 213.411ms | |
- ScannerThreadsUserTime: 1s802ms | |
- ScannerThreadsVoluntaryContextSwitches: 11.97K (11975) | |
- TotalRawHdfsReadTime(*): 10.426ms | |
- TotalReadThroughput: 95.89 MB/sec | |
Filter 0 (16.00 MB): | |
- Rows processed: 0 (0) | |
- Rows rejected: 0 (0) | |
- Rows total: 11.56M (11559184) | |
Fragment F00: | |
Instance 514ee9ab39cdc507:17 (host=cdh3.net.cuberonlabs.com:22000):(Total: 7s782ms, non-child: 1s509ms, % non-child: 19.39%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.39 GB | |
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 185.10 MB, 205.64 MB, 361.19 MB, 387.00 MB, 556.44 MB, 554.78 MB, 637.42 MB, 609.11 MB, 527.98 MB, 406.24 MB, 325.19 MB, 203.47 MB, 122.34 MB | |
ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 10, 10, 8, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 5.33 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 677.73 MB (710655691) | |
- PerHostPeakMemUsage: 2.16 GB (2318232477) | |
- RowsProduced: 5.23M (5232220) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 7.611ms | |
- TotalStorageWaitTime: 96.800ms | |
- TotalThreadsInvoluntaryContextSwitches: 55 (55) | |
- TotalThreadsTotalWallClockTime: 38s799ms | |
- TotalThreadsSysTime: 640.000ms | |
- TotalThreadsUserTime: 8s708ms | |
- TotalThreadsVoluntaryContextSwitches: 15.31K (15310) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 7s548ms | |
- ExecTreeExecTime: 4s462ms | |
- OpenTime: 188.245ms | |
- ExecTreeOpenTime: 39.792us | |
- PrepareTime: 46.019ms | |
- ExecTreePrepareTime: 726.544us | |
DataStreamSender (dst_id=24):(Total: 1s584ms, non-child: 1s584ms, % non-child: 100.00%) | |
- BytesSent: 276.41 MB (289837842) | |
- NetworkThroughput(*): 721.32 MB/sec | |
- OverallThroughput: 174.50 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 5.23M (5232220) | |
- SerializeBatchTime: 1s199ms | |
- TransmitDataRPCTime: 383.201ms | |
- UncompressedRowBatchSize: 434.83 MB (455951011) | |
CodeGen:(Total: 228.039ms, non-child: 228.039ms, % non-child: 100.00%) | |
- CodegenTime: 5.182ms | |
- CompileTime: 42.385ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 73 (73) | |
- NumInstructions: 1.41K (1412) | |
- OptimizationTime: 143.630ms | |
- PeakMemoryUsage: 706.00 KB (722944) | |
- PrepareTime: 41.065ms | |
AGGREGATION_NODE (id=3):(Total: 4s461ms, non-child: 3s556ms, % non-child: 79.73%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 628.464us | |
- GetResultsTime: 123.660ms | |
- HTResizeTime: 202.827ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 652.16 MB (683836526) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 37.17 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 5.23M (5232220) | |
- RowsReturnedRate: 1.17 M/sec | |
- StreamingTime: 3s397ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=2):(Total: 904.408ms, non-child: 904.408ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.39 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35 | |
Runtime filters: Only following filters arrived: , waited 783ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:70 | |
BytesRead(500.000ms): 0, 0, 105.88 MB, 143.20 MB, 206.87 MB, 301.16 MB, 327.83 MB, 418.77 MB, 432.24 MB | |
- FooterProcessingTime: (Avg: 9.817ms ; Min: 3.249ms ; Max: 50.757ms ; Number of samples: 35) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.22 | |
- BytesRead: 432.24 MB (453237686) | |
- BytesReadDataNodeCache: 421.44 MB (441912627) | |
- BytesReadLocal: 432.24 MB (453237686) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 432.24 MB (453237686) | |
- DecompressionTime: 905.674ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 2 (2) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 35 (35) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 37.00 MB (38794707) | |
- PerReadThreadRawHdfsThroughput: 35.15 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 44.939ms | |
- RowBatchQueuePutWaitTime: 25s713ms | |
- RowsRead: 14.44M (14439291) | |
- RowsReturned: 14.44M (14439291) | |
- RowsReturnedRate: 15.97 M/sec | |
- ScanRangesComplete: 35 (35) | |
- ScannerThreadsInvoluntaryContextSwitches: 39 (39) | |
- ScannerThreadsTotalWallClockTime: 31s063ms | |
- MaterializeTupleTime(*): 787.470ms | |
- ScannerThreadsSysTime: 272.000ms | |
- ScannerThreadsUserTime: 2s184ms | |
- ScannerThreadsVoluntaryContextSwitches: 14.83K (14834) | |
- TotalRawHdfsReadTime(*): 12.007ms | |
- TotalReadThroughput: 96.05 MB/sec | |
Filter 0 (16.00 MB): | |
- Rows processed: 0 (0) | |
- Rows rejected: 0 (0) | |
- Rows total: 14.44M (14439291) | |
Instance 514ee9ab39cdc507:1d (host=cdh5.net.cuberonlabs.com:22000):(Total: 7s481ms, non-child: 1s348ms, % non-child: 18.03%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.36 GB | |
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 187.92 MB, 236.01 MB, 364.84 MB, 429.07 MB, 556.03 MB, 582.15 MB, 649.84 MB, 568.54 MB, 446.85 MB, 365.75 MB, 244.15 MB, 162.92 MB, 41.15 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 10, 8, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 5.07 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 678.53 MB (711488676) | |
- PerHostPeakMemUsage: 2.15 GB (2303708143) | |
- RowsProduced: 5.38M (5379618) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 6.941ms | |
- TotalStorageWaitTime: 110.134ms | |
- TotalThreadsInvoluntaryContextSwitches: 34 (34) | |
- TotalThreadsTotalWallClockTime: 37s031ms | |
- TotalThreadsSysTime: 636.000ms | |
- TotalThreadsUserTime: 8s480ms | |
- TotalThreadsVoluntaryContextSwitches: 14.92K (14916) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 7s266ms | |
- ExecTreeExecTime: 4s121ms | |
- OpenTime: 170.007ms | |
- ExecTreeOpenTime: 48.024us | |
- PrepareTime: 45.521ms | |
- ExecTreePrepareTime: 824.132us | |
DataStreamSender (dst_id=24):(Total: 1s803ms, non-child: 1s803ms, % non-child: 100.00%) | |
- BytesSent: 286.92 MB (300861929) | |
- NetworkThroughput(*): 409.25 MB/sec | |
- OverallThroughput: 159.05 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 5.38M (5379618) | |
- SerializeBatchTime: 1s102ms | |
- TransmitDataRPCTime: 701.102ms | |
- UncompressedRowBatchSize: 452.23 MB (474193247) | |
CodeGen:(Total: 208.299ms, non-child: 208.299ms, % non-child: 100.00%) | |
- CodegenTime: 5.007ms | |
- CompileTime: 43.576ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 73 (73) | |
- NumInstructions: 1.41K (1412) | |
- OptimizationTime: 124.926ms | |
- PeakMemoryUsage: 706.00 KB (722944) | |
- PrepareTime: 38.988ms | |
AGGREGATION_NODE (id=3):(Total: 4s120ms, non-child: 3s220ms, % non-child: 78.16%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 2.800ms | |
- GetResultsTime: 141.112ms | |
- HTResizeTime: 212.125ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 652.25 MB (683936972) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 35.71 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 5.38M (5379618) | |
- RowsReturnedRate: 1.31 M/sec | |
- StreamingTime: 3s046ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=2):(Total: 899.939ms, non-child: 899.939ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.36 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35 | |
Runtime filters: Only following filters arrived: , waited 803ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:70 | |
BytesRead(500.000ms): 0, 0, 120.80 MB, 133.77 MB, 239.03 MB, 279.37 MB, 353.73 MB, 433.86 MB | |
- FooterProcessingTime: (Avg: 11.888ms ; Min: 3.692ms ; Max: 46.672ms ; Number of samples: 35) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.62 | |
- BytesRead: 433.86 MB (454933101) | |
- BytesReadDataNodeCache: 423.06 MB (443611786) | |
- BytesReadLocal: 433.86 MB (454933101) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 433.86 MB (454933101) | |
- DecompressionTime: 1s070ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 2 (2) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 35 (35) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 37.83 MB (39666615) | |
- PerReadThreadRawHdfsThroughput: 30.97 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 32.210ms | |
- RowBatchQueuePutWaitTime: 23s876ms | |
- RowsRead: 13.95M (13952334) | |
- RowsReturned: 13.95M (13952334) | |
- RowsReturnedRate: 15.50 M/sec | |
- ScanRangesComplete: 35 (35) | |
- ScannerThreadsInvoluntaryContextSwitches: 27 (27) | |
- ScannerThreadsTotalWallClockTime: 29s595ms | |
- MaterializeTupleTime(*): 786.412ms | |
- ScannerThreadsSysTime: 244.000ms | |
- ScannerThreadsUserTime: 2s304ms | |
- ScannerThreadsVoluntaryContextSwitches: 14.49K (14486) | |
- TotalRawHdfsReadTime(*): 13.679ms | |
- TotalReadThroughput: 108.46 MB/sec | |
Filter 0 (16.00 MB): | |
- Rows processed: 0 (0) | |
- Rows rejected: 0 (0) | |
- Rows total: 13.95M (13952334) | |
Instance 514ee9ab39cdc507:12 (host=cdh4.net.cuberonlabs.com:22000):(Total: 7s332ms, non-child: 1s091ms, % non-child: 14.89%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:40/3.59 GB | |
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 187.74 MB, 203.76 MB, 363.92 MB, 434.28 MB, 555.31 MB, 555.22 MB, 650.02 MB, 568.66 MB, 447.02 MB, 365.87 MB, 244.04 MB, 130.51 MB, 41.41 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 10, 10, 1, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 5.20 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 683.26 MB (716447973) | |
- PerHostPeakMemUsage: 2.13 GB (2284202661) | |
- RowsProduced: 5.60M (5603026) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 8.432ms | |
- TotalStorageWaitTime: 87.968ms | |
- TotalThreadsInvoluntaryContextSwitches: 54 (54) | |
- TotalThreadsTotalWallClockTime: 37s767ms | |
- TotalThreadsSysTime: 812.000ms | |
- TotalThreadsUserTime: 8s256ms | |
- TotalThreadsVoluntaryContextSwitches: 15.81K (15810) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 7s140ms | |
- ExecTreeExecTime: 4s169ms | |
- OpenTime: 155.948ms | |
- ExecTreeOpenTime: 39.344us | |
- PrepareTime: 35.411ms | |
- ExecTreePrepareTime: 729.932us | |
DataStreamSender (dst_id=24):(Total: 1s887ms, non-child: 1s887ms, % non-child: 100.00%) | |
- BytesSent: 295.29 MB (309636992) | |
- NetworkThroughput(*): 455.14 MB/sec | |
- OverallThroughput: 156.44 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 5.60M (5603026) | |
- SerializeBatchTime: 1s237ms | |
- TransmitDataRPCTime: 648.795ms | |
- UncompressedRowBatchSize: 465.80 MB (488430203) | |
CodeGen:(Total: 185.775ms, non-child: 185.775ms, % non-child: 100.00%) | |
- CodegenTime: 3.773ms | |
- CompileTime: 39.931ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 73 (73) | |
- NumInstructions: 1.41K (1412) | |
- OptimizationTime: 114.679ms | |
- PeakMemoryUsage: 706.00 KB (722944) | |
- PrepareTime: 30.369ms | |
AGGREGATION_NODE (id=3):(Total: 4s167ms, non-child: 3s235ms, % non-child: 77.64%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 771.256us | |
- GetResultsTime: 116.769ms | |
- HTResizeTime: 200.741ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 652.14 MB (683816441) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 36.18 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 5.60M (5603026) | |
- RowsReturnedRate: 1.34 M/sec | |
- StreamingTime: 3s090ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=2):(Total: 931.911ms, non-child: 931.911ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:40/3.59 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 40 out of 40 | |
Runtime filters: Only following filters arrived: , waited 823ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:80 | |
BytesRead(500.000ms): 0, 0, 115.80 MB, 129.28 MB, 223.92 MB, 294.83 MB, 371.07 MB, 459.98 MB | |
- FooterProcessingTime: (Avg: 8.958ms ; Min: 3.176ms ; Max: 37.350ms ; Number of samples: 40) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.88 | |
- BytesRead: 459.98 MB (482322831) | |
- BytesReadDataNodeCache: 447.64 MB (469384703) | |
- BytesReadLocal: 459.98 MB (482322831) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 459.98 MB (482322831) | |
- DecompressionTime: 1s027ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 2 (2) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 40 (40) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 37.40 MB (39217051) | |
- PerReadThreadRawHdfsThroughput: 31.02 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 33.716ms | |
- RowBatchQueuePutWaitTime: 24s654ms | |
- RowsRead: 15.04M (15041855) | |
- RowsReturned: 15.04M (15041855) | |
- RowsReturnedRate: 16.14 M/sec | |
- ScanRangesComplete: 40 (40) | |
- ScannerThreadsInvoluntaryContextSwitches: 43 (43) | |
- ScannerThreadsTotalWallClockTime: 30s470ms | |
- MaterializeTupleTime(*): 800.643ms | |
- ScannerThreadsSysTime: 368.000ms | |
- ScannerThreadsUserTime: 2s276ms | |
- ScannerThreadsVoluntaryContextSwitches: 15.48K (15484) | |
- TotalRawHdfsReadTime(*): 14.478ms | |
- TotalReadThroughput: 114.99 MB/sec | |
Filter 0 (16.00 MB): | |
- Rows processed: 0 (0) | |
- Rows rejected: 0 (0) | |
- Rows total: 15.04M (15041855) | |
Instance 514ee9ab39cdc507:18 (host=cdh17.net.cuberonlabs.com:22000):(Total: 6s912ms, non-child: 1s320ms, % non-child: 19.11%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.58 GB | |
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 184.75 MB, 203.93 MB, 362.53 MB, 363.95 MB, 416.18 MB, 552.78 MB, 521.61 MB, 423.96 MB, 326.34 MB, 228.66 MB, 131.08 MB, 33.26 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 10, 9, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 5.43 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 556.40 MB (583425568) | |
- PerHostPeakMemUsage: 1.75 GB (1879028559) | |
- RowsProduced: 4.28M (4284546) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 6.722ms | |
- TotalStorageWaitTime: 90.974ms | |
- TotalThreadsInvoluntaryContextSwitches: 18 (18) | |
- TotalThreadsTotalWallClockTime: 36s029ms | |
- TotalThreadsSysTime: 632.000ms | |
- TotalThreadsUserTime: 7s348ms | |
- TotalThreadsVoluntaryContextSwitches: 11.59K (11589) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 6s722ms | |
- ExecTreeExecTime: 4s076ms | |
- OpenTime: 152.679ms | |
- ExecTreeOpenTime: 41.716us | |
- PrepareTime: 37.195ms | |
- ExecTreePrepareTime: 737.372us | |
DataStreamSender (dst_id=24):(Total: 1s331ms, non-child: 1s331ms, % non-child: 100.00%) | |
- BytesSent: 227.94 MB (239015276) | |
- NetworkThroughput(*): 634.21 MB/sec | |
- OverallThroughput: 171.24 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 4.28M (4284546) | |
- SerializeBatchTime: 970.989ms | |
- TransmitDataRPCTime: 359.410ms | |
- UncompressedRowBatchSize: 357.34 MB (374701393) | |
CodeGen:(Total: 184.445ms, non-child: 184.445ms, % non-child: 100.00%) | |
- CodegenTime: 3.764ms | |
- CompileTime: 41.873ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 73 (73) | |
- NumInstructions: 1.41K (1412) | |
- OptimizationTime: 109.361ms | |
- PeakMemoryUsage: 706.00 KB (722944) | |
- PrepareTime: 32.444ms | |
AGGREGATION_NODE (id=3):(Total: 4s075ms, non-child: 3s171ms, % non-child: 77.81%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 621.577us | |
- GetResultsTime: 120.216ms | |
- HTResizeTime: 255.295ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 524.22 MB (549683385) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 36.57 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.28M (4284546) | |
- RowsReturnedRate: 1.05 M/sec | |
- StreamingTime: 3s021ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=2):(Total: 904.408ms, non-child: 904.408ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.58 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 26 out of 26 | |
Runtime filters: Only following filters arrived: , waited 823ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:52 | |
BytesRead(500.000ms): 0, 0, 115.34 MB, 115.34 MB, 182.54 MB, 240.63 MB, 264.31 MB, 330.99 MB | |
- FooterProcessingTime: (Avg: 11.043ms ; Min: 2.644ms ; Max: 43.484ms ; Number of samples: 26) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.75 | |
- BytesRead: 330.99 MB (347066972) | |
- BytesReadDataNodeCache: 322.96 MB (338652199) | |
- BytesReadLocal: 330.99 MB (347066972) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 330.99 MB (347066972) | |
- DecompressionTime: 806.682ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 2 (2) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 26 (26) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 38.65 MB (40523701) | |
- PerReadThreadRawHdfsThroughput: 31.86 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 31.816ms | |
- RowBatchQueuePutWaitTime: 23s987ms | |
- RowsRead: 10.92M (10919165) | |
- RowsReturned: 10.92M (10919165) | |
- RowsReturnedRate: 12.07 M/sec | |
- ScanRangesComplete: 26 (26) | |
- ScannerThreadsInvoluntaryContextSwitches: 10 (10) | |
- ScannerThreadsTotalWallClockTime: 29s154ms | |
- MaterializeTupleTime(*): 633.210ms | |
- ScannerThreadsSysTime: 172.000ms | |
- ScannerThreadsUserTime: 1s796ms | |
- ScannerThreadsVoluntaryContextSwitches: 11.25K (11251) | |
- TotalRawHdfsReadTime(*): 10.144ms | |
- TotalReadThroughput: 82.75 MB/sec | |
Filter 0 (16.00 MB): | |
- Rows processed: 0 (0) | |
- Rows rejected: 0 (0) | |
- Rows total: 10.92M (10919165) | |
Instance 514ee9ab39cdc507:13 (host=cdh16.net.cuberonlabs.com:22000):(Total: 6s641ms, non-child: 1s388ms, % non-child: 20.90%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.64 GB | |
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 203.78 MB, 235.70 MB, 363.60 MB, 431.65 MB, 549.81 MB, 521.90 MB, 423.98 MB, 326.26 MB, 228.64 MB, 130.84 MB, 33.31 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 8, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 5.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 556.44 MB (583473332) | |
- PerHostPeakMemUsage: 1.64 GB (1763578733) | |
- RowsProduced: 4.39M (4385303) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 5.815ms | |
- TotalStorageWaitTime: 54.375ms | |
- TotalThreadsInvoluntaryContextSwitches: 21 (21) | |
- TotalThreadsTotalWallClockTime: 33s508ms | |
- TotalThreadsSysTime: 560.000ms | |
- TotalThreadsUserTime: 7s056ms | |
- TotalThreadsVoluntaryContextSwitches: 11.75K (11748) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 6s459ms | |
- ExecTreeExecTime: 3s773ms | |
- OpenTime: 147.268ms | |
- ExecTreeOpenTime: 36.610us | |
- PrepareTime: 35.118ms | |
- ExecTreePrepareTime: 661.166us | |
DataStreamSender (dst_id=24):(Total: 1s304ms, non-child: 1s304ms, % non-child: 100.00%) | |
- BytesSent: 232.76 MB (244062142) | |
- NetworkThroughput(*): 763.54 MB/sec | |
- OverallThroughput: 178.42 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 4.39M (4385303) | |
- SerializeBatchTime: 998.939ms | |
- TransmitDataRPCTime: 304.837ms | |
- UncompressedRowBatchSize: 365.86 MB (383632260) | |
CodeGen:(Total: 176.880ms, non-child: 176.880ms, % non-child: 100.00%) | |
- CodegenTime: 3.706ms | |
- CompileTime: 39.327ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 73 (73) | |
- NumInstructions: 1.41K (1412) | |
- OptimizationTime: 106.684ms | |
- PeakMemoryUsage: 706.00 KB (722944) | |
- PrepareTime: 30.110ms | |
AGGREGATION_NODE (id=3):(Total: 3s772ms, non-child: 2s864ms, % non-child: 75.94%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 705.934us | |
- GetResultsTime: 123.473ms | |
- HTResizeTime: 229.786ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 524.24 MB (549702601) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 36.38 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.39M (4385303) | |
- RowsReturnedRate: 1.16 M/sec | |
- StreamingTime: 2s713ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=2):(Total: 907.537ms, non-child: 907.537ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.64 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 | |
Runtime filters: Only following filters arrived: , waited 823ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:56 | |
BytesRead(500.000ms): 0, 0, 120.24 MB, 146.94 MB, 243.90 MB, 271.58 MB, 338.43 MB | |
- FooterProcessingTime: (Avg: 11.259ms ; Min: 3.230ms ; Max: 37.617ms ; Number of samples: 28) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.43 | |
- BytesRead: 338.43 MB (354874263) | |
- BytesReadDataNodeCache: 329.80 MB (345817326) | |
- BytesReadLocal: 338.43 MB (354874263) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 338.43 MB (354874263) | |
- DecompressionTime: 754.485ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 2 (2) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 28 (28) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 37.77 MB (39608233) | |
- PerReadThreadRawHdfsThroughput: 29.37 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 35.989ms | |
- RowBatchQueuePutWaitTime: 21s863ms | |
- RowsRead: 11.05M (11051815) | |
- RowsReturned: 11.05M (11051815) | |
- RowsReturnedRate: 12.18 M/sec | |
- ScanRangesComplete: 28 (28) | |
- ScannerThreadsInvoluntaryContextSwitches: 13 (13) | |
- ScannerThreadsTotalWallClockTime: 26s901ms | |
- MaterializeTupleTime(*): 612.518ms | |
- ScannerThreadsSysTime: 180.000ms | |
- ScannerThreadsUserTime: 1s704ms | |
- ScannerThreadsVoluntaryContextSwitches: 11.43K (11433) | |
- TotalRawHdfsReadTime(*): 11.253ms | |
- TotalReadThroughput: 96.70 MB/sec | |
Filter 0 (16.00 MB): | |
- Rows processed: 0 (0) | |
- Rows rejected: 0 (0) | |
- Rows total: 11.05M (11051815) | |
Instance 514ee9ab39cdc507:19 (host=cdh2.net.cuberonlabs.com:22000):(Total: 6s637ms, non-child: 1s188ms, % non-child: 17.91%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/3.00 GB | |
MemoryUsage(500.000ms): 2.05 MB, 1.37 MB, 43.92 MB, 204.13 MB, 362.23 MB, 363.31 MB, 556.16 MB, 552.23 MB, 489.10 MB, 391.40 MB, 293.79 MB, 196.07 MB, 130.91 MB, 33.23 MB | |
ThreadUsage(500.000ms): 1, 9, 10, 10, 10, 10, 10, 9, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 5.36 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 558.37 MB (585496347) | |
- PerHostPeakMemUsage: 1.74 GB (1866918022) | |
- RowsProduced: 4.86M (4858229) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 7.465ms | |
- TotalStorageWaitTime: 62.051ms | |
- TotalThreadsInvoluntaryContextSwitches: 27 (27) | |
- TotalThreadsTotalWallClockTime: 34s474ms | |
- TotalThreadsSysTime: 676.000ms | |
- TotalThreadsUserTime: 7s340ms | |
- TotalThreadsVoluntaryContextSwitches: 13.47K (13468) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 6s422ms | |
- ExecTreeExecTime: 3s744ms | |
- OpenTime: 179.831ms | |
- ExecTreeOpenTime: 48.556us | |
- PrepareTime: 34.408ms | |
- ExecTreePrepareTime: 741.516us | |
DataStreamSender (dst_id=24):(Total: 1s497ms, non-child: 1s497ms, % non-child: 100.00%) | |
- BytesSent: 257.13 MB (269623144) | |
- NetworkThroughput(*): 746.80 MB/sec | |
- OverallThroughput: 171.71 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 4.86M (4858229) | |
- SerializeBatchTime: 1s152ms | |
- TransmitDataRPCTime: 344.313ms | |
- UncompressedRowBatchSize: 404.42 MB (424064953) | |
CodeGen:(Total: 208.138ms, non-child: 208.138ms, % non-child: 100.00%) | |
- CodegenTime: 4.173ms | |
- CompileTime: 48.434ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 73 (73) | |
- NumInstructions: 1.41K (1412) | |
- OptimizationTime: 129.193ms | |
- PeakMemoryUsage: 706.00 KB (722944) | |
- PrepareTime: 29.801ms | |
AGGREGATION_NODE (id=3):(Total: 3s742ms, non-child: 2s846ms, % non-child: 76.06%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 1.022ms | |
- GetResultsTime: 122.613ms | |
- HTResizeTime: 193.419ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 524.27 MB (549733277) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 36.05 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.86M (4858229) | |
- RowsReturnedRate: 1.30 M/sec | |
- StreamingTime: 2s697ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=2):(Total: 896.106ms, non-child: 896.106ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/3.00 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32 | |
Runtime filters: Only following filters arrived: , waited 803ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:64 | |
BytesRead(500.000ms): 0, 0, 116.42 MB, 116.42 MB, 227.61 MB, 244.34 MB, 341.06 MB, 384.71 MB | |
- FooterProcessingTime: (Avg: 12.375ms ; Min: 2.931ms ; Max: 63.332ms ; Number of samples: 32) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 8.71 | |
- BytesRead: 384.71 MB (403402232) | |
- BytesReadDataNodeCache: 374.84 MB (393048946) | |
- BytesReadLocal: 384.71 MB (403402232) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 384.71 MB (403402232) | |
- DecompressionTime: 882.708ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 2 (2) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 32 (32) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 38.08 MB (39929878) | |
- PerReadThreadRawHdfsThroughput: 33.26 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 33.163ms | |
- RowBatchQueuePutWaitTime: 21s372ms | |
- RowsRead: 12.59M (12593336) | |
- RowsReturned: 12.59M (12593336) | |
- RowsReturnedRate: 14.05 M/sec | |
- ScanRangesComplete: 32 (32) | |
- ScannerThreadsInvoluntaryContextSwitches: 17 (17) | |
- ScannerThreadsTotalWallClockTime: 27s871ms | |
- MaterializeTupleTime(*): 697.891ms | |
- ScannerThreadsSysTime: 252.000ms | |
- ScannerThreadsUserTime: 2s008ms | |
- ScannerThreadsVoluntaryContextSwitches: 13.05K (13055) | |
- TotalRawHdfsReadTime(*): 11.295ms | |
- TotalReadThroughput: 96.18 MB/sec | |
Filter 0 (16.00 MB): | |
- Rows processed: 0 (0) | |
- Rows rejected: 0 (0) | |
- Rows total: 12.59M (12593336) | |
Instance 514ee9ab39cdc507:1c (host=cdh1.net.cuberonlabs.com:22000):(Total: 6s423ms, non-child: 1s139ms, % non-child: 17.74%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/2.99 GB | |
MemoryUsage(500.000ms): 2.05 MB, 1.37 MB, 27.57 MB, 197.10 MB, 356.18 MB, 357.15 MB, 550.12 MB, 546.52 MB, 489.12 MB, 391.49 MB, 293.74 MB, 196.14 MB, 98.34 MB | |
ThreadUsage(500.000ms): 1, 1, 8, 8, 8, 8, 8, 7, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 4.15 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 551.79 MB (578591555) | |
- PerHostPeakMemUsage: 1.81 GB (1939587581) | |
- RowsProduced: 4.79M (4794858) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 7.618ms | |
- TotalStorageWaitTime: 108.653ms | |
- TotalThreadsInvoluntaryContextSwitches: 45 (45) | |
- TotalThreadsTotalWallClockTime: 27s386ms | |
- TotalThreadsSysTime: 596.000ms | |
- TotalThreadsUserTime: 7s192ms | |
- TotalThreadsVoluntaryContextSwitches: 13.34K (13343) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 6s245ms | |
- ExecTreeExecTime: 3s737ms | |
- OpenTime: 141.013ms | |
- ExecTreeOpenTime: 40.668us | |
- PrepareTime: 36.668ms | |
- ExecTreePrepareTime: 8.919ms | |
DataStreamSender (dst_id=24):(Total: 1s375ms, non-child: 1s375ms, % non-child: 100.00%) | |
- BytesSent: 253.69 MB (266013619) | |
- NetworkThroughput(*): 745.44 MB/sec | |
- OverallThroughput: 184.44 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 4.79M (4794858) | |
- SerializeBatchTime: 1s034ms | |
- TransmitDataRPCTime: 340.324ms | |
- UncompressedRowBatchSize: 398.88 MB (418257477) | |
CodeGen:(Total: 164.113ms, non-child: 164.113ms, % non-child: 100.00%) | |
- CodegenTime: 2.546ms | |
- CompileTime: 40.027ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 73 (73) | |
- NumInstructions: 1.41K (1412) | |
- OptimizationTime: 99.960ms | |
- PeakMemoryUsage: 706.00 KB (722944) | |
- PrepareTime: 23.653ms | |
AGGREGATION_NODE (id=3):(Total: 3s744ms, non-child: 2s801ms, % non-child: 74.81%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 2.725ms | |
- GetResultsTime: 111.908ms | |
- HTResizeTime: 197.261ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 524.24 MB (549701310) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 36.49 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.79M (4794858) | |
- RowsReturnedRate: 1.28 M/sec | |
- StreamingTime: 2s665ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=2):(Total: 943.004ms, non-child: 943.004ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/2.99 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35 | |
Runtime filters: Only following filters arrived: , waited 829ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:70 | |
BytesRead(500.000ms): 0, 0, 55.90 MB, 108.45 MB, 187.11 MB, 265.74 MB, 344.61 MB, 383.67 MB | |
- FooterProcessingTime: (Avg: 12.341ms ; Min: 3.729ms ; Max: 76.218ms ; Number of samples: 35) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 5.86 | |
- BytesRead: 383.67 MB (402308363) | |
- BytesReadDataNodeCache: 372.88 MB (390990094) | |
- BytesReadLocal: 383.67 MB (402308363) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 383.67 MB (402308363) | |
- DecompressionTime: 894.256ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 2 (2) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 35 (35) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 31.03 MB (32542382) | |
- PerReadThreadRawHdfsThroughput: 32.72 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 40.794ms | |
- RowBatchQueuePutWaitTime: 15s986ms | |
- RowsRead: 12.55M (12550697) | |
- RowsReturned: 12.55M (12550697) | |
- RowsReturnedRate: 13.31 M/sec | |
- ScanRangesComplete: 35 (35) | |
- ScannerThreadsInvoluntaryContextSwitches: 30 (30) | |
- ScannerThreadsTotalWallClockTime: 20s999ms | |
- MaterializeTupleTime(*): 681.589ms | |
- ScannerThreadsSysTime: 280.000ms | |
- ScannerThreadsUserTime: 2s016ms | |
- ScannerThreadsVoluntaryContextSwitches: 12.99K (12992) | |
- TotalRawHdfsReadTime(*): 11.450ms | |
- TotalReadThroughput: 95.92 MB/sec | |
Filter 0 (16.00 MB): | |
- Rows processed: 0 (0) | |
- Rows rejected: 0 (0) | |
- Rows total: 12.55M (12550697) | |
Instance 514ee9ab39cdc507:15 (host=cdh6.net.cuberonlabs.com:22000):(Total: 6s113ms, non-child: 1s045ms, % non-child: 17.10%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/2.89 GB | |
MemoryUsage(500.000ms): 2.05 MB, 1.37 MB, 42.41 MB, 203.34 MB, 363.65 MB, 362.92 MB, 555.62 MB, 528.86 MB, 424.01 MB, 326.38 MB, 228.63 MB, 130.91 MB, 33.18 MB | |
ThreadUsage(500.000ms): 1, 1, 10, 10, 10, 10, 10, 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 4.46 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 557.58 MB (584668810) | |
- PerHostPeakMemUsage: 1.67 GB (1794839264) | |
- RowsProduced: 4.66M (4663530) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 6.315ms | |
- TotalStorageWaitTime: 86.677ms | |
- TotalThreadsInvoluntaryContextSwitches: 22 (22) | |
- TotalThreadsTotalWallClockTime: 31s145ms | |
- TotalThreadsSysTime: 492.000ms | |
- TotalThreadsUserTime: 6s848ms | |
- TotalThreadsVoluntaryContextSwitches: 12.71K (12707) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s897ms | |
- ExecTreeExecTime: 3s518ms | |
- OpenTime: 177.526ms | |
- ExecTreeOpenTime: 49.884us | |
- PrepareTime: 38.315ms | |
- ExecTreePrepareTime: 684.628us | |
DataStreamSender (dst_id=24):(Total: 1s340ms, non-child: 1s340ms, % non-child: 100.00%) | |
- BytesSent: 247.32 MB (259328986) | |
- NetworkThroughput(*): 751.79 MB/sec | |
- OverallThroughput: 184.56 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 4.66M (4663530) | |
- SerializeBatchTime: 1s010ms | |
- TransmitDataRPCTime: 328.969ms | |
- UncompressedRowBatchSize: 388.66 MB (407541293) | |
CodeGen:(Total: 210.314ms, non-child: 210.314ms, % non-child: 100.00%) | |
- CodegenTime: 4.103ms | |
- CompileTime: 62.392ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 73 (73) | |
- NumInstructions: 1.41K (1412) | |
- OptimizationTime: 113.813ms | |
- PeakMemoryUsage: 706.00 KB (722944) | |
- PrepareTime: 33.309ms | |
AGGREGATION_NODE (id=3):(Total: 3s517ms, non-child: 2s627ms, % non-child: 74.70%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 572.760us | |
- GetResultsTime: 112.696ms | |
- HTResizeTime: 180.793ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 524.31 MB (549773890) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 36.60 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.66M (4663530) | |
- RowsReturnedRate: 1.33 M/sec | |
- StreamingTime: 2s492ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=2):(Total: 890.074ms, non-child: 890.074ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/2.89 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32 | |
Runtime filters: Only following filters arrived: , waited 803ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:64 | |
BytesRead(500.000ms): 0, 0, 113.42 MB, 126.70 MB, 218.61 MB, 281.90 MB, 348.45 MB, 371.87 MB | |
- FooterProcessingTime: (Avg: 12.084ms ; Min: 3.180ms ; Max: 46.430ms ; Number of samples: 32) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.43 | |
- BytesRead: 371.87 MB (389930944) | |
- BytesReadDataNodeCache: 362.00 MB (379580217) | |
- BytesReadLocal: 371.87 MB (389930944) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 371.87 MB (389930944) | |
- DecompressionTime: 841.196ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 2 (2) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 32 (32) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 37.49 MB (39313688) | |
- PerReadThreadRawHdfsThroughput: 37.69 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 37.240ms | |
- RowBatchQueuePutWaitTime: 19s572ms | |
- RowsRead: 12.15M (12150960) | |
- RowsReturned: 12.15M (12150960) | |
- RowsReturnedRate: 13.65 M/sec | |
- ScanRangesComplete: 32 (32) | |
- ScannerThreadsInvoluntaryContextSwitches: 16 (16) | |
- ScannerThreadsTotalWallClockTime: 25s069ms | |
- MaterializeTupleTime(*): 668.817ms | |
- ScannerThreadsSysTime: 180.000ms | |
- ScannerThreadsUserTime: 1s932ms | |
- ScannerThreadsVoluntaryContextSwitches: 12.43K (12427) | |
- TotalRawHdfsReadTime(*): 9.634ms | |
- TotalReadThroughput: 92.97 MB/sec | |
Filter 0 (16.00 MB): | |
- Rows processed: 0 (0) | |
- Rows rejected: 0 (0) | |
- Rows total: 12.15M (12150960) | |
Instance 514ee9ab39cdc507:22 (host=cdh10.net.cuberonlabs.com:22000):(Total: 6s081ms, non-child: 809.232ms, % non-child: 13.31%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.75 GB | |
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 206.67 MB, 365.55 MB, 365.67 MB, 555.79 MB, 548.63 MB, 456.63 MB, 358.80 MB, 261.27 MB, 163.58 MB, 33.25 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 7, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 5.25 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 560.96 MB (588212896) | |
- PerHostPeakMemUsage: 1.66 GB (1784016472) | |
- RowsProduced: 4.57M (4572828) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 9.421ms | |
- TotalStorageWaitTime: 114.773ms | |
- TotalThreadsInvoluntaryContextSwitches: 49 (49) | |
- TotalThreadsTotalWallClockTime: 30s502ms | |
- TotalThreadsSysTime: 636.000ms | |
- TotalThreadsUserTime: 6s464ms | |
- TotalThreadsVoluntaryContextSwitches: 12.15K (12151) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s891ms | |
- ExecTreeExecTime: 3s497ms | |
- OpenTime: 152.020ms | |
- ExecTreeOpenTime: 36.090us | |
- PrepareTime: 37.710ms | |
- ExecTreePrepareTime: 748.248us | |
DataStreamSender (dst_id=24):(Total: 1s592ms, non-child: 1s592ms, % non-child: 100.00%) | |
- BytesSent: 243.06 MB (254868683) | |
- NetworkThroughput(*): 407.26 MB/sec | |
- OverallThroughput: 152.64 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 4.57M (4572828) | |
- SerializeBatchTime: 994.709ms | |
- TransmitDataRPCTime: 596.816ms | |
- UncompressedRowBatchSize: 382.38 MB (400955551) | |
CodeGen:(Total: 183.657ms, non-child: 183.657ms, % non-child: 100.00%) | |
- CodegenTime: 3.898ms | |
- CompileTime: 39.873ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 73 (73) | |
- NumInstructions: 1.41K (1412) | |
- OptimizationTime: 110.956ms | |
- PeakMemoryUsage: 706.00 KB (722944) | |
- PrepareTime: 32.049ms | |
AGGREGATION_NODE (id=3):(Total: 3s496ms, non-child: 2s578ms, % non-child: 73.74%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 1.014ms | |
- GetResultsTime: 113.486ms | |
- HTResizeTime: 188.242ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 524.23 MB (549692743) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 35.11 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.57M (4572828) | |
- RowsReturnedRate: 1.31 M/sec | |
- StreamingTime: 2s440ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=2):(Total: 918.030ms, non-child: 918.030ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.75 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30 | |
Runtime filters: Only following filters arrived: , waited 824ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
File Formats: PARQUET/SNAPPY:60 | |
BytesRead(500.000ms): 0, 0, 117.15 MB, 143.75 MB, 250.76 MB, 327.35 MB, 354.06 MB | |
- FooterProcessingTime: (Avg: 13.739ms ; Min: 3.041ms ; Max: 49.831ms ; Number of samples: 30) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.29 | |
- BytesRead: 354.06 MB (371259437) | |
- BytesReadDataNodeCache: 344.81 MB (361554938) | |
- BytesReadLocal: 354.06 MB (371259437) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 354.06 MB (371259437) | |
- DecompressionTime: 752.010ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 2 (2) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 30 (30) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 40.59 MB (42565388) | |
- PerReadThreadRawHdfsThroughput: 34.33 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 41.898ms | |
- RowBatchQueuePutWaitTime: 19s102ms | |
- RowsRead: 11.46M (11459388) | |
- RowsReturned: 11.46M (11459388) | |
- RowsReturnedRate: 12.48 M/sec | |
- ScanRangesComplete: 30 (30) | |
- ScannerThreadsInvoluntaryContextSwitches: 42 (42) | |
- ScannerThreadsTotalWallClockTime: 24s458ms | |
- MaterializeTupleTime(*): 586.825ms | |
- ScannerThreadsSysTime: 204.000ms | |
- ScannerThreadsUserTime: 1s736ms | |
- ScannerThreadsVoluntaryContextSwitches: 11.83K (11829) | |
- TotalRawHdfsReadTime(*): 10.072ms | |
- TotalReadThroughput: 101.16 MB/sec | |
Filter 0 (16.00 MB): | |
- Rows processed: 0 (0) | |
- Rows rejected: 0 (0) | |
- Rows total: 11.46M (11459388) | |
Instance 514ee9ab39cdc507:21 (host=cdh9.net.cuberonlabs.com:22000):(Total: 5s977ms, non-child: 940.172ms, % non-child: 15.73%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/3.02 GB | |
MemoryUsage(500.000ms): 2.05 MB, 1.37 MB, 40.54 MB, 204.31 MB, 364.41 MB, 379.48 MB, 556.04 MB, 536.75 MB, 424.00 MB, 326.52 MB, 196.08 MB, 98.47 MB | |
ThreadUsage(500.000ms): 1, 9, 10, 10, 10, 10, 10, 4, 1, 1, 1, 1 | |
- AverageThreadTokens: 5.67 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 557.72 MB (584806842) | |
- PerHostPeakMemUsage: 1.69 GB (1813107104) | |
- RowsProduced: 4.85M (4853569) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 8.834ms | |
- TotalStorageWaitTime: 43.479ms | |
- TotalThreadsInvoluntaryContextSwitches: 28 (28) | |
- TotalThreadsTotalWallClockTime: 32s301ms | |
- TotalThreadsSysTime: 524.000ms | |
- TotalThreadsUserTime: 6s584ms | |
- TotalThreadsVoluntaryContextSwitches: 13.43K (13425) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s783ms | |
- ExecTreeExecTime: 3s566ms | |
- OpenTime: 155.432ms | |
- ExecTreeOpenTime: 37.702us | |
- PrepareTime: 38.316ms | |
- ExecTreePrepareTime: 808.971us | |
DataStreamSender (dst_id=24):(Total: 1s283ms, non-child: 1s283ms, % non-child: 100.00%) | |
- BytesSent: 257.44 MB (269940699) | |
- NetworkThroughput(*): 746.43 MB/sec | |
- OverallThroughput: 200.52 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 4.85M (4853569) | |
- SerializeBatchTime: 938.230ms | |
- TransmitDataRPCTime: 344.888ms | |
- UncompressedRowBatchSize: 404.92 MB (424589956) | |
CodeGen:(Total: 187.863ms, non-child: 187.863ms, % non-child: 100.00%) | |
- CodegenTime: 3.949ms | |
- CompileTime: 40.763ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 73 (73) | |
- NumInstructions: 1.41K (1412) | |
- OptimizationTime: 113.479ms | |
- PeakMemoryUsage: 706.00 KB (722944) | |
- PrepareTime: 32.838ms | |
AGGREGATION_NODE (id=3):(Total: 3s565ms, non-child: 2s663ms, % non-child: 74.70%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 676.644us | |
- GetResultsTime: 99.482ms | |
- HTResizeTime: 182.971ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 524.26 MB (549723860) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 35.69 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.85M (4853569) | |
- RowsReturnedRate: 1.36 M/sec | |
- StreamingTime: 2s540ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=2):(Total: 901.930ms, non-child: 901.930ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/3.02 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31 | |
Runtime filters: Only following filters arrived: , waited 823ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:62 | |
BytesRead(500.000ms): 0, 0, 103.98 MB, 117.11 MB, 217.76 MB, 270.98 MB, 347.78 MB, 387.40 MB | |
- FooterProcessingTime: (Avg: 12.984ms ; Min: 2.639ms ; Max: 60.996ms ; Number of samples: 31) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 8.00 | |
- BytesRead: 387.40 MB (406219320) | |
- BytesReadDataNodeCache: 377.84 MB (396191917) | |
- BytesReadLocal: 387.40 MB (406219320) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 387.40 MB (406219320) | |
- DecompressionTime: 811.635ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 2 (2) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 31 (31) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 37.91 MB (39750521) | |
- PerReadThreadRawHdfsThroughput: 36.06 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 26.780ms | |
- RowBatchQueuePutWaitTime: 20s161ms | |
- RowsRead: 12.71M (12711965) | |
- RowsReturned: 12.71M (12711965) | |
- RowsReturnedRate: 14.09 M/sec | |
- ScanRangesComplete: 31 (31) | |
- ScannerThreadsInvoluntaryContextSwitches: 23 (23) | |
- ScannerThreadsTotalWallClockTime: 26s362ms | |
- MaterializeTupleTime(*): 638.552ms | |
- ScannerThreadsSysTime: 204.000ms | |
- ScannerThreadsUserTime: 1s824ms | |
- ScannerThreadsVoluntaryContextSwitches: 13.10K (13103) | |
- TotalRawHdfsReadTime(*): 10.491ms | |
- TotalReadThroughput: 96.85 MB/sec | |
Filter 0 (16.00 MB): | |
- Rows processed: 0 (0) | |
- Rows rejected: 0 (0) | |
- Rows total: 12.71M (12711965) | |
Instance 514ee9ab39cdc507:1f (host=cdh8.net.cuberonlabs.com:22000):(Total: 5s970ms, non-child: 747.470ms, % non-child: 12.52%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.70 GB | |
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 204.50 MB, 235.14 MB, 363.40 MB, 555.63 MB, 539.86 MB, 456.60 MB, 358.77 MB, 228.68 MB, 130.98 MB, 33.27 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 5, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 5.08 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 558.00 MB (585104887) | |
- PerHostPeakMemUsage: 1.63 GB (1748411303) | |
- RowsProduced: 4.35M (4348675) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 7.694ms | |
- TotalStorageWaitTime: 106.236ms | |
- TotalThreadsInvoluntaryContextSwitches: 39 (39) | |
- TotalThreadsTotalWallClockTime: 31s216ms | |
- TotalThreadsSysTime: 540.000ms | |
- TotalThreadsUserTime: 6s672ms | |
- TotalThreadsVoluntaryContextSwitches: 12.23K (12233) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s749ms | |
- ExecTreeExecTime: 3s441ms | |
- OpenTime: 188.687ms | |
- ExecTreeOpenTime: 63.645us | |
- PrepareTime: 32.516ms | |
- ExecTreePrepareTime: 714.738us | |
DataStreamSender (dst_id=24):(Total: 1s567ms, non-child: 1s567ms, % non-child: 100.00%) | |
- BytesSent: 229.65 MB (240800981) | |
- NetworkThroughput(*): 387.49 MB/sec | |
- OverallThroughput: 146.50 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 4.35M (4348675) | |
- SerializeBatchTime: 974.138ms | |
- TransmitDataRPCTime: 592.655ms | |
- UncompressedRowBatchSize: 361.15 MB (378692981) | |
CodeGen:(Total: 215.842ms, non-child: 215.842ms, % non-child: 100.00%) | |
- CodegenTime: 3.273ms | |
- CompileTime: 62.743ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 73 (73) | |
- NumInstructions: 1.41K (1412) | |
- OptimizationTime: 124.760ms | |
- PeakMemoryUsage: 706.00 KB (722944) | |
- PrepareTime: 27.712ms | |
AGGREGATION_NODE (id=3):(Total: 3s440ms, non-child: 2s563ms, % non-child: 74.52%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 570.935us | |
- GetResultsTime: 113.082ms | |
- HTResizeTime: 193.469ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 524.29 MB (549761556) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 36.29 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.35M (4348675) | |
- RowsReturnedRate: 1.26 M/sec | |
- StreamingTime: 2s425ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=2):(Total: 876.413ms, non-child: 876.413ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.70 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 | |
Runtime filters: Only following filters arrived: , waited 783ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:56 | |
BytesRead(500.000ms): 0, 0, 116.17 MB, 156.70 MB, 249.29 MB, 316.03 MB, 345.44 MB | |
- FooterProcessingTime: (Avg: 11.868ms ; Min: 2.985ms ; Max: 42.725ms ; Number of samples: 28) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.00 | |
- BytesRead: 345.44 MB (362217941) | |
- BytesReadDataNodeCache: 336.80 MB (353164502) | |
- BytesReadLocal: 345.44 MB (362217941) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 345.44 MB (362217941) | |
- DecompressionTime: 871.125ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 2 (2) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 28 (28) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 37.49 MB (39315743) | |
- PerReadThreadRawHdfsThroughput: 37.64 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 35.226ms | |
- RowBatchQueuePutWaitTime: 19s017ms | |
- RowsRead: 11.39M (11388046) | |
- RowsReturned: 11.39M (11388046) | |
- RowsReturnedRate: 12.99 M/sec | |
- ScanRangesComplete: 28 (28) | |
- ScannerThreadsInvoluntaryContextSwitches: 27 (27) | |
- ScannerThreadsTotalWallClockTime: 25s278ms | |
- MaterializeTupleTime(*): 664.422ms | |
- ScannerThreadsSysTime: 164.000ms | |
- ScannerThreadsUserTime: 1s948ms | |
- ScannerThreadsVoluntaryContextSwitches: 11.89K (11887) | |
- TotalRawHdfsReadTime(*): 8.961ms | |
- TotalReadThroughput: 98.70 MB/sec | |
Filter 0 (16.00 MB): | |
- Rows processed: 0 (0) | |
- Rows rejected: 0 (0) | |
- Rows total: 11.39M (11388046) | |
Instance 514ee9ab39cdc507:14 (host=cdh13.net.cuberonlabs.com:22000):(Total: 5s871ms, non-child: 925.565ms, % non-child: 15.76%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/2.80 GB | |
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 187.75 MB, 204.16 MB, 366.19 MB, 451.24 MB, 552.89 MB, 489.09 MB, 359.04 MB, 261.19 MB, 131.08 MB, 33.01 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 9, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 5.42 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 558.06 MB (585168101) | |
- PerHostPeakMemUsage: 1.66 GB (1782381748) | |
- RowsProduced: 4.64M (4636970) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 6.695ms | |
- TotalStorageWaitTime: 76.330ms | |
- TotalThreadsInvoluntaryContextSwitches: 23 (23) | |
- TotalThreadsTotalWallClockTime: 31s119ms | |
- TotalThreadsSysTime: 556.000ms | |
- TotalThreadsUserTime: 6s372ms | |
- TotalThreadsVoluntaryContextSwitches: 12.48K (12476) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s683ms | |
- ExecTreeExecTime: 3s499ms | |
- OpenTime: 148.839ms | |
- ExecTreeOpenTime: 37.582us | |
- PrepareTime: 39.032ms | |
- ExecTreePrepareTime: 821.258us | |
DataStreamSender (dst_id=24):(Total: 1s265ms, non-child: 1s265ms, % non-child: 100.00%) | |
- BytesSent: 247.01 MB (259008146) | |
- NetworkThroughput(*): 711.06 MB/sec | |
- OverallThroughput: 195.26 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 4.64M (4636970) | |
- SerializeBatchTime: 916.918ms | |
- TransmitDataRPCTime: 347.381ms | |
- UncompressedRowBatchSize: 388.37 MB (407230356) | |
CodeGen:(Total: 181.765ms, non-child: 181.765ms, % non-child: 100.00%) | |
- CodegenTime: 4.076ms | |
- CompileTime: 39.025ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 73 (73) | |
- NumInstructions: 1.41K (1412) | |
- OptimizationTime: 108.669ms | |
- PeakMemoryUsage: 706.00 KB (722944) | |
- PrepareTime: 32.936ms | |
AGGREGATION_NODE (id=3):(Total: 3s498ms, non-child: 2s590ms, % non-child: 74.03%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 673.506us | |
- GetResultsTime: 99.458ms | |
- HTResizeTime: 189.067ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 524.27 MB (549740424) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 35.23 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.64M (4636970) | |
- RowsReturnedRate: 1.33 M/sec | |
- StreamingTime: 2s469ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=2):(Total: 908.553ms, non-child: 908.553ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/2.80 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31 | |
Runtime filters: Only following filters arrived: , waited 824ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:62 | |
BytesRead(500.000ms): 0, 0, 108.93 MB, 136.37 MB, 232.35 MB, 276.62 MB, 360.67 MB | |
- FooterProcessingTime: (Avg: 11.181ms ; Min: 2.436ms ; Max: 54.744ms ; Number of samples: 31) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.57 | |
- BytesRead: 360.67 MB (378194120) | |
- BytesReadDataNodeCache: 351.12 MB (368172058) | |
- BytesReadLocal: 360.67 MB (378194120) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 360.67 MB (378194120) | |
- DecompressionTime: 768.648ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 2 (2) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 31 (31) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 37.89 MB (39732003) | |
- PerReadThreadRawHdfsThroughput: 35.28 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 36.856ms | |
- RowBatchQueuePutWaitTime: 19s809ms | |
- RowsRead: 11.68M (11677391) | |
- RowsReturned: 11.68M (11677391) | |
- RowsReturnedRate: 12.85 M/sec | |
- ScanRangesComplete: 31 (31) | |
- ScannerThreadsInvoluntaryContextSwitches: 17 (17) | |
- ScannerThreadsTotalWallClockTime: 25s287ms | |
- MaterializeTupleTime(*): 611.905ms | |
- ScannerThreadsSysTime: 220.000ms | |
- ScannerThreadsUserTime: 1s744ms | |
- ScannerThreadsVoluntaryContextSwitches: 12.12K (12119) | |
- TotalRawHdfsReadTime(*): 9.982ms | |
- TotalReadThroughput: 103.05 MB/sec | |
Filter 0 (16.00 MB): | |
- Rows processed: 0 (0) | |
- Rows rejected: 0 (0) | |
- Rows total: 11.68M (11677391) | |
Instance 514ee9ab39cdc507:16 (host=cdh15.net.cuberonlabs.com:22000):(Total: 5s712ms, non-child: 986.595ms, % non-child: 17.27%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.66 GB | |
MemoryUsage(500.000ms): 1.35 MB, 1.37 MB, 5.69 MB, 203.96 MB, 363.77 MB, 384.01 MB, 553.28 MB, 489.37 MB, 391.35 MB, 261.30 MB, 163.50 MB, 65.76 MB | |
ThreadUsage(500.000ms): 1, 1, 10, 10, 10, 10, 9, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 4.67 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 556.90 MB (583948431) | |
- PerHostPeakMemUsage: 1.57 GB (1688553772) | |
- RowsProduced: 4.41M (4413574) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 8.596ms | |
- TotalStorageWaitTime: 98.115ms | |
- TotalThreadsInvoluntaryContextSwitches: 44 (44) | |
- TotalThreadsTotalWallClockTime: 29s418ms | |
- TotalThreadsSysTime: 512.000ms | |
- TotalThreadsUserTime: 5s996ms | |
- TotalThreadsVoluntaryContextSwitches: 11.74K (11745) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s519ms | |
- ExecTreeExecTime: 3s269ms | |
- OpenTime: 154.690ms | |
- ExecTreeOpenTime: 40.398us | |
- PrepareTime: 38.780ms | |
- ExecTreePrepareTime: 774.259us | |
DataStreamSender (dst_id=24):(Total: 1s270ms, non-child: 1s270ms, % non-child: 100.00%) | |
- BytesSent: 235.15 MB (246567845) | |
- NetworkThroughput(*): 733.27 MB/sec | |
- OverallThroughput: 185.09 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 4.41M (4413574) | |
- SerializeBatchTime: 948.988ms | |
- TransmitDataRPCTime: 320.678ms | |
- UncompressedRowBatchSize: 369.48 MB (387425805) | |
CodeGen:(Total: 187.460ms, non-child: 187.460ms, % non-child: 100.00%) | |
- CodegenTime: 3.872ms | |
- CompileTime: 40.036ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 73 (73) | |
- NumInstructions: 1.41K (1412) | |
- OptimizationTime: 113.434ms | |
- PeakMemoryUsage: 706.00 KB (722944) | |
- PrepareTime: 33.220ms | |
AGGREGATION_NODE (id=3):(Total: 3s268ms, non-child: 2s371ms, % non-child: 72.58%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 361.612us | |
- GetResultsTime: 110.995ms | |
- HTResizeTime: 182.928ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 524.25 MB (549718437) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 36.23 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.41M (4413574) | |
- RowsReturnedRate: 1.35 M/sec | |
- StreamingTime: 2s238ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=2):(Total: 896.261ms, non-child: 896.261ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.66 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30 | |
Runtime filters: Only following filters arrived: , waited 823ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:60 | |
BytesRead(500.000ms): 0, 0, 14.33 MB, 131.48 MB, 214.59 MB, 264.25 MB, 342.47 MB | |
- FooterProcessingTime: (Avg: 13.111ms ; Min: 3.051ms ; Max: 56.753ms ; Number of samples: 30) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.33 | |
- BytesRead: 342.47 MB (359108875) | |
- BytesReadDataNodeCache: 333.22 MB (349403564) | |
- BytesReadLocal: 342.47 MB (359108875) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 342.47 MB (359108875) | |
- DecompressionTime: 663.903ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 2 (2) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 30 (30) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 37.79 MB (39629261) | |
- PerReadThreadRawHdfsThroughput: 30.01 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 31.903ms | |
- RowBatchQueuePutWaitTime: 17s783ms | |
- RowsRead: 11.11M (11113210) | |
- RowsReturned: 11.11M (11113210) | |
- RowsReturnedRate: 12.40 M/sec | |
- ScanRangesComplete: 30 (30) | |
- ScannerThreadsInvoluntaryContextSwitches: 35 (35) | |
- ScannerThreadsTotalWallClockTime: 23s744ms | |
- MaterializeTupleTime(*): 513.564ms | |
- ScannerThreadsSysTime: 176.000ms | |
- ScannerThreadsUserTime: 1s520ms | |
- ScannerThreadsVoluntaryContextSwitches: 11.45K (11453) | |
- TotalRawHdfsReadTime(*): 11.144ms | |
- TotalReadThroughput: 97.85 MB/sec | |
Filter 0 (16.00 MB): | |
- Rows processed: 0 (0) | |
- Rows rejected: 0 (0) | |
- Rows total: 11.11M (11113210) | |
Instance 514ee9ab39cdc507:1e (host=cdh7.net.cuberonlabs.com:22000):(Total: 5s584ms, non-child: 644.896ms, % non-child: 11.55%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:27/2.46 GB | |
MemoryUsage(500.000ms): 2.05 MB, 1.37 MB, 44.47 MB, 203.43 MB, 361.81 MB, 364.15 MB, 549.85 MB, 489.04 MB, 391.34 MB, 260.98 MB, 131.00 MB | |
ThreadUsage(500.000ms): 1, 9, 10, 10, 10, 10, 8, 1, 1, 1, 1 | |
- AverageThreadTokens: 5.64 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 552.40 MB (579233628) | |
- PerHostPeakMemUsage: 1.58 GB (1699637471) | |
- RowsProduced: 4.15M (4150227) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 10.184ms | |
- TotalStorageWaitTime: 118.617ms | |
- TotalThreadsInvoluntaryContextSwitches: 39 (39) | |
- TotalThreadsTotalWallClockTime: 29s742ms | |
- TotalThreadsSysTime: 544.000ms | |
- TotalThreadsUserTime: 6s072ms | |
- TotalThreadsVoluntaryContextSwitches: 11.25K (11249) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 5s384ms | |
- ExecTreeExecTime: 3s366ms | |
- OpenTime: 159.715ms | |
- ExecTreeOpenTime: 47.736us | |
- PrepareTime: 40.238ms | |
- ExecTreePrepareTime: 1.240ms | |
DataStreamSender (dst_id=24):(Total: 1s380ms, non-child: 1s380ms, % non-child: 100.00%) | |
- BytesSent: 219.89 MB (230573220) | |
- NetworkThroughput(*): 409.41 MB/sec | |
- OverallThroughput: 159.31 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 4.15M (4150227) | |
- SerializeBatchTime: 842.415ms | |
- TransmitDataRPCTime: 537.099ms | |
- UncompressedRowBatchSize: 345.00 MB (361760812) | |
CodeGen:(Total: 192.721ms, non-child: 192.721ms, % non-child: 100.00%) | |
- CodegenTime: 4.023ms | |
- CompileTime: 41.669ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 73 (73) | |
- NumInstructions: 1.41K (1412) | |
- OptimizationTime: 116.686ms | |
- PeakMemoryUsage: 706.00 KB (722944) | |
- PrepareTime: 33.572ms | |
AGGREGATION_NODE (id=3):(Total: 3s366ms, non-child: 2s460ms, % non-child: 73.10%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 3.018ms | |
- GetResultsTime: 100.660ms | |
- HTResizeTime: 195.254ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 524.13 MB (549590100) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 36.61 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 4.15M (4150227) | |
- RowsReturnedRate: 1.23 M/sec | |
- StreamingTime: 2s333ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=2):(Total: 905.629ms, non-child: 905.629ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:27/2.46 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 27 out of 27 | |
Runtime filters: Only following filters arrived: , waited 803ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:54 | |
BytesRead(500.000ms): 0, 0, 112.62 MB, 112.62 MB, 181.51 MB, 248.29 MB, 314.97 MB | |
- FooterProcessingTime: (Avg: 15.053ms ; Min: 3.059ms ; Max: 48.490ms ; Number of samples: 27) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 8.50 | |
- BytesRead: 314.97 MB (330266381) | |
- BytesReadDataNodeCache: 306.65 MB (321540951) | |
- BytesReadLocal: 314.97 MB (330266381) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 314.97 MB (330266381) | |
- DecompressionTime: 797.524ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 2 (2) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 27 (27) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 37.81 MB (39642068) | |
- PerReadThreadRawHdfsThroughput: 38.92 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 49.250ms | |
- RowBatchQueuePutWaitTime: 18s019ms | |
- RowsRead: 10.29M (10293228) | |
- RowsReturned: 10.29M (10293228) | |
- RowsReturnedRate: 11.37 M/sec | |
- ScanRangesComplete: 27 (27) | |
- ScannerThreadsInvoluntaryContextSwitches: 27 (27) | |
- ScannerThreadsTotalWallClockTime: 24s198ms | |
- MaterializeTupleTime(*): 593.475ms | |
- ScannerThreadsSysTime: 208.000ms | |
- ScannerThreadsUserTime: 1s748ms | |
- ScannerThreadsVoluntaryContextSwitches: 10.89K (10886) | |
- TotalRawHdfsReadTime(*): 7.902ms | |
- TotalReadThroughput: 89.99 MB/sec | |
Filter 0 (16.00 MB): | |
- Rows processed: 0 (0) | |
- Rows rejected: 0 (0) | |
- Rows total: 10.29M (10293228) | |
Instance 514ee9ab39cdc507:20 (host=cdh11.net.cuberonlabs.com:22000):(Total: 5s080ms, non-child: 783.754ms, % non-child: 15.43%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:21/2.18 GB | |
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 206.13 MB, 364.76 MB, 365.69 MB, 538.60 MB, 456.55 MB, 326.29 MB, 195.95 MB, 33.36 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 4, 1, 1, 1, 1 | |
- AverageThreadTokens: 4.90 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 546.99 MB (573565060) | |
- PerHostPeakMemUsage: 1.48 GB (1591793359) | |
- RowsProduced: 3.77M (3768829) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 6.201ms | |
- TotalStorageWaitTime: 77.370ms | |
- TotalThreadsInvoluntaryContextSwitches: 16 (16) | |
- TotalThreadsTotalWallClockTime: 26s415ms | |
- TotalThreadsSysTime: 428.000ms | |
- TotalThreadsUserTime: 5s276ms | |
- TotalThreadsVoluntaryContextSwitches: 9.71K (9715) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 4s899ms | |
- ExecTreeExecTime: 3s055ms | |
- OpenTime: 146.565ms | |
- ExecTreeOpenTime: 33.053us | |
- PrepareTime: 34.498ms | |
- ExecTreePrepareTime: 784.355us | |
DataStreamSender (dst_id=24):(Total: 1s066ms, non-child: 1s066ms, % non-child: 100.00%) | |
- BytesSent: 201.54 MB (211335214) | |
- NetworkThroughput(*): 702.02 MB/sec | |
- OverallThroughput: 189.04 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 3.77M (3768829) | |
- SerializeBatchTime: 778.486ms | |
- TransmitDataRPCTime: 287.093ms | |
- UncompressedRowBatchSize: 315.92 MB (331270904) | |
CodeGen:(Total: 175.646ms, non-child: 175.646ms, % non-child: 100.00%) | |
- CodegenTime: 3.503ms | |
- CompileTime: 39.177ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 73 (73) | |
- NumInstructions: 1.41K (1412) | |
- OptimizationTime: 106.188ms | |
- PeakMemoryUsage: 706.00 KB (722944) | |
- PrepareTime: 29.551ms | |
AGGREGATION_NODE (id=3):(Total: 3s054ms, non-child: 2s150ms, % non-child: 70.39%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 862.689us | |
- GetResultsTime: 101.697ms | |
- HTResizeTime: 203.959ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 524.23 MB (549690076) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 35.27 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 3.77M (3768829) | |
- RowsReturnedRate: 1.23 M/sec | |
- StreamingTime: 2s025ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=2):(Total: 904.465ms, non-child: 904.465ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:21/2.18 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 21 out of 21 | |
Runtime filters: Only following filters arrived: , waited 824ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
File Formats: PARQUET/SNAPPY:42 | |
BytesRead(500.000ms): 0, 0, 121.14 MB, 201.53 MB, 240.47 MB, 280.98 MB | |
- FooterProcessingTime: (Avg: 14.390ms ; Min: 3.177ms ; Max: 49.657ms ; Number of samples: 21) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.50 | |
- BytesRead: 280.98 MB (294628359) | |
- BytesReadDataNodeCache: 274.50 MB (287832965) | |
- BytesReadLocal: 280.98 MB (294628359) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 280.98 MB (294628359) | |
- DecompressionTime: 623.473ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 2 (2) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 21 (21) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 40.00 MB (41940953) | |
- PerReadThreadRawHdfsThroughput: 34.37 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 39.985ms | |
- RowBatchQueuePutWaitTime: 15s263ms | |
- RowsRead: 8.99M (8989956) | |
- RowsReturned: 8.99M (8989956) | |
- RowsReturnedRate: 9.94 M/sec | |
- ScanRangesComplete: 21 (21) | |
- ScannerThreadsInvoluntaryContextSwitches: 12 (12) | |
- ScannerThreadsTotalWallClockTime: 21s369ms | |
- MaterializeTupleTime(*): 474.319ms | |
- ScannerThreadsSysTime: 132.000ms | |
- ScannerThreadsUserTime: 1s400ms | |
- ScannerThreadsVoluntaryContextSwitches: 9.35K (9350) | |
- TotalRawHdfsReadTime(*): 7.984ms | |
- TotalReadThroughput: 93.66 MB/sec | |
Filter 0 (16.00 MB): | |
- Rows processed: 0 (0) | |
- Rows rejected: 0 (0) | |
- Rows total: 8.99M (8989956) | |
Instance 514ee9ab39cdc507:1a (host=cdh12.net.cuberonlabs.com:22000):(Total: 4s984ms, non-child: 964.882ms, % non-child: 19.36%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:20/1.81 GB | |
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 189.46 MB, 207.86 MB, 364.91 MB, 395.96 MB, 319.98 MB, 221.84 MB, 148.16 MB, 49.93 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 3, 1, 1, 1, 1 | |
- AverageThreadTokens: 4.80 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 411.53 MB (431523752) | |
- PerHostPeakMemUsage: 1.12 GB (1201773720) | |
- RowsProduced: 3.19M (3190684) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 6.693ms | |
- TotalStorageWaitTime: 63.199ms | |
- TotalThreadsInvoluntaryContextSwitches: 24 (24) | |
- TotalThreadsTotalWallClockTime: 24s305ms | |
- TotalThreadsSysTime: 452.000ms | |
- TotalThreadsUserTime: 5s004ms | |
- TotalThreadsVoluntaryContextSwitches: 8.38K (8377) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 4s788ms | |
- ExecTreeExecTime: 2s788ms | |
- OpenTime: 157.083ms | |
- ExecTreeOpenTime: 36.913us | |
- PrepareTime: 38.783ms | |
- ExecTreePrepareTime: 727.872us | |
DataStreamSender (dst_id=24):(Total: 1s041ms, non-child: 1s041ms, % non-child: 100.00%) | |
- BytesSent: 169.57 MB (177809606) | |
- NetworkThroughput(*): 583.62 MB/sec | |
- OverallThroughput: 162.75 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 3.19M (3190684) | |
- SerializeBatchTime: 750.814ms | |
- TransmitDataRPCTime: 290.551ms | |
- UncompressedRowBatchSize: 265.21 MB (278094165) | |
CodeGen:(Total: 189.793ms, non-child: 189.793ms, % non-child: 100.00%) | |
- CodegenTime: 3.885ms | |
- CompileTime: 40.538ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 73 (73) | |
- NumInstructions: 1.41K (1412) | |
- OptimizationTime: 115.174ms | |
- PeakMemoryUsage: 706.00 KB (722944) | |
- PrepareTime: 33.274ms | |
AGGREGATION_NODE (id=3):(Total: 2s788ms, non-child: 1s896ms, % non-child: 68.03%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 1.600ms | |
- GetResultsTime: 107.466ms | |
- HTResizeTime: 200.247ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 397.14 MB (416431198) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 37.14 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 3.19M (3190684) | |
- RowsReturnedRate: 1.14 M/sec | |
- StreamingTime: 1s761ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=2):(Total: 891.434ms, non-child: 891.434ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:20/1.81 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 20 out of 20 | |
Runtime filters: Only following filters arrived: , waited 823ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
File Formats: PARQUET/SNAPPY:40 | |
BytesRead(500.000ms): 0, 0, 106.77 MB, 133.53 MB, 232.35 MB, 232.35 MB | |
- FooterProcessingTime: (Avg: 16.666ms ; Min: 3.441ms ; Max: 56.684ms ; Number of samples: 20) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.33 | |
- BytesRead: 232.35 MB (243633322) | |
- BytesReadDataNodeCache: 226.18 MB (237164635) | |
- BytesReadLocal: 232.35 MB (243633322) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 232.35 MB (243633322) | |
- DecompressionTime: 560.666ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 2 (2) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 20 (20) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 39.91 MB (41851230) | |
- PerReadThreadRawHdfsThroughput: 26.51 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 31.226ms | |
- RowBatchQueuePutWaitTime: 12s978ms | |
- RowsRead: 7.62M (7619211) | |
- RowsReturned: 7.62M (7619211) | |
- RowsReturnedRate: 8.55 M/sec | |
- ScanRangesComplete: 20 (20) | |
- ScannerThreadsInvoluntaryContextSwitches: 18 (18) | |
- ScannerThreadsTotalWallClockTime: 19s359ms | |
- MaterializeTupleTime(*): 438.491ms | |
- ScannerThreadsSysTime: 188.000ms | |
- ScannerThreadsUserTime: 1s208ms | |
- ScannerThreadsVoluntaryContextSwitches: 8.04K (8035) | |
- TotalRawHdfsReadTime(*): 8.557ms | |
- TotalReadThroughput: 77.45 MB/sec | |
Filter 0 (16.00 MB): | |
- Rows processed: 0 (0) | |
- Rows rejected: 0 (0) | |
- Rows total: 7.62M (7619211) | |
Instance 514ee9ab39cdc507:1b (host=cdh14.net.cuberonlabs.com:22000):(Total: 4s754ms, non-child: 763.589ms, % non-child: 16.06%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:22/2.04 GB | |
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 188.06 MB, 235.20 MB, 363.93 MB, 537.24 MB, 424.25 MB, 261.27 MB, 131.09 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 4, 1, 1, 1 | |
- AverageThreadTokens: 5.33 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 541.05 MB (567328174) | |
- PerHostPeakMemUsage: 1.44 GB (1548652528) | |
- RowsProduced: 3.53M (3531621) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 5.887ms | |
- TotalStorageWaitTime: 65.721ms | |
- TotalThreadsInvoluntaryContextSwitches: 25 (25) | |
- TotalThreadsTotalWallClockTime: 24s820ms | |
- TotalThreadsSysTime: 468.000ms | |
- TotalThreadsUserTime: 4s840ms | |
- TotalThreadsVoluntaryContextSwitches: 9.25K (9249) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 4s579ms | |
- ExecTreeExecTime: 2s826ms | |
- OpenTime: 140.412ms | |
- ExecTreeOpenTime: 31.442us | |
- PrepareTime: 34.047ms | |
- ExecTreePrepareTime: 654.852us | |
DataStreamSender (dst_id=24):(Total: 996.014ms, non-child: 996.014ms, % non-child: 100.00%) | |
- BytesSent: 186.94 MB (196019152) | |
- NetworkThroughput(*): 767.00 MB/sec | |
- OverallThroughput: 187.69 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 3.53M (3531621) | |
- SerializeBatchTime: 751.637ms | |
- TransmitDataRPCTime: 243.726ms | |
- UncompressedRowBatchSize: 293.39 MB (307646551) | |
CodeGen:(Total: 168.902ms, non-child: 168.902ms, % non-child: 100.00%) | |
- CodegenTime: 3.185ms | |
- CompileTime: 37.722ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 73 (73) | |
- NumInstructions: 1.41K (1412) | |
- OptimizationTime: 101.535ms | |
- PeakMemoryUsage: 706.00 KB (722944) | |
- PrepareTime: 28.999ms | |
AGGREGATION_NODE (id=3):(Total: 2s825ms, non-child: 1s911ms, % non-child: 67.63%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 2.061ms | |
- GetResultsTime: 101.299ms | |
- HTResizeTime: 178.163ms | |
- HashBuckets: 8.39M (8388608) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 524.27 MB (549737445) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 36.56 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 3.53M (3531621) | |
- RowsReturnedRate: 1.25 M/sec | |
- StreamingTime: 1s790ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=2):(Total: 914.697ms, non-child: 914.697ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:22/2.04 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 22 out of 22 | |
Runtime filters: Only following filters arrived: , waited 844ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:44 | |
BytesRead(500.000ms): 0, 0, 98.77 MB, 150.53 MB, 262.37 MB, 262.37 MB | |
- FooterProcessingTime: (Avg: 17.329ms ; Min: 3.535ms ; Max: 61.890ms ; Number of samples: 22) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.50 | |
- BytesRead: 262.37 MB (275119793) | |
- BytesReadDataNodeCache: 255.59 MB (268003604) | |
- BytesReadLocal: 262.37 MB (275119793) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 262.37 MB (275119793) | |
- DecompressionTime: 591.515ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 2 (2) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 22 (22) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 37.00 MB (38802289) | |
- PerReadThreadRawHdfsThroughput: 31.19 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 35.725ms | |
- RowBatchQueuePutWaitTime: 13s591ms | |
- RowsRead: 8.55M (8554292) | |
- RowsReturned: 8.55M (8554292) | |
- RowsReturnedRate: 9.35 M/sec | |
- ScanRangesComplete: 22 (22) | |
- ScannerThreadsInvoluntaryContextSwitches: 19 (19) | |
- ScannerThreadsTotalWallClockTime: 20s100ms | |
- MaterializeTupleTime(*): 451.485ms | |
- ScannerThreadsSysTime: 184.000ms | |
- ScannerThreadsUserTime: 1s292ms | |
- ScannerThreadsVoluntaryContextSwitches: 8.96K (8964) | |
- TotalRawHdfsReadTime(*): 8.214ms | |
- TotalReadThroughput: 87.46 MB/sec | |
Filter 0 (16.00 MB): | |
- Rows processed: 0 (0) | |
- Rows rejected: 0 (0) | |
- Rows total: 8.55M (8554292) | |
Averaged Fragment F07:(Total: 2s966ms, non-child: 27.803ms, % non-child: 0.94%) | |
split sizes: min: 0, max: 0, avg: 0, stddev: 0 | |
completion times: min:2s952ms max:2s985ms mean: 2s968ms stddev:8.135ms | |
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec | |
num instances: 17 | |
- AverageThreadTokens: 1.08 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 39.41 MB (41320558) | |
- PerHostPeakMemUsage: 1.37 GB (1470385006) | |
- RowsProduced: 30.48K (30477) | |
- TotalNetworkReceiveTime: 2s291ms | |
- TotalNetworkSendTime: 7.033ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 11 (11) | |
- TotalThreadsTotalWallClockTime: 3s184ms | |
- TotalThreadsSysTime: 97.176ms | |
- TotalThreadsUserTime: 824.705ms | |
- TotalThreadsVoluntaryContextSwitches: 4.76K (4763) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s886ms | |
- ExecTreeExecTime: 1s844ms | |
- OpenTime: 1s036ms | |
- ExecTreeOpenTime: 578.883ms | |
- PrepareTime: 43.735ms | |
- ExecTreePrepareTime: 902.610us | |
DataStreamSender (dst_id=33):(Total: 23.849ms, non-child: 23.849ms, % non-child: 100.00%) | |
- BytesSent: 1.64 MB (1714946) | |
- NetworkThroughput(*): 350.81 MB/sec | |
- OverallThroughput: 70.89 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 30.48K (30477) | |
- SerializeBatchTime: 17.697ms | |
- TransmitDataRPCTime: 6.039ms | |
- UncompressedRowBatchSize: 2.50 MB (2624015) | |
CodeGen:(Total: 490.489ms, non-child: 490.489ms, % non-child: 100.00%) | |
- CodegenTime: 2.622ms | |
- CompileTime: 159.638ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 92 (92) | |
- NumInstructions: 3.46K (3457) | |
- OptimizationTime: 296.559ms | |
- PeakMemoryUsage: 1.69 MB (1769984) | |
- PrepareTime: 33.520ms | |
AGGREGATION_NODE (id=8):(Total: 2s424ms, non-child: 94.774ms, % non-child: 3.91%) | |
- GetNewBlockTime: 273.734us | |
- GetResultsTime: 7.431ms | |
- HTResizeTime: 1.224ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 12.95 MB (13574479) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 493.19 | |
- ReductionFactorThresholdToExpand: 1.10 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 30.48K (30477) | |
- RowsReturnedRate: 12.57 K/sec | |
- StreamingTime: 84.499ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=7):(Total: 2s329ms, non-child: 215.970ms, % non-child: 9.27%) | |
- BuildRows: 30.48K (30477) | |
- BuildTime: 40.337ms | |
- PeakMemoryUsage: 10.18 MB (10672922) | |
- ProbeRows: 2.22M (2221711) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 209.383ms | |
- RowsReturned: 80.29K (80293) | |
- RowsReturnedRate: 34.47 K/sec | |
Hash Join Builder (join_node_id=7): | |
- BuildRowsPartitionTime: 12.663ms | |
- BuildRowsPartitioned: 30.48K (30477) | |
- GetNewBlockTime: 118.710us | |
- HashBuckets: 65.54K (65536) | |
- HashCollisions: 16 (16) | |
- HashTablesBuildTime: 2.243ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 10.04 MB (10524800) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=32):(Total: 220.756ms, non-child: 220.756ms, % non-child: 100.00%) | |
- BytesReceived: 1.38 MB (1450005) | |
- ConvertRowBatchTime: 621.766us | |
- DeserializeRowBatchTimer: 3.458ms | |
- FirstBatchArrivalWaitTime: 204.616ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.48K (30477) | |
- RowsReturnedRate: 143.18 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=31):(Total: 2s113ms, non-child: 2s113ms, % non-child: 100.00%) | |
- BytesReceived: 102.14 MB (107102132) | |
- ConvertRowBatchTime: 37.430ms | |
- DeserializeRowBatchTimer: 327.855ms | |
- FirstBatchArrivalWaitTime: 573.711ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.22M (2221711) | |
- RowsReturnedRate: 1.05 M/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Fragment F07: | |
Instance 514ee9ab39cdc507:6f (host=cdh12.net.cuberonlabs.com:22000):(Total: 2s983ms, non-child: 35.194ms, % non-child: 1.18%) | |
MemoryUsage(500.000ms): 3.11 MB, 27.43 MB, 29.10 MB, 37.21 MB, 38.50 MB, 38.49 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 39.42 MB (41331426) | |
- PerHostPeakMemUsage: 1.12 GB (1201773720) | |
- RowsProduced: 30.45K (30454) | |
- TotalNetworkReceiveTime: 2s312ms | |
- TotalNetworkSendTime: 10.475ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 5 (5) | |
- TotalThreadsTotalWallClockTime: 3s255ms | |
- TotalThreadsSysTime: 132.000ms | |
- TotalThreadsUserTime: 844.000ms | |
- TotalThreadsVoluntaryContextSwitches: 4.07K (4074) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s903ms | |
- ExecTreeExecTime: 1s849ms | |
- OpenTime: 1s040ms | |
- ExecTreeOpenTime: 625.245ms | |
- PrepareTime: 39.425ms | |
- ExecTreePrepareTime: 1.035ms | |
DataStreamSender (dst_id=33):(Total: 28.108ms, non-child: 28.108ms, % non-child: 100.00%) | |
- BytesSent: 1.63 MB (1713708) | |
- NetworkThroughput(*): 211.21 MB/sec | |
- OverallThroughput: 58.14 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 30.45K (30454) | |
- SerializeBatchTime: 20.282ms | |
- TransmitDataRPCTime: 7.737ms | |
- UncompressedRowBatchSize: 2.50 MB (2621294) | |
CodeGen:(Total: 444.784ms, non-child: 444.784ms, % non-child: 100.00%) | |
- CodegenTime: 2.481ms | |
- CompileTime: 142.221ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 92 (92) | |
- NumInstructions: 3.46K (3457) | |
- OptimizationTime: 272.036ms | |
- PeakMemoryUsage: 1.69 MB (1769984) | |
- PrepareTime: 29.836ms | |
AGGREGATION_NODE (id=8):(Total: 2s475ms, non-child: 120.072ms, % non-child: 4.85%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 285.988us | |
- GetResultsTime: 8.745ms | |
- HTResizeTime: 1.492ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 12.91 MB (13536008) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 507.78 | |
- ReductionFactorThresholdToExpand: 1.10 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 30.45K (30454) | |
- RowsReturnedRate: 12.30 K/sec | |
- StreamingTime: 106.358ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=7):(Total: 2s355ms, non-child: 249.557ms, % non-child: 10.59%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 30.45K (30454) | |
- BuildTime: 52.401ms | |
- PeakMemoryUsage: 10.18 MB (10672623) | |
- ProbeRows: 2.22M (2219305) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 242.245ms | |
- RowsReturned: 80.25K (80255) | |
- RowsReturnedRate: 34.07 K/sec | |
Hash Join Builder (join_node_id=7): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 2 of 2 Runtime Filters Published | |
- BuildRowsPartitionTime: 17.487ms | |
- BuildRowsPartitioned: 30.45K (30454) | |
- GetNewBlockTime: 187.828us | |
- HashBuckets: 65.54K (65536) | |
- HashCollisions: 13 (13) | |
- HashTablesBuildTime: 2.395ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 10.04 MB (10524800) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=32):(Total: 258.931ms, non-child: 965.917us, % non-child: 0.37%) | |
BytesReceived(500.000ms): 0, 1.38 MB, 1.38 MB, 1.38 MB, 1.38 MB, 1.38 MB | |
- BytesReceived: 1.38 MB (1448552) | |
- ConvertRowBatchTime: 674.361us | |
- DeserializeRowBatchTimer: 3.699ms | |
- FirstBatchArrivalWaitTime: 250.269ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.45K (30454) | |
- RowsReturnedRate: 117.61 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=31):(Total: 2s106ms, non-child: 188.042ms, % non-child: 8.93%) | |
BytesReceived(500.000ms): 0, 0, 17.71 MB, 54.33 MB, 88.40 MB, 101.64 MB | |
- BytesReceived: 102.00 MB (106953299) | |
- ConvertRowBatchTime: 45.184ms | |
- DeserializeRowBatchTimer: 396.517ms | |
- FirstBatchArrivalWaitTime: 621.685ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.22M (2219305) | |
- RowsReturnedRate: 1.05 M/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:73 (host=cdh7.net.cuberonlabs.com:22000):(Total: 2s980ms, non-child: 31.169ms, % non-child: 1.05%) | |
MemoryUsage(500.000ms): 3.11 MB, 1.43 MB, 28.89 MB, 37.43 MB, 37.79 MB, 39.04 MB | |
ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.17 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 39.65 MB (41572331) | |
- PerHostPeakMemUsage: 1.27 GB (1366441402) | |
- RowsProduced: 30.51K (30512) | |
- TotalNetworkReceiveTime: 2s208ms | |
- TotalNetworkSendTime: 11.683ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 24 (24) | |
- TotalThreadsTotalWallClockTime: 3s167ms | |
- TotalThreadsSysTime: 108.000ms | |
- TotalThreadsUserTime: 872.000ms | |
- TotalThreadsVoluntaryContextSwitches: 4.35K (4346) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s900ms | |
- ExecTreeExecTime: 1s849ms | |
- OpenTime: 1s034ms | |
- ExecTreeOpenTime: 550.687ms | |
- PrepareTime: 45.386ms | |
- ExecTreePrepareTime: 1.063ms | |
DataStreamSender (dst_id=33):(Total: 31.614ms, non-child: 31.614ms, % non-child: 100.00%) | |
- BytesSent: 1.64 MB (1716874) | |
- NetworkThroughput(*): 139.74 MB/sec | |
- OverallThroughput: 51.79 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 30.51K (30512) | |
- SerializeBatchTime: 19.776ms | |
- TransmitDataRPCTime: 11.717ms | |
- UncompressedRowBatchSize: 2.51 MB (2627053) | |
CodeGen:(Total: 517.098ms, non-child: 517.098ms, % non-child: 100.00%) | |
- CodegenTime: 2.649ms | |
- CompileTime: 172.820ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 92 (92) | |
- NumInstructions: 3.46K (3457) | |
- OptimizationTime: 309.349ms | |
- PeakMemoryUsage: 1.69 MB (1769984) | |
- PrepareTime: 34.149ms | |
AGGREGATION_NODE (id=8):(Total: 2s400ms, non-child: 109.245ms, % non-child: 4.55%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 546.682us | |
- GetResultsTime: 7.792ms | |
- HTResizeTime: 1.221ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 12.97 MB (13598820) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 488.31 | |
- ReductionFactorThresholdToExpand: 1.10 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 30.51K (30512) | |
- RowsReturnedRate: 12.71 K/sec | |
- StreamingTime: 98.650ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=7):(Total: 2s291ms, non-child: 235.613ms, % non-child: 10.28%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 30.51K (30512) | |
- BuildTime: 30.334ms | |
- PeakMemoryUsage: 10.18 MB (10671130) | |
- ProbeRows: 2.22M (2222535) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 228.284ms | |
- RowsReturned: 80.08K (80085) | |
- RowsReturnedRate: 34.95 K/sec | |
Hash Join Builder (join_node_id=7): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 2 of 2 Runtime Filters Published | |
- BuildRowsPartitionTime: 10.137ms | |
- BuildRowsPartitioned: 30.51K (30512) | |
- GetNewBlockTime: 206.168us | |
- HashBuckets: 65.54K (65536) | |
- HashCollisions: 13 (13) | |
- HashTablesBuildTime: 1.901ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 10.04 MB (10524800) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=32):(Total: 202.204ms, non-child: 1.351ms, % non-child: 0.67%) | |
BytesReceived(500.000ms): 0, 0, 1.38 MB, 1.38 MB, 1.38 MB, 1.38 MB | |
- BytesReceived: 1.38 MB (1451153) | |
- ConvertRowBatchTime: 599.862us | |
- DeserializeRowBatchTimer: 4.201ms | |
- FirstBatchArrivalWaitTime: 176.581ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.51K (30512) | |
- RowsReturnedRate: 150.90 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=31):(Total: 2s055ms, non-child: 176.233ms, % non-child: 8.57%) | |
BytesReceived(500.000ms): 0, 0, 908.46 KB, 40.15 MB, 76.13 MB, 100.01 MB | |
- BytesReceived: 102.17 MB (107131219) | |
- ConvertRowBatchTime: 43.212ms | |
- DeserializeRowBatchTimer: 363.159ms | |
- FirstBatchArrivalWaitTime: 545.607ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.22M (2222535) | |
- RowsReturnedRate: 1.08 M/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:77 (host=cdh10.net.cuberonlabs.com:22000):(Total: 2s978ms, non-child: 26.323ms, % non-child: 0.88%) | |
MemoryUsage(500.000ms): 1.42 MB, 27.43 MB, 29.05 MB, 37.71 MB, 38.18 MB, 25.31 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 39.41 MB (41321127) | |
- PerHostPeakMemUsage: 1.50 GB (1609929093) | |
- RowsProduced: 30.21K (30212) | |
- TotalNetworkReceiveTime: 2s264ms | |
- TotalNetworkSendTime: 10.286ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 37 (37) | |
- TotalThreadsTotalWallClockTime: 3s153ms | |
- TotalThreadsSysTime: 84.000ms | |
- TotalThreadsUserTime: 824.000ms | |
- TotalThreadsVoluntaryContextSwitches: 4.82K (4815) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s899ms | |
- ExecTreeExecTime: 1s851ms | |
- OpenTime: 1s025ms | |
- ExecTreeOpenTime: 544.048ms | |
- PrepareTime: 53.815ms | |
- ExecTreePrepareTime: 685.104us | |
DataStreamSender (dst_id=33):(Total: 31.816ms, non-child: 31.816ms, % non-child: 100.00%) | |
- BytesSent: 1.62 MB (1700254) | |
- NetworkThroughput(*): 111.70 MB/sec | |
- OverallThroughput: 50.96 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 30.21K (30212) | |
- SerializeBatchTime: 17.177ms | |
- TransmitDataRPCTime: 14.516ms | |
- UncompressedRowBatchSize: 2.48 MB (2601300) | |
CodeGen:(Total: 523.822ms, non-child: 523.822ms, % non-child: 100.00%) | |
- CodegenTime: 2.630ms | |
- CompileTime: 168.023ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 92 (92) | |
- NumInstructions: 3.46K (3457) | |
- OptimizationTime: 311.675ms | |
- PeakMemoryUsage: 1.69 MB (1769984) | |
- PrepareTime: 43.329ms | |
AGGREGATION_NODE (id=8):(Total: 2s396ms, non-child: 88.317ms, % non-child: 3.69%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 263.153us | |
- GetResultsTime: 6.886ms | |
- HTResizeTime: 1.262ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 12.91 MB (13535346) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 489.00 | |
- ReductionFactorThresholdToExpand: 1.10 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 30.21K (30212) | |
- RowsReturnedRate: 12.61 K/sec | |
- StreamingTime: 77.301ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=7):(Total: 2s308ms, non-child: 196.657ms, % non-child: 8.52%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 30.21K (30212) | |
- BuildTime: 36.148ms | |
- PeakMemoryUsage: 10.18 MB (10673640) | |
- ProbeRows: 2.22M (2220659) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 189.982ms | |
- RowsReturned: 79.68K (79683) | |
- RowsReturnedRate: 34.52 K/sec | |
Hash Join Builder (join_node_id=7): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 2 of 2 Runtime Filters Published | |
- BuildRowsPartitionTime: 12.053ms | |
- BuildRowsPartitioned: 30.21K (30212) | |
- GetNewBlockTime: 143.058us | |
- HashBuckets: 65.54K (65536) | |
- HashCollisions: 16 (16) | |
- HashTablesBuildTime: 1.729ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 10.04 MB (10524800) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=32):(Total: 192.874ms, non-child: 955.647us, % non-child: 0.50%) | |
BytesReceived(500.000ms): 0, 1.37 MB, 1.37 MB, 1.37 MB, 1.37 MB | |
- BytesReceived: 1.37 MB (1436465) | |
- ConvertRowBatchTime: 444.991us | |
- DeserializeRowBatchTimer: 3.103ms | |
- FirstBatchArrivalWaitTime: 171.504ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.21K (30212) | |
- RowsReturnedRate: 156.64 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=31):(Total: 2s111ms, non-child: 116.822ms, % non-child: 5.53%) | |
BytesReceived(500.000ms): 0, 0, 27.04 MB, 63.31 MB, 94.31 MB | |
- BytesReceived: 102.09 MB (107047423) | |
- ConvertRowBatchTime: 34.099ms | |
- DeserializeRowBatchTimer: 295.502ms | |
- FirstBatchArrivalWaitTime: 540.398ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.22M (2220659) | |
- RowsReturnedRate: 1.05 M/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:76 (host=cdh9.net.cuberonlabs.com:22000):(Total: 2s972ms, non-child: 28.817ms, % non-child: 0.97%) | |
MemoryUsage(500.000ms): 3.11 MB, 1.43 MB, 27.74 MB, 31.87 MB, 38.06 MB, 38.92 MB | |
ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.17 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 39.38 MB (41295369) | |
- PerHostPeakMemUsage: 1.49 GB (1603367675) | |
- RowsProduced: 30.39K (30392) | |
- TotalNetworkReceiveTime: 2s349ms | |
- TotalNetworkSendTime: 5.488ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 2 (2) | |
- TotalThreadsTotalWallClockTime: 3s220ms | |
- TotalThreadsSysTime: 96.000ms | |
- TotalThreadsUserTime: 804.000ms | |
- TotalThreadsVoluntaryContextSwitches: 4.93K (4934) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s891ms | |
- ExecTreeExecTime: 1s851ms | |
- OpenTime: 1s038ms | |
- ExecTreeOpenTime: 601.403ms | |
- PrepareTime: 42.514ms | |
- ExecTreePrepareTime: 787.627us | |
DataStreamSender (dst_id=33):(Total: 21.350ms, non-child: 21.350ms, % non-child: 100.00%) | |
- BytesSent: 1.63 MB (1709536) | |
- NetworkThroughput(*): 522.57 MB/sec | |
- OverallThroughput: 76.36 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 30.39K (30392) | |
- SerializeBatchTime: 18.125ms | |
- TransmitDataRPCTime: 3.119ms | |
- UncompressedRowBatchSize: 2.50 MB (2616790) | |
CodeGen:(Total: 468.706ms, non-child: 468.706ms, % non-child: 100.00%) | |
- CodegenTime: 3.113ms | |
- CompileTime: 151.534ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 92 (92) | |
- NumInstructions: 3.46K (3457) | |
- OptimizationTime: 284.076ms | |
- PeakMemoryUsage: 1.69 MB (1769984) | |
- PrepareTime: 32.377ms | |
AGGREGATION_NODE (id=8):(Total: 2s453ms, non-child: 93.398ms, % non-child: 3.81%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 250.447us | |
- GetResultsTime: 9.443ms | |
- HTResizeTime: 1.020ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 12.98 MB (13610763) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 488.12 | |
- ReductionFactorThresholdToExpand: 1.10 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 30.39K (30392) | |
- RowsReturnedRate: 12.39 K/sec | |
- StreamingTime: 81.369ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=7):(Total: 2s359ms, non-child: 216.624ms, % non-child: 9.18%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 30.39K (30392) | |
- BuildTime: 41.656ms | |
- PeakMemoryUsage: 10.18 MB (10674414) | |
- ProbeRows: 2.23M (2225196) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 210.449ms | |
- RowsReturned: 80.12K (80119) | |
- RowsReturnedRate: 33.95 K/sec | |
Hash Join Builder (join_node_id=7): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 2 of 2 Runtime Filters Published | |
- BuildRowsPartitionTime: 14.366ms | |
- BuildRowsPartitioned: 30.39K (30392) | |
- GetNewBlockTime: 88.421us | |
- HashBuckets: 65.54K (65536) | |
- HashCollisions: 18 (18) | |
- HashTablesBuildTime: 2.910ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 10.04 MB (10524800) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=32):(Total: 249.359ms, non-child: 1.150ms, % non-child: 0.46%) | |
BytesReceived(500.000ms): 0, 0, 1.38 MB, 1.38 MB, 1.38 MB, 1.38 MB | |
- BytesReceived: 1.38 MB (1445621) | |
- ConvertRowBatchTime: 692.829us | |
- DeserializeRowBatchTimer: 2.496ms | |
- FirstBatchArrivalWaitTime: 226.921ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.39K (30392) | |
- RowsReturnedRate: 121.88 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=31):(Total: 2s143ms, non-child: 104.342ms, % non-child: 4.87%) | |
BytesReceived(500.000ms): 0, 0, 176.58 KB, 38.96 MB, 75.01 MB, 99.86 MB | |
- BytesReceived: 102.31 MB (107277079) | |
- ConvertRowBatchTime: 37.084ms | |
- DeserializeRowBatchTimer: 299.331ms | |
- FirstBatchArrivalWaitTime: 594.240ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.23M (2225196) | |
- RowsReturnedRate: 1.04 M/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:74 (host=cdh8.net.cuberonlabs.com:22000):(Total: 2s970ms, non-child: 24.550ms, % non-child: 0.83%) | |
MemoryUsage(500.000ms): 1.42 MB, 27.43 MB, 29.94 MB, 37.59 MB, 38.24 MB, 24.55 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 39.38 MB (41290613) | |
- PerHostPeakMemUsage: 1.35 GB (1451309932) | |
- RowsProduced: 30.64K (30637) | |
- TotalNetworkReceiveTime: 2s192ms | |
- TotalNetworkSendTime: 8.395ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 13 (13) | |
- TotalThreadsTotalWallClockTime: 3s124ms | |
- TotalThreadsSysTime: 104.000ms | |
- TotalThreadsUserTime: 852.000ms | |
- TotalThreadsVoluntaryContextSwitches: 4.60K (4603) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s888ms | |
- ExecTreeExecTime: 1s845ms | |
- OpenTime: 1s039ms | |
- ExecTreeOpenTime: 513.413ms | |
- PrepareTime: 41.741ms | |
- ExecTreePrepareTime: 688.639us | |
DataStreamSender (dst_id=33):(Total: 28.046ms, non-child: 28.046ms, % non-child: 100.00%) | |
- BytesSent: 1.64 MB (1723410) | |
- NetworkThroughput(*): 138.69 MB/sec | |
- OverallThroughput: 58.60 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 30.64K (30637) | |
- SerializeBatchTime: 16.069ms | |
- TransmitDataRPCTime: 11.850ms | |
- UncompressedRowBatchSize: 2.51 MB (2636627) | |
CodeGen:(Total: 557.655ms, non-child: 557.655ms, % non-child: 100.00%) | |
- CodegenTime: 2.547ms | |
- CompileTime: 153.366ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 92 (92) | |
- NumInstructions: 3.46K (3457) | |
- OptimizationTime: 371.642ms | |
- PeakMemoryUsage: 1.69 MB (1769984) | |
- PrepareTime: 31.909ms | |
AGGREGATION_NODE (id=8):(Total: 2s359ms, non-child: 92.248ms, % non-child: 3.91%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 174.054us | |
- GetResultsTime: 6.990ms | |
- HTResizeTime: 1.303ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 12.97 MB (13598349) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 507.14 | |
- ReductionFactorThresholdToExpand: 1.10 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 30.64K (30637) | |
- RowsReturnedRate: 12.98 K/sec | |
- StreamingTime: 82.869ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=7):(Total: 2s267ms, non-child: 192.684ms, % non-child: 8.50%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 30.64K (30637) | |
- BuildTime: 38.681ms | |
- PeakMemoryUsage: 10.18 MB (10672226) | |
- ProbeRows: 2.23M (2225622) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 186.720ms | |
- RowsReturned: 80.62K (80623) | |
- RowsReturnedRate: 35.55 K/sec | |
Hash Join Builder (join_node_id=7): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 2 of 2 Runtime Filters Published | |
- BuildRowsPartitionTime: 12.490ms | |
- BuildRowsPartitioned: 30.64K (30637) | |
- GetNewBlockTime: 70.096us | |
- HashBuckets: 65.54K (65536) | |
- HashCollisions: 20 (20) | |
- HashTablesBuildTime: 2.048ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 10.04 MB (10524800) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=32):(Total: 157.359ms, non-child: 1.099ms, % non-child: 0.70%) | |
BytesReceived(500.000ms): 0, 1.39 MB, 1.39 MB, 1.39 MB, 1.39 MB | |
- BytesReceived: 1.39 MB (1458127) | |
- ConvertRowBatchTime: 575.615us | |
- DeserializeRowBatchTimer: 4.810ms | |
- FirstBatchArrivalWaitTime: 138.110ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.64K (30637) | |
- RowsReturnedRate: 194.69 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=31):(Total: 2s075ms, non-child: 135.277ms, % non-child: 6.52%) | |
BytesReceived(500.000ms): 0, 0, 27.40 MB, 63.85 MB, 94.78 MB | |
- BytesReceived: 102.32 MB (107294559) | |
- ConvertRowBatchTime: 33.954ms | |
- DeserializeRowBatchTimer: 310.307ms | |
- FirstBatchArrivalWaitTime: 508.402ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.23M (2225622) | |
- RowsReturnedRate: 1.07 M/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:6d (host=cdh17.net.cuberonlabs.com:22000):(Total: 2s969ms, non-child: 28.372ms, % non-child: 0.96%) | |
MemoryUsage(500.000ms): 3.11 MB, 26.43 MB, 33.52 MB, 37.00 MB, 38.37 MB, 38.56 MB | |
ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.17 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 39.36 MB (41268705) | |
- PerHostPeakMemUsage: 1.10 GB (1185118898) | |
- RowsProduced: 30.45K (30451) | |
- TotalNetworkReceiveTime: 2s150ms | |
- TotalNetworkSendTime: 6.269ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 8 (8) | |
- TotalThreadsTotalWallClockTime: 3s127ms | |
- TotalThreadsSysTime: 124.000ms | |
- TotalThreadsUserTime: 876.000ms | |
- TotalThreadsVoluntaryContextSwitches: 4.79K (4785) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s887ms | |
- ExecTreeExecTime: 1s844ms | |
- OpenTime: 1s039ms | |
- ExecTreeOpenTime: 520.566ms | |
- PrepareTime: 43.000ms | |
- ExecTreePrepareTime: 706.144us | |
DataStreamSender (dst_id=33):(Total: 24.116ms, non-child: 24.116ms, % non-child: 100.00%) | |
- BytesSent: 1.63 MB (1713879) | |
- NetworkThroughput(*): 337.80 MB/sec | |
- OverallThroughput: 67.77 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 30.45K (30451) | |
- SerializeBatchTime: 19.180ms | |
- TransmitDataRPCTime: 4.838ms | |
- UncompressedRowBatchSize: 2.50 MB (2620432) | |
CodeGen:(Total: 551.112ms, non-child: 551.112ms, % non-child: 100.00%) | |
- CodegenTime: 2.572ms | |
- CompileTime: 211.324ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 92 (92) | |
- NumInstructions: 3.46K (3457) | |
- OptimizationTime: 305.390ms | |
- PeakMemoryUsage: 1.69 MB (1769984) | |
- PrepareTime: 33.610ms | |
AGGREGATION_NODE (id=8):(Total: 2s366ms, non-child: 107.798ms, % non-child: 4.56%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 169.376us | |
- GetResultsTime: 9.531ms | |
- HTResizeTime: 1.915ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 12.97 MB (13599077) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 489.61 | |
- ReductionFactorThresholdToExpand: 1.10 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 30.45K (30451) | |
- RowsReturnedRate: 12.87 K/sec | |
- StreamingTime: 95.631ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=7):(Total: 2s258ms, non-child: 232.915ms, % non-child: 10.31%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 30.45K (30451) | |
- BuildTime: 38.008ms | |
- PeakMemoryUsage: 10.18 MB (10672398) | |
- ProbeRows: 2.23M (2225981) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 226.765ms | |
- RowsReturned: 80.37K (80366) | |
- RowsReturnedRate: 35.59 K/sec | |
Hash Join Builder (join_node_id=7): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 2 of 2 Runtime Filters Published | |
- BuildRowsPartitionTime: 11.231ms | |
- BuildRowsPartitioned: 30.45K (30451) | |
- GetNewBlockTime: 107.106us | |
- HashBuckets: 65.54K (65536) | |
- HashCollisions: 12 (12) | |
- HashTablesBuildTime: 2.191ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 10.04 MB (10524800) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=32):(Total: 162.381ms, non-child: 1.204ms, % non-child: 0.74%) | |
BytesReceived(500.000ms): 0, 1.38 MB, 1.38 MB, 1.38 MB, 1.38 MB, 1.38 MB | |
- BytesReceived: 1.38 MB (1449110) | |
- ConvertRowBatchTime: 623.585us | |
- DeserializeRowBatchTimer: 2.817ms | |
- FirstBatchArrivalWaitTime: 144.460ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.45K (30451) | |
- RowsReturnedRate: 187.53 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=31):(Total: 2s025ms, non-child: 112.257ms, % non-child: 5.54%) | |
BytesReceived(500.000ms): 0, 0, 13.73 MB, 51.05 MB, 86.28 MB, 101.82 MB | |
- BytesReceived: 102.36 MB (107334395) | |
- ConvertRowBatchTime: 32.228ms | |
- DeserializeRowBatchTimer: 331.236ms | |
- FirstBatchArrivalWaitTime: 512.864ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.23M (2225981) | |
- RowsReturnedRate: 1.10 M/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:69 (host=cdh13.net.cuberonlabs.com:22000):(Total: 2s967ms, non-child: 31.036ms, % non-child: 1.05%) | |
MemoryUsage(500.000ms): 1.42 MB, 27.43 MB, 29.37 MB, 37.95 MB, 38.75 MB, 38.63 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 39.37 MB (41279187) | |
- PerHostPeakMemUsage: 1.50 GB (1613813494) | |
- RowsProduced: 30.80K (30796) | |
- TotalNetworkReceiveTime: 2s303ms | |
- TotalNetworkSendTime: 7.548ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 1 (1) | |
- TotalThreadsTotalWallClockTime: 3s204ms | |
- TotalThreadsSysTime: 76.000ms | |
- TotalThreadsUserTime: 852.000ms | |
- TotalThreadsVoluntaryContextSwitches: 4.86K (4860) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s887ms | |
- ExecTreeExecTime: 1s843ms | |
- OpenTime: 1s037ms | |
- ExecTreeOpenTime: 600.651ms | |
- PrepareTime: 43.277ms | |
- ExecTreePrepareTime: 1.108ms | |
DataStreamSender (dst_id=33):(Total: 23.022ms, non-child: 23.022ms, % non-child: 100.00%) | |
- BytesSent: 1.65 MB (1732465) | |
- NetworkThroughput(*): 449.35 MB/sec | |
- OverallThroughput: 71.77 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 30.80K (30796) | |
- SerializeBatchTime: 19.248ms | |
- TransmitDataRPCTime: 3.676ms | |
- UncompressedRowBatchSize: 2.53 MB (2651835) | |
CodeGen:(Total: 468.832ms, non-child: 468.832ms, % non-child: 100.00%) | |
- CodegenTime: 2.786ms | |
- CompileTime: 151.129ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 92 (92) | |
- NumInstructions: 3.46K (3457) | |
- OptimizationTime: 283.926ms | |
- PeakMemoryUsage: 1.69 MB (1769984) | |
- PrepareTime: 33.035ms | |
AGGREGATION_NODE (id=8):(Total: 2s445ms, non-child: 94.538ms, % non-child: 3.87%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 288.966us | |
- GetResultsTime: 8.473ms | |
- HTResizeTime: 1.222ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 12.87 MB (13492702) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 459.35 | |
- ReductionFactorThresholdToExpand: 1.10 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 30.80K (30796) | |
- RowsReturnedRate: 12.60 K/sec | |
- StreamingTime: 83.268ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=7):(Total: 2s350ms, non-child: 244.000ms, % non-child: 10.38%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 30.80K (30796) | |
- BuildTime: 40.088ms | |
- PeakMemoryUsage: 10.18 MB (10672710) | |
- ProbeRows: 2.22M (2221369) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 238.332ms | |
- RowsReturned: 81.12K (81118) | |
- RowsReturnedRate: 34.51 K/sec | |
Hash Join Builder (join_node_id=7): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 2 of 2 Runtime Filters Published | |
- BuildRowsPartitionTime: 11.161ms | |
- BuildRowsPartitioned: 30.80K (30796) | |
- GetNewBlockTime: 75.297us | |
- HashBuckets: 65.54K (65536) | |
- HashCollisions: 14 (14) | |
- HashTablesBuildTime: 2.371ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 10.04 MB (10524800) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=32):(Total: 239.861ms, non-child: 1.338ms, % non-child: 0.56%) | |
BytesReceived(500.000ms): 0, 1.40 MB, 1.40 MB, 1.40 MB, 1.40 MB, 1.40 MB | |
- BytesReceived: 1.40 MB (1464999) | |
- ConvertRowBatchTime: 681.921us | |
- DeserializeRowBatchTimer: 3.775ms | |
- FirstBatchArrivalWaitTime: 227.543ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.80K (30796) | |
- RowsReturnedRate: 128.39 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=31):(Total: 2s106ms, non-child: 113.355ms, % non-child: 5.38%) | |
BytesReceived(500.000ms): 0, 0, 20.26 MB, 56.73 MB, 90.06 MB, 101.90 MB | |
- BytesReceived: 102.13 MB (107087612) | |
- ConvertRowBatchTime: 37.613ms | |
- DeserializeRowBatchTimer: 328.882ms | |
- FirstBatchArrivalWaitTime: 596.439ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.22M (2221369) | |
- RowsReturnedRate: 1.05 M/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:75 (host=cdh11.net.cuberonlabs.com:22000):(Total: 2s967ms, non-child: 26.435ms, % non-child: 0.89%) | |
MemoryUsage(500.000ms): 1.42 MB, 27.43 MB, 30.27 MB, 38.27 MB, 38.50 MB, 16.20 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 39.48 MB (41393865) | |
- PerHostPeakMemUsage: 1.39 GB (1494361848) | |
- RowsProduced: 30.28K (30279) | |
- TotalNetworkReceiveTime: 2s338ms | |
- TotalNetworkSendTime: 5.763ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 8 (8) | |
- TotalThreadsTotalWallClockTime: 3s208ms | |
- TotalThreadsSysTime: 92.000ms | |
- TotalThreadsUserTime: 820.000ms | |
- TotalThreadsVoluntaryContextSwitches: 4.80K (4798) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s886ms | |
- ExecTreeExecTime: 1s846ms | |
- OpenTime: 1s047ms | |
- ExecTreeOpenTime: 593.390ms | |
- PrepareTime: 33.968ms | |
- ExecTreePrepareTime: 644.360us | |
DataStreamSender (dst_id=33):(Total: 21.835ms, non-child: 21.835ms, % non-child: 100.00%) | |
- BytesSent: 1.63 MB (1703990) | |
- NetworkThroughput(*): 455.69 MB/sec | |
- OverallThroughput: 74.42 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 30.28K (30279) | |
- SerializeBatchTime: 18.152ms | |
- TransmitDataRPCTime: 3.566ms | |
- UncompressedRowBatchSize: 2.49 MB (2607517) | |
CodeGen:(Total: 478.869ms, non-child: 478.869ms, % non-child: 100.00%) | |
- CodegenTime: 1.905ms | |
- CompileTime: 159.109ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 92 (92) | |
- NumInstructions: 3.46K (3457) | |
- OptimizationTime: 293.394ms | |
- PeakMemoryUsage: 1.69 MB (1769984) | |
- PrepareTime: 25.577ms | |
AGGREGATION_NODE (id=8):(Total: 2s440ms, non-child: 92.371ms, % non-child: 3.78%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 138.138us | |
- GetResultsTime: 6.939ms | |
- HTResizeTime: 1.259ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 12.97 MB (13596213) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 493.14 | |
- ReductionFactorThresholdToExpand: 1.10 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 30.28K (30279) | |
- RowsReturnedRate: 12.41 K/sec | |
- StreamingTime: 83.104ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=7):(Total: 2s348ms, non-child: 204.501ms, % non-child: 8.71%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 30.28K (30279) | |
- BuildTime: 35.435ms | |
- PeakMemoryUsage: 10.18 MB (10676080) | |
- ProbeRows: 2.23M (2225047) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 197.410ms | |
- RowsReturned: 79.26K (79259) | |
- RowsReturnedRate: 33.75 K/sec | |
Hash Join Builder (join_node_id=7): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 2 of 2 Runtime Filters Published | |
- BuildRowsPartitionTime: 13.984ms | |
- BuildRowsPartitioned: 30.28K (30279) | |
- GetNewBlockTime: 118.992us | |
- HashBuckets: 65.54K (65536) | |
- HashCollisions: 24 (24) | |
- HashTablesBuildTime: 2.030ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 10.04 MB (10524800) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=32):(Total: 239.193ms, non-child: 1.216ms, % non-child: 0.51%) | |
BytesReceived(500.000ms): 0, 1.37 MB, 1.37 MB, 1.37 MB, 1.37 MB | |
- BytesReceived: 1.37 MB (1440841) | |
- ConvertRowBatchTime: 645.092us | |
- DeserializeRowBatchTimer: 3.021ms | |
- FirstBatchArrivalWaitTime: 217.382ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.28K (30279) | |
- RowsReturnedRate: 126.59 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=31):(Total: 2s143ms, non-child: 124.041ms, % non-child: 5.79%) | |
BytesReceived(500.000ms): 0, 0, 29.91 MB, 66.31 MB, 96.22 MB | |
- BytesReceived: 102.30 MB (107266213) | |
- ConvertRowBatchTime: 38.443ms | |
- DeserializeRowBatchTimer: 328.696ms | |
- FirstBatchArrivalWaitTime: 588.857ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.23M (2225047) | |
- RowsReturnedRate: 1.04 M/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:70 (host=cdh14.net.cuberonlabs.com:22000):(Total: 2s966ms, non-child: 26.525ms, % non-child: 0.89%) | |
MemoryUsage(500.000ms): 1.42 MB, 27.43 MB, 30.15 MB, 38.39 MB, 38.27 MB, 37.41 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 39.44 MB (41351762) | |
- PerHostPeakMemUsage: 1.44 GB (1548652528) | |
- RowsProduced: 30.57K (30571) | |
- TotalNetworkReceiveTime: 2s322ms | |
- TotalNetworkSendTime: 6.246ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 3 (3) | |
- TotalThreadsTotalWallClockTime: 3s232ms | |
- TotalThreadsSysTime: 76.000ms | |
- TotalThreadsUserTime: 868.000ms | |
- TotalThreadsVoluntaryContextSwitches: 4.71K (4714) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s885ms | |
- ExecTreeExecTime: 1s844ms | |
- OpenTime: 1s040ms | |
- ExecTreeOpenTime: 624.689ms | |
- PrepareTime: 40.764ms | |
- ExecTreePrepareTime: 1.039ms | |
DataStreamSender (dst_id=33):(Total: 22.622ms, non-child: 22.622ms, % non-child: 100.00%) | |
- BytesSent: 1.64 MB (1719638) | |
- NetworkThroughput(*): 601.04 MB/sec | |
- OverallThroughput: 72.49 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 30.57K (30571) | |
- SerializeBatchTime: 19.813ms | |
- TransmitDataRPCTime: 2.728ms | |
- UncompressedRowBatchSize: 2.51 MB (2632749) | |
CodeGen:(Total: 447.717ms, non-child: 447.717ms, % non-child: 100.00%) | |
- CodegenTime: 2.153ms | |
- CompileTime: 148.842ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 92 (92) | |
- NumInstructions: 3.46K (3457) | |
- OptimizationTime: 266.189ms | |
- PeakMemoryUsage: 1.69 MB (1769984) | |
- PrepareTime: 32.108ms | |
AGGREGATION_NODE (id=8):(Total: 2s469ms, non-child: 99.156ms, % non-child: 4.01%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 262.981us | |
- GetResultsTime: 7.513ms | |
- HTResizeTime: 1.636ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 13.02 MB (13656513) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 511.99 | |
- ReductionFactorThresholdToExpand: 1.10 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 30.57K (30571) | |
- RowsReturnedRate: 12.38 K/sec | |
- StreamingTime: 88.955ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=7):(Total: 2s370ms, non-child: 258.952ms, % non-child: 10.92%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 30.57K (30571) | |
- BuildTime: 42.167ms | |
- PeakMemoryUsage: 10.18 MB (10671383) | |
- ProbeRows: 2.22M (2220280) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 251.935ms | |
- RowsReturned: 80.55K (80553) | |
- RowsReturnedRate: 33.98 K/sec | |
Hash Join Builder (join_node_id=7): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 2 of 2 Runtime Filters Published | |
- BuildRowsPartitionTime: 12.815ms | |
- BuildRowsPartitioned: 30.57K (30571) | |
- GetNewBlockTime: 82.045us | |
- HashBuckets: 65.54K (65536) | |
- HashCollisions: 13 (13) | |
- HashTablesBuildTime: 2.461ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 10.04 MB (10524800) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=32):(Total: 264.290ms, non-child: 1.165ms, % non-child: 0.44%) | |
BytesReceived(500.000ms): 0, 1.39 MB, 1.39 MB, 1.39 MB, 1.39 MB, 1.39 MB | |
- BytesReceived: 1.39 MB (1454086) | |
- ConvertRowBatchTime: 725.357us | |
- DeserializeRowBatchTimer: 4.203ms | |
- FirstBatchArrivalWaitTime: 248.061ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.57K (30571) | |
- RowsReturnedRate: 115.67 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=31):(Total: 2s111ms, non-child: 124.841ms, % non-child: 5.91%) | |
BytesReceived(500.000ms): 0, 0, 20.44 MB, 56.81 MB, 90.12 MB, 101.83 MB | |
- BytesReceived: 102.06 MB (107018615) | |
- ConvertRowBatchTime: 46.927ms | |
- DeserializeRowBatchTimer: 326.084ms | |
- FirstBatchArrivalWaitTime: 620.271ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.22M (2220280) | |
- RowsReturnedRate: 1.05 M/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:67 (host=cdh4.net.cuberonlabs.com:22000):(Total: 2s963ms, non-child: 25.685ms, % non-child: 0.87%) | |
MemoryUsage(500.000ms): 3.11 MB, 26.47 MB, 30.94 MB, 37.83 MB, 38.21 MB, 38.91 MB | |
ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.17 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 39.42 MB (41337976) | |
- PerHostPeakMemUsage: 1.49 GB (1602749019) | |
- RowsProduced: 30.78K (30778) | |
- TotalNetworkReceiveTime: 2s341ms | |
- TotalNetworkSendTime: 7.259ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 11 (11) | |
- TotalThreadsTotalWallClockTime: 3s187ms | |
- TotalThreadsSysTime: 76.000ms | |
- TotalThreadsUserTime: 800.000ms | |
- TotalThreadsVoluntaryContextSwitches: 4.80K (4799) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s879ms | |
- ExecTreeExecTime: 1s838ms | |
- OpenTime: 1s040ms | |
- ExecTreeOpenTime: 595.022ms | |
- PrepareTime: 43.281ms | |
- ExecTreePrepareTime: 714.344us | |
DataStreamSender (dst_id=33):(Total: 25.842ms, non-child: 25.842ms, % non-child: 100.00%) | |
- BytesSent: 1.65 MB (1731946) | |
- NetworkThroughput(*): 197.87 MB/sec | |
- OverallThroughput: 63.92 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 30.78K (30778) | |
- SerializeBatchTime: 17.399ms | |
- TransmitDataRPCTime: 8.347ms | |
- UncompressedRowBatchSize: 2.53 MB (2650681) | |
CodeGen:(Total: 477.159ms, non-child: 477.159ms, % non-child: 100.00%) | |
- CodegenTime: 2.647ms | |
- CompileTime: 159.322ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 92 (92) | |
- NumInstructions: 3.46K (3457) | |
- OptimizationTime: 284.510ms | |
- PeakMemoryUsage: 1.69 MB (1769984) | |
- PrepareTime: 32.556ms | |
AGGREGATION_NODE (id=8):(Total: 2s434ms, non-child: 90.068ms, % non-child: 3.70%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 212.640us | |
- GetResultsTime: 7.495ms | |
- HTResizeTime: 1.558ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 12.88 MB (13505543) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 490.67 | |
- ReductionFactorThresholdToExpand: 1.10 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 30.78K (30778) | |
- RowsReturnedRate: 12.64 K/sec | |
- StreamingTime: 79.222ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=7):(Total: 2s344ms, non-child: 192.547ms, % non-child: 8.21%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 30.78K (30778) | |
- BuildTime: 38.062ms | |
- PeakMemoryUsage: 10.18 MB (10673175) | |
- ProbeRows: 2.22M (2219647) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 186.195ms | |
- RowsReturned: 81.56K (81563) | |
- RowsReturnedRate: 34.79 K/sec | |
Hash Join Builder (join_node_id=7): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 2 of 2 Runtime Filters Published | |
- BuildRowsPartitionTime: 12.390ms | |
- BuildRowsPartitioned: 30.78K (30778) | |
- GetNewBlockTime: 200.164us | |
- HashBuckets: 65.54K (65536) | |
- HashCollisions: 45 (45) | |
- HashTablesBuildTime: 1.549ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 10.04 MB (10524800) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=32):(Total: 229.010ms, non-child: 960.696us, % non-child: 0.42%) | |
BytesReceived(500.000ms): 0, 1.37 MB, 1.40 MB, 1.40 MB, 1.40 MB, 1.40 MB | |
- BytesReceived: 1.40 MB (1463644) | |
- ConvertRowBatchTime: 518.780us | |
- DeserializeRowBatchTimer: 3.145ms | |
- FirstBatchArrivalWaitTime: 218.817ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.78K (30778) | |
- RowsReturnedRate: 134.40 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=31):(Total: 2s151ms, non-child: 118.786ms, % non-child: 5.52%) | |
BytesReceived(500.000ms): 0, 0, 12.11 MB, 49.70 MB, 85.10 MB, 101.46 MB | |
- BytesReceived: 102.05 MB (107007510) | |
- ConvertRowBatchTime: 33.212ms | |
- DeserializeRowBatchTimer: 299.723ms | |
- FirstBatchArrivalWaitTime: 588.043ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.22M (2219647) | |
- RowsReturnedRate: 1.03 M/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:68 (host=cdh16.net.cuberonlabs.com:22000):(Total: 2s962ms, non-child: 29.233ms, % non-child: 0.99%) | |
MemoryUsage(500.000ms): 1.42 MB, 27.43 MB, 29.22 MB, 38.48 MB, 37.54 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 39.30 MB (41210205) | |
- PerHostPeakMemUsage: 1.37 GB (1468229737) | |
- RowsProduced: 30.73K (30728) | |
- TotalNetworkReceiveTime: 2s296ms | |
- TotalNetworkSendTime: 5.362ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 2 (2) | |
- TotalThreadsTotalWallClockTime: 3s171ms | |
- TotalThreadsSysTime: 96.000ms | |
- TotalThreadsUserTime: 804.000ms | |
- TotalThreadsVoluntaryContextSwitches: 5.13K (5133) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s882ms | |
- ExecTreeExecTime: 1s840ms | |
- OpenTime: 1s034ms | |
- ExecTreeOpenTime: 576.755ms | |
- PrepareTime: 45.688ms | |
- ExecTreePrepareTime: 650.886us | |
DataStreamSender (dst_id=33):(Total: 24.062ms, non-child: 24.062ms, % non-child: 100.00%) | |
- BytesSent: 1.65 MB (1728736) | |
- NetworkThroughput(*): 401.91 MB/sec | |
- OverallThroughput: 68.52 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 30.73K (30728) | |
- SerializeBatchTime: 19.824ms | |
- TransmitDataRPCTime: 4.102ms | |
- UncompressedRowBatchSize: 2.52 MB (2646891) | |
CodeGen:(Total: 491.743ms, non-child: 491.743ms, % non-child: 100.00%) | |
- CodegenTime: 3.279ms | |
- CompileTime: 152.368ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 92 (92) | |
- NumInstructions: 3.46K (3457) | |
- OptimizationTime: 304.226ms | |
- PeakMemoryUsage: 1.69 MB (1769984) | |
- PrepareTime: 34.270ms | |
AGGREGATION_NODE (id=8):(Total: 2s417ms, non-child: 85.892ms, % non-child: 3.55%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 176.999us | |
- GetResultsTime: 7.108ms | |
- HTResizeTime: 1.014ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 12.91 MB (13536259) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 490.08 | |
- ReductionFactorThresholdToExpand: 1.10 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 30.73K (30728) | |
- RowsReturnedRate: 12.71 K/sec | |
- StreamingTime: 76.589ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=7):(Total: 2s331ms, non-child: 210.033ms, % non-child: 9.01%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 30.73K (30728) | |
- BuildTime: 35.012ms | |
- PeakMemoryUsage: 10.18 MB (10672664) | |
- ProbeRows: 2.22M (2224064) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 204.098ms | |
- RowsReturned: 80.74K (80744) | |
- RowsReturnedRate: 34.62 K/sec | |
Hash Join Builder (join_node_id=7): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 2 of 2 Runtime Filters Published | |
- BuildRowsPartitionTime: 12.838ms | |
- BuildRowsPartitioned: 30.73K (30728) | |
- GetNewBlockTime: 108.596us | |
- HashBuckets: 65.54K (65536) | |
- HashCollisions: 18 (18) | |
- HashTablesBuildTime: 2.002ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 10.04 MB (10524800) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=32):(Total: 219.252ms, non-child: 1.200ms, % non-child: 0.55%) | |
BytesReceived(500.000ms): 0, 1.39 MB, 1.39 MB, 1.39 MB, 1.39 MB | |
- BytesReceived: 1.39 MB (1461037) | |
- ConvertRowBatchTime: 562.423us | |
- DeserializeRowBatchTimer: 3.331ms | |
- FirstBatchArrivalWaitTime: 205.187ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.73K (30728) | |
- RowsReturnedRate: 140.15 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=31):(Total: 2s121ms, non-child: 132.512ms, % non-child: 6.24%) | |
BytesReceived(500.000ms): 0, 0, 30.10 MB, 66.50 MB, 96.24 MB | |
- BytesReceived: 102.29 MB (107263071) | |
- ConvertRowBatchTime: 39.055ms | |
- DeserializeRowBatchTimer: 379.623ms | |
- FirstBatchArrivalWaitTime: 573.321ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.22M (2224064) | |
- RowsReturnedRate: 1.05 M/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:6a (host=cdh6.net.cuberonlabs.com:22000):(Total: 2s962ms, non-child: 26.576ms, % non-child: 0.90%) | |
MemoryUsage(500.000ms): 3.11 MB, 1.43 MB, 27.88 MB, 32.50 MB, 37.62 MB, 37.59 MB | |
ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.17 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 39.36 MB (41269315) | |
- PerHostPeakMemUsage: 1.35 GB (1448427474) | |
- RowsProduced: 30.23K (30234) | |
- TotalNetworkReceiveTime: 2s300ms | |
- TotalNetworkSendTime: 5.084ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 3 (3) | |
- TotalThreadsTotalWallClockTime: 3s175ms | |
- TotalThreadsSysTime: 76.000ms | |
- TotalThreadsUserTime: 832.000ms | |
- TotalThreadsVoluntaryContextSwitches: 5.12K (5122) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s880ms | |
- ExecTreeExecTime: 1s840ms | |
- OpenTime: 1s040ms | |
- ExecTreeOpenTime: 577.813ms | |
- PrepareTime: 41.348ms | |
- ExecTreePrepareTime: 673.480us | |
DataStreamSender (dst_id=33):(Total: 23.295ms, non-child: 23.295ms, % non-child: 100.00%) | |
- BytesSent: 1.62 MB (1701503) | |
- NetworkThroughput(*): 389.73 MB/sec | |
- OverallThroughput: 69.66 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 30.23K (30234) | |
- SerializeBatchTime: 19.035ms | |
- TransmitDataRPCTime: 4.163ms | |
- UncompressedRowBatchSize: 2.48 MB (2602622) | |
CodeGen:(Total: 493.775ms, non-child: 493.775ms, % non-child: 100.00%) | |
- CodegenTime: 2.602ms | |
- CompileTime: 160.950ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 92 (92) | |
- NumInstructions: 3.46K (3457) | |
- OptimizationTime: 300.344ms | |
- PeakMemoryUsage: 1.69 MB (1769984) | |
- PrepareTime: 31.748ms | |
AGGREGATION_NODE (id=8):(Total: 2s418ms, non-child: 85.457ms, % non-child: 3.53%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 161.272us | |
- GetResultsTime: 7.590ms | |
- HTResizeTime: 1.077ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 12.89 MB (13520180) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 498.75 | |
- ReductionFactorThresholdToExpand: 1.10 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 30.23K (30234) | |
- RowsReturnedRate: 12.50 K/sec | |
- StreamingTime: 75.522ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=7):(Total: 2s333ms, non-child: 200.578ms, % non-child: 8.60%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 30.23K (30234) | |
- BuildTime: 45.042ms | |
- PeakMemoryUsage: 10.18 MB (10673957) | |
- ProbeRows: 2.22M (2220537) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 194.207ms | |
- RowsReturned: 79.54K (79543) | |
- RowsReturnedRate: 34.09 K/sec | |
Hash Join Builder (join_node_id=7): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 2 of 2 Runtime Filters Published | |
- BuildRowsPartitionTime: 14.704ms | |
- BuildRowsPartitioned: 30.23K (30234) | |
- GetNewBlockTime: 125.072us | |
- HashBuckets: 65.54K (65536) | |
- HashCollisions: 16 (16) | |
- HashTablesBuildTime: 2.238ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 10.04 MB (10524800) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=32):(Total: 209.504ms, non-child: 1.225ms, % non-child: 0.58%) | |
BytesReceived(500.000ms): 0, 0, 1.37 MB, 1.37 MB, 1.37 MB, 1.37 MB | |
- BytesReceived: 1.37 MB (1439488) | |
- ConvertRowBatchTime: 802.692us | |
- DeserializeRowBatchTimer: 3.396ms | |
- FirstBatchArrivalWaitTime: 203.207ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.23K (30234) | |
- RowsReturnedRate: 144.31 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=31):(Total: 2s132ms, non-child: 111.456ms, % non-child: 5.23%) | |
BytesReceived(500.000ms): 0, 0, 263.07 KB, 39.08 MB, 75.08 MB, 99.67 MB | |
- BytesReceived: 102.06 MB (107018518) | |
- ConvertRowBatchTime: 35.509ms | |
- DeserializeRowBatchTimer: 298.880ms | |
- FirstBatchArrivalWaitTime: 571.666ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.22M (2220537) | |
- RowsReturnedRate: 1.04 M/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:72 (host=cdh5.net.cuberonlabs.com:22000):(Total: 2s961ms, non-child: 21.219ms, % non-child: 0.72%) | |
MemoryUsage(500.000ms): 1.42 MB, 27.43 MB, 30.64 MB, 37.36 MB, 37.89 MB, 39.07 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 39.29 MB (41199970) | |
- PerHostPeakMemUsage: 1.38 GB (1486351700) | |
- RowsProduced: 30.67K (30669) | |
- TotalNetworkReceiveTime: 2s401ms | |
- TotalNetworkSendTime: 6.290ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 4 (4) | |
- TotalThreadsTotalWallClockTime: 3s231ms | |
- TotalThreadsSysTime: 80.000ms | |
- TotalThreadsUserTime: 772.000ms | |
- TotalThreadsVoluntaryContextSwitches: 4.62K (4622) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s881ms | |
- ExecTreeExecTime: 1s845ms | |
- OpenTime: 1s044ms | |
- ExecTreeOpenTime: 619.463ms | |
- PrepareTime: 35.379ms | |
- ExecTreePrepareTime: 1.140ms | |
DataStreamSender (dst_id=33):(Total: 24.745ms, non-child: 24.745ms, % non-child: 100.00%) | |
- BytesSent: 1.65 MB (1726368) | |
- NetworkThroughput(*): 213.34 MB/sec | |
- OverallThroughput: 66.53 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 30.67K (30669) | |
- SerializeBatchTime: 16.908ms | |
- TransmitDataRPCTime: 7.717ms | |
- UncompressedRowBatchSize: 2.52 MB (2640672) | |
CodeGen:(Total: 450.205ms, non-child: 450.205ms, % non-child: 100.00%) | |
- CodegenTime: 2.385ms | |
- CompileTime: 143.887ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 92 (92) | |
- NumInstructions: 3.46K (3457) | |
- OptimizationTime: 279.431ms | |
- PeakMemoryUsage: 1.69 MB (1769984) | |
- PrepareTime: 26.140ms | |
AGGREGATION_NODE (id=8):(Total: 2s465ms, non-child: 89.681ms, % non-child: 3.64%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 312.176us | |
- GetResultsTime: 5.238ms | |
- HTResizeTime: 1.068ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 12.90 MB (13531716) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 483.42 | |
- ReductionFactorThresholdToExpand: 1.10 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 30.67K (30669) | |
- RowsReturnedRate: 12.44 K/sec | |
- StreamingTime: 81.483ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=7):(Total: 2s375ms, non-child: 199.962ms, % non-child: 8.42%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 30.67K (30669) | |
- BuildTime: 40.018ms | |
- PeakMemoryUsage: 10.18 MB (10672621) | |
- ProbeRows: 2.22M (2219481) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 193.834ms | |
- RowsReturned: 81.36K (81361) | |
- RowsReturnedRate: 34.24 K/sec | |
Hash Join Builder (join_node_id=7): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 2 of 2 Runtime Filters Published | |
- BuildRowsPartitionTime: 10.275ms | |
- BuildRowsPartitioned: 30.67K (30669) | |
- GetNewBlockTime: 77.728us | |
- HashBuckets: 65.54K (65536) | |
- HashCollisions: 12 (12) | |
- HashTablesBuildTime: 2.470ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 10.04 MB (10524800) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=32):(Total: 265.106ms, non-child: 825.668us, % non-child: 0.31%) | |
BytesReceived(500.000ms): 0, 1.39 MB, 1.39 MB, 1.39 MB, 1.39 MB, 1.39 MB | |
- BytesReceived: 1.39 MB (1458600) | |
- ConvertRowBatchTime: 451.196us | |
- DeserializeRowBatchTimer: 3.472ms | |
- FirstBatchArrivalWaitTime: 246.182ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.67K (30669) | |
- RowsReturnedRate: 115.69 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=31):(Total: 2s176ms, non-child: 143.985ms, % non-child: 6.62%) | |
BytesReceived(500.000ms): 0, 0, 20.68 MB, 57.06 MB, 90.21 MB, 101.82 MB | |
- BytesReceived: 102.03 MB (106982246) | |
- ConvertRowBatchTime: 34.052ms | |
- DeserializeRowBatchTimer: 323.994ms | |
- FirstBatchArrivalWaitTime: 612.240ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.22M (2219481) | |
- RowsReturnedRate: 1.02 M/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:71 (host=cdh1.net.cuberonlabs.com:22000):(Total: 2s959ms, non-child: 31.269ms, % non-child: 1.06%) | |
MemoryUsage(500.000ms): 3.11 MB, 1.43 MB, 27.55 MB, 30.48 MB, 37.92 MB, 37.32 MB | |
ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.17 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 39.33 MB (41242714) | |
- PerHostPeakMemUsage: 1.40 GB (1507241412) | |
- RowsProduced: 30.12K (30123) | |
- TotalNetworkReceiveTime: 2s339ms | |
- TotalNetworkSendTime: 5.772ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 20 (20) | |
- TotalThreadsTotalWallClockTime: 3s221ms | |
- TotalThreadsSysTime: 136.000ms | |
- TotalThreadsUserTime: 780.000ms | |
- TotalThreadsVoluntaryContextSwitches: 4.47K (4472) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s887ms | |
- ExecTreeExecTime: 1s846ms | |
- OpenTime: 1s029ms | |
- ExecTreeOpenTime: 607.156ms | |
- PrepareTime: 43.043ms | |
- ExecTreePrepareTime: 1.943ms | |
DataStreamSender (dst_id=33):(Total: 21.149ms, non-child: 21.149ms, % non-child: 100.00%) | |
- BytesSent: 1.62 MB (1695130) | |
- NetworkThroughput(*): 433.73 MB/sec | |
- OverallThroughput: 76.44 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 30.12K (30123) | |
- SerializeBatchTime: 17.230ms | |
- TransmitDataRPCTime: 3.727ms | |
- UncompressedRowBatchSize: 2.47 MB (2594256) | |
CodeGen:(Total: 452.157ms, non-child: 452.157ms, % non-child: 100.00%) | |
- CodegenTime: 2.275ms | |
- CompileTime: 148.868ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 92 (92) | |
- NumInstructions: 3.46K (3457) | |
- OptimizationTime: 272.042ms | |
- PeakMemoryUsage: 1.69 MB (1769984) | |
- PrepareTime: 30.642ms | |
AGGREGATION_NODE (id=8):(Total: 2s455ms, non-child: 101.497ms, % non-child: 4.13%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 558.644us | |
- GetResultsTime: 7.154ms | |
- HTResizeTime: 1.087ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 12.89 MB (13520159) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 504.70 | |
- ReductionFactorThresholdToExpand: 1.10 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 30.12K (30123) | |
- RowsReturnedRate: 12.27 K/sec | |
- StreamingTime: 91.138ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=7):(Total: 2s353ms, non-child: 219.633ms, % non-child: 9.33%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 30.12K (30123) | |
- BuildTime: 51.814ms | |
- PeakMemoryUsage: 10.18 MB (10672128) | |
- ProbeRows: 2.22M (2221252) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 211.638ms | |
- RowsReturned: 79.65K (79652) | |
- RowsReturnedRate: 33.84 K/sec | |
Hash Join Builder (join_node_id=7): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 2 of 2 Runtime Filters Published | |
- BuildRowsPartitionTime: 11.817ms | |
- BuildRowsPartitioned: 30.12K (30123) | |
- GetNewBlockTime: 86.860us | |
- HashBuckets: 65.54K (65536) | |
- HashCollisions: 16 (16) | |
- HashTablesBuildTime: 3.181ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 10.04 MB (10524800) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=32):(Total: 252.492ms, non-child: 1.225ms, % non-child: 0.49%) | |
BytesReceived(500.000ms): 0, 0, 1.37 MB, 1.37 MB, 1.37 MB, 1.37 MB | |
- BytesReceived: 1.37 MB (1434860) | |
- ConvertRowBatchTime: 604.280us | |
- DeserializeRowBatchTimer: 3.710ms | |
- FirstBatchArrivalWaitTime: 232.887ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.12K (30123) | |
- RowsReturnedRate: 119.30 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=31):(Total: 2s134ms, non-child: 178.529ms, % non-child: 8.36%) | |
BytesReceived(500.000ms): 0, 0, 60.25 KB, 38.19 MB, 74.20 MB, 99.48 MB | |
- BytesReceived: 102.11 MB (107069877) | |
- ConvertRowBatchTime: 40.329ms | |
- DeserializeRowBatchTimer: 382.210ms | |
- FirstBatchArrivalWaitTime: 602.101ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.22M (2221252) | |
- RowsReturnedRate: 1.04 M/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:6e (host=cdh2.net.cuberonlabs.com:22000):(Total: 2s959ms, non-child: 26.910ms, % non-child: 0.91%) | |
MemoryUsage(500.000ms): 3.11 MB, 1.43 MB, 28.00 MB, 33.48 MB, 38.84 MB, 38.97 MB | |
ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.17 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 39.50 MB (41423370) | |
- PerHostPeakMemUsage: 1.47 GB (1583684231) | |
- RowsProduced: 30.54K (30540) | |
- TotalNetworkReceiveTime: 2s302ms | |
- TotalNetworkSendTime: 5.654ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 8 (8) | |
- TotalThreadsTotalWallClockTime: 3s175ms | |
- TotalThreadsSysTime: 84.000ms | |
- TotalThreadsUserTime: 832.000ms | |
- TotalThreadsVoluntaryContextSwitches: 4.85K (4851) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s878ms | |
- ExecTreeExecTime: 1s843ms | |
- OpenTime: 1s022ms | |
- ExecTreeOpenTime: 589.804ms | |
- PrepareTime: 57.642ms | |
- ExecTreePrepareTime: 1.071ms | |
DataStreamSender (dst_id=33):(Total: 19.375ms, non-child: 19.375ms, % non-child: 100.00%) | |
- BytesSent: 1.64 MB (1718575) | |
- NetworkThroughput(*): 455.06 MB/sec | |
- OverallThroughput: 84.59 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 30.54K (30540) | |
- SerializeBatchTime: 15.654ms | |
- TransmitDataRPCTime: 3.601ms | |
- UncompressedRowBatchSize: 2.51 MB (2628031) | |
CodeGen:(Total: 478.922ms, non-child: 478.922ms, % non-child: 100.00%) | |
- CodegenTime: 2.551ms | |
- CompileTime: 149.466ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 92 (92) | |
- NumInstructions: 3.46K (3457) | |
- OptimizationTime: 282.306ms | |
- PeakMemoryUsage: 1.69 MB (1769984) | |
- PrepareTime: 46.130ms | |
AGGREGATION_NODE (id=8):(Total: 2s434ms, non-child: 89.908ms, % non-child: 3.69%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 312.580us | |
- GetResultsTime: 6.344ms | |
- HTResizeTime: 738.432us | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 13.03 MB (13659792) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 487.08 | |
- ReductionFactorThresholdToExpand: 1.10 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 30.54K (30540) | |
- RowsReturnedRate: 12.55 K/sec | |
- StreamingTime: 80.861ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=7):(Total: 2s344ms, non-child: 227.869ms, % non-child: 9.72%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 30.54K (30540) | |
- BuildTime: 42.823ms | |
- PeakMemoryUsage: 10.18 MB (10672068) | |
- ProbeRows: 2.22M (2219807) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 220.549ms | |
- RowsReturned: 80.22K (80222) | |
- RowsReturnedRate: 34.22 K/sec | |
Hash Join Builder (join_node_id=7): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 2 of 2 Runtime Filters Published | |
- BuildRowsPartitionTime: 12.691ms | |
- BuildRowsPartitioned: 30.54K (30540) | |
- GetNewBlockTime: 92.824us | |
- HashBuckets: 65.54K (65536) | |
- HashCollisions: 8 (8) | |
- HashTablesBuildTime: 2.498ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 10.04 MB (10524800) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=32):(Total: 230.588ms, non-child: 1.130ms, % non-child: 0.49%) | |
BytesReceived(500.000ms): 0, 0, 1.39 MB, 1.39 MB, 1.39 MB, 1.39 MB | |
- BytesReceived: 1.39 MB (1452862) | |
- ConvertRowBatchTime: 670.228us | |
- DeserializeRowBatchTimer: 3.204ms | |
- FirstBatchArrivalWaitTime: 214.747ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.54K (30540) | |
- RowsReturnedRate: 132.44 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=31):(Total: 2s116ms, non-child: 124.672ms, % non-child: 5.89%) | |
BytesReceived(500.000ms): 0, 0, 346.25 KB, 39.24 MB, 75.27 MB, 99.74 MB | |
- BytesReceived: 102.04 MB (106991620) | |
- ConvertRowBatchTime: 38.227ms | |
- DeserializeRowBatchTimer: 322.299ms | |
- FirstBatchArrivalWaitTime: 585.133ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.22M (2219807) | |
- RowsReturnedRate: 1.05 M/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:6c (host=cdh3.net.cuberonlabs.com:22000):(Total: 2s958ms, non-child: 29.606ms, % non-child: 1.00%) | |
MemoryUsage(500.000ms): 3.11 MB, 27.43 MB, 28.96 MB, 38.68 MB, 37.94 MB, 37.29 MB | |
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 39.45 MB (41366491) | |
- PerHostPeakMemUsage: 1.13 GB (1217735172) | |
- RowsProduced: 30.25K (30249) | |
- TotalNetworkReceiveTime: 2s141ms | |
- TotalNetworkSendTime: 6.661ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 35 (35) | |
- TotalThreadsTotalWallClockTime: 3s078ms | |
- TotalThreadsSysTime: 116.000ms | |
- TotalThreadsUserTime: 848.000ms | |
- TotalThreadsVoluntaryContextSwitches: 4.96K (4962) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s877ms | |
- ExecTreeExecTime: 1s840ms | |
- OpenTime: 1s027ms | |
- ExecTreeOpenTime: 497.059ms | |
- PrepareTime: 53.154ms | |
- ExecTreePrepareTime: 790.708us | |
DataStreamSender (dst_id=33):(Total: 19.641ms, non-child: 19.641ms, % non-child: 100.00%) | |
- BytesSent: 1.62 MB (1701777) | |
- NetworkThroughput(*): 411.07 MB/sec | |
- OverallThroughput: 82.63 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 30.25K (30249) | |
- SerializeBatchTime: 15.602ms | |
- TransmitDataRPCTime: 3.948ms | |
- UncompressedRowBatchSize: 2.48 MB (2604464) | |
CodeGen:(Total: 571.051ms, non-child: 571.051ms, % non-child: 100.00%) | |
- CodegenTime: 3.455ms | |
- CompileTime: 184.820ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 92 (92) | |
- NumInstructions: 3.46K (3457) | |
- OptimizationTime: 343.731ms | |
- PeakMemoryUsage: 1.69 MB (1769984) | |
- PrepareTime: 41.462ms | |
AGGREGATION_NODE (id=8):(Total: 2s338ms, non-child: 91.729ms, % non-child: 3.92%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 320.416us | |
- GetResultsTime: 6.217ms | |
- HTResizeTime: 1.231ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 13.04 MB (13668340) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 506.56 | |
- ReductionFactorThresholdToExpand: 1.10 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 30.25K (30249) | |
- RowsReturnedRate: 12.94 K/sec | |
- StreamingTime: 83.122ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=7):(Total: 2s246ms, non-child: 200.914ms, % non-child: 8.94%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 30.25K (30249) | |
- BuildTime: 37.890ms | |
- PeakMemoryUsage: 10.18 MB (10673888) | |
- ProbeRows: 2.22M (2220811) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 194.662ms | |
- RowsReturned: 79.45K (79450) | |
- RowsReturnedRate: 35.37 K/sec | |
Hash Join Builder (join_node_id=7): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 2 of 2 Runtime Filters Published | |
- BuildRowsPartitionTime: 12.113ms | |
- BuildRowsPartitioned: 30.25K (30249) | |
- GetNewBlockTime: 105.204us | |
- HashBuckets: 65.54K (65536) | |
- HashCollisions: 11 (11) | |
- HashTablesBuildTime: 1.693ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 10.04 MB (10524800) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=32):(Total: 135.325ms, non-child: 998.716us, % non-child: 0.74%) | |
BytesReceived(500.000ms): 0, 1.37 MB, 1.37 MB, 1.37 MB, 1.37 MB, 1.37 MB | |
- BytesReceived: 1.37 MB (1440047) | |
- ConvertRowBatchTime: 589.964us | |
- DeserializeRowBatchTimer: 2.894ms | |
- FirstBatchArrivalWaitTime: 123.571ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.25K (30249) | |
- RowsReturnedRate: 223.53 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=31):(Total: 2s045ms, non-child: 112.855ms, % non-child: 5.52%) | |
BytesReceived(500.000ms): 0, 0, 19.74 MB, 56.26 MB, 89.68 MB, 101.85 MB | |
- BytesReceived: 102.13 MB (107087588) | |
- ConvertRowBatchTime: 33.463ms | |
- DeserializeRowBatchTimer: 301.876ms | |
- FirstBatchArrivalWaitTime: 489.737ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.22M (2220811) | |
- RowsReturnedRate: 1.09 M/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:6b (host=cdh15.net.cuberonlabs.com:22000):(Total: 2s950ms, non-child: 23.728ms, % non-child: 0.80%) | |
MemoryUsage(500.000ms): 1.41 MB, 1.43 MB, 27.43 MB, 29.40 MB, 39.10 MB, 38.29 MB | |
ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1 | |
- AverageThreadTokens: 1.17 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 39.38 MB (41295070) | |
- PerHostPeakMemUsage: 1.50 GB (1607357771) | |
- RowsProduced: 30.50K (30498) | |
- TotalNetworkReceiveTime: 2s385ms | |
- TotalNetworkSendTime: 5.336ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 18 (18) | |
- TotalThreadsTotalWallClockTime: 3s195ms | |
- TotalThreadsSysTime: 96.000ms | |
- TotalThreadsUserTime: 740.000ms | |
- TotalThreadsVoluntaryContextSwitches: 5.08K (5083) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 1s872ms | |
- ExecTreeExecTime: 1s842ms | |
- OpenTime: 1s038ms | |
- ExecTreeOpenTime: 603.850ms | |
- PrepareTime: 40.077ms | |
- ExecTreePrepareTime: 601.566us | |
DataStreamSender (dst_id=33):(Total: 14.797ms, non-child: 14.797ms, % non-child: 100.00%) | |
- BytesSent: 1.64 MB (1716295) | |
- NetworkThroughput(*): 493.28 MB/sec | |
- OverallThroughput: 110.61 MB/sec | |
- PeakMemoryUsage: 1.06 MB (1111936) | |
- RowsReturned: 30.50K (30498) | |
- SerializeBatchTime: 11.371ms | |
- TransmitDataRPCTime: 3.318ms | |
- UncompressedRowBatchSize: 2.50 MB (2625057) | |
CodeGen:(Total: 464.711ms, non-child: 464.711ms, % non-child: 100.00%) | |
- CodegenTime: 2.552ms | |
- CompileTime: 155.795ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 92 (92) | |
- NumInstructions: 3.46K (3457) | |
- OptimizationTime: 277.241ms | |
- PeakMemoryUsage: 1.69 MB (1769984) | |
- PrepareTime: 30.960ms | |
AGGREGATION_NODE (id=8):(Total: 2s447ms, non-child: 79.791ms, % non-child: 3.26%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 218.966us | |
- GetResultsTime: 6.875ms | |
- HTResizeTime: 707.507us | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 2 (2) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 12.97 MB (13600374) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 488.47 | |
- ReductionFactorThresholdToExpand: 1.10 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 30.50K (30498) | |
- RowsReturnedRate: 12.46 K/sec | |
- StreamingTime: 71.035ms | |
- UnpinTime: 0.000ns | |
HASH_JOIN_NODE (id=7):(Total: 2s367ms, non-child: 188.452ms, % non-child: 7.96%) | |
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously | |
- BuildRows: 30.50K (30498) | |
- BuildTime: 40.158ms | |
- PeakMemoryUsage: 10.18 MB (10672572) | |
- ProbeRows: 2.22M (2217505) | |
- ProbeRowsPartitioned: 0 (0) | |
- ProbeTime: 182.216ms | |
- RowsReturned: 80.39K (80393) | |
- RowsReturnedRate: 33.96 K/sec | |
Hash Join Builder (join_node_id=7): | |
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled | |
Runtime filters: 2 of 2 Runtime Filters Published | |
- BuildRowsPartitionTime: 12.724ms | |
- BuildRowsPartitioned: 30.50K (30498) | |
- GetNewBlockTime: 142.620us | |
- HashBuckets: 65.54K (65536) | |
- HashCollisions: 15 (15) | |
- HashTablesBuildTime: 2.470ms | |
- LargestPartitionPercent: 6 (6) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 10.04 MB (10524800) | |
- PinTime: 0.000ns | |
- RepartitionTime: 0.000ns | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 0.000ns | |
EXCHANGE_NODE (id=32):(Total: 245.122ms, non-child: 1.064ms, % non-child: 0.43%) | |
BytesReceived(500.000ms): 0, 0, 1.38 MB, 1.38 MB, 1.38 MB, 1.38 MB | |
- BytesReceived: 1.38 MB (1450598) | |
- ConvertRowBatchTime: 706.861us | |
- DeserializeRowBatchTimer: 3.502ms | |
- FirstBatchArrivalWaitTime: 233.046ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 30.50K (30498) | |
- RowsReturnedRate: 124.42 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
EXCHANGE_NODE (id=31):(Total: 2s179ms, non-child: 99.566ms, % non-child: 4.57%) | |
BytesReceived(500.000ms): 0, 0, 0, 34.70 MB, 70.85 MB, 98.04 MB | |
- BytesReceived: 101.95 MB (106905413) | |
- ConvertRowBatchTime: 33.724ms | |
- DeserializeRowBatchTimer: 285.213ms | |
- FirstBatchArrivalWaitTime: 602.084ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 2.22M (2217505) | |
- RowsReturnedRate: 1.02 M/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Averaged Fragment F04:(Total: 2s469ms, non-child: 570.679ms, % non-child: 23.11%) | |
split sizes: min: 1.81 GB, max: 3.59 GB, avg: 2.76 GB, stddev: 468.16 MB | |
completion times: min:2s122ms max:2s905ms mean: 2s470ms stddev:207.758ms | |
execution rates: min:823.68 MB/sec max:1.31 GB/sec mean:1.11 GB/sec stddev:128.25 MB/sec | |
num instances: 17 | |
- AverageThreadTokens: 7.28 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 102.75 MB (107743019) | |
- PerHostPeakMemUsage: 1.15 GB (1237569248) | |
- RowsProduced: 2.22M (2221711) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 13.111ms | |
- TotalStorageWaitTime: 149.829ms | |
- TotalThreadsInvoluntaryContextSwitches: 48 (48) | |
- TotalThreadsTotalWallClockTime: 17s657ms | |
- TotalThreadsSysTime: 400.705ms | |
- TotalThreadsUserTime: 4s453ms | |
- TotalThreadsVoluntaryContextSwitches: 3.92K (3917) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s357ms | |
- ExecTreeExecTime: 981.603ms | |
- OpenTime: 76.627ms | |
- ExecTreeOpenTime: 41.849us | |
- PrepareTime: 34.850ms | |
- ExecTreePrepareTime: 311.152us | |
DataStreamSender (dst_id=31):(Total: 810.450ms, non-child: 810.450ms, % non-child: 100.00%) | |
- BytesSent: 102.14 MB (107102132) | |
- NetworkThroughput(*): 478.15 MB/sec | |
- OverallThroughput: 127.55 MB/sec | |
- PeakMemoryUsage: 1.04 MB (1089588) | |
- RowsReturned: 2.22M (2221711) | |
- SerializeBatchTime: 572.875ms | |
- TransmitDataRPCTime: 237.037ms | |
- UncompressedRowBatchSize: 176.28 MB (184839048) | |
CodeGen:(Total: 107.276ms, non-child: 107.276ms, % non-child: 100.00%) | |
- CodegenTime: 1.415ms | |
- CompileTime: 14.007ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 32 (32) | |
- NumInstructions: 547 (547) | |
- OptimizationTime: 61.493ms | |
- PeakMemoryUsage: 273.50 KB (280064) | |
- PrepareTime: 31.060ms | |
HDFS_SCAN_NODE (id=4):(Total: 980.913ms, non-child: 980.913ms, % non-child: 100.00%) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.93 | |
- BytesRead: 372.01 MB (390076376) | |
- BytesReadDataNodeCache: 362.88 MB (380505970) | |
- BytesReadLocal: 372.01 MB (390076376) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 372.01 MB (390076376) | |
- DecompressionTime: 751.176ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 29 (29) | |
- NumScannerThreadsStarted: 8 (8) | |
- PeakMemoryUsage: 85.62 MB (89779341) | |
- PerReadThreadRawHdfsThroughput: 36.59 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 50.199ms | |
- RowBatchQueuePutWaitTime: 7s433ms | |
- RowsRead: 11.56M (11559184) | |
- RowsReturned: 2.22M (2221711) | |
- RowsReturnedRate: 2.26 M/sec | |
- ScanRangesComplete: 29 (29) | |
- ScannerThreadsInvoluntaryContextSwitches: 44 (44) | |
- ScannerThreadsTotalWallClockTime: 15s223ms | |
- MaterializeTupleTime(*): 2s257ms | |
- ScannerThreadsSysTime: 271.058ms | |
- ScannerThreadsUserTime: 3s148ms | |
- ScannerThreadsVoluntaryContextSwitches: 3.34K (3338) | |
- TotalRawHdfsReadTime(*): 10.060ms | |
- TotalReadThroughput: 143.27 MB/sec | |
Filter 1 (8.00 MB): | |
- Rows processed: 10.33M (10331985) | |
- Rows rejected: 3.57M (3571189) | |
- Rows total: 11.56M (11559184) | |
Filter 2 (8.00 MB): | |
- Rows processed: 7.68M (7681788) | |
- Rows rejected: 5.77M (5766283) | |
- Rows total: 7.99M (7987995) | |
Fragment F04: | |
Instance 514ee9ab39cdc507:3f (host=cdh5.net.cuberonlabs.com:22000):(Total: 2s903ms, non-child: 673.619ms, % non-child: 23.20%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.36 GB | |
Filter 2 arrival: 1s242ms | |
Filter 1 arrival: 1s366ms | |
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 67.30 MB, 92.09 MB, 87.50 MB, 64.83 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 3 | |
- AverageThreadTokens: 7.33 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 106.99 MB (112184150) | |
- PerHostPeakMemUsage: 1.38 GB (1486351700) | |
- RowsProduced: 2.49M (2493270) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 12.025ms | |
- TotalStorageWaitTime: 172.829ms | |
- TotalThreadsInvoluntaryContextSwitches: 57 (57) | |
- TotalThreadsTotalWallClockTime: 21s297ms | |
- TotalThreadsSysTime: 544.000ms | |
- TotalThreadsUserTime: 5s532ms | |
- TotalThreadsVoluntaryContextSwitches: 4.49K (4486) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s795ms | |
- ExecTreeExecTime: 1s000ms | |
- OpenTime: 76.703ms | |
- ExecTreeOpenTime: 39.400us | |
- PrepareTime: 31.608ms | |
- ExecTreePrepareTime: 292.184us | |
DataStreamSender (dst_id=31):(Total: 1s126ms, non-child: 1s126ms, % non-child: 100.00%) | |
- BytesSent: 115.32 MB (120920318) | |
- NetworkThroughput(*): 267.07 MB/sec | |
- OverallThroughput: 102.40 MB/sec | |
- PeakMemoryUsage: 1.05 MB (1098744) | |
- RowsReturned: 2.49M (2493270) | |
- SerializeBatchTime: 693.750ms | |
- TransmitDataRPCTime: 431.789ms | |
- UncompressedRowBatchSize: 197.97 MB (207585567) | |
CodeGen:(Total: 104.630ms, non-child: 104.630ms, % non-child: 100.00%) | |
- CodegenTime: 1.377ms | |
- CompileTime: 14.073ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 32 (32) | |
- NumInstructions: 547 (547) | |
- OptimizationTime: 61.651ms | |
- PeakMemoryUsage: 273.50 KB (280064) | |
- PrepareTime: 28.200ms | |
HDFS_SCAN_NODE (id=4):(Total: 999.468ms, non-child: 999.468ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.36 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35 | |
Runtime filters: Only following filters arrived: , waited 923ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:105 | |
BytesRead(500.000ms): 0, 0, 122.16 MB, 245.06 MB, 350.17 MB, 456.00 MB | |
- FooterProcessingTime: (Avg: 13.338ms ; Min: 3.070ms ; Max: 45.345ms ; Number of samples: 35) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.33 | |
- BytesRead: 456.00 MB (478151119) | |
- BytesReadDataNodeCache: 445.20 MB (466829804) | |
- BytesReadLocal: 456.00 MB (478151119) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 456.00 MB (478151119) | |
- DecompressionTime: 995.540ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 35 (35) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 89.76 MB (94118577) | |
- PerReadThreadRawHdfsThroughput: 34.20 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 58.846ms | |
- RowBatchQueuePutWaitTime: 10s321ms | |
- RowsRead: 13.95M (13952334) | |
- RowsReturned: 2.49M (2493270) | |
- RowsReturnedRate: 2.49 M/sec | |
- ScanRangesComplete: 35 (35) | |
- ScannerThreadsInvoluntaryContextSwitches: 52 (52) | |
- ScannerThreadsTotalWallClockTime: 18s425ms | |
- MaterializeTupleTime(*): 2s858ms | |
- ScannerThreadsSysTime: 328.000ms | |
- ScannerThreadsUserTime: 3s920ms | |
- ScannerThreadsVoluntaryContextSwitches: 3.81K (3815) | |
- TotalRawHdfsReadTime(*): 13.021ms | |
- TotalReadThroughput: 152.00 MB/sec | |
Filter 1 (8.00 MB): | |
- Rows processed: 12.72M (12723942) | |
- Rows rejected: 4.52M (4520695) | |
- Rows total: 13.95M (13952334) | |
Filter 2 (8.00 MB): | |
- Rows processed: 9.14M (9139799) | |
- Rows rejected: 6.94M (6938369) | |
- Rows total: 9.43M (9431639) | |
Instance 514ee9ab39cdc507:34 (host=cdh4.net.cuberonlabs.com:22000):(Total: 2s738ms, non-child: 660.950ms, % non-child: 24.14%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:40/3.59 GB | |
Filter 2 arrival: 1s183ms | |
Filter 1 arrival: 1s281ms | |
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 58.08 MB, 92.44 MB, 80.95 MB, 16.16 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 1 | |
- AverageThreadTokens: 7.00 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 105.45 MB (110570590) | |
- PerHostPeakMemUsage: 1.24 GB (1328686555) | |
- RowsProduced: 2.73M (2733568) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 14.978ms | |
- TotalStorageWaitTime: 195.240ms | |
- TotalThreadsInvoluntaryContextSwitches: 77 (77) | |
- TotalThreadsTotalWallClockTime: 19s937ms | |
- TotalThreadsSysTime: 600.000ms | |
- TotalThreadsUserTime: 5s608ms | |
- TotalThreadsVoluntaryContextSwitches: 4.87K (4870) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s635ms | |
- ExecTreeExecTime: 1s004ms | |
- OpenTime: 65.287ms | |
- ExecTreeOpenTime: 37.616us | |
- PrepareTime: 37.783ms | |
- ExecTreePrepareTime: 364.452us | |
DataStreamSender (dst_id=31):(Total: 975.151ms, non-child: 975.151ms, % non-child: 100.00%) | |
- BytesSent: 125.06 MB (131139844) | |
- NetworkThroughput(*): 386.32 MB/sec | |
- OverallThroughput: 128.25 MB/sec | |
- PeakMemoryUsage: 1.05 MB (1098744) | |
- RowsReturned: 2.73M (2733568) | |
- SerializeBatchTime: 650.868ms | |
- TransmitDataRPCTime: 323.729ms | |
- UncompressedRowBatchSize: 215.94 MB (226428167) | |
CodeGen:(Total: 99.175ms, non-child: 99.175ms, % non-child: 100.00%) | |
- CodegenTime: 1.222ms | |
- CompileTime: 12.312ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 32 (32) | |
- NumInstructions: 547 (547) | |
- OptimizationTime: 52.073ms | |
- PeakMemoryUsage: 273.50 KB (280064) | |
- PrepareTime: 34.226ms | |
HDFS_SCAN_NODE (id=4):(Total: 1s003ms, non-child: 1s003ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:40/3.59 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 40 out of 40 | |
Runtime filters: Only following filters arrived: , waited 923ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:120 | |
BytesRead(500.000ms): 0, 0, 113.98 MB, 237.68 MB, 411.45 MB | |
- FooterProcessingTime: (Avg: 11.433ms ; Min: 3.372ms ; Max: 53.866ms ; Number of samples: 40) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.20 | |
- BytesRead: 483.40 MB (506880472) | |
- BytesReadDataNodeCache: 471.06 MB (493942344) | |
- BytesReadLocal: 483.40 MB (506880472) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 483.40 MB (506880472) | |
- DecompressionTime: 976.650ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 40 (40) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 88.16 MB (92440462) | |
- PerReadThreadRawHdfsThroughput: 31.94 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 64.414ms | |
- RowBatchQueuePutWaitTime: 8s872ms | |
- RowsRead: 15.04M (15041855) | |
- RowsReturned: 2.73M (2733568) | |
- RowsReturnedRate: 2.72 M/sec | |
- ScanRangesComplete: 40 (40) | |
- ScannerThreadsInvoluntaryContextSwitches: 76 (76) | |
- ScannerThreadsTotalWallClockTime: 17s237ms | |
- MaterializeTupleTime(*): 2s986ms | |
- ScannerThreadsSysTime: 416.000ms | |
- ScannerThreadsUserTime: 4s120ms | |
- ScannerThreadsVoluntaryContextSwitches: 4.16K (4161) | |
- TotalRawHdfsReadTime(*): 14.777ms | |
- TotalReadThroughput: 164.58 MB/sec | |
Filter 1 (8.00 MB): | |
- Rows processed: 14.01M (14011449) | |
- Rows rejected: 4.79M (4790698) | |
- Rows total: 15.04M (15041855) | |
Filter 2 (8.00 MB): | |
- Rows processed: 10.00M (10000277) | |
- Rows rejected: 7.52M (7517589) | |
- Rows total: 10.25M (10251157) | |
Instance 514ee9ab39cdc507:39 (host=cdh3.net.cuberonlabs.com:22000):(Total: 2s696ms, non-child: 745.042ms, % non-child: 27.63%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.39 GB | |
Filter 2 arrival: 1s175ms | |
Filter 1 arrival: 1s315ms | |
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 65.53 MB, 86.82 MB, 66.64 MB | |
ThreadUsage(500.000ms): 1, 9, 9, 9, 9 | |
- AverageThreadTokens: 7.40 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 97.91 MB (102667266) | |
- PerHostPeakMemUsage: 1.12 GB (1198374937) | |
- RowsProduced: 2.71M (2705054) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 12.786ms | |
- TotalStorageWaitTime: 128.156ms | |
- TotalThreadsInvoluntaryContextSwitches: 31 (31) | |
- TotalThreadsTotalWallClockTime: 18s007ms | |
- TotalThreadsSysTime: 460.000ms | |
- TotalThreadsUserTime: 5s600ms | |
- TotalThreadsVoluntaryContextSwitches: 4.84K (4845) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s600ms | |
- ExecTreeExecTime: 997.055ms | |
- OpenTime: 67.374ms | |
- ExecTreeOpenTime: 41.188us | |
- PrepareTime: 28.266ms | |
- ExecTreePrepareTime: 278.856us | |
DataStreamSender (dst_id=31):(Total: 864.096ms, non-child: 864.096ms, % non-child: 100.00%) | |
- BytesSent: 123.28 MB (129265987) | |
- NetworkThroughput(*): 572.24 MB/sec | |
- OverallThroughput: 142.67 MB/sec | |
- PeakMemoryUsage: 1.02 MB (1065976) | |
- RowsReturned: 2.71M (2705054) | |
- SerializeBatchTime: 648.095ms | |
- TransmitDataRPCTime: 215.428ms | |
- UncompressedRowBatchSize: 213.51 MB (223877808) | |
CodeGen:(Total: 91.471ms, non-child: 91.471ms, % non-child: 100.00%) | |
- CodegenTime: 1.364ms | |
- CompileTime: 12.915ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 32 (32) | |
- NumInstructions: 547 (547) | |
- OptimizationTime: 53.367ms | |
- PeakMemoryUsage: 273.50 KB (280064) | |
- PrepareTime: 24.604ms | |
HDFS_SCAN_NODE (id=4):(Total: 995.884ms, non-child: 995.884ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.39 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35 | |
Runtime filters: Only following filters arrived: , waited 927ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:105 | |
BytesRead(500.000ms): 0, 0, 114.71 MB, 239.81 MB, 427.43 MB | |
- FooterProcessingTime: (Avg: 15.402ms ; Min: 3.359ms ; Max: 73.829ms ; Number of samples: 35) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.40 | |
- BytesRead: 454.94 MB (477042646) | |
- BytesReadDataNodeCache: 444.14 MB (465717587) | |
- BytesReadLocal: 454.94 MB (477042646) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 454.94 MB (477042646) | |
- DecompressionTime: 902.956ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 35 (35) | |
- NumScannerThreadsStarted: 8 (8) | |
- PeakMemoryUsage: 80.90 MB (84832626) | |
- PerReadThreadRawHdfsThroughput: 34.96 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 53.969ms | |
- RowBatchQueuePutWaitTime: 7s497ms | |
- RowsRead: 14.44M (14439291) | |
- RowsReturned: 2.71M (2705054) | |
- RowsReturnedRate: 2.72 M/sec | |
- ScanRangesComplete: 35 (35) | |
- ScannerThreadsInvoluntaryContextSwitches: 29 (29) | |
- ScannerThreadsTotalWallClockTime: 15s339ms | |
- MaterializeTupleTime(*): 2s939ms | |
- ScannerThreadsSysTime: 316.000ms | |
- ScannerThreadsUserTime: 4s088ms | |
- ScannerThreadsVoluntaryContextSwitches: 4.14K (4143) | |
- TotalRawHdfsReadTime(*): 12.708ms | |
- TotalReadThroughput: 170.97 MB/sec | |
Filter 1 (8.00 MB): | |
- Rows processed: 13.18M (13184146) | |
- Rows rejected: 4.56M (4555952) | |
- Rows total: 14.44M (14439291) | |
Filter 2 (8.00 MB): | |
- Rows processed: 9.65M (9645771) | |
- Rows rejected: 7.18M (7178285) | |
- Rows total: 9.88M (9883339) | |
Instance 514ee9ab39cdc507:3e (host=cdh1.net.cuberonlabs.com:22000):(Total: 2s635ms, non-child: 599.141ms, % non-child: 22.73%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/2.99 GB | |
Filter 2 arrival: 1s185ms | |
Filter 1 arrival: 1s341ms | |
MemoryUsage(500.000ms): 334.49 KB, 62.31 KB, 2.27 MB, 77.31 MB, 68.63 MB, 55.44 MB | |
ThreadUsage(500.000ms): 1, 1, 8, 8, 8, 3 | |
- AverageThreadTokens: 4.83 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 88.78 MB (93096546) | |
- PerHostPeakMemUsage: 1.19 GB (1275970066) | |
- RowsProduced: 2.34M (2336860) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 22.958ms | |
- TotalStorageWaitTime: 180.549ms | |
- TotalThreadsInvoluntaryContextSwitches: 30 (30) | |
- TotalThreadsTotalWallClockTime: 15s608ms | |
- TotalThreadsSysTime: 480.000ms | |
- TotalThreadsUserTime: 5s004ms | |
- TotalThreadsVoluntaryContextSwitches: 4.11K (4111) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s548ms | |
- ExecTreeExecTime: 1s025ms | |
- OpenTime: 61.212ms | |
- ExecTreeOpenTime: 37.100us | |
- PrepareTime: 25.463ms | |
- ExecTreePrepareTime: 372.712us | |
DataStreamSender (dst_id=31):(Total: 930.079ms, non-child: 930.079ms, % non-child: 100.00%) | |
- BytesSent: 106.67 MB (111848715) | |
- NetworkThroughput(*): 379.47 MB/sec | |
- OverallThroughput: 114.69 MB/sec | |
- PeakMemoryUsage: 1.05 MB (1098744) | |
- RowsReturned: 2.34M (2336860) | |
- SerializeBatchTime: 648.376ms | |
- TransmitDataRPCTime: 281.098ms | |
- UncompressedRowBatchSize: 184.59 MB (193553406) | |
CodeGen:(Total: 81.664ms, non-child: 81.664ms, % non-child: 100.00%) | |
- CodegenTime: 798.924us | |
- CompileTime: 10.997ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 32 (32) | |
- NumInstructions: 547 (547) | |
- OptimizationTime: 49.495ms | |
- PeakMemoryUsage: 273.50 KB (280064) | |
- PrepareTime: 20.720ms | |
HDFS_SCAN_NODE (id=4):(Total: 1s024ms, non-child: 1s024ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/2.99 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35 | |
Runtime filters: Only following filters arrived: , waited 944ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:105 | |
BytesRead(500.000ms): 0, 0, 700.00 KB, 116.79 MB, 292.41 MB, 403.52 MB | |
- FooterProcessingTime: (Avg: 13.986ms ; Min: 3.512ms ; Max: 72.248ms ; Number of samples: 35) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 4.60 | |
- BytesRead: 403.52 MB (423122517) | |
- BytesReadDataNodeCache: 392.73 MB (411804248) | |
- BytesReadLocal: 403.52 MB (423122517) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 403.52 MB (423122517) | |
- DecompressionTime: 797.218ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 35 (35) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 71.69 MB (75171250) | |
- PerReadThreadRawHdfsThroughput: 32.08 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 65.796ms | |
- RowBatchQueuePutWaitTime: 5s681ms | |
- RowsRead: 12.55M (12550697) | |
- RowsReturned: 2.34M (2336860) | |
- RowsReturnedRate: 2.28 M/sec | |
- ScanRangesComplete: 35 (35) | |
- ScannerThreadsInvoluntaryContextSwitches: 26 (26) | |
- ScannerThreadsTotalWallClockTime: 12s998ms | |
- MaterializeTupleTime(*): 2s639ms | |
- ScannerThreadsSysTime: 352.000ms | |
- ScannerThreadsUserTime: 3s588ms | |
- ScannerThreadsVoluntaryContextSwitches: 3.50K (3496) | |
- TotalRawHdfsReadTime(*): 12.283ms | |
- TotalReadThroughput: 134.51 MB/sec | |
Filter 1 (8.00 MB): | |
- Rows processed: 11.57M (11574639) | |
- Rows rejected: 3.85M (3852025) | |
- Rows total: 12.55M (12550697) | |
Filter 2 (8.00 MB): | |
- Rows processed: 8.55M (8550192) | |
- Rows rejected: 6.36M (6361812) | |
- Rows total: 8.70M (8698672) | |
Instance 514ee9ab39cdc507:3b (host=cdh2.net.cuberonlabs.com:22000):(Total: 2s590ms, non-child: 661.203ms, % non-child: 25.52%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/3.00 GB | |
Filter 2 arrival: 1s182ms | |
Filter 1 arrival: 1s324ms | |
MemoryUsage(500.000ms): 334.49 KB, 62.31 KB, 14.01 MB, 92.36 MB, 94.59 MB, 16.14 MB | |
ThreadUsage(500.000ms): 1, 9, 10, 10, 10, 1 | |
- AverageThreadTokens: 6.83 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 97.16 MB (101881340) | |
- PerHostPeakMemUsage: 1.14 GB (1223487800) | |
- RowsProduced: 2.38M (2378568) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 12.402ms | |
- TotalStorageWaitTime: 106.668ms | |
- TotalThreadsInvoluntaryContextSwitches: 27 (27) | |
- TotalThreadsTotalWallClockTime: 19s525ms | |
- TotalThreadsSysTime: 428.000ms | |
- TotalThreadsUserTime: 5s036ms | |
- TotalThreadsVoluntaryContextSwitches: 3.96K (3958) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s482ms | |
- ExecTreeExecTime: 985.345ms | |
- OpenTime: 76.289ms | |
- ExecTreeOpenTime: 45.912us | |
- PrepareTime: 31.672ms | |
- ExecTreePrepareTime: 317.280us | |
DataStreamSender (dst_id=31):(Total: 840.495ms, non-child: 840.495ms, % non-child: 100.00%) | |
- BytesSent: 108.53 MB (113802732) | |
- NetworkThroughput(*): 571.65 MB/sec | |
- OverallThroughput: 129.13 MB/sec | |
- PeakMemoryUsage: 1.05 MB (1098744) | |
- RowsReturned: 2.38M (2378568) | |
- SerializeBatchTime: 650.033ms | |
- TransmitDataRPCTime: 189.855ms | |
- UncompressedRowBatchSize: 187.72 MB (196835081) | |
CodeGen:(Total: 104.229ms, non-child: 104.229ms, % non-child: 100.00%) | |
- CodegenTime: 1.312ms | |
- CompileTime: 13.926ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 32 (32) | |
- NumInstructions: 547 (547) | |
- OptimizationTime: 61.307ms | |
- PeakMemoryUsage: 273.50 KB (280064) | |
- PrepareTime: 28.328ms | |
HDFS_SCAN_NODE (id=4):(Total: 984.515ms, non-child: 984.515ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/3.00 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32 | |
Runtime filters: Only following filters arrived: , waited 924ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:96 | |
BytesRead(500.000ms): 0, 0, 33.05 MB, 169.27 MB, 330.32 MB | |
- FooterProcessingTime: (Avg: 14.657ms ; Min: 3.089ms ; Max: 56.792ms ; Number of samples: 32) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 8.75 | |
- BytesRead: 404.37 MB (424008438) | |
- BytesReadDataNodeCache: 394.49 MB (413655152) | |
- BytesReadLocal: 404.37 MB (424008438) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 404.37 MB (424008438) | |
- DecompressionTime: 836.483ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 32 (32) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 80.35 MB (84247929) | |
- PerReadThreadRawHdfsThroughput: 37.03 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 46.572ms | |
- RowBatchQueuePutWaitTime: 8s336ms | |
- RowsRead: 12.59M (12593336) | |
- RowsReturned: 2.38M (2378568) | |
- RowsReturnedRate: 2.42 M/sec | |
- ScanRangesComplete: 32 (32) | |
- ScannerThreadsInvoluntaryContextSwitches: 22 (22) | |
- ScannerThreadsTotalWallClockTime: 16s966ms | |
- MaterializeTupleTime(*): 2s560ms | |
- ScannerThreadsSysTime: 276.000ms | |
- ScannerThreadsUserTime: 3s624ms | |
- ScannerThreadsVoluntaryContextSwitches: 3.45K (3454) | |
- TotalRawHdfsReadTime(*): 10.665ms | |
- TotalReadThroughput: 132.13 MB/sec | |
Filter 1 (8.00 MB): | |
- Rows processed: 11.43M (11431091) | |
- Rows rejected: 3.83M (3834795) | |
- Rows total: 12.59M (12593336) | |
Filter 2 (8.00 MB): | |
- Rows processed: 8.54M (8542477) | |
- Rows rejected: 6.38M (6379973) | |
- Rows total: 8.76M (8758541) | |
Instance 514ee9ab39cdc507:41 (host=cdh8.net.cuberonlabs.com:22000):(Total: 2s576ms, non-child: 539.434ms, % non-child: 20.94%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.70 GB | |
Filter 2 arrival: 1s245ms | |
Filter 1 arrival: 1s367ms | |
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 100.93 MB, 89.16 MB, 77.99 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10, 6 | |
- AverageThreadTokens: 7.40 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 101.00 MB (105905193) | |
- PerHostPeakMemUsage: 1.13 GB (1208346900) | |
- RowsProduced: 2.30M (2301609) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 14.827ms | |
- TotalStorageWaitTime: 139.351ms | |
- TotalThreadsInvoluntaryContextSwitches: 62 (62) | |
- TotalThreadsTotalWallClockTime: 19s229ms | |
- TotalThreadsSysTime: 420.000ms | |
- TotalThreadsUserTime: 4s332ms | |
- TotalThreadsVoluntaryContextSwitches: 4.11K (4111) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s455ms | |
- ExecTreeExecTime: 971.590ms | |
- OpenTime: 73.343ms | |
- ExecTreeOpenTime: 39.575us | |
- PrepareTime: 47.299ms | |
- ExecTreePrepareTime: 250.871us | |
DataStreamSender (dst_id=31):(Total: 950.453ms, non-child: 950.453ms, % non-child: 100.00%) | |
- BytesSent: 106.50 MB (111676941) | |
- NetworkThroughput(*): 305.35 MB/sec | |
- OverallThroughput: 112.06 MB/sec | |
- PeakMemoryUsage: 1.05 MB (1098744) | |
- RowsReturned: 2.30M (2301609) | |
- SerializeBatchTime: 601.062ms | |
- TransmitDataRPCTime: 348.787ms | |
- UncompressedRowBatchSize: 183.77 MB (192693719) | |
CodeGen:(Total: 115.543ms, non-child: 115.543ms, % non-child: 100.00%) | |
- CodegenTime: 2.066ms | |
- CompileTime: 12.723ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 32 (32) | |
- NumInstructions: 547 (547) | |
- OptimizationTime: 58.947ms | |
- PeakMemoryUsage: 273.50 KB (280064) | |
- PrepareTime: 42.838ms | |
HDFS_SCAN_NODE (id=4):(Total: 970.767ms, non-child: 970.767ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.70 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 | |
Runtime filters: Only following filters arrived: , waited 904ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:84 | |
BytesRead(500.000ms): 0, 0, 120.62 MB, 256.39 MB, 362.83 MB | |
- FooterProcessingTime: (Avg: 14.339ms ; Min: 2.651ms ; Max: 62.240ms ; Number of samples: 28) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.40 | |
- BytesRead: 362.83 MB (380457173) | |
- BytesReadDataNodeCache: 354.20 MB (371403734) | |
- BytesReadLocal: 362.83 MB (380457173) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 362.83 MB (380457173) | |
- DecompressionTime: 743.662ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 28 (28) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 83.96 MB (88037483) | |
- PerReadThreadRawHdfsThroughput: 43.55 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 51.098ms | |
- RowBatchQueuePutWaitTime: 8s762ms | |
- RowsRead: 11.39M (11388046) | |
- RowsReturned: 2.30M (2301609) | |
- RowsReturnedRate: 2.37 M/sec | |
- ScanRangesComplete: 28 (28) | |
- ScannerThreadsInvoluntaryContextSwitches: 60 (60) | |
- ScannerThreadsTotalWallClockTime: 16s700ms | |
- MaterializeTupleTime(*): 2s155ms | |
- ScannerThreadsSysTime: 260.000ms | |
- ScannerThreadsUserTime: 2s964ms | |
- ScannerThreadsVoluntaryContextSwitches: 3.57K (3571) | |
- TotalRawHdfsReadTime(*): 8.135ms | |
- TotalReadThroughput: 145.13 MB/sec | |
Filter 1 (8.00 MB): | |
- Rows processed: 10.05M (10048669) | |
- Rows rejected: 3.37M (3369959) | |
- Rows total: 11.39M (11388046) | |
Filter 2 (8.00 MB): | |
- Rows processed: 7.62M (7620775) | |
- Rows rejected: 5.72M (5716478) | |
- Rows total: 8.02M (8018087) | |
Instance 514ee9ab39cdc507:44 (host=cdh10.net.cuberonlabs.com:22000):(Total: 2s563ms, non-child: 573.246ms, % non-child: 22.37%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.75 GB | |
Filter 2 arrival: 1s278ms | |
Filter 1 arrival: 1s374ms | |
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 88.19 MB, 101.34 MB, 83.21 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10, 6 | |
- AverageThreadTokens: 7.40 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 116.08 MB (121720253) | |
- PerHostPeakMemUsage: 1.16 GB (1241765271) | |
- RowsProduced: 2.20M (2203358) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 9.068ms | |
- TotalStorageWaitTime: 169.240ms | |
- TotalThreadsInvoluntaryContextSwitches: 190 (190) | |
- TotalThreadsTotalWallClockTime: 18s113ms | |
- TotalThreadsSysTime: 392.000ms | |
- TotalThreadsUserTime: 4s064ms | |
- TotalThreadsVoluntaryContextSwitches: 3.79K (3792) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s418ms | |
- ExecTreeExecTime: 948.116ms | |
- OpenTime: 98.963ms | |
- ExecTreeOpenTime: 50.128us | |
- PrepareTime: 45.929ms | |
- ExecTreePrepareTime: 466.204us | |
DataStreamSender (dst_id=31):(Total: 902.101ms, non-child: 902.101ms, % non-child: 100.00%) | |
- BytesSent: 102.11 MB (107067375) | |
- NetworkThroughput(*): 343.58 MB/sec | |
- OverallThroughput: 113.19 MB/sec | |
- PeakMemoryUsage: 1.05 MB (1098744) | |
- RowsReturned: 2.20M (2203358) | |
- SerializeBatchTime: 604.279ms | |
- TransmitDataRPCTime: 297.189ms | |
- UncompressedRowBatchSize: 175.81 MB (184350185) | |
CodeGen:(Total: 139.881ms, non-child: 139.881ms, % non-child: 100.00%) | |
- CodegenTime: 1.506ms | |
- CompileTime: 19.035ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 32 (32) | |
- NumInstructions: 547 (547) | |
- OptimizationTime: 78.561ms | |
- PeakMemoryUsage: 273.50 KB (280064) | |
- PrepareTime: 41.494ms | |
HDFS_SCAN_NODE (id=4):(Total: 947.794ms, non-child: 947.794ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.75 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30 | |
Runtime filters: Only following filters arrived: , waited 884ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
File Formats: PARQUET/SNAPPY:90 | |
BytesRead(500.000ms): 0, 0, 119.98 MB, 257.58 MB, 371.89 MB | |
- FooterProcessingTime: (Avg: 18.296ms ; Min: 2.880ms ; Max: 66.746ms ; Number of samples: 30) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.40 | |
- BytesRead: 371.89 MB (389958203) | |
- BytesReadDataNodeCache: 362.64 MB (380253704) | |
- BytesReadLocal: 371.89 MB (389958203) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 371.89 MB (389958203) | |
- DecompressionTime: 664.765ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 30 (30) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 98.90 MB (103703766) | |
- PerReadThreadRawHdfsThroughput: 39.18 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 52.598ms | |
- RowBatchQueuePutWaitTime: 8s600ms | |
- RowsRead: 11.46M (11459388) | |
- RowsReturned: 2.20M (2203358) | |
- RowsReturnedRate: 2.32 M/sec | |
- ScanRangesComplete: 30 (30) | |
- ScannerThreadsInvoluntaryContextSwitches: 180 (180) | |
- ScannerThreadsTotalWallClockTime: 15s596ms | |
- MaterializeTupleTime(*): 1s912ms | |
- ScannerThreadsSysTime: 288.000ms | |
- ScannerThreadsUserTime: 2s616ms | |
- ScannerThreadsVoluntaryContextSwitches: 3.40K (3404) | |
- TotalRawHdfsReadTime(*): 9.268ms | |
- TotalReadThroughput: 148.76 MB/sec | |
Filter 1 (8.00 MB): | |
- Rows processed: 10.50M (10498359) | |
- Rows rejected: 3.69M (3691719) | |
- Rows total: 11.46M (11459388) | |
Filter 2 (8.00 MB): | |
- Rows processed: 7.34M (7339929) | |
- Rows rejected: 5.56M (5564311) | |
- Rows total: 7.77M (7767669) | |
Instance 514ee9ab39cdc507:3a (host=cdh17.net.cuberonlabs.com:22000):(Total: 2s520ms, non-child: 675.537ms, % non-child: 26.80%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.58 GB | |
Filter 2 arrival: 1s204ms | |
Filter 1 arrival: 1s325ms | |
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 55.97 MB, 81.09 MB, 87.67 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10, 9 | |
- AverageThreadTokens: 8.00 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 101.20 MB (106116696) | |
- PerHostPeakMemUsage: 1.10 GB (1185118898) | |
- RowsProduced: 2.16M (2157672) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 17.831ms | |
- TotalStorageWaitTime: 147.238ms | |
- TotalThreadsInvoluntaryContextSwitches: 23 (23) | |
- TotalThreadsTotalWallClockTime: 18s001ms | |
- TotalThreadsSysTime: 368.000ms | |
- TotalThreadsUserTime: 4s600ms | |
- TotalThreadsVoluntaryContextSwitches: 3.73K (3732) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s412ms | |
- ExecTreeExecTime: 985.673ms | |
- OpenTime: 73.631ms | |
- ExecTreeOpenTime: 41.521us | |
- PrepareTime: 34.120ms | |
- ExecTreePrepareTime: 282.506us | |
DataStreamSender (dst_id=31):(Total: 756.253ms, non-child: 756.253ms, % non-child: 100.00%) | |
- BytesSent: 99.23 MB (104052737) | |
- NetworkThroughput(*): 551.79 MB/sec | |
- OverallThroughput: 131.22 MB/sec | |
- PeakMemoryUsage: 1.05 MB (1098744) | |
- RowsReturned: 2.16M (2157672) | |
- SerializeBatchTime: 575.913ms | |
- TransmitDataRPCTime: 179.836ms | |
- UncompressedRowBatchSize: 170.77 MB (179060553) | |
CodeGen:(Total: 103.940ms, non-child: 103.940ms, % non-child: 100.00%) | |
- CodegenTime: 1.283ms | |
- CompileTime: 13.787ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 32 (32) | |
- NumInstructions: 547 (547) | |
- OptimizationTime: 58.572ms | |
- PeakMemoryUsage: 273.50 KB (280064) | |
- PrepareTime: 30.910ms | |
HDFS_SCAN_NODE (id=4):(Total: 985.052ms, non-child: 985.052ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.58 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 26 out of 26 | |
Runtime filters: Only following filters arrived: , waited 924ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:78 | |
BytesRead(500.000ms): 0, 0, 126.10 MB, 233.31 MB, 348.22 MB | |
- FooterProcessingTime: (Avg: 14.258ms ; Min: 2.829ms ; Max: 49.622ms ; Number of samples: 26) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.00 | |
- BytesRead: 348.22 MB (365131885) | |
- BytesReadDataNodeCache: 340.19 MB (356717112) | |
- BytesReadLocal: 348.22 MB (365131885) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 348.22 MB (365131885) | |
- DecompressionTime: 775.288ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 26 (26) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 84.18 MB (88274267) | |
- PerReadThreadRawHdfsThroughput: 33.84 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 49.556ms | |
- RowBatchQueuePutWaitTime: 8s323ms | |
- RowsRead: 10.92M (10919165) | |
- RowsReturned: 2.16M (2157672) | |
- RowsReturnedRate: 2.19 M/sec | |
- ScanRangesComplete: 26 (26) | |
- ScannerThreadsInvoluntaryContextSwitches: 20 (20) | |
- ScannerThreadsTotalWallClockTime: 15s514ms | |
- MaterializeTupleTime(*): 2s268ms | |
- ScannerThreadsSysTime: 240.000ms | |
- ScannerThreadsUserTime: 3s240ms | |
- ScannerThreadsVoluntaryContextSwitches: 3.12K (3122) | |
- TotalRawHdfsReadTime(*): 10.049ms | |
- TotalReadThroughput: 139.29 MB/sec | |
Filter 1 (8.00 MB): | |
- Rows processed: 9.79M (9790286) | |
- Rows rejected: 3.33M (3328545) | |
- Rows total: 10.92M (10919165) | |
Filter 2 (8.00 MB): | |
- Rows processed: 7.30M (7298780) | |
- Rows rejected: 5.43M (5432948) | |
- Rows total: 7.59M (7590620) | |
Instance 514ee9ab39cdc507:37 (host=cdh6.net.cuberonlabs.com:22000):(Total: 2s459ms, non-child: 613.694ms, % non-child: 24.95%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/2.89 GB | |
Filter 2 arrival: 1s176ms | |
Filter 1 arrival: 1s319ms | |
MemoryUsage(500.000ms): 334.49 KB, 62.31 KB, 8.47 MB, 88.34 MB, 83.63 MB | |
ThreadUsage(500.000ms): 1, 1, 10, 10, 10 | |
- AverageThreadTokens: 6.40 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 101.08 MB (105986718) | |
- PerHostPeakMemUsage: 1.12 GB (1202239123) | |
- RowsProduced: 2.27M (2274652) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 15.768ms | |
- TotalStorageWaitTime: 176.283ms | |
- TotalThreadsInvoluntaryContextSwitches: 28 (28) | |
- TotalThreadsTotalWallClockTime: 17s490ms | |
- TotalThreadsSysTime: 432.000ms | |
- TotalThreadsUserTime: 4s652ms | |
- TotalThreadsVoluntaryContextSwitches: 3.88K (3884) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s359ms | |
- ExecTreeExecTime: 1s002ms | |
- OpenTime: 71.529ms | |
- ExecTreeOpenTime: 35.336us | |
- PrepareTime: 28.933ms | |
- ExecTreePrepareTime: 303.304us | |
DataStreamSender (dst_id=31):(Total: 748.363ms, non-child: 748.363ms, % non-child: 100.00%) | |
- BytesSent: 103.58 MB (108608715) | |
- NetworkThroughput(*): 605.18 MB/sec | |
- OverallThroughput: 138.41 MB/sec | |
- PeakMemoryUsage: 1.05 MB (1098744) | |
- RowsReturned: 2.27M (2274652) | |
- SerializeBatchTime: 576.658ms | |
- TransmitDataRPCTime: 171.152ms | |
- UncompressedRowBatchSize: 179.30 MB (188014357) | |
CodeGen:(Total: 96.251ms, non-child: 96.251ms, % non-child: 100.00%) | |
- CodegenTime: 1.292ms | |
- CompileTime: 13.202ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 32 (32) | |
- NumInstructions: 547 (547) | |
- OptimizationTime: 57.519ms | |
- PeakMemoryUsage: 273.50 KB (280064) | |
- PrepareTime: 24.934ms | |
HDFS_SCAN_NODE (id=4):(Total: 1s001ms, non-child: 1s001ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/2.89 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32 | |
Runtime filters: Only following filters arrived: , waited 923ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:96 | |
BytesRead(500.000ms): 0, 0, 53.20 MB, 185.52 MB, 355.23 MB | |
- FooterProcessingTime: (Avg: 14.196ms ; Min: 2.877ms ; Max: 61.234ms ; Number of samples: 32) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.75 | |
- BytesRead: 390.94 MB (409928073) | |
- BytesReadDataNodeCache: 381.07 MB (399577346) | |
- BytesReadLocal: 390.94 MB (409928073) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 390.94 MB (409928073) | |
- DecompressionTime: 782.762ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 32 (32) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 83.72 MB (87787375) | |
- PerReadThreadRawHdfsThroughput: 44.41 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 66.226ms | |
- RowBatchQueuePutWaitTime: 7s510ms | |
- RowsRead: 12.15M (12150960) | |
- RowsReturned: 2.27M (2274652) | |
- RowsReturnedRate: 2.27 M/sec | |
- ScanRangesComplete: 32 (32) | |
- ScannerThreadsInvoluntaryContextSwitches: 21 (21) | |
- ScannerThreadsTotalWallClockTime: 15s059ms | |
- MaterializeTupleTime(*): 2s407ms | |
- ScannerThreadsSysTime: 300.000ms | |
- ScannerThreadsUserTime: 3s364ms | |
- ScannerThreadsVoluntaryContextSwitches: 3.21K (3214) | |
- TotalRawHdfsReadTime(*): 8.595ms | |
- TotalReadThroughput: 142.09 MB/sec | |
Filter 1 (8.00 MB): | |
- Rows processed: 10.92M (10922816) | |
- Rows rejected: 3.81M (3808558) | |
- Rows total: 12.15M (12150960) | |
Filter 2 (8.00 MB): | |
- Rows processed: 8.12M (8119170) | |
- Rows rejected: 6.07M (6067750) | |
- Rows total: 8.34M (8342402) | |
Instance 514ee9ab39cdc507:40 (host=cdh7.net.cuberonlabs.com:22000):(Total: 2s447ms, non-child: 503.545ms, % non-child: 20.57%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:27/2.46 GB | |
Filter 2 arrival: 1s232ms | |
Filter 1 arrival: 1s378ms | |
MemoryUsage(500.000ms): 334.49 KB, 62.31 KB, 7.66 MB, 90.08 MB, 82.52 MB | |
ThreadUsage(500.000ms): 1, 9, 10, 10, 10 | |
- AverageThreadTokens: 8.00 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 104.44 MB (109515662) | |
- PerHostPeakMemUsage: 1.11 GB (1196289976) | |
- RowsProduced: 2.07M (2065360) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 18.971ms | |
- TotalStorageWaitTime: 335.720ms | |
- TotalThreadsInvoluntaryContextSwitches: 115 (115) | |
- TotalThreadsTotalWallClockTime: 17s797ms | |
- TotalThreadsSysTime: 416.000ms | |
- TotalThreadsUserTime: 4s308ms | |
- TotalThreadsVoluntaryContextSwitches: 4.09K (4091) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s331ms | |
- ExecTreeExecTime: 995.729ms | |
- OpenTime: 80.687ms | |
- ExecTreeOpenTime: 42.046us | |
- PrepareTime: 35.068ms | |
- ExecTreePrepareTime: 292.340us | |
DataStreamSender (dst_id=31):(Total: 837.499ms, non-child: 837.499ms, % non-child: 100.00%) | |
- BytesSent: 94.83 MB (99432439) | |
- NetworkThroughput(*): 286.50 MB/sec | |
- OverallThroughput: 113.23 MB/sec | |
- PeakMemoryUsage: 1.05 MB (1098744) | |
- RowsReturned: 2.07M (2065360) | |
- SerializeBatchTime: 506.040ms | |
- TransmitDataRPCTime: 330.984ms | |
- UncompressedRowBatchSize: 164.14 MB (172117913) | |
CodeGen:(Total: 111.516ms, non-child: 111.516ms, % non-child: 100.00%) | |
- CodegenTime: 1.531ms | |
- CompileTime: 14.397ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 32 (32) | |
- NumInstructions: 547 (547) | |
- OptimizationTime: 65.014ms | |
- PeakMemoryUsage: 273.50 KB (280064) | |
- PrepareTime: 31.325ms | |
HDFS_SCAN_NODE (id=4):(Total: 995.100ms, non-child: 995.100ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:27/2.46 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 27 out of 27 | |
Runtime filters: Only following filters arrived: , waited 924ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:81 | |
BytesRead(500.000ms): 0, 0, 76.60 MB, 145.04 MB, 303.30 MB | |
- FooterProcessingTime: (Avg: 19.756ms ; Min: 3.067ms ; Max: 105.169ms ; Number of samples: 27) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 8.75 | |
- BytesRead: 331.18 MB (347264442) | |
- BytesReadDataNodeCache: 322.86 MB (338539012) | |
- BytesReadLocal: 331.18 MB (347264442) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 331.18 MB (347264442) | |
- DecompressionTime: 768.852ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 27 (27) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 87.33 MB (91574953) | |
- PerReadThreadRawHdfsThroughput: 40.30 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 57.167ms | |
- RowBatchQueuePutWaitTime: 6s517ms | |
- RowsRead: 10.29M (10293228) | |
- RowsReturned: 2.07M (2065360) | |
- RowsReturnedRate: 2.08 M/sec | |
- ScanRangesComplete: 27 (27) | |
- ScannerThreadsInvoluntaryContextSwitches: 105 (105) | |
- ScannerThreadsTotalWallClockTime: 15s384ms | |
- MaterializeTupleTime(*): 2s269ms | |
- ScannerThreadsSysTime: 280.000ms | |
- ScannerThreadsUserTime: 3s064ms | |
- ScannerThreadsVoluntaryContextSwitches: 3.27K (3271) | |
- TotalRawHdfsReadTime(*): 8.024ms | |
- TotalReadThroughput: 121.32 MB/sec | |
Filter 1 (8.00 MB): | |
- Rows processed: 8.91M (8909474) | |
- Rows rejected: 2.93M (2928028) | |
- Rows total: 10.29M (10293228) | |
Filter 2 (8.00 MB): | |
- Rows processed: 7.04M (7041616) | |
- Rows rejected: 5.30M (5299840) | |
- Rows total: 7.37M (7365200) | |
Instance 514ee9ab39cdc507:43 (host=cdh9.net.cuberonlabs.com:22000):(Total: 2s438ms, non-child: 565.029ms, % non-child: 23.17%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/3.02 GB | |
Filter 2 arrival: 1s253ms | |
Filter 1 arrival: 1s370ms | |
MemoryUsage(500.000ms): 334.49 KB, 62.31 KB, 8.42 MB, 85.30 MB, 80.66 MB | |
ThreadUsage(500.000ms): 1, 9, 10, 10, 10 | |
- AverageThreadTokens: 8.00 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 97.75 MB (102496077) | |
- PerHostPeakMemUsage: 1.14 GB (1228248750) | |
- RowsProduced: 2.54M (2540173) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 18.063ms | |
- TotalStorageWaitTime: 87.061ms | |
- TotalThreadsInvoluntaryContextSwitches: 12 (12) | |
- TotalThreadsTotalWallClockTime: 18s373ms | |
- TotalThreadsSysTime: 324.000ms | |
- TotalThreadsUserTime: 4s756ms | |
- TotalThreadsVoluntaryContextSwitches: 4.33K (4332) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s326ms | |
- ExecTreeExecTime: 973.536ms | |
- OpenTime: 78.648ms | |
- ExecTreeOpenTime: 42.455us | |
- PrepareTime: 33.332ms | |
- ExecTreePrepareTime: 334.133us | |
DataStreamSender (dst_id=31):(Total: 792.071ms, non-child: 792.071ms, % non-child: 100.00%) | |
- BytesSent: 117.66 MB (123373300) | |
- NetworkThroughput(*): 618.18 MB/sec | |
- OverallThroughput: 148.54 MB/sec | |
- PeakMemoryUsage: 1.02 MB (1065976) | |
- RowsReturned: 2.54M (2540173) | |
- SerializeBatchTime: 601.158ms | |
- TransmitDataRPCTime: 190.330ms | |
- UncompressedRowBatchSize: 202.52 MB (212361693) | |
CodeGen:(Total: 107.974ms, non-child: 107.974ms, % non-child: 100.00%) | |
- CodegenTime: 1.436ms | |
- CompileTime: 14.389ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 32 (32) | |
- NumInstructions: 547 (547) | |
- OptimizationTime: 63.154ms | |
- PeakMemoryUsage: 273.50 KB (280064) | |
- PrepareTime: 29.725ms | |
HDFS_SCAN_NODE (id=4):(Total: 973.028ms, non-child: 973.028ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/3.02 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31 | |
Runtime filters: Only following filters arrived: , waited 923ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:93 | |
BytesRead(500.000ms): 0, 0, 28.85 MB, 168.43 MB, 393.09 MB | |
- FooterProcessingTime: (Avg: 13.276ms ; Min: 2.899ms ; Max: 47.455ms ; Number of samples: 31) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 8.75 | |
- BytesRead: 407.14 MB (426915606) | |
- BytesReadDataNodeCache: 397.58 MB (416888203) | |
- BytesReadLocal: 407.14 MB (426915606) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 407.14 MB (426915606) | |
- DecompressionTime: 755.764ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 31 (31) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 80.89 MB (84818613) | |
- PerReadThreadRawHdfsThroughput: 38.55 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 37.815ms | |
- RowBatchQueuePutWaitTime: 7s682ms | |
- RowsRead: 12.71M (12711965) | |
- RowsReturned: 2.54M (2540173) | |
- RowsReturnedRate: 2.61 M/sec | |
- ScanRangesComplete: 31 (31) | |
- ScannerThreadsInvoluntaryContextSwitches: 11 (11) | |
- ScannerThreadsTotalWallClockTime: 15s968ms | |
- MaterializeTupleTime(*): 2s413ms | |
- ScannerThreadsSysTime: 236.000ms | |
- ScannerThreadsUserTime: 3s428ms | |
- ScannerThreadsVoluntaryContextSwitches: 3.62K (3618) | |
- TotalRawHdfsReadTime(*): 10.313ms | |
- TotalReadThroughput: 157.24 MB/sec | |
Filter 1 (8.00 MB): | |
- Rows processed: 11.32M (11317517) | |
- Rows rejected: 3.75M (3745695) | |
- Rows total: 12.71M (12711965) | |
Filter 2 (8.00 MB): | |
- Rows processed: 8.55M (8549502) | |
- Rows rejected: 6.43M (6426097) | |
- Rows total: 8.97M (8966270) | |
Instance 514ee9ab39cdc507:35 (host=cdh16.net.cuberonlabs.com:22000):(Total: 2s315ms, non-child: 483.680ms, % non-child: 20.89%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.64 GB | |
Filter 2 arrival: 1s228ms | |
Filter 1 arrival: 1s322ms | |
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 91.80 MB, 84.44 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10 | |
- AverageThreadTokens: 7.75 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 98.24 MB (103010051) | |
- PerHostPeakMemUsage: 1.12 GB (1206706067) | |
- RowsProduced: 2.15M (2149394) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 16.808ms | |
- TotalStorageWaitTime: 181.040ms | |
- TotalThreadsInvoluntaryContextSwitches: 10 (10) | |
- TotalThreadsTotalWallClockTime: 15s897ms | |
- TotalThreadsSysTime: 304.000ms | |
- TotalThreadsUserTime: 4s096ms | |
- TotalThreadsVoluntaryContextSwitches: 3.49K (3487) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s205ms | |
- ExecTreeExecTime: 967.844ms | |
- OpenTime: 76.892ms | |
- ExecTreeOpenTime: 40.505us | |
- PrepareTime: 32.959ms | |
- ExecTreePrepareTime: 237.637us | |
DataStreamSender (dst_id=31):(Total: 758.788ms, non-child: 758.788ms, % non-child: 100.00%) | |
- BytesSent: 99.38 MB (104202598) | |
- NetworkThroughput(*): 514.76 MB/sec | |
- OverallThroughput: 130.97 MB/sec | |
- PeakMemoryUsage: 1.05 MB (1098744) | |
- RowsReturned: 2.15M (2149394) | |
- SerializeBatchTime: 565.191ms | |
- TransmitDataRPCTime: 193.050ms | |
- UncompressedRowBatchSize: 170.94 MB (179239272) | |
CodeGen:(Total: 106.191ms, non-child: 106.191ms, % non-child: 100.00%) | |
- CodegenTime: 1.428ms | |
- CompileTime: 13.981ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 32 (32) | |
- NumInstructions: 547 (547) | |
- OptimizationTime: 61.855ms | |
- PeakMemoryUsage: 273.50 KB (280064) | |
- PrepareTime: 29.616ms | |
HDFS_SCAN_NODE (id=4):(Total: 967.112ms, non-child: 967.112ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.64 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 | |
Runtime filters: Only following filters arrived: , waited 923ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:84 | |
BytesRead(500.000ms): 0, 0, 125.80 MB, 299.26 MB | |
- FooterProcessingTime: (Avg: 13.192ms ; Min: 2.890ms ; Max: 54.360ms ; Number of samples: 28) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.75 | |
- BytesRead: 355.65 MB (372923733) | |
- BytesReadDataNodeCache: 347.01 MB (363866796) | |
- BytesReadLocal: 355.65 MB (372923733) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 355.65 MB (372923733) | |
- DecompressionTime: 698.464ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 28 (28) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 81.01 MB (84943509) | |
- PerReadThreadRawHdfsThroughput: 31.82 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 33.702ms | |
- RowBatchQueuePutWaitTime: 6s752ms | |
- RowsRead: 11.05M (11051815) | |
- RowsReturned: 2.15M (2149394) | |
- RowsReturnedRate: 2.22 M/sec | |
- ScanRangesComplete: 28 (28) | |
- ScannerThreadsInvoluntaryContextSwitches: 9 (9) | |
- ScannerThreadsTotalWallClockTime: 13s614ms | |
- MaterializeTupleTime(*): 1s970ms | |
- ScannerThreadsSysTime: 224.000ms | |
- ScannerThreadsUserTime: 2s872ms | |
- ScannerThreadsVoluntaryContextSwitches: 3.06K (3065) | |
- TotalRawHdfsReadTime(*): 10.914ms | |
- TotalReadThroughput: 149.63 MB/sec | |
Filter 1 (8.00 MB): | |
- Rows processed: 9.84M (9841992) | |
- Rows rejected: 3.38M (3382474) | |
- Rows total: 11.05M (11051815) | |
Filter 2 (8.00 MB): | |
- Rows processed: 7.32M (7316765) | |
- Rows rejected: 5.52M (5519947) | |
- Rows total: 7.67M (7669341) | |
Instance 514ee9ab39cdc507:36 (host=cdh13.net.cuberonlabs.com:22000):(Total: 2s287ms, non-child: 545.263ms, % non-child: 23.83%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/2.80 GB | |
Filter 2 arrival: 1s183ms | |
Filter 1 arrival: 1s313ms | |
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 83.95 MB, 91.20 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10 | |
- AverageThreadTokens: 7.75 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 107.30 MB (112511598) | |
- PerHostPeakMemUsage: 1.13 GB (1212995919) | |
- RowsProduced: 2.12M (2116190) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 6.925ms | |
- TotalStorageWaitTime: 125.046ms | |
- TotalThreadsInvoluntaryContextSwitches: 29 (29) | |
- TotalThreadsTotalWallClockTime: 15s871ms | |
- TotalThreadsSysTime: 356.000ms | |
- TotalThreadsUserTime: 4s248ms | |
- TotalThreadsVoluntaryContextSwitches: 3.90K (3904) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s176ms | |
- ExecTreeExecTime: 975.677ms | |
- OpenTime: 77.271ms | |
- ExecTreeOpenTime: 43.291us | |
- PrepareTime: 34.427ms | |
- ExecTreePrepareTime: 414.211us | |
DataStreamSender (dst_id=31):(Total: 659.919ms, non-child: 659.919ms, % non-child: 100.00%) | |
- BytesSent: 97.56 MB (102301510) | |
- NetworkThroughput(*): 648.29 MB/sec | |
- OverallThroughput: 147.84 MB/sec | |
- PeakMemoryUsage: 1.05 MB (1098744) | |
- RowsReturned: 2.12M (2116190) | |
- SerializeBatchTime: 508.960ms | |
- TransmitDataRPCTime: 150.492ms | |
- UncompressedRowBatchSize: 168.16 MB (176327357) | |
CodeGen:(Total: 107.355ms, non-child: 107.355ms, % non-child: 100.00%) | |
- CodegenTime: 1.338ms | |
- CompileTime: 13.950ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 32 (32) | |
- NumInstructions: 547 (547) | |
- OptimizationTime: 62.183ms | |
- PeakMemoryUsage: 273.50 KB (280064) | |
- PrepareTime: 30.468ms | |
HDFS_SCAN_NODE (id=4):(Total: 975.257ms, non-child: 975.257ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/2.80 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31 | |
Runtime filters: Only following filters arrived: , waited 924ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:93 | |
BytesRead(500.000ms): 0, 0, 114.22 MB, 298.80 MB | |
- FooterProcessingTime: (Avg: 12.148ms ; Min: 2.607ms ; Max: 47.645ms ; Number of samples: 31) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.75 | |
- BytesRead: 379.46 MB (397894562) | |
- BytesReadDataNodeCache: 369.90 MB (387872500) | |
- BytesReadLocal: 379.46 MB (397894562) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 379.46 MB (397894562) | |
- DecompressionTime: 713.376ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 31 (31) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 89.99 MB (94365110) | |
- PerReadThreadRawHdfsThroughput: 38.90 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 40.998ms | |
- RowBatchQueuePutWaitTime: 6s263ms | |
- RowsRead: 11.68M (11677391) | |
- RowsReturned: 2.12M (2116190) | |
- RowsReturnedRate: 2.17 M/sec | |
- ScanRangesComplete: 31 (31) | |
- ScannerThreadsInvoluntaryContextSwitches: 24 (24) | |
- ScannerThreadsTotalWallClockTime: 13s618ms | |
- MaterializeTupleTime(*): 2s207ms | |
- ScannerThreadsSysTime: 224.000ms | |
- ScannerThreadsUserTime: 3s108ms | |
- ScannerThreadsVoluntaryContextSwitches: 3.35K (3347) | |
- TotalRawHdfsReadTime(*): 9.525ms | |
- TotalReadThroughput: 149.40 MB/sec | |
Filter 1 (8.00 MB): | |
- Rows processed: 10.44M (10444627) | |
- Rows rejected: 3.95M (3945787) | |
- Rows total: 11.68M (11677391) | |
Filter 2 (8.00 MB): | |
- Rows processed: 7.47M (7474580) | |
- Rows rejected: 5.62M (5615414) | |
- Rows total: 7.73M (7731604) | |
Instance 514ee9ab39cdc507:3c (host=cdh12.net.cuberonlabs.com:22000):(Total: 2s253ms, non-child: 427.952ms, % non-child: 18.99%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:20/1.81 GB | |
Filter 2 arrival: 1s255ms | |
Filter 1 arrival: 1s392ms | |
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 57.48 MB, 83.97 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10 | |
- AverageThreadTokens: 7.75 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 107.91 MB (113150469) | |
- PerHostPeakMemUsage: 1.12 GB (1201773720) | |
- RowsProduced: 1.69M (1692231) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 7.149ms | |
- TotalStorageWaitTime: 96.740ms | |
- TotalThreadsInvoluntaryContextSwitches: 14 (14) | |
- TotalThreadsTotalWallClockTime: 16s813ms | |
- TotalThreadsSysTime: 324.000ms | |
- TotalThreadsUserTime: 3s288ms | |
- TotalThreadsVoluntaryContextSwitches: 3.33K (3330) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s134ms | |
- ExecTreeExecTime: 957.231ms | |
- OpenTime: 81.364ms | |
- ExecTreeOpenTime: 43.704us | |
- PrepareTime: 38.305ms | |
- ExecTreePrepareTime: 238.994us | |
DataStreamSender (dst_id=31):(Total: 753.685ms, non-child: 753.685ms, % non-child: 100.00%) | |
- BytesSent: 78.55 MB (82369455) | |
- NetworkThroughput(*): 264.31 MB/sec | |
- OverallThroughput: 104.23 MB/sec | |
- PeakMemoryUsage: 984.99 KB (1008632) | |
- RowsReturned: 1.69M (1692231) | |
- SerializeBatchTime: 456.039ms | |
- TransmitDataRPCTime: 297.203ms | |
- UncompressedRowBatchSize: 135.17 MB (141731854) | |
CodeGen:(Total: 115.657ms, non-child: 115.657ms, % non-child: 100.00%) | |
- CodegenTime: 1.642ms | |
- CompileTime: 14.611ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 32 (32) | |
- NumInstructions: 547 (547) | |
- OptimizationTime: 65.450ms | |
- PeakMemoryUsage: 273.50 KB (280064) | |
- PrepareTime: 34.738ms | |
HDFS_SCAN_NODE (id=4):(Total: 956.581ms, non-child: 956.581ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:20/1.81 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 20 out of 20 | |
Runtime filters: Only following filters arrived: , waited 904ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
File Formats: PARQUET/SNAPPY:60 | |
BytesRead(500.000ms): 0, 0, 125.52 MB, 213.01 MB | |
- FooterProcessingTime: (Avg: 25.096ms ; Min: 3.239ms ; Max: 63.428ms ; Number of samples: 20) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.75 | |
- BytesRead: 244.33 MB (256195759) | |
- BytesReadDataNodeCache: 238.16 MB (249727072) | |
- BytesReadLocal: 244.33 MB (256195759) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 244.33 MB (256195759) | |
- DecompressionTime: 571.883ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 20 (20) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 90.61 MB (95013829) | |
- PerReadThreadRawHdfsThroughput: 32.63 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 40.796ms | |
- RowBatchQueuePutWaitTime: 6s726ms | |
- RowsRead: 7.62M (7619211) | |
- RowsReturned: 1.69M (1692231) | |
- RowsReturnedRate: 1.77 M/sec | |
- ScanRangesComplete: 20 (20) | |
- ScannerThreadsInvoluntaryContextSwitches: 12 (12) | |
- ScannerThreadsTotalWallClockTime: 14s597ms | |
- MaterializeTupleTime(*): 1s597ms | |
- ScannerThreadsSysTime: 184.000ms | |
- ScannerThreadsUserTime: 2s200ms | |
- ScannerThreadsVoluntaryContextSwitches: 2.71K (2706) | |
- TotalRawHdfsReadTime(*): 7.312ms | |
- TotalReadThroughput: 106.50 MB/sec | |
Filter 1 (8.00 MB): | |
- Rows processed: 6.18M (6175108) | |
- Rows rejected: 2.08M (2077633) | |
- Rows total: 7.62M (7619211) | |
Filter 2 (8.00 MB): | |
- Rows processed: 5.15M (5149386) | |
- Rows rejected: 3.85M (3849347) | |
- Rows total: 5.54M (5541578) | |
Instance 514ee9ab39cdc507:42 (host=cdh11.net.cuberonlabs.com:22000):(Total: 2s219ms, non-child: 479.643ms, % non-child: 21.61%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:21/2.18 GB | |
Filter 2 arrival: 1s253ms | |
Filter 1 arrival: 1s368ms | |
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 106.55 MB, 105.27 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10 | |
- AverageThreadTokens: 7.75 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 109.01 MB (114300249) | |
- PerHostPeakMemUsage: 1.13 GB (1213483033) | |
- RowsProduced: 1.82M (1815269) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 5.498ms | |
- TotalStorageWaitTime: 97.344ms | |
- TotalThreadsInvoluntaryContextSwitches: 20 (20) | |
- TotalThreadsTotalWallClockTime: 16s478ms | |
- TotalThreadsSysTime: 312.000ms | |
- TotalThreadsUserTime: 3s552ms | |
- TotalThreadsVoluntaryContextSwitches: 3.10K (3099) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s103ms | |
- ExecTreeExecTime: 982.167ms | |
- OpenTime: 80.595ms | |
- ExecTreeOpenTime: 47.578us | |
- PrepareTime: 35.571ms | |
- ExecTreePrepareTime: 305.007us | |
DataStreamSender (dst_id=31):(Total: 646.700ms, non-child: 646.700ms, % non-child: 100.00%) | |
- BytesSent: 84.17 MB (88259837) | |
- NetworkThroughput(*): 573.90 MB/sec | |
- OverallThroughput: 130.15 MB/sec | |
- PeakMemoryUsage: 1.05 MB (1098744) | |
- RowsReturned: 1.82M (1815269) | |
- SerializeBatchTime: 499.527ms | |
- TransmitDataRPCTime: 146.665ms | |
- UncompressedRowBatchSize: 144.71 MB (151735864) | |
CodeGen:(Total: 111.697ms, non-child: 111.697ms, % non-child: 100.00%) | |
- CodegenTime: 1.485ms | |
- CompileTime: 14.747ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 32 (32) | |
- NumInstructions: 547 (547) | |
- OptimizationTime: 64.638ms | |
- PeakMemoryUsage: 273.50 KB (280064) | |
- PrepareTime: 31.552ms | |
HDFS_SCAN_NODE (id=4):(Total: 981.880ms, non-child: 981.880ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:21/2.18 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 21 out of 21 | |
Runtime filters: Only following filters arrived: , waited 923ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
File Formats: PARQUET/SNAPPY:63 | |
BytesRead(500.000ms): 0, 0, 126.17 MB, 295.08 MB | |
- FooterProcessingTime: (Avg: 15.731ms ; Min: 2.930ms ; Max: 43.360ms ; Number of samples: 21) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.75 | |
- BytesRead: 295.08 MB (309412485) | |
- BytesReadDataNodeCache: 288.60 MB (302617091) | |
- BytesReadLocal: 295.08 MB (309412485) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 295.08 MB (309412485) | |
- DecompressionTime: 619.220ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 21 (21) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 92.00 MB (96468568) | |
- PerReadThreadRawHdfsThroughput: 42.25 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 46.960ms | |
- RowBatchQueuePutWaitTime: 6s478ms | |
- RowsRead: 8.99M (8989956) | |
- RowsReturned: 1.82M (1815269) | |
- RowsReturnedRate: 1.85 M/sec | |
- ScanRangesComplete: 21 (21) | |
- ScannerThreadsInvoluntaryContextSwitches: 20 (20) | |
- ScannerThreadsTotalWallClockTime: 14s294ms | |
- MaterializeTupleTime(*): 1s718ms | |
- ScannerThreadsSysTime: 228.000ms | |
- ScannerThreadsUserTime: 2s432ms | |
- ScannerThreadsVoluntaryContextSwitches: 2.69K (2685) | |
- TotalRawHdfsReadTime(*): 6.820ms | |
- TotalReadThroughput: 147.54 MB/sec | |
Filter 1 (8.00 MB): | |
- Rows processed: 7.71M (7705493) | |
- Rows rejected: 2.78M (2781853) | |
- Rows total: 8.99M (8989956) | |
Filter 2 (8.00 MB): | |
- Rows processed: 5.85M (5854823) | |
- Rows rejected: 4.39M (4392834) | |
- Rows total: 6.21M (6208103) | |
Instance 514ee9ab39cdc507:38 (host=cdh15.net.cuberonlabs.com:22000):(Total: 2s209ms, non-child: 486.983ms, % non-child: 22.04%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.66 GB | |
Filter 2 arrival: 1s176ms | |
Filter 1 arrival: 1s311ms | |
MemoryUsage(500.000ms): 52.99 KB, 62.31 KB, 86.31 KB, 77.44 MB, 84.29 MB | |
ThreadUsage(500.000ms): 1, 1, 10, 10, 10 | |
- AverageThreadTokens: 6.40 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 104.37 MB (109435945) | |
- PerHostPeakMemUsage: 1.12 GB (1205171847) | |
- RowsProduced: 2.05M (2047960) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 6.485ms | |
- TotalStorageWaitTime: 101.473ms | |
- TotalThreadsInvoluntaryContextSwitches: 75 (75) | |
- TotalThreadsTotalWallClockTime: 16s040ms | |
- TotalThreadsSysTime: 356.000ms | |
- TotalThreadsUserTime: 3s932ms | |
- TotalThreadsVoluntaryContextSwitches: 3.36K (3364) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s092ms | |
- ExecTreeExecTime: 955.363ms | |
- OpenTime: 81.031ms | |
- ExecTreeOpenTime: 42.805us | |
- PrepareTime: 36.086ms | |
- ExecTreePrepareTime: 290.026us | |
DataStreamSender (dst_id=31):(Total: 654.227ms, non-child: 654.227ms, % non-child: 100.00%) | |
- BytesSent: 92.99 MB (97511479) | |
- NetworkThroughput(*): 591.91 MB/sec | |
- OverallThroughput: 142.14 MB/sec | |
- PeakMemoryUsage: 1.05 MB (1098744) | |
- RowsReturned: 2.05M (2047960) | |
- SerializeBatchTime: 496.665ms | |
- TransmitDataRPCTime: 157.109ms | |
- UncompressedRowBatchSize: 161.35 MB (169190904) | |
CodeGen:(Total: 113.108ms, non-child: 113.108ms, % non-child: 100.00%) | |
- CodegenTime: 1.548ms | |
- CompileTime: 14.605ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 32 (32) | |
- NumInstructions: 547 (547) | |
- OptimizationTime: 65.430ms | |
- PeakMemoryUsage: 273.50 KB (280064) | |
- PrepareTime: 32.294ms | |
HDFS_SCAN_NODE (id=4):(Total: 954.854ms, non-child: 954.854ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.66 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30 | |
Runtime filters: Only following filters arrived: , waited 904ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:90 | |
BytesRead(500.000ms): 0, 0, 300.00 KB, 167.42 MB, 359.86 MB | |
- FooterProcessingTime: (Avg: 17.012ms ; Min: 2.770ms ; Max: 65.700ms ; Number of samples: 30) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.75 | |
- BytesRead: 359.86 MB (377336639) | |
- BytesReadDataNodeCache: 350.60 MB (367631328) | |
- BytesReadLocal: 359.86 MB (377336639) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 359.86 MB (377336639) | |
- DecompressionTime: 668.942ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 30 (30) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 87.23 MB (91468692) | |
- PerReadThreadRawHdfsThroughput: 34.17 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 41.277ms | |
- RowBatchQueuePutWaitTime: 6s170ms | |
- RowsRead: 11.11M (11113210) | |
- RowsReturned: 2.05M (2047960) | |
- RowsReturnedRate: 2.14 M/sec | |
- ScanRangesComplete: 30 (30) | |
- ScannerThreadsInvoluntaryContextSwitches: 74 (74) | |
- ScannerThreadsTotalWallClockTime: 13s867ms | |
- MaterializeTupleTime(*): 1s985ms | |
- ScannerThreadsSysTime: 268.000ms | |
- ScannerThreadsUserTime: 2s804ms | |
- ScannerThreadsVoluntaryContextSwitches: 2.98K (2977) | |
- TotalRawHdfsReadTime(*): 10.284ms | |
- TotalReadThroughput: 143.94 MB/sec | |
Filter 1 (8.00 MB): | |
- Rows processed: 9.73M (9727261) | |
- Rows rejected: 3.53M (3526130) | |
- Rows total: 11.11M (11113210) | |
Filter 2 (8.00 MB): | |
- Rows processed: 7.34M (7342879) | |
- Rows rejected: 5.54M (5539120) | |
- Rows total: 7.59M (7587080) | |
Instance 514ee9ab39cdc507:3d (host=cdh14.net.cuberonlabs.com:22000):(Total: 2s121ms, non-child: 467.589ms, % non-child: 22.04%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:22/2.04 GB | |
Filter 2 arrival: 1s238ms | |
Filter 1 arrival: 1s344ms | |
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 68.30 MB, 87.90 MB | |
ThreadUsage(500.000ms): 1, 10, 10, 10 | |
- AverageThreadTokens: 7.75 | |
- BloomFilterBytes: 16.00 MB (16777216) | |
- PeakMemoryUsage: 102.12 MB (107082528) | |
- PerHostPeakMemUsage: 1.14 GB (1223666665) | |
- RowsProduced: 1.76M (1757910) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 10.350ms | |
- TotalStorageWaitTime: 107.113ms | |
- TotalThreadsInvoluntaryContextSwitches: 16 (16) | |
- TotalThreadsTotalWallClockTime: 15s695ms | |
- TotalThreadsSysTime: 296.000ms | |
- TotalThreadsUserTime: 3s108ms | |
- TotalThreadsVoluntaryContextSwitches: 3.20K (3201) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 2s003ms | |
- ExecTreeExecTime: 959.223ms | |
- OpenTime: 81.844ms | |
- ExecTreeOpenTime: 41.285us | |
- PrepareTime: 35.627ms | |
- ExecTreePrepareTime: 248.867us | |
DataStreamSender (dst_id=31):(Total: 581.607ms, non-child: 581.607ms, % non-child: 100.00%) | |
- BytesSent: 80.97 MB (84902275) | |
- NetworkThroughput(*): 648.12 MB/sec | |
- OverallThroughput: 139.22 MB/sec | |
- PeakMemoryUsage: 1.05 MB (1098744) | |
- RowsReturned: 1.76M (1757910) | |
- SerializeBatchTime: 456.265ms | |
- TransmitDataRPCTime: 124.929ms | |
- UncompressedRowBatchSize: 140.34 MB (147160131) | |
CodeGen:(Total: 113.415ms, non-child: 113.415ms, % non-child: 100.00%) | |
- CodegenTime: 1.430ms | |
- CompileTime: 14.472ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 32 (32) | |
- NumInstructions: 547 (547) | |
- OptimizationTime: 66.163ms | |
- PeakMemoryUsage: 273.50 KB (280064) | |
- PrepareTime: 32.043ms | |
HDFS_SCAN_NODE (id=4):(Total: 958.695ms, non-child: 958.695ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:22/2.04 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 22 out of 22 | |
Runtime filters: Only following filters arrived: , waited 904ms | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:66 | |
BytesRead(500.000ms): 0, 0, 118.26 MB, 261.11 MB | |
- FooterProcessingTime: (Avg: 23.177ms ; Min: 3.315ms ; Max: 72.449ms ; Number of samples: 22) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 6.75 | |
- BytesRead: 275.30 MB (288674646) | |
- BytesReadDataNodeCache: 268.52 MB (281558457) | |
- BytesReadLocal: 275.30 MB (288674646) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 275.30 MB (288674646) | |
- DecompressionTime: 498.171ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 22 (22) | |
- NumScannerThreadsStarted: 9 (9) | |
- PeakMemoryUsage: 84.86 MB (88981795) | |
- PerReadThreadRawHdfsThroughput: 32.25 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 45.589ms | |
- RowBatchQueuePutWaitTime: 5s877ms | |
- RowsRead: 8.55M (8554292) | |
- RowsReturned: 1.76M (1757910) | |
- RowsReturnedRate: 1.83 M/sec | |
- ScanRangesComplete: 22 (22) | |
- ScannerThreadsInvoluntaryContextSwitches: 11 (11) | |
- ScannerThreadsTotalWallClockTime: 13s609ms | |
- MaterializeTupleTime(*): 1s483ms | |
- ScannerThreadsSysTime: 188.000ms | |
- ScannerThreadsUserTime: 2s100ms | |
- ScannerThreadsVoluntaryContextSwitches: 2.71K (2708) | |
- TotalRawHdfsReadTime(*): 8.336ms | |
- TotalReadThroughput: 130.56 MB/sec | |
Filter 1 (8.00 MB): | |
- Rows processed: 7.34M (7336885) | |
- Rows rejected: 2.57M (2569676) | |
- Rows total: 8.55M (8554292) | |
Filter 2 (8.00 MB): | |
- Rows processed: 5.60M (5603688) | |
- Rows rejected: 4.23M (4226706) | |
- Rows total: 5.98M (5984616) | |
Averaged Fragment F06:(Total: 727.199ms, non-child: 19.705ms, % non-child: 2.71%) | |
split sizes: min: 0, max: 0, avg: 0, stddev: 0 | |
completion times: min:716.217ms max:742.308ms mean: 728.009ms stddev:6.591ms | |
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec | |
num instances: 17 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 11.34 MB (11893844) | |
- PerHostPeakMemUsage: 382.09 MB (400655012) | |
- RowsProduced: 30.48K (30477) | |
- TotalNetworkReceiveTime: 537.789ms | |
- TotalNetworkSendTime: 5.871ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 691.075ms | |
- TotalThreadsSysTime: 7.529ms | |
- TotalThreadsUserTime: 142.352ms | |
- TotalThreadsVoluntaryContextSwitches: 240 (240) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 33.739ms | |
- ExecTreeExecTime: 2.863ms | |
- OpenTime: 657.355ms | |
- ExecTreeOpenTime: 560.817ms | |
- PrepareTime: 36.046ms | |
- ExecTreePrepareTime: 860.193us | |
DataStreamSender (dst_id=32):(Total: 15.475ms, non-child: 15.475ms, % non-child: 100.00%) | |
- BytesSent: 1.38 MB (1450005) | |
- NetworkThroughput(*): 447.41 MB/sec | |
- OverallThroughput: 94.67 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 30.48K (30477) | |
- SerializeBatchTime: 11.347ms | |
- TransmitDataRPCTime: 4.056ms | |
- UncompressedRowBatchSize: 1.89 MB (1981262) | |
CodeGen:(Total: 127.505ms, non-child: 127.505ms, % non-child: 100.00%) | |
- CodegenTime: 2.753ms | |
- CompileTime: 23.380ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 45 (45) | |
- NumInstructions: 786 (786) | |
- OptimizationTime: 71.980ms | |
- PeakMemoryUsage: 393.00 KB (402432) | |
- PrepareTime: 31.422ms | |
AGGREGATION_NODE (id=30):(Total: 564.512ms, non-child: 24.420ms, % non-child: 4.33%) | |
- BuildTime: 20.275ms | |
- GetNewBlockTime: 717.739us | |
- GetResultsTime: 1.689ms | |
- HTResizeTime: 2.015ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 11.12 MB (11656121) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 30.48K (30477) | |
- RowsReturnedRate: 54.03 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.044us | |
EXCHANGE_NODE (id=29):(Total: 540.092ms, non-child: 540.092ms, % non-child: 100.00%) | |
- BytesReceived: 5.29 MB (5546297) | |
- ConvertRowBatchTime: 2.035ms | |
- DeserializeRowBatchTimer: 11.917ms | |
- FirstBatchArrivalWaitTime: 277.742ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 116.80K (116799) | |
- RowsReturnedRate: 216.45 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Fragment F06: | |
Instance 514ee9ab39cdc507:61 (host=cdh5.net.cuberonlabs.com:22000):(Total: 740.880ms, non-child: 21.907ms, % non-child: 2.96%) | |
MemoryUsage(500.000ms): 2.37 MB | |
ThreadUsage(500.000ms): 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 11.42 MB (11973390) | |
- PerHostPeakMemUsage: 385.83 MB (404575445) | |
- RowsProduced: 30.56K (30557) | |
- TotalNetworkReceiveTime: 573.723ms | |
- TotalNetworkSendTime: 8.306ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 712.159ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 132.000ms | |
- TotalThreadsVoluntaryContextSwitches: 249 (249) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 46.126ms | |
- ExecTreeExecTime: 5.413ms | |
- OpenTime: 666.059ms | |
- ExecTreeOpenTime: 593.983ms | |
- PrepareTime: 28.574ms | |
- ExecTreePrepareTime: 630.572us | |
DataStreamSender (dst_id=32):(Total: 22.329ms, non-child: 22.329ms, % non-child: 100.00%) | |
- BytesSent: 1.39 MB (1454306) | |
- NetworkThroughput(*): 156.60 MB/sec | |
- OverallThroughput: 62.11 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 30.56K (30557) | |
- SerializeBatchTime: 13.419ms | |
- TransmitDataRPCTime: 8.856ms | |
- UncompressedRowBatchSize: 1.89 MB (1986409) | |
CodeGen:(Total: 96.662ms, non-child: 96.662ms, % non-child: 100.00%) | |
- CodegenTime: 1.807ms | |
- CompileTime: 20.362ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 45 (45) | |
- NumInstructions: 786 (786) | |
- OptimizationTime: 50.923ms | |
- PeakMemoryUsage: 393.00 KB (402432) | |
- PrepareTime: 24.914ms | |
AGGREGATION_NODE (id=30):(Total: 599.981ms, non-child: 24.261ms, % non-child: 4.04%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 17.862ms | |
- GetNewBlockTime: 399.076us | |
- GetResultsTime: 2.143ms | |
- HTResizeTime: 2.015ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 11.11 MB (11652262) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 30.56K (30557) | |
- RowsReturnedRate: 50.93 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 952.000ns | |
EXCHANGE_NODE (id=29):(Total: 575.720ms, non-child: 3.521ms, % non-child: 0.61%) | |
BytesReceived(500.000ms): 0 | |
- BytesReceived: 5.31 MB (5563652) | |
- ConvertRowBatchTime: 1.756ms | |
- DeserializeRowBatchTimer: 11.362ms | |
- FirstBatchArrivalWaitTime: 310.021ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 117.15K (117151) | |
- RowsReturnedRate: 203.49 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:5e (host=cdh12.net.cuberonlabs.com:22000):(Total: 735.579ms, non-child: 18.749ms, % non-child: 2.55%) | |
MemoryUsage(500.000ms): 2.37 MB | |
ThreadUsage(500.000ms): 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 11.33 MB (11883000) | |
- PerHostPeakMemUsage: 346.18 MB (362992000) | |
- RowsProduced: 30.27K (30272) | |
- TotalNetworkReceiveTime: 550.317ms | |
- TotalNetworkSendTime: 7.459ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 705.335ms | |
- TotalThreadsSysTime: 16.000ms | |
- TotalThreadsUserTime: 136.000ms | |
- TotalThreadsVoluntaryContextSwitches: 207 (207) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 41.720ms | |
- ExecTreeExecTime: 3.112ms | |
- OpenTime: 663.624ms | |
- ExecTreeOpenTime: 574.741ms | |
- PrepareTime: 30.183ms | |
- ExecTreePrepareTime: 581.516us | |
DataStreamSender (dst_id=32):(Total: 23.410ms, non-child: 23.410ms, % non-child: 100.00%) | |
- BytesSent: 1.37 MB (1439979) | |
- NetworkThroughput(*): 140.87 MB/sec | |
- OverallThroughput: 58.66 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 30.27K (30272) | |
- SerializeBatchTime: 13.625ms | |
- TransmitDataRPCTime: 9.748ms | |
- UncompressedRowBatchSize: 1.88 MB (1967884) | |
CodeGen:(Total: 115.012ms, non-child: 115.012ms, % non-child: 100.00%) | |
- CodegenTime: 2.405ms | |
- CompileTime: 22.554ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 45 (45) | |
- NumInstructions: 786 (786) | |
- OptimizationTime: 65.353ms | |
- PeakMemoryUsage: 393.00 KB (402432) | |
- PrepareTime: 26.486ms | |
AGGREGATION_NODE (id=30):(Total: 578.408ms, non-child: 25.602ms, % non-child: 4.43%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 21.378ms | |
- GetNewBlockTime: 180.539us | |
- GetResultsTime: 1.860ms | |
- HTResizeTime: 1.166ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 11.11 MB (11652262) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 30.27K (30272) | |
- RowsReturnedRate: 52.34 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 779.000ns | |
EXCHANGE_NODE (id=29):(Total: 552.806ms, non-child: 3.654ms, % non-child: 0.66%) | |
BytesReceived(500.000ms): 0 | |
- BytesReceived: 5.24 MB (5493171) | |
- ConvertRowBatchTime: 2.248ms | |
- DeserializeRowBatchTimer: 11.854ms | |
- FirstBatchArrivalWaitTime: 290.898ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 115.69K (115687) | |
- RowsReturnedRate: 209.27 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:66 (host=cdh10.net.cuberonlabs.com:22000):(Total: 733.353ms, non-child: 21.920ms, % non-child: 2.99%) | |
MemoryUsage(500.000ms): 2.67 MB | |
ThreadUsage(500.000ms): 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 11.33 MB (11883000) | |
- PerHostPeakMemUsage: 376.66 MB (394960185) | |
- RowsProduced: 30.40K (30397) | |
- TotalNetworkReceiveTime: 534.018ms | |
- TotalNetworkSendTime: 5.066ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 690.408ms | |
- TotalThreadsSysTime: 8.000ms | |
- TotalThreadsUserTime: 144.000ms | |
- TotalThreadsVoluntaryContextSwitches: 225 (225) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 35.409ms | |
- ExecTreeExecTime: 2.975ms | |
- OpenTime: 655.025ms | |
- ExecTreeOpenTime: 560.216ms | |
- PrepareTime: 42.859ms | |
- ExecTreePrepareTime: 672.310us | |
DataStreamSender (dst_id=32):(Total: 14.997ms, non-child: 14.997ms, % non-child: 100.00%) | |
- BytesSent: 1.38 MB (1446283) | |
- NetworkThroughput(*): 562.02 MB/sec | |
- OverallThroughput: 91.97 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 30.40K (30397) | |
- SerializeBatchTime: 12.495ms | |
- TransmitDataRPCTime: 2.454ms | |
- UncompressedRowBatchSize: 1.88 MB (1976009) | |
CodeGen:(Total: 132.600ms, non-child: 132.600ms, % non-child: 100.00%) | |
- CodegenTime: 2.763ms | |
- CompileTime: 23.670ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 45 (45) | |
- NumInstructions: 786 (786) | |
- OptimizationTime: 70.020ms | |
- PeakMemoryUsage: 393.00 KB (402432) | |
- PrepareTime: 38.216ms | |
AGGREGATION_NODE (id=30):(Total: 563.834ms, non-child: 27.262ms, % non-child: 4.84%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 23.143ms | |
- GetNewBlockTime: 804.336us | |
- GetResultsTime: 2.048ms | |
- HTResizeTime: 2.116ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 11.12 MB (11661290) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 30.40K (30397) | |
- RowsReturnedRate: 53.91 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 982.000ns | |
EXCHANGE_NODE (id=29):(Total: 536.571ms, non-child: 3.999ms, % non-child: 0.75%) | |
BytesReceived(500.000ms): 60.82 KB | |
- BytesReceived: 5.29 MB (5548510) | |
- ConvertRowBatchTime: 2.284ms | |
- DeserializeRowBatchTimer: 11.564ms | |
- FirstBatchArrivalWaitTime: 270.302ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 116.80K (116802) | |
- RowsReturnedRate: 217.68 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:59 (host=cdh6.net.cuberonlabs.com:22000):(Total: 733.089ms, non-child: 24.553ms, % non-child: 3.35%) | |
MemoryUsage(500.000ms): 2.75 MB, 11.21 MB | |
ThreadUsage(500.000ms): 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 11.33 MB (11883000) | |
- PerHostPeakMemUsage: 396.78 MB (416054636) | |
- RowsProduced: 30.35K (30348) | |
- TotalNetworkReceiveTime: 521.711ms | |
- TotalNetworkSendTime: 5.614ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 2 (2) | |
- TotalThreadsTotalWallClockTime: 694.449ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 168.000ms | |
- TotalThreadsVoluntaryContextSwitches: 231 (231) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 42.596ms | |
- ExecTreeExecTime: 3.671ms | |
- OpenTime: 651.884ms | |
- ExecTreeOpenTime: 545.014ms | |
- PrepareTime: 38.562ms | |
- ExecTreePrepareTime: 1.325ms | |
DataStreamSender (dst_id=32):(Total: 18.817ms, non-child: 18.817ms, % non-child: 100.00%) | |
- BytesSent: 1.38 MB (1442960) | |
- NetworkThroughput(*): 616.79 MB/sec | |
- OverallThroughput: 73.13 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 30.35K (30348) | |
- SerializeBatchTime: 16.520ms | |
- TransmitDataRPCTime: 2.231ms | |
- UncompressedRowBatchSize: 1.88 MB (1972824) | |
CodeGen:(Total: 139.743ms, non-child: 139.743ms, % non-child: 100.00%) | |
- CodegenTime: 2.783ms | |
- CompileTime: 21.892ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 45 (45) | |
- NumInstructions: 786 (786) | |
- OptimizationTime: 83.903ms | |
- PeakMemoryUsage: 393.00 KB (402432) | |
- PrepareTime: 33.208ms | |
AGGREGATION_NODE (id=30):(Total: 549.974ms, non-child: 25.851ms, % non-child: 4.70%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 20.436ms | |
- GetNewBlockTime: 855.092us | |
- GetResultsTime: 2.452ms | |
- HTResizeTime: 1.728ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 11.12 MB (11659695) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 30.35K (30348) | |
- RowsReturnedRate: 55.18 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.472us | |
EXCHANGE_NODE (id=29):(Total: 524.122ms, non-child: 4.284ms, % non-child: 0.82%) | |
BytesReceived(500.000ms): 0, 2.36 MB | |
- BytesReceived: 5.33 MB (5590454) | |
- ConvertRowBatchTime: 2.132ms | |
- DeserializeRowBatchTimer: 14.147ms | |
- FirstBatchArrivalWaitTime: 264.766ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 117.80K (117796) | |
- RowsReturnedRate: 224.75 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:63 (host=cdh8.net.cuberonlabs.com:22000):(Total: 732.429ms, non-child: 18.134ms, % non-child: 2.48%) | |
MemoryUsage(500.000ms): 2.70 MB | |
ThreadUsage(500.000ms): 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 11.33 MB (11883000) | |
- PerHostPeakMemUsage: 378.86 MB (397268194) | |
- RowsProduced: 30.22K (30219) | |
- TotalNetworkReceiveTime: 545.965ms | |
- TotalNetworkSendTime: 6.385ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 1 (1) | |
- TotalThreadsTotalWallClockTime: 695.798ms | |
- TotalThreadsSysTime: 12.000ms | |
- TotalThreadsUserTime: 132.000ms | |
- TotalThreadsVoluntaryContextSwitches: 246 (246) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 37.056ms | |
- ExecTreeExecTime: 3.054ms | |
- OpenTime: 658.766ms | |
- ExecTreeOpenTime: 564.887ms | |
- PrepareTime: 36.541ms | |
- ExecTreePrepareTime: 700.650us | |
DataStreamSender (dst_id=32):(Total: 20.425ms, non-child: 20.425ms, % non-child: 100.00%) | |
- BytesSent: 1.37 MB (1438860) | |
- NetworkThroughput(*): 184.61 MB/sec | |
- OverallThroughput: 67.18 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 30.22K (30219) | |
- SerializeBatchTime: 12.931ms | |
- TransmitDataRPCTime: 7.432ms | |
- UncompressedRowBatchSize: 1.87 MB (1964439) | |
CodeGen:(Total: 125.256ms, non-child: 125.256ms, % non-child: 100.00%) | |
- CodegenTime: 2.963ms | |
- CompileTime: 20.723ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 45 (45) | |
- NumInstructions: 786 (786) | |
- OptimizationTime: 71.875ms | |
- PeakMemoryUsage: 393.00 KB (402432) | |
- PrepareTime: 31.916ms | |
AGGREGATION_NODE (id=30):(Total: 568.613ms, non-child: 20.858ms, % non-child: 3.67%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 16.713ms | |
- GetNewBlockTime: 260.356us | |
- GetResultsTime: 1.905ms | |
- HTResizeTime: 2.637ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 11.11 MB (11648166) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 30.22K (30219) | |
- RowsReturnedRate: 53.15 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 980.000ns | |
EXCHANGE_NODE (id=29):(Total: 547.755ms, non-child: 2.764ms, % non-child: 0.50%) | |
BytesReceived(500.000ms): 121.55 KB | |
- BytesReceived: 5.24 MB (5498866) | |
- ConvertRowBatchTime: 1.563ms | |
- DeserializeRowBatchTimer: 10.663ms | |
- FirstBatchArrivalWaitTime: 277.785ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 115.75K (115751) | |
- RowsReturnedRate: 211.32 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:62 (host=cdh7.net.cuberonlabs.com:22000):(Total: 731.886ms, non-child: 18.504ms, % non-child: 2.53%) | |
MemoryUsage(500.000ms): 2.75 MB, 11.17 MB | |
ThreadUsage(500.000ms): 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 11.33 MB (11883000) | |
- PerHostPeakMemUsage: 380.97 MB (399479666) | |
- RowsProduced: 30.49K (30492) | |
- TotalNetworkReceiveTime: 535.496ms | |
- TotalNetworkSendTime: 6.455ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 694.155ms | |
- TotalThreadsSysTime: 12.000ms | |
- TotalThreadsUserTime: 144.000ms | |
- TotalThreadsVoluntaryContextSwitches: 222 (222) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 36.727ms | |
- ExecTreeExecTime: 3.074ms | |
- OpenTime: 657.457ms | |
- ExecTreeOpenTime: 557.534ms | |
- PrepareTime: 37.626ms | |
- ExecTreePrepareTime: 1.163ms | |
DataStreamSender (dst_id=32):(Total: 19.373ms, non-child: 19.373ms, % non-child: 100.00%) | |
- BytesSent: 1.38 MB (1450016) | |
- NetworkThroughput(*): 225.30 MB/sec | |
- OverallThroughput: 71.38 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 30.49K (30492) | |
- SerializeBatchTime: 13.181ms | |
- TransmitDataRPCTime: 6.137ms | |
- UncompressedRowBatchSize: 1.89 MB (1982184) | |
CodeGen:(Total: 132.264ms, non-child: 132.264ms, % non-child: 100.00%) | |
- CodegenTime: 3.106ms | |
- CompileTime: 24.679ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 45 (45) | |
- NumInstructions: 786 (786) | |
- OptimizationTime: 74.005ms | |
- PeakMemoryUsage: 393.00 KB (402432) | |
- PrepareTime: 32.730ms | |
AGGREGATION_NODE (id=30):(Total: 561.743ms, non-child: 23.699ms, % non-child: 4.22%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 19.017ms | |
- GetNewBlockTime: 417.869us | |
- GetResultsTime: 1.869ms | |
- HTResizeTime: 1.519ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 11.12 MB (11660305) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 30.49K (30492) | |
- RowsReturnedRate: 54.28 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 784.000ns | |
EXCHANGE_NODE (id=29):(Total: 538.044ms, non-child: 3.785ms, % non-child: 0.70%) | |
BytesReceived(500.000ms): 0, 2.46 MB | |
- BytesReceived: 5.29 MB (5546249) | |
- ConvertRowBatchTime: 2.197ms | |
- DeserializeRowBatchTimer: 13.389ms | |
- FirstBatchArrivalWaitTime: 271.242ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 116.84K (116836) | |
- RowsReturnedRate: 217.15 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:5d (host=cdh2.net.cuberonlabs.com:22000):(Total: 728.911ms, non-child: 21.508ms, % non-child: 2.95%) | |
MemoryUsage(500.000ms): 2.75 MB, 11.17 MB | |
ThreadUsage(500.000ms): 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 11.33 MB (11883000) | |
- PerHostPeakMemUsage: 377.94 MB (396297272) | |
- RowsProduced: 30.51K (30514) | |
- TotalNetworkReceiveTime: 521.696ms | |
- TotalNetworkSendTime: 5.655ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 688.141ms | |
- TotalThreadsSysTime: 16.000ms | |
- TotalThreadsUserTime: 148.000ms | |
- TotalThreadsVoluntaryContextSwitches: 238 (238) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 35.319ms | |
- ExecTreeExecTime: 2.952ms | |
- OpenTime: 652.848ms | |
- ExecTreeOpenTime: 546.676ms | |
- PrepareTime: 40.671ms | |
- ExecTreePrepareTime: 588.252us | |
DataStreamSender (dst_id=32):(Total: 15.118ms, non-child: 15.118ms, % non-child: 100.00%) | |
- BytesSent: 1.38 MB (1451601) | |
- NetworkThroughput(*): 566.58 MB/sec | |
- OverallThroughput: 91.56 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 30.51K (30514) | |
- SerializeBatchTime: 12.622ms | |
- TransmitDataRPCTime: 2.443ms | |
- UncompressedRowBatchSize: 1.89 MB (1983614) | |
CodeGen:(Total: 142.095ms, non-child: 142.095ms, % non-child: 100.00%) | |
- CodegenTime: 3.186ms | |
- CompileTime: 26.207ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 45 (45) | |
- NumInstructions: 786 (786) | |
- OptimizationTime: 78.742ms | |
- PeakMemoryUsage: 393.00 KB (402432) | |
- PrepareTime: 36.339ms | |
AGGREGATION_NODE (id=30):(Total: 550.187ms, non-child: 25.815ms, % non-child: 4.69%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 21.851ms | |
- GetNewBlockTime: 245.280us | |
- GetResultsTime: 1.889ms | |
- HTResizeTime: 2.335ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 11.12 MB (11656532) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 30.51K (30514) | |
- RowsReturnedRate: 55.46 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 944.000ns | |
EXCHANGE_NODE (id=29):(Total: 524.372ms, non-child: 3.708ms, % non-child: 0.71%) | |
BytesReceived(500.000ms): 0, 2.37 MB | |
- BytesReceived: 5.28 MB (5533953) | |
- ConvertRowBatchTime: 2.397ms | |
- DeserializeRowBatchTimer: 12.008ms | |
- FirstBatchArrivalWaitTime: 262.716ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 116.61K (116611) | |
- RowsReturnedRate: 222.38 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:57 (host=cdh16.net.cuberonlabs.com:22000):(Total: 725.959ms, non-child: 21.829ms, % non-child: 3.01%) | |
MemoryUsage(500.000ms): 3.11 MB | |
ThreadUsage(500.000ms): 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 11.33 MB (11883000) | |
- PerHostPeakMemUsage: 380.14 MB (398604618) | |
- RowsProduced: 30.48K (30484) | |
- TotalNetworkReceiveTime: 523.774ms | |
- TotalNetworkSendTime: 5.574ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 1 (1) | |
- TotalThreadsTotalWallClockTime: 687.069ms | |
- TotalThreadsSysTime: 4.000ms | |
- TotalThreadsUserTime: 152.000ms | |
- TotalThreadsVoluntaryContextSwitches: 272 (272) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 35.765ms | |
- ExecTreeExecTime: 3.157ms | |
- OpenTime: 651.320ms | |
- ExecTreeOpenTime: 552.082ms | |
- PrepareTime: 38.838ms | |
- ExecTreePrepareTime: 665.533us | |
DataStreamSender (dst_id=32):(Total: 15.062ms, non-child: 15.062ms, % non-child: 100.00%) | |
- BytesSent: 1.38 MB (1450251) | |
- NetworkThroughput(*): 587.53 MB/sec | |
- OverallThroughput: 91.82 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 30.48K (30484) | |
- SerializeBatchTime: 12.656ms | |
- TransmitDataRPCTime: 2.354ms | |
- UncompressedRowBatchSize: 1.89 MB (1981664) | |
CodeGen:(Total: 133.191ms, non-child: 133.191ms, % non-child: 100.00%) | |
- CodegenTime: 3.060ms | |
- CompileTime: 24.383ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 45 (45) | |
- NumInstructions: 786 (786) | |
- OptimizationTime: 73.715ms | |
- PeakMemoryUsage: 393.00 KB (402432) | |
- PrepareTime: 34.297ms | |
AGGREGATION_NODE (id=30):(Total: 555.875ms, non-child: 29.346ms, % non-child: 5.28%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 25.121ms | |
- GetNewBlockTime: 1.674ms | |
- GetResultsTime: 1.959ms | |
- HTResizeTime: 2.917ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 11.12 MB (11656340) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 30.48K (30484) | |
- RowsReturnedRate: 54.84 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 916.000ns | |
EXCHANGE_NODE (id=29):(Total: 526.528ms, non-child: 4.386ms, % non-child: 0.83%) | |
BytesReceived(500.000ms): 574.36 KB | |
- BytesReceived: 5.32 MB (5580303) | |
- ConvertRowBatchTime: 2.440ms | |
- DeserializeRowBatchTimer: 14.767ms | |
- FirstBatchArrivalWaitTime: 274.108ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 117.50K (117503) | |
- RowsReturnedRate: 223.16 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:64 (host=cdh11.net.cuberonlabs.com:22000):(Total: 725.097ms, non-child: 19.021ms, % non-child: 2.62%) | |
MemoryUsage(500.000ms): 3.08 MB | |
ThreadUsage(500.000ms): 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 11.34 MB (11888240) | |
- PerHostPeakMemUsage: 386.83 MB (405618375) | |
- RowsProduced: 30.52K (30523) | |
- TotalNetworkReceiveTime: 526.857ms | |
- TotalNetworkSendTime: 5.394ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 1 (1) | |
- TotalThreadsTotalWallClockTime: 689.101ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 160.000ms | |
- TotalThreadsVoluntaryContextSwitches: 246 (246) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 28.546ms | |
- ExecTreeExecTime: 2.192ms | |
- OpenTime: 660.567ms | |
- ExecTreeOpenTime: 545.819ms | |
- PrepareTime: 35.935ms | |
- ExecTreePrepareTime: 686.058us | |
DataStreamSender (dst_id=32):(Total: 12.032ms, non-child: 12.032ms, % non-child: 100.00%) | |
- BytesSent: 1.39 MB (1453207) | |
- NetworkThroughput(*): 621.27 MB/sec | |
- OverallThroughput: 115.18 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 30.52K (30523) | |
- SerializeBatchTime: 9.762ms | |
- TransmitDataRPCTime: 2.230ms | |
- UncompressedRowBatchSize: 1.89 MB (1984199) | |
CodeGen:(Total: 145.367ms, non-child: 145.367ms, % non-child: 100.00%) | |
- CodegenTime: 2.755ms | |
- CompileTime: 26.740ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 45 (45) | |
- NumInstructions: 786 (786) | |
- OptimizationTime: 86.128ms | |
- PeakMemoryUsage: 393.00 KB (402432) | |
- PrepareTime: 31.748ms | |
AGGREGATION_NODE (id=30):(Total: 548.675ms, non-child: 19.902ms, % non-child: 3.63%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 16.646ms | |
- GetNewBlockTime: 213.139us | |
- GetResultsTime: 1.325ms | |
- HTResizeTime: 1.867ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 11.11 MB (11651033) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 30.52K (30523) | |
- RowsReturnedRate: 55.63 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 988.000ns | |
EXCHANGE_NODE (id=29):(Total: 528.773ms, non-child: 2.940ms, % non-child: 0.56%) | |
BytesReceived(500.000ms): 515.06 KB | |
- BytesReceived: 5.26 MB (5518124) | |
- ConvertRowBatchTime: 1.697ms | |
- DeserializeRowBatchTimer: 11.318ms | |
- FirstBatchArrivalWaitTime: 259.450ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 116.29K (116289) | |
- RowsReturnedRate: 219.92 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:5f (host=cdh14.net.cuberonlabs.com:22000):(Total: 724.920ms, non-child: 19.075ms, % non-child: 2.63%) | |
MemoryUsage(500.000ms): 2.37 MB | |
ThreadUsage(500.000ms): 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 11.36 MB (11916050) | |
- PerHostPeakMemUsage: 375.41 MB (393643300) | |
- RowsProduced: 30.54K (30536) | |
- TotalNetworkReceiveTime: 545.385ms | |
- TotalNetworkSendTime: 5.378ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 691.383ms | |
- TotalThreadsSysTime: 8.000ms | |
- TotalThreadsUserTime: 140.000ms | |
- TotalThreadsVoluntaryContextSwitches: 214 (214) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 30.802ms | |
- ExecTreeExecTime: 2.393ms | |
- OpenTime: 660.596ms | |
- ExecTreeOpenTime: 568.013ms | |
- PrepareTime: 33.432ms | |
- ExecTreePrepareTime: 1.042ms | |
DataStreamSender (dst_id=32):(Total: 13.221ms, non-child: 13.221ms, % non-child: 100.00%) | |
- BytesSent: 1.39 MB (1453492) | |
- NetworkThroughput(*): 524.83 MB/sec | |
- OverallThroughput: 104.84 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 30.54K (30536) | |
- SerializeBatchTime: 10.542ms | |
- TransmitDataRPCTime: 2.641ms | |
- UncompressedRowBatchSize: 1.89 MB (1985044) | |
CodeGen:(Total: 121.194ms, non-child: 121.194ms, % non-child: 100.00%) | |
- CodegenTime: 2.863ms | |
- CompileTime: 23.378ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 45 (45) | |
- NumInstructions: 786 (786) | |
- OptimizationTime: 68.080ms | |
- PeakMemoryUsage: 393.00 KB (402432) | |
- PrepareTime: 29.019ms | |
AGGREGATION_NODE (id=30):(Total: 571.428ms, non-child: 23.534ms, % non-child: 4.12%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 19.686ms | |
- GetNewBlockTime: 407.172us | |
- GetResultsTime: 1.523ms | |
- HTResizeTime: 1.660ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 11.11 MB (11652262) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 30.54K (30536) | |
- RowsReturnedRate: 53.44 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 818.000ns | |
EXCHANGE_NODE (id=29):(Total: 547.893ms, non-child: 3.553ms, % non-child: 0.65%) | |
BytesReceived(500.000ms): 0 | |
- BytesReceived: 5.26 MB (5518343) | |
- ConvertRowBatchTime: 2.203ms | |
- DeserializeRowBatchTimer: 12.523ms | |
- FirstBatchArrivalWaitTime: 283.078ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 116.21K (116211) | |
- RowsReturnedRate: 212.10 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:58 (host=cdh13.net.cuberonlabs.com:22000):(Total: 724.803ms, non-child: 20.570ms, % non-child: 2.84%) | |
MemoryUsage(500.000ms): 2.37 MB | |
ThreadUsage(500.000ms): 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 11.38 MB (11928195) | |
- PerHostPeakMemUsage: 391.21 MB (410213646) | |
- RowsProduced: 30.47K (30466) | |
- TotalNetworkReceiveTime: 528.505ms | |
- TotalNetworkSendTime: 5.239ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 688.171ms | |
- TotalThreadsSysTime: 8.000ms | |
- TotalThreadsUserTime: 152.000ms | |
- TotalThreadsVoluntaryContextSwitches: 211 (211) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 33.864ms | |
- ExecTreeExecTime: 2.908ms | |
- OpenTime: 654.321ms | |
- ExecTreeOpenTime: 557.110ms | |
- PrepareTime: 36.584ms | |
- ExecTreePrepareTime: 1.095ms | |
DataStreamSender (dst_id=32):(Total: 14.658ms, non-child: 14.658ms, % non-child: 100.00%) | |
- BytesSent: 1.38 MB (1450793) | |
- NetworkThroughput(*): 565.94 MB/sec | |
- OverallThroughput: 94.39 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 30.47K (30466) | |
- SerializeBatchTime: 12.144ms | |
- TransmitDataRPCTime: 2.444ms | |
- UncompressedRowBatchSize: 1.89 MB (1980494) | |
CodeGen:(Total: 128.487ms, non-child: 128.487ms, % non-child: 100.00%) | |
- CodegenTime: 2.716ms | |
- CompileTime: 23.457ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 45 (45) | |
- NumInstructions: 786 (786) | |
- OptimizationTime: 72.686ms | |
- PeakMemoryUsage: 393.00 KB (402432) | |
- PrepareTime: 31.597ms | |
AGGREGATION_NODE (id=30):(Total: 561.087ms, non-child: 29.222ms, % non-child: 5.21%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 24.793ms | |
- GetNewBlockTime: 746.580us | |
- GetResultsTime: 1.821ms | |
- HTResizeTime: 1.550ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 11.13 MB (11668113) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 30.47K (30466) | |
- RowsReturnedRate: 54.30 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.052us | |
EXCHANGE_NODE (id=29):(Total: 531.864ms, non-child: 4.587ms, % non-child: 0.86%) | |
BytesReceived(500.000ms): 0 | |
- BytesReceived: 5.30 MB (5557088) | |
- ConvertRowBatchTime: 3.020ms | |
- DeserializeRowBatchTimer: 11.158ms | |
- FirstBatchArrivalWaitTime: 277.735ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 117.01K (117013) | |
- RowsReturnedRate: 220.00 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:65 (host=cdh9.net.cuberonlabs.com:22000):(Total: 724.708ms, non-child: 17.726ms, % non-child: 2.45%) | |
MemoryUsage(500.000ms): 2.75 MB, 11.17 MB | |
ThreadUsage(500.000ms): 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 11.33 MB (11883000) | |
- PerHostPeakMemUsage: 380.31 MB (398787248) | |
- RowsProduced: 30.64K (30639) | |
- TotalNetworkReceiveTime: 542.496ms | |
- TotalNetworkSendTime: 4.734ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 1 (1) | |
- TotalThreadsTotalWallClockTime: 687.350ms | |
- TotalThreadsSysTime: 12.000ms | |
- TotalThreadsUserTime: 132.000ms | |
- TotalThreadsVoluntaryContextSwitches: 237 (237) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 27.569ms | |
- ExecTreeExecTime: 2.398ms | |
- OpenTime: 659.801ms | |
- ExecTreeOpenTime: 558.897ms | |
- PrepareTime: 37.265ms | |
- ExecTreePrepareTime: 700.818us | |
DataStreamSender (dst_id=32):(Total: 11.372ms, non-child: 11.372ms, % non-child: 100.00%) | |
- BytesSent: 1.39 MB (1456566) | |
- NetworkThroughput(*): 641.18 MB/sec | |
- OverallThroughput: 122.14 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 30.64K (30639) | |
- SerializeBatchTime: 9.156ms | |
- TransmitDataRPCTime: 2.166ms | |
- UncompressedRowBatchSize: 1.90 MB (1991739) | |
CodeGen:(Total: 133.637ms, non-child: 133.637ms, % non-child: 100.00%) | |
- CodegenTime: 2.999ms | |
- CompileTime: 24.910ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 45 (45) | |
- NumInstructions: 786 (786) | |
- OptimizationTime: 74.809ms | |
- PeakMemoryUsage: 393.00 KB (402432) | |
- PrepareTime: 33.117ms | |
AGGREGATION_NODE (id=30):(Total: 561.972ms, non-child: 17.775ms, % non-child: 3.16%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 14.309ms | |
- GetNewBlockTime: 320.624us | |
- GetResultsTime: 1.374ms | |
- HTResizeTime: 1.615ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 11.12 MB (11656358) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 30.64K (30639) | |
- RowsReturnedRate: 54.52 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 840.000ns | |
EXCHANGE_NODE (id=29):(Total: 544.197ms, non-child: 2.383ms, % non-child: 0.44%) | |
BytesReceived(500.000ms): 0, 2.34 MB | |
- BytesReceived: 5.33 MB (5591481) | |
- ConvertRowBatchTime: 1.486ms | |
- DeserializeRowBatchTimer: 8.921ms | |
- FirstBatchArrivalWaitTime: 270.726ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 117.76K (117764) | |
- RowsReturnedRate: 216.40 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:60 (host=cdh1.net.cuberonlabs.com:22000):(Total: 724.087ms, non-child: 20.549ms, % non-child: 2.84%) | |
MemoryUsage(500.000ms): 2.75 MB, 11.21 MB | |
ThreadUsage(500.000ms): 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 11.33 MB (11883000) | |
- PerHostPeakMemUsage: 456.03 MB (478183185) | |
- RowsProduced: 30.18K (30176) | |
- TotalNetworkReceiveTime: 547.046ms | |
- TotalNetworkSendTime: 5.850ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 687.074ms | |
- TotalThreadsSysTime: 8.000ms | |
- TotalThreadsUserTime: 128.000ms | |
- TotalThreadsVoluntaryContextSwitches: 242 (242) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 29.269ms | |
- ExecTreeExecTime: 2.408ms | |
- OpenTime: 657.838ms | |
- ExecTreeOpenTime: 570.610ms | |
- PrepareTime: 36.935ms | |
- ExecTreePrepareTime: 1.640ms | |
DataStreamSender (dst_id=32):(Total: 12.787ms, non-child: 12.787ms, % non-child: 100.00%) | |
- BytesSent: 1.37 MB (1436088) | |
- NetworkThroughput(*): 485.42 MB/sec | |
- OverallThroughput: 107.10 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 30.18K (30176) | |
- SerializeBatchTime: 9.572ms | |
- TransmitDataRPCTime: 2.821ms | |
- UncompressedRowBatchSize: 1.87 MB (1961644) | |
CodeGen:(Total: 116.126ms, non-child: 116.126ms, % non-child: 100.00%) | |
- CodegenTime: 2.326ms | |
- CompileTime: 21.732ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 45 (45) | |
- NumInstructions: 786 (786) | |
- OptimizationTime: 64.575ms | |
- PeakMemoryUsage: 393.00 KB (402432) | |
- PrepareTime: 29.157ms | |
AGGREGATION_NODE (id=30):(Total: 574.624ms, non-child: 25.142ms, % non-child: 4.38%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 20.664ms | |
- GetNewBlockTime: 1.200ms | |
- GetResultsTime: 1.404ms | |
- HTResizeTime: 1.776ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 11.12 MB (11660610) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 30.18K (30176) | |
- RowsReturnedRate: 52.51 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.824us | |
EXCHANGE_NODE (id=29):(Total: 549.481ms, non-child: 3.964ms, % non-child: 0.72%) | |
BytesReceived(500.000ms): 0, 2.26 MB | |
- BytesReceived: 5.24 MB (5489958) | |
- ConvertRowBatchTime: 2.144ms | |
- DeserializeRowBatchTimer: 12.837ms | |
- FirstBatchArrivalWaitTime: 287.503ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 115.50K (115500) | |
- RowsReturnedRate: 210.20 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:5a (host=cdh15.net.cuberonlabs.com:22000):(Total: 722.799ms, non-child: 19.923ms, % non-child: 2.76%) | |
MemoryUsage(500.000ms): 2.36 MB, 7.21 MB | |
ThreadUsage(500.000ms): 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 11.33 MB (11883000) | |
- PerHostPeakMemUsage: 375.05 MB (393265454) | |
- RowsProduced: 30.58K (30583) | |
- TotalNetworkReceiveTime: 538.903ms | |
- TotalNetworkSendTime: 5.365ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 688.712ms | |
- TotalThreadsSysTime: 16.000ms | |
- TotalThreadsUserTime: 132.000ms | |
- TotalThreadsVoluntaryContextSwitches: 237 (237) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 31.810ms | |
- ExecTreeExecTime: 2.594ms | |
- OpenTime: 656.911ms | |
- ExecTreeOpenTime: 561.100ms | |
- PrepareTime: 34.027ms | |
- ExecTreePrepareTime: 639.079us | |
DataStreamSender (dst_id=32):(Total: 13.195ms, non-child: 13.195ms, % non-child: 100.00%) | |
- BytesSent: 1.39 MB (1454496) | |
- NetworkThroughput(*): 637.34 MB/sec | |
- OverallThroughput: 105.12 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 30.58K (30583) | |
- SerializeBatchTime: 10.954ms | |
- TransmitDataRPCTime: 2.176ms | |
- UncompressedRowBatchSize: 1.90 MB (1988099) | |
CodeGen:(Total: 125.375ms, non-child: 125.375ms, % non-child: 100.00%) | |
- CodegenTime: 2.771ms | |
- CompileTime: 23.703ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 45 (45) | |
- NumInstructions: 786 (786) | |
- OptimizationTime: 71.027ms | |
- PeakMemoryUsage: 393.00 KB (402432) | |
- PrepareTime: 29.874ms | |
AGGREGATION_NODE (id=30):(Total: 564.305ms, non-child: 23.136ms, % non-child: 4.10%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 19.512ms | |
- GetNewBlockTime: 196.570us | |
- GetResultsTime: 1.634ms | |
- HTResizeTime: 2.222ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 11.11 MB (11654022) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 30.58K (30583) | |
- RowsReturnedRate: 54.20 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 970.000ns | |
EXCHANGE_NODE (id=29):(Total: 541.169ms, non-child: 3.240ms, % non-child: 0.60%) | |
BytesReceived(500.000ms): 0, 1.52 MB | |
- BytesReceived: 5.30 MB (5560302) | |
- ConvertRowBatchTime: 2.011ms | |
- DeserializeRowBatchTimer: 10.884ms | |
- FirstBatchArrivalWaitTime: 280.536ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 117.01K (117010) | |
- RowsReturnedRate: 216.22 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:5c (host=cdh17.net.cuberonlabs.com:22000):(Total: 722.364ms, non-child: 17.786ms, % non-child: 2.46%) | |
MemoryUsage(500.000ms): 2.37 MB | |
ThreadUsage(500.000ms): 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 11.34 MB (11888240) | |
- PerHostPeakMemUsage: 361.40 MB (378952889) | |
- RowsProduced: 30.64K (30641) | |
- TotalNetworkReceiveTime: 530.585ms | |
- TotalNetworkSendTime: 6.299ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 686.933ms | |
- TotalThreadsSysTime: 4.000ms | |
- TotalThreadsUserTime: 148.000ms | |
- TotalThreadsVoluntaryContextSwitches: 263 (263) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 30.836ms | |
- ExecTreeExecTime: 2.406ms | |
- OpenTime: 656.110ms | |
- ExecTreeOpenTime: 558.683ms | |
- PrepareTime: 35.372ms | |
- ExecTreePrepareTime: 707.990us | |
DataStreamSender (dst_id=32):(Total: 14.680ms, non-child: 14.680ms, % non-child: 100.00%) | |
- BytesSent: 1.39 MB (1457838) | |
- NetworkThroughput(*): 232.29 MB/sec | |
- OverallThroughput: 94.70 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 30.64K (30641) | |
- SerializeBatchTime: 8.651ms | |
- TransmitDataRPCTime: 5.985ms | |
- UncompressedRowBatchSize: 1.90 MB (1991869) | |
CodeGen:(Total: 128.119ms, non-child: 128.119ms, % non-child: 100.00%) | |
- CodegenTime: 2.935ms | |
- CompileTime: 24.062ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 45 (45) | |
- NumInstructions: 786 (786) | |
- OptimizationTime: 72.130ms | |
- PeakMemoryUsage: 393.00 KB (402432) | |
- PrepareTime: 31.150ms | |
AGGREGATION_NODE (id=30):(Total: 561.777ms, non-child: 29.285ms, % non-child: 5.21%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 25.687ms | |
- GetNewBlockTime: 1.256ms | |
- GetResultsTime: 1.467ms | |
- HTResizeTime: 3.565ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 11.11 MB (11652314) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 30.64K (30641) | |
- RowsReturnedRate: 54.54 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.326us | |
EXCHANGE_NODE (id=29):(Total: 532.491ms, non-child: 3.230ms, % non-child: 0.61%) | |
BytesReceived(500.000ms): 0 | |
- BytesReceived: 5.33 MB (5583955) | |
- ConvertRowBatchTime: 1.701ms | |
- DeserializeRowBatchTimer: 12.326ms | |
- FirstBatchArrivalWaitTime: 278.456ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 117.62K (117620) | |
- RowsReturnedRate: 220.89 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:5b (host=cdh3.net.cuberonlabs.com:22000):(Total: 716.077ms, non-child: 16.661ms, % non-child: 2.33%) | |
MemoryUsage(500.000ms): 2.37 MB | |
ThreadUsage(500.000ms): 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 11.33 MB (11883000) | |
- PerHostPeakMemUsage: 357.28 MB (374633487) | |
- RowsProduced: 30.64K (30643) | |
- TotalNetworkReceiveTime: 568.436ms | |
- TotalNetworkSendTime: 5.276ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 1 (1) | |
- TotalThreadsTotalWallClockTime: 690.071ms | |
- TotalThreadsSysTime: 4.000ms | |
- TotalThreadsUserTime: 112.000ms | |
- TotalThreadsVoluntaryContextSwitches: 315 (315) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 25.166ms | |
- ExecTreeExecTime: 2.085ms | |
- OpenTime: 664.919ms | |
- ExecTreeOpenTime: 591.124ms | |
- PrepareTime: 25.948ms | |
- ExecTreePrepareTime: 1.016ms | |
DataStreamSender (dst_id=32):(Total: 10.158ms, non-child: 10.158ms, % non-child: 100.00%) | |
- BytesSent: 1.39 MB (1456738) | |
- NetworkThroughput(*): 527.52 MB/sec | |
- OverallThroughput: 136.76 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 30.64K (30643) | |
- SerializeBatchTime: 7.471ms | |
- TransmitDataRPCTime: 2.633ms | |
- UncompressedRowBatchSize: 1.90 MB (1991999) | |
CodeGen:(Total: 95.051ms, non-child: 95.051ms, % non-child: 100.00%) | |
- CodegenTime: 1.806ms | |
- CompileTime: 20.976ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 45 (45) | |
- NumInstructions: 786 (786) | |
- OptimizationTime: 51.707ms | |
- PeakMemoryUsage: 393.00 KB (402432) | |
- PrepareTime: 21.909ms | |
AGGREGATION_NODE (id=30):(Total: 594.206ms, non-child: 23.880ms, % non-child: 4.02%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 20.328ms | |
- GetNewBlockTime: 2.530ms | |
- GetResultsTime: 1.033ms | |
- HTResizeTime: 1.976ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 11.12 MB (11660244) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 30.64K (30643) | |
- RowsReturnedRate: 51.57 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 808.000ns | |
EXCHANGE_NODE (id=29):(Total: 570.325ms, non-child: 2.994ms, % non-child: 0.52%) | |
BytesReceived(500.000ms): 0 | |
- BytesReceived: 5.33 MB (5584117) | |
- ConvertRowBatchTime: 1.639ms | |
- DeserializeRowBatchTimer: 11.935ms | |
- FirstBatchArrivalWaitTime: 312.251ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 117.58K (117579) | |
- RowsReturnedRate: 206.16 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Instance 514ee9ab39cdc507:56 (host=cdh4.net.cuberonlabs.com:22000):(Total: 715.447ms, non-child: 16.568ms, % non-child: 2.32%) | |
MemoryUsage(500.000ms): 2.37 MB | |
ThreadUsage(500.000ms): 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 11.34 MB (11888240) | |
- PerHostPeakMemUsage: 388.72 MB (407605616) | |
- RowsProduced: 30.63K (30633) | |
- TotalNetworkReceiveTime: 507.508ms | |
- TotalNetworkSendTime: 5.755ms | |
- TotalStorageWaitTime: 0.000ns | |
- TotalThreadsInvoluntaryContextSwitches: 5 (5) | |
- TotalThreadsTotalWallClockTime: 671.965ms | |
- TotalThreadsSysTime: 0.000ns | |
- TotalThreadsUserTime: 160.000ms | |
- TotalThreadsVoluntaryContextSwitches: 236 (236) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 24.985ms | |
- ExecTreeExecTime: 1.880ms | |
- OpenTime: 646.995ms | |
- ExecTreeOpenTime: 527.392ms | |
- PrepareTime: 43.430ms | |
- ExecTreePrepareTime: 767.252us | |
DataStreamSender (dst_id=32):(Total: 11.448ms, non-child: 11.448ms, % non-child: 100.00%) | |
- BytesSent: 1.39 MB (1456616) | |
- NetworkThroughput(*): 329.95 MB/sec | |
- OverallThroughput: 121.34 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 30.63K (30633) | |
- SerializeBatchTime: 7.200ms | |
- TransmitDataRPCTime: 4.210ms | |
- UncompressedRowBatchSize: 1.90 MB (1991349) | |
CodeGen:(Total: 157.409ms, non-child: 157.409ms, % non-child: 100.00%) | |
- CodegenTime: 3.554ms | |
- CompileTime: 24.034ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 45 (45) | |
- NumInstructions: 786 (786) | |
- OptimizationTime: 93.983ms | |
- PeakMemoryUsage: 393.00 KB (402432) | |
- PrepareTime: 38.491ms | |
AGGREGATION_NODE (id=30):(Total: 530.020ms, non-child: 20.571ms, % non-child: 3.88%) | |
ExecOption: Codegen Enabled | |
- BuildTime: 17.521ms | |
- GetNewBlockTime: 493.172us | |
- GetResultsTime: 1.004ms | |
- HTResizeTime: 1.585ms | |
- HashBuckets: 65.54K (65536) | |
- LargestPartitionPercent: 1 (1) | |
- MaxPartitionLevel: 0 (0) | |
- NumRepartitions: 0 (0) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 11.11 MB (11652262) | |
- PinTime: 0.000ns | |
- RowsRepartitioned: 0 (0) | |
- RowsReturned: 30.63K (30633) | |
- RowsReturnedRate: 57.80 K/sec | |
- SpilledPartitions: 0 (0) | |
- UnpinTime: 1.328us | |
EXCHANGE_NODE (id=29):(Total: 509.448ms, non-child: 3.239ms, % non-child: 0.64%) | |
BytesReceived(500.000ms): 0 | |
- BytesReceived: 5.27 MB (5528536) | |
- ConvertRowBatchTime: 1.669ms | |
- DeserializeRowBatchTimer: 10.939ms | |
- FirstBatchArrivalWaitTime: 250.042ms | |
- PeakMemoryUsage: 0 | |
- RowsReturned: 116.47K (116468) | |
- RowsReturnedRate: 228.62 K/sec | |
- SendersBlockedTimer: 0.000ns | |
- SendersBlockedTotalTimer(*): 0.000ns | |
Averaged Fragment F05:(Total: 586.880ms, non-child: 31.115ms, % non-child: 5.30%) | |
split sizes: min: 1.81 GB, max: 3.59 GB, avg: 2.76 GB, stddev: 468.16 MB | |
completion times: min:445.050ms max:688.967ms mean: 588.336ms stddev:78.409ms | |
execution rates: min:3.93 GB/sec max:5.62 GB/sec mean:4.69 GB/sec stddev:513.44 MB/sec | |
num instances: 17 | |
- AverageThreadTokens: 5.29 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 77.55 MB (81315222) | |
- PerHostPeakMemUsage: 373.39 MB (391526364) | |
- RowsProduced: 116.80K (116799) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 5.272ms | |
- TotalStorageWaitTime: 132.746ms | |
- TotalThreadsInvoluntaryContextSwitches: 24 (24) | |
- TotalThreadsTotalWallClockTime: 2s925ms | |
- TotalThreadsSysTime: 411.764ms | |
- TotalThreadsUserTime: 1s730ms | |
- TotalThreadsVoluntaryContextSwitches: 2.88K (2880) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 447.336ms | |
- ExecTreeExecTime: 381.921ms | |
- OpenTime: 104.239ms | |
- ExecTreeOpenTime: 44.204us | |
- PrepareTime: 35.262ms | |
- ExecTreePrepareTime: 776.279us | |
DataStreamSender (dst_id=29):(Total: 39.370ms, non-child: 39.370ms, % non-child: 100.00%) | |
- BytesSent: 5.29 MB (5546297) | |
- NetworkThroughput(*): 624.97 MB/sec | |
- OverallThroughput: 139.13 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 116.80K (116799) | |
- SerializeBatchTime: 29.105ms | |
- TransmitDataRPCTime: 10.194ms | |
- UncompressedRowBatchSize: 7.24 MB (7592710) | |
CodeGen:(Total: 133.708ms, non-child: 133.708ms, % non-child: 100.00%) | |
- CodegenTime: 3.332ms | |
- CompileTime: 26.844ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.04K (1041) | |
- OptimizationTime: 76.142ms | |
- PeakMemoryUsage: 520.50 KB (532992) | |
- PrepareTime: 29.995ms | |
AGGREGATION_NODE (id=6):(Total: 382.685ms, non-child: 223.177ms, % non-child: 58.32%) | |
- GetNewBlockTime: 194.600us | |
- GetResultsTime: 4.361ms | |
- HTResizeTime: 7.586ms | |
- HashBuckets: 262.14K (262144) | |
- LargestPartitionPercent: 3 (3) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 21.01 MB (22028317) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 95.93 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 116.80K (116799) | |
- RowsReturnedRate: 309.60 K/sec | |
- StreamingTime: 215.699ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=5):(Total: 159.508ms, non-child: 159.508ms, % non-child: 100.00%) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 4.47 | |
- BytesRead: 372.01 MB (390076376) | |
- BytesReadDataNodeCache: 362.88 MB (380505970) | |
- BytesReadLocal: 372.01 MB (390076376) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 372.01 MB (390076376) | |
- DecompressionTime: 725.154ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 29 (29) | |
- NumScannerThreadsStarted: 6 (6) | |
- PeakMemoryUsage: 60.36 MB (63295486) | |
- PerReadThreadRawHdfsThroughput: 35.40 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 153.412ms | |
- RowBatchQueuePutWaitTime: 0.000ns | |
- RowsRead: 11.56M (11559184) | |
- RowsReturned: 213.53K (213525) | |
- RowsReturnedRate: 1.40 M/sec | |
- ScanRangesComplete: 29 (29) | |
- ScannerThreadsInvoluntaryContextSwitches: 21 (21) | |
- ScannerThreadsTotalWallClockTime: 2s373ms | |
- MaterializeTupleTime(*): 663.547ms | |
- ScannerThreadsSysTime: 290.588ms | |
- ScannerThreadsUserTime: 1s468ms | |
- ScannerThreadsVoluntaryContextSwitches: 2.50K (2497) | |
- TotalRawHdfsReadTime(*): 10.362ms | |
- TotalReadThroughput: 299.08 MB/sec | |
Fragment F05: | |
Instance 514ee9ab39cdc507:50 (host=cdh5.net.cuberonlabs.com:22000):(Total: 687.604ms, non-child: 34.153ms, % non-child: 4.97%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.36 GB | |
MemoryUsage(500.000ms): 54.97 MB | |
ThreadUsage(500.000ms): 8 | |
- AverageThreadTokens: 8.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 78.50 MB (82310017) | |
- PerHostPeakMemUsage: 385.83 MB (404575445) | |
- RowsProduced: 132.98K (132979) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 7.037ms | |
- TotalStorageWaitTime: 147.665ms | |
- TotalThreadsInvoluntaryContextSwitches: 11 (11) | |
- TotalThreadsTotalWallClockTime: 3s343ms | |
- TotalThreadsSysTime: 456.000ms | |
- TotalThreadsUserTime: 1s944ms | |
- TotalThreadsVoluntaryContextSwitches: 3.66K (3657) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 541.865ms | |
- ExecTreeExecTime: 440.373ms | |
- OpenTime: 109.894ms | |
- ExecTreeOpenTime: 41.136us | |
- PrepareTime: 35.814ms | |
- ExecTreePrepareTime: 682.136us | |
DataStreamSender (dst_id=29):(Total: 72.317ms, non-child: 72.317ms, % non-child: 100.00%) | |
- BytesSent: 6.02 MB (6314568) | |
- NetworkThroughput(*): 227.55 MB/sec | |
- OverallThroughput: 83.27 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 132.98K (132979) | |
- SerializeBatchTime: 45.800ms | |
- TransmitDataRPCTime: 26.464ms | |
- UncompressedRowBatchSize: 8.24 MB (8644483) | |
CodeGen:(Total: 140.116ms, non-child: 140.116ms, % non-child: 100.00%) | |
- CodegenTime: 3.559ms | |
- CompileTime: 27.724ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.04K (1041) | |
- OptimizationTime: 80.800ms | |
- PeakMemoryUsage: 520.50 KB (532992) | |
- PrepareTime: 30.795ms | |
AGGREGATION_NODE (id=6):(Total: 441.016ms, non-child: 269.191ms, % non-child: 61.04%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 126.556us | |
- GetResultsTime: 6.514ms | |
- HTResizeTime: 8.240ms | |
- HashBuckets: 262.14K (262144) | |
- LargestPartitionPercent: 3 (3) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 21.12 MB (22150881) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 94.90 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 132.98K (132979) | |
- RowsReturnedRate: 301.53 K/sec | |
- StreamingTime: 259.087ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=5):(Total: 171.824ms, non-child: 171.824ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.36 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:105 | |
BytesRead(500.000ms): 213.46 MB | |
- FooterProcessingTime: (Avg: 11.181ms ; Min: 3.027ms ; Max: 40.808ms ; Number of samples: 35) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.00 | |
- BytesRead: 456.00 MB (478151119) | |
- BytesReadDataNodeCache: 445.20 MB (466829804) | |
- BytesReadLocal: 456.00 MB (478151119) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 456.00 MB (478151119) | |
- DecompressionTime: 839.814ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 35 (35) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 61.28 MB (64258403) | |
- PerReadThreadRawHdfsThroughput: 41.57 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 168.273ms | |
- RowBatchQueuePutWaitTime: 0.000ns | |
- RowsRead: 13.95M (13952334) | |
- RowsReturned: 252.70K (252699) | |
- RowsReturnedRate: 1.47 M/sec | |
- ScanRangesComplete: 35 (35) | |
- ScannerThreadsInvoluntaryContextSwitches: 11 (11) | |
- ScannerThreadsTotalWallClockTime: 2s691ms | |
- MaterializeTupleTime(*): 725.278ms | |
- ScannerThreadsSysTime: 304.000ms | |
- ScannerThreadsUserTime: 1s632ms | |
- ScannerThreadsVoluntaryContextSwitches: 3.32K (3323) | |
- TotalRawHdfsReadTime(*): 10.712ms | |
- TotalReadThroughput: 426.91 MB/sec | |
Instance 514ee9ab39cdc507:45 (host=cdh4.net.cuberonlabs.com:22000):(Total: 661.247ms, non-child: 31.385ms, % non-child: 4.75%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:40/3.59 GB | |
MemoryUsage(500.000ms): 49.60 MB | |
ThreadUsage(500.000ms): 8 | |
- AverageThreadTokens: 8.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 77.28 MB (81036607) | |
- PerHostPeakMemUsage: 388.72 MB (407605616) | |
- RowsProduced: 141.25K (141246) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 5.610ms | |
- TotalStorageWaitTime: 177.993ms | |
- TotalThreadsInvoluntaryContextSwitches: 29 (29) | |
- TotalThreadsTotalWallClockTime: 3s632ms | |
- TotalThreadsSysTime: 544.000ms | |
- TotalThreadsUserTime: 2s136ms | |
- TotalThreadsVoluntaryContextSwitches: 3.25K (3249) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 527.406ms | |
- ExecTreeExecTime: 458.044ms | |
- OpenTime: 95.539ms | |
- ExecTreeOpenTime: 40.960us | |
- PrepareTime: 38.263ms | |
- ExecTreePrepareTime: 989.420us | |
DataStreamSender (dst_id=29):(Total: 42.865ms, non-child: 42.865ms, % non-child: 100.00%) | |
- BytesSent: 6.40 MB (6708961) | |
- NetworkThroughput(*): 559.19 MB/sec | |
- OverallThroughput: 149.26 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 141.25K (141246) | |
- SerializeBatchTime: 31.349ms | |
- TransmitDataRPCTime: 11.441ms | |
- UncompressedRowBatchSize: 8.76 MB (9181874) | |
CodeGen:(Total: 127.990ms, non-child: 127.990ms, % non-child: 100.00%) | |
- CodegenTime: 2.601ms | |
- CompileTime: 24.009ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.04K (1041) | |
- OptimizationTime: 70.392ms | |
- PeakMemoryUsage: 520.50 KB (532992) | |
- PrepareTime: 33.012ms | |
AGGREGATION_NODE (id=6):(Total: 459.005ms, non-child: 266.717ms, % non-child: 58.11%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 243.252us | |
- GetResultsTime: 4.172ms | |
- HTResizeTime: 7.295ms | |
- HashBuckets: 262.14K (262144) | |
- LargestPartitionPercent: 3 (3) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 21.12 MB (22142733) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 94.30 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 141.25K (141246) | |
- RowsReturnedRate: 307.72 K/sec | |
- StreamingTime: 259.330ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=5):(Total: 192.288ms, non-child: 192.288ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:40/3.59 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 40 out of 40 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:120 | |
BytesRead(500.000ms): 82.77 MB | |
- FooterProcessingTime: (Avg: 9.690ms ; Min: 2.778ms ; Max: 38.629ms ; Number of samples: 40) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.00 | |
- BytesRead: 483.40 MB (506880472) | |
- BytesReadDataNodeCache: 471.06 MB (493942344) | |
- BytesReadLocal: 483.40 MB (506880472) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 483.40 MB (506880472) | |
- DecompressionTime: 891.624ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 40 (40) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 59.39 MB (62270139) | |
- PerReadThreadRawHdfsThroughput: 38.33 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 187.115ms | |
- RowBatchQueuePutWaitTime: 0.000ns | |
- RowsRead: 15.04M (15041855) | |
- RowsReturned: 277.35K (277345) | |
- RowsReturnedRate: 1.44 M/sec | |
- ScanRangesComplete: 40 (40) | |
- ScannerThreadsInvoluntaryContextSwitches: 25 (25) | |
- ScannerThreadsTotalWallClockTime: 3s009ms | |
- MaterializeTupleTime(*): 849.276ms | |
- ScannerThreadsSysTime: 396.000ms | |
- ScannerThreadsUserTime: 1s864ms | |
- ScannerThreadsVoluntaryContextSwitches: 2.71K (2710) | |
- TotalRawHdfsReadTime(*): 12.314ms | |
- TotalReadThroughput: 165.53 MB/sec | |
Instance 514ee9ab39cdc507:4a (host=cdh3.net.cuberonlabs.com:22000):(Total: 660.221ms, non-child: 35.841ms, % non-child: 5.43%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.39 GB | |
MemoryUsage(500.000ms): 54.43 MB | |
ThreadUsage(500.000ms): 8 | |
- AverageThreadTokens: 8.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 84.45 MB (88551574) | |
- PerHostPeakMemUsage: 357.28 MB (374633487) | |
- RowsProduced: 141.71K (141710) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 5.858ms | |
- TotalStorageWaitTime: 138.966ms | |
- TotalThreadsInvoluntaryContextSwitches: 108 (108) | |
- TotalThreadsTotalWallClockTime: 3s465ms | |
- TotalThreadsSysTime: 500.000ms | |
- TotalThreadsUserTime: 2s116ms | |
- TotalThreadsVoluntaryContextSwitches: 3.84K (3836) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 507.450ms | |
- ExecTreeExecTime: 437.331ms | |
- OpenTime: 123.153ms | |
- ExecTreeOpenTime: 40.432us | |
- PrepareTime: 29.572ms | |
- ExecTreePrepareTime: 735.848us | |
DataStreamSender (dst_id=29):(Total: 39.239ms, non-child: 39.239ms, % non-child: 100.00%) | |
- BytesSent: 6.42 MB (6731770) | |
- NetworkThroughput(*): 727.37 MB/sec | |
- OverallThroughput: 163.61 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 141.71K (141710) | |
- SerializeBatchTime: 30.358ms | |
- TransmitDataRPCTime: 8.826ms | |
- UncompressedRowBatchSize: 8.79 MB (9212034) | |
CodeGen:(Total: 147.088ms, non-child: 147.088ms, % non-child: 100.00%) | |
- CodegenTime: 3.001ms | |
- CompileTime: 31.999ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.04K (1041) | |
- OptimizationTime: 89.550ms | |
- PeakMemoryUsage: 520.50 KB (532992) | |
- PrepareTime: 24.838ms | |
AGGREGATION_NODE (id=6):(Total: 438.052ms, non-child: 279.724ms, % non-child: 63.86%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 129.259us | |
- GetResultsTime: 3.910ms | |
- HTResizeTime: 7.898ms | |
- HashBuckets: 262.14K (262144) | |
- LargestPartitionPercent: 3 (3) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 21.13 MB (22152905) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 97.39 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 141.71K (141710) | |
- RowsReturnedRate: 323.50 K/sec | |
- StreamingTime: 272.196ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=5):(Total: 158.327ms, non-child: 158.327ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.39 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:105 | |
BytesRead(500.000ms): 178.97 MB | |
- FooterProcessingTime: (Avg: 10.346ms ; Min: 2.755ms ; Max: 31.854ms ; Number of samples: 35) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.00 | |
- BytesRead: 454.94 MB (477042646) | |
- BytesReadDataNodeCache: 444.14 MB (465717587) | |
- BytesReadLocal: 454.94 MB (477042646) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 454.94 MB (477042646) | |
- DecompressionTime: 877.653ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 35 (35) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 65.39 MB (68567960) | |
- PerReadThreadRawHdfsThroughput: 34.27 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 154.473ms | |
- RowBatchQueuePutWaitTime: 0.000ns | |
- RowsRead: 14.44M (14439291) | |
- RowsReturned: 272.20K (272203) | |
- RowsReturnedRate: 1.72 M/sec | |
- ScanRangesComplete: 35 (35) | |
- ScannerThreadsInvoluntaryContextSwitches: 99 (99) | |
- ScannerThreadsTotalWallClockTime: 2s835ms | |
- MaterializeTupleTime(*): 823.963ms | |
- ScannerThreadsSysTime: 348.000ms | |
- ScannerThreadsUserTime: 1s812ms | |
- ScannerThreadsVoluntaryContextSwitches: 3.33K (3332) | |
- TotalRawHdfsReadTime(*): 12.965ms | |
- TotalReadThroughput: 357.95 MB/sec | |
Instance 514ee9ab39cdc507:46 (host=cdh16.net.cuberonlabs.com:22000):(Total: 657.968ms, non-child: 38.804ms, % non-child: 5.90%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.64 GB | |
MemoryUsage(500.000ms): 49.01 MB | |
ThreadUsage(500.000ms): 8 | |
- AverageThreadTokens: 8.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 77.80 MB (81581582) | |
- PerHostPeakMemUsage: 366.62 MB (384426439) | |
- RowsProduced: 112.39K (112393) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 4.051ms | |
- TotalStorageWaitTime: 130.369ms | |
- TotalThreadsInvoluntaryContextSwitches: 7 (7) | |
- TotalThreadsTotalWallClockTime: 3s252ms | |
- TotalThreadsSysTime: 516.000ms | |
- TotalThreadsUserTime: 1s900ms | |
- TotalThreadsVoluntaryContextSwitches: 2.80K (2803) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 512.585ms | |
- ExecTreeExecTime: 434.420ms | |
- OpenTime: 107.614ms | |
- ExecTreeOpenTime: 37.742us | |
- PrepareTime: 37.672ms | |
- ExecTreePrepareTime: 808.157us | |
DataStreamSender (dst_id=29):(Total: 44.664ms, non-child: 44.664ms, % non-child: 100.00%) | |
- BytesSent: 5.09 MB (5336638) | |
- NetworkThroughput(*): 590.69 MB/sec | |
- OverallThroughput: 113.95 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 112.39K (112393) | |
- SerializeBatchTime: 35.993ms | |
- TransmitDataRPCTime: 8.616ms | |
- UncompressedRowBatchSize: 6.97 MB (7306289) | |
CodeGen:(Total: 139.296ms, non-child: 139.296ms, % non-child: 100.00%) | |
- CodegenTime: 3.578ms | |
- CompileTime: 27.548ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.04K (1041) | |
- OptimizationTime: 78.864ms | |
- PeakMemoryUsage: 520.50 KB (532992) | |
- PrepareTime: 32.113ms | |
AGGREGATION_NODE (id=6):(Total: 435.203ms, non-child: 236.026ms, % non-child: 54.23%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 190.487us | |
- GetResultsTime: 5.736ms | |
- HTResizeTime: 8.575ms | |
- HashBuckets: 262.14K (262144) | |
- LargestPartitionPercent: 3 (3) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 21.10 MB (22120903) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 95.89 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 112.39K (112393) | |
- RowsReturnedRate: 258.25 K/sec | |
- StreamingTime: 227.286ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=5):(Total: 199.177ms, non-child: 199.177ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.64 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:84 | |
BytesRead(500.000ms): 314.21 MB | |
- FooterProcessingTime: (Avg: 11.264ms ; Min: 3.319ms ; Max: 45.412ms ; Number of samples: 28) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.00 | |
- BytesRead: 355.65 MB (372923733) | |
- BytesReadDataNodeCache: 347.01 MB (363866796) | |
- BytesReadLocal: 355.65 MB (372923733) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 355.65 MB (372923733) | |
- DecompressionTime: 807.599ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 28 (28) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 59.58 MB (62474573) | |
- PerReadThreadRawHdfsThroughput: 32.98 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 196.385ms | |
- RowBatchQueuePutWaitTime: 0.000ns | |
- RowsRead: 11.05M (11051815) | |
- RowsReturned: 204.57K (204566) | |
- RowsReturnedRate: 1.03 M/sec | |
- ScanRangesComplete: 28 (28) | |
- ScannerThreadsInvoluntaryContextSwitches: 7 (7) | |
- ScannerThreadsTotalWallClockTime: 2s632ms | |
- MaterializeTupleTime(*): 779.791ms | |
- ScannerThreadsSysTime: 400.000ms | |
- ScannerThreadsUserTime: 1s600ms | |
- ScannerThreadsVoluntaryContextSwitches: 2.51K (2508) | |
- TotalRawHdfsReadTime(*): 10.532ms | |
- TotalReadThroughput: 628.41 MB/sec | |
Instance 514ee9ab39cdc507:4b (host=cdh17.net.cuberonlabs.com:22000):(Total: 655.398ms, non-child: 29.401ms, % non-child: 4.49%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.58 GB | |
MemoryUsage(500.000ms): 57.25 MB | |
ThreadUsage(500.000ms): 8 | |
- AverageThreadTokens: 8.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 80.12 MB (84009455) | |
- PerHostPeakMemUsage: 361.40 MB (378952889) | |
- RowsProduced: 120.43K (120434) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 5.335ms | |
- TotalStorageWaitTime: 107.031ms | |
- TotalThreadsInvoluntaryContextSwitches: 88 (88) | |
- TotalThreadsTotalWallClockTime: 3s303ms | |
- TotalThreadsSysTime: 596.000ms | |
- TotalThreadsUserTime: 2s032ms | |
- TotalThreadsVoluntaryContextSwitches: 2.27K (2275) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 508.773ms | |
- ExecTreeExecTime: 435.748ms | |
- OpenTime: 109.170ms | |
- ExecTreeOpenTime: 43.822us | |
- PrepareTime: 37.417ms | |
- ExecTreePrepareTime: 818.414us | |
DataStreamSender (dst_id=29):(Total: 48.755ms, non-child: 48.755ms, % non-child: 100.00%) | |
- BytesSent: 5.45 MB (5715393) | |
- NetworkThroughput(*): 299.97 MB/sec | |
- OverallThroughput: 111.80 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 120.43K (120434) | |
- SerializeBatchTime: 30.533ms | |
- TransmitDataRPCTime: 18.170ms | |
- UncompressedRowBatchSize: 7.47 MB (7828962) | |
CodeGen:(Total: 140.684ms, non-child: 140.684ms, % non-child: 100.00%) | |
- CodegenTime: 3.670ms | |
- CompileTime: 28.925ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.04K (1041) | |
- OptimizationTime: 78.911ms | |
- PeakMemoryUsage: 520.50 KB (532992) | |
- PrepareTime: 32.098ms | |
AGGREGATION_NODE (id=6):(Total: 436.557ms, non-child: 314.593ms, % non-child: 72.06%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 187.740us | |
- GetResultsTime: 4.395ms | |
- HTResizeTime: 12.206ms | |
- HashBuckets: 262.14K (262144) | |
- LargestPartitionPercent: 3 (3) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 21.11 MB (22137429) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 96.78 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 120.43K (120434) | |
- RowsReturnedRate: 275.87 K/sec | |
- StreamingTime: 306.643ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=5):(Total: 121.963ms, non-child: 121.963ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.58 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 26 out of 26 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:78 | |
BytesRead(500.000ms): 105.29 MB | |
- FooterProcessingTime: (Avg: 11.716ms ; Min: 3.793ms ; Max: 41.744ms ; Number of samples: 26) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.00 | |
- BytesRead: 348.22 MB (365131885) | |
- BytesReadDataNodeCache: 340.19 MB (356717112) | |
- BytesReadLocal: 348.22 MB (365131885) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 348.22 MB (365131885) | |
- DecompressionTime: 840.908ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 26 (26) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 62.05 MB (65063625) | |
- PerReadThreadRawHdfsThroughput: 28.28 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 118.812ms | |
- RowBatchQueuePutWaitTime: 0.000ns | |
- RowsRead: 10.92M (10919165) | |
- RowsReturned: 216.19K (216191) | |
- RowsReturnedRate: 1.77 M/sec | |
- ScanRangesComplete: 26 (26) | |
- ScannerThreadsInvoluntaryContextSwitches: 79 (79) | |
- ScannerThreadsTotalWallClockTime: 2s685ms | |
- MaterializeTupleTime(*): 870.115ms | |
- ScannerThreadsSysTime: 448.000ms | |
- ScannerThreadsUserTime: 1s692ms | |
- ScannerThreadsVoluntaryContextSwitches: 1.93K (1928) | |
- TotalRawHdfsReadTime(*): 12.023ms | |
- TotalReadThroughput: 210.58 MB/sec | |
Instance 514ee9ab39cdc507:48 (host=cdh6.net.cuberonlabs.com:22000):(Total: 653.523ms, non-child: 32.066ms, % non-child: 4.91%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/2.89 GB | |
MemoryUsage(500.000ms): 1.88 MB, 23.21 MB | |
ThreadUsage(500.000ms): 1, 2 | |
- AverageThreadTokens: 1.50 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 71.25 MB (74706123) | |
- PerHostPeakMemUsage: 396.78 MB (416054636) | |
- RowsProduced: 123.36K (123356) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 4.166ms | |
- TotalStorageWaitTime: 154.366ms | |
- TotalThreadsInvoluntaryContextSwitches: 17 (17) | |
- TotalThreadsTotalWallClockTime: 3s212ms | |
- TotalThreadsSysTime: 364.000ms | |
- TotalThreadsUserTime: 1s768ms | |
- TotalThreadsVoluntaryContextSwitches: 3.09K (3087) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 514.814ms | |
- ExecTreeExecTime: 444.423ms | |
- OpenTime: 104.093ms | |
- ExecTreeOpenTime: 82.860us | |
- PrepareTime: 34.563ms | |
- ExecTreePrepareTime: 802.400us | |
DataStreamSender (dst_id=29):(Total: 43.077ms, non-child: 43.077ms, % non-child: 100.00%) | |
- BytesSent: 5.58 MB (5855826) | |
- NetworkThroughput(*): 593.20 MB/sec | |
- OverallThroughput: 129.64 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 123.36K (123356) | |
- SerializeBatchTime: 33.598ms | |
- TransmitDataRPCTime: 9.414ms | |
- UncompressedRowBatchSize: 7.65 MB (8018940) | |
CodeGen:(Total: 133.143ms, non-child: 133.143ms, % non-child: 100.00%) | |
- CodegenTime: 3.411ms | |
- CompileTime: 27.694ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.04K (1041) | |
- OptimizationTime: 75.192ms | |
- PeakMemoryUsage: 520.50 KB (532992) | |
- PrepareTime: 29.504ms | |
AGGREGATION_NODE (id=6):(Total: 445.236ms, non-child: 217.385ms, % non-child: 48.82%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 273.844us | |
- GetResultsTime: 5.039ms | |
- HTResizeTime: 6.122ms | |
- HashBuckets: 262.14K (262144) | |
- LargestPartitionPercent: 3 (3) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 21.14 MB (22165714) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 92.62 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 123.36K (123356) | |
- RowsReturnedRate: 277.06 K/sec | |
- StreamingTime: 209.665ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=5):(Total: 227.850ms, non-child: 227.850ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/2.89 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:96 | |
BytesRead(500.000ms): 0, 390.94 MB | |
- FooterProcessingTime: (Avg: 9.728ms ; Min: 3.129ms ; Max: 27.061ms ; Number of samples: 32) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 1.00 | |
- BytesRead: 390.94 MB (409928073) | |
- BytesReadDataNodeCache: 381.07 MB (399577346) | |
- BytesReadLocal: 390.94 MB (409928073) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 390.94 MB (409928073) | |
- DecompressionTime: 716.149ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 32 (32) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 54.24 MB (56877713) | |
- PerReadThreadRawHdfsThroughput: 40.59 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 181.382ms | |
- RowBatchQueuePutWaitTime: 0.000ns | |
- RowsRead: 12.15M (12150960) | |
- RowsReturned: 226.91K (226915) | |
- RowsReturnedRate: 995.89 K/sec | |
- ScanRangesComplete: 32 (32) | |
- ScannerThreadsInvoluntaryContextSwitches: 15 (15) | |
- ScannerThreadsTotalWallClockTime: 2s593ms | |
- MaterializeTupleTime(*): 645.871ms | |
- ScannerThreadsSysTime: 256.000ms | |
- ScannerThreadsUserTime: 1s492ms | |
- ScannerThreadsVoluntaryContextSwitches: 2.67K (2670) | |
- TotalRawHdfsReadTime(*): 9.406ms | |
- TotalReadThroughput: 390.94 MB/sec | |
Instance 514ee9ab39cdc507:4f (host=cdh1.net.cuberonlabs.com:22000):(Total: 646.511ms, non-child: 30.992ms, % non-child: 4.79%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/2.99 GB | |
MemoryUsage(500.000ms): 1.88 MB, 53.26 MB | |
ThreadUsage(500.000ms): 1, 6 | |
- AverageThreadTokens: 3.50 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 67.81 MB (71105797) | |
- PerHostPeakMemUsage: 456.03 MB (478183185) | |
- RowsProduced: 125.59K (125593) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 4.787ms | |
- TotalStorageWaitTime: 174.654ms | |
- TotalThreadsInvoluntaryContextSwitches: 12 (12) | |
- TotalThreadsTotalWallClockTime: 3s210ms | |
- TotalThreadsSysTime: 356.000ms | |
- TotalThreadsUserTime: 1s884ms | |
- TotalThreadsVoluntaryContextSwitches: 2.56K (2558) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 521.745ms | |
- ExecTreeExecTime: 458.849ms | |
- OpenTime: 91.609ms | |
- ExecTreeOpenTime: 38.944us | |
- PrepareTime: 33.134ms | |
- ExecTreePrepareTime: 646.472us | |
DataStreamSender (dst_id=29):(Total: 37.268ms, non-child: 37.268ms, % non-child: 100.00%) | |
- BytesSent: 5.69 MB (5963404) | |
- NetworkThroughput(*): 678.90 MB/sec | |
- OverallThroughput: 152.60 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 125.59K (125593) | |
- SerializeBatchTime: 28.785ms | |
- TransmitDataRPCTime: 8.376ms | |
- UncompressedRowBatchSize: 7.79 MB (8164357) | |
CodeGen:(Total: 118.770ms, non-child: 118.770ms, % non-child: 100.00%) | |
- CodegenTime: 3.437ms | |
- CompileTime: 23.685ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.04K (1041) | |
- OptimizationTime: 66.302ms | |
- PeakMemoryUsage: 520.50 KB (532992) | |
- PrepareTime: 28.101ms | |
AGGREGATION_NODE (id=6):(Total: 459.478ms, non-child: 221.947ms, % non-child: 48.30%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 527.576us | |
- GetResultsTime: 4.388ms | |
- HTResizeTime: 6.007ms | |
- HashBuckets: 262.14K (262144) | |
- LargestPartitionPercent: 3 (3) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 21.13 MB (22158339) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 95.82 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 125.59K (125593) | |
- RowsReturnedRate: 273.34 K/sec | |
- StreamingTime: 214.786ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=5):(Total: 237.531ms, non-child: 237.531ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/2.99 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:105 | |
BytesRead(500.000ms): 0, 403.52 MB | |
- FooterProcessingTime: (Avg: 9.537ms ; Min: 3.384ms ; Max: 30.438ms ; Number of samples: 35) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 5.00 | |
- BytesRead: 403.52 MB (423122517) | |
- BytesReadDataNodeCache: 392.73 MB (411804248) | |
- BytesReadLocal: 403.52 MB (423122517) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 403.52 MB (423122517) | |
- DecompressionTime: 743.317ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 35 (35) | |
- NumScannerThreadsStarted: 6 (6) | |
- PeakMemoryUsage: 51.80 MB (54321003) | |
- PerReadThreadRawHdfsThroughput: 27.96 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 234.240ms | |
- RowBatchQueuePutWaitTime: 0.000ns | |
- RowsRead: 12.55M (12550697) | |
- RowsReturned: 231.64K (231641) | |
- RowsReturnedRate: 975.20 K/sec | |
- ScanRangesComplete: 35 (35) | |
- ScannerThreadsInvoluntaryContextSwitches: 6 (6) | |
- ScannerThreadsTotalWallClockTime: 2s596ms | |
- MaterializeTupleTime(*): 675.027ms | |
- ScannerThreadsSysTime: 240.000ms | |
- ScannerThreadsUserTime: 1s632ms | |
- ScannerThreadsVoluntaryContextSwitches: 2.11K (2108) | |
- TotalRawHdfsReadTime(*): 14.091ms | |
- TotalReadThroughput: 403.52 MB/sec | |
Instance 514ee9ab39cdc507:55 (host=cdh10.net.cuberonlabs.com:22000):(Total: 645.472ms, non-child: 35.451ms, % non-child: 5.49%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.75 GB | |
MemoryUsage(500.000ms): 63.91 MB | |
ThreadUsage(500.000ms): 8 | |
- AverageThreadTokens: 8.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 89.85 MB (94211855) | |
- PerHostPeakMemUsage: 367.15 MB (384989011) | |
- RowsProduced: 112.36K (112359) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 5.451ms | |
- TotalStorageWaitTime: 170.218ms | |
- TotalThreadsInvoluntaryContextSwitches: 84 (84) | |
- TotalThreadsTotalWallClockTime: 3s288ms | |
- TotalThreadsSysTime: 392.000ms | |
- TotalThreadsUserTime: 1s888ms | |
- TotalThreadsVoluntaryContextSwitches: 2.82K (2822) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 504.889ms | |
- ExecTreeExecTime: 436.558ms | |
- OpenTime: 105.468ms | |
- ExecTreeOpenTime: 39.362us | |
- PrepareTime: 35.078ms | |
- ExecTreePrepareTime: 741.854us | |
DataStreamSender (dst_id=29):(Total: 37.986ms, non-child: 37.986ms, % non-child: 100.00%) | |
- BytesSent: 5.09 MB (5337854) | |
- NetworkThroughput(*): 731.72 MB/sec | |
- OverallThroughput: 134.01 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 112.36K (112359) | |
- SerializeBatchTime: 30.973ms | |
- TransmitDataRPCTime: 6.956ms | |
- UncompressedRowBatchSize: 6.97 MB (7304059) | |
CodeGen:(Total: 134.764ms, non-child: 134.764ms, % non-child: 100.00%) | |
- CodegenTime: 3.433ms | |
- CompileTime: 27.716ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.04K (1041) | |
- OptimizationTime: 76.560ms | |
- PeakMemoryUsage: 520.50 KB (532992) | |
- PrepareTime: 29.786ms | |
AGGREGATION_NODE (id=6):(Total: 437.269ms, non-child: 268.131ms, % non-child: 61.32%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 203.126us | |
- GetResultsTime: 4.867ms | |
- HTResizeTime: 9.102ms | |
- HashBuckets: 262.14K (262144) | |
- LargestPartitionPercent: 3 (3) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 21.10 MB (22126445) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 100.37 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 112.36K (112359) | |
- RowsReturnedRate: 256.95 K/sec | |
- StreamingTime: 259.892ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=5):(Total: 169.137ms, non-child: 169.137ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.75 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
File Formats: PARQUET/SNAPPY:90 | |
BytesRead(500.000ms): 289.40 MB | |
- FooterProcessingTime: (Avg: 11.885ms ; Min: 3.114ms ; Max: 57.629ms ; Number of samples: 30) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.00 | |
- BytesRead: 371.89 MB (389958203) | |
- BytesReadDataNodeCache: 362.64 MB (380253704) | |
- BytesReadLocal: 371.89 MB (389958203) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 371.89 MB (389958203) | |
- DecompressionTime: 778.890ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 30 (30) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 75.14 MB (78789187) | |
- PerReadThreadRawHdfsThroughput: 38.10 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 161.809ms | |
- RowBatchQueuePutWaitTime: 0.000ns | |
- RowsRead: 11.46M (11459388) | |
- RowsReturned: 199.85K (199852) | |
- RowsReturnedRate: 1.18 M/sec | |
- ScanRangesComplete: 30 (30) | |
- ScannerThreadsInvoluntaryContextSwitches: 71 (71) | |
- ScannerThreadsTotalWallClockTime: 2s677ms | |
- MaterializeTupleTime(*): 726.168ms | |
- ScannerThreadsSysTime: 244.000ms | |
- ScannerThreadsUserTime: 1s604ms | |
- ScannerThreadsVoluntaryContextSwitches: 2.53K (2530) | |
- TotalRawHdfsReadTime(*): 9.531ms | |
- TotalReadThroughput: 578.80 MB/sec | |
Instance 514ee9ab39cdc507:47 (host=cdh13.net.cuberonlabs.com:22000):(Total: 621.852ms, non-child: 30.232ms, % non-child: 4.86%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/2.80 GB | |
MemoryUsage(500.000ms): 49.12 MB | |
ThreadUsage(500.000ms): 8 | |
- AverageThreadTokens: 8.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 76.25 MB (79955745) | |
- PerHostPeakMemUsage: 380.17 MB (398636858) | |
- RowsProduced: 117.26K (117259) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 4.502ms | |
- TotalStorageWaitTime: 242.949ms | |
- TotalThreadsInvoluntaryContextSwitches: 0 (0) | |
- TotalThreadsTotalWallClockTime: 3s193ms | |
- TotalThreadsSysTime: 420.000ms | |
- TotalThreadsUserTime: 1s676ms | |
- TotalThreadsVoluntaryContextSwitches: 3.04K (3037) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 481.211ms | |
- ExecTreeExecTime: 423.309ms | |
- OpenTime: 104.672ms | |
- ExecTreeOpenTime: 42.384us | |
- PrepareTime: 35.933ms | |
- ExecTreePrepareTime: 763.140us | |
DataStreamSender (dst_id=29):(Total: 32.748ms, non-child: 32.748ms, % non-child: 100.00%) | |
- BytesSent: 5.31 MB (5570881) | |
- NetworkThroughput(*): 881.00 MB/sec | |
- OverallThroughput: 162.23 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 117.26K (117259) | |
- SerializeBatchTime: 26.654ms | |
- TransmitDataRPCTime: 6.030ms | |
- UncompressedRowBatchSize: 7.27 MB (7622583) | |
CodeGen:(Total: 134.809ms, non-child: 134.809ms, % non-child: 100.00%) | |
- CodegenTime: 3.459ms | |
- CompileTime: 26.767ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.04K (1041) | |
- OptimizationTime: 76.743ms | |
- PeakMemoryUsage: 520.50 KB (532992) | |
- PrepareTime: 30.558ms | |
AGGREGATION_NODE (id=6):(Total: 424.062ms, non-child: 204.892ms, % non-child: 48.32%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 214.859us | |
- GetResultsTime: 3.988ms | |
- HTResizeTime: 6.145ms | |
- HashBuckets: 262.14K (262144) | |
- LargestPartitionPercent: 3 (3) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 21.12 MB (22148937) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 98.52 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 117.26K (117259) | |
- RowsReturnedRate: 276.51 K/sec | |
- StreamingTime: 198.435ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=5):(Total: 219.170ms, non-child: 219.170ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/2.80 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:93 | |
BytesRead(500.000ms): 223.12 MB | |
- FooterProcessingTime: (Avg: 13.222ms ; Min: 2.911ms ; Max: 58.156ms ; Number of samples: 31) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.00 | |
- BytesRead: 379.46 MB (397894562) | |
- BytesReadDataNodeCache: 369.90 MB (387872500) | |
- BytesReadLocal: 379.46 MB (397894562) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 379.46 MB (397894562) | |
- DecompressionTime: 715.004ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 31 (31) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 60.63 MB (63573195) | |
- PerReadThreadRawHdfsThroughput: 34.75 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 216.053ms | |
- RowBatchQueuePutWaitTime: 0.000ns | |
- RowsRead: 11.68M (11677391) | |
- RowsReturned: 214.94K (214943) | |
- RowsReturnedRate: 980.71 K/sec | |
- ScanRangesComplete: 31 (31) | |
- ScannerThreadsInvoluntaryContextSwitches: 0 (0) | |
- ScannerThreadsTotalWallClockTime: 2s607ms | |
- MaterializeTupleTime(*): 626.952ms | |
- ScannerThreadsSysTime: 312.000ms | |
- ScannerThreadsUserTime: 1s424ms | |
- ScannerThreadsVoluntaryContextSwitches: 2.60K (2603) | |
- TotalRawHdfsReadTime(*): 10.665ms | |
- TotalReadThroughput: 446.23 MB/sec | |
Instance 514ee9ab39cdc507:51 (host=cdh7.net.cuberonlabs.com:22000):(Total: 549.323ms, non-child: 28.015ms, % non-child: 5.10%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:27/2.46 GB | |
MemoryUsage(500.000ms): 1.88 MB | |
ThreadUsage(500.000ms): 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 77.58 MB (81349514) | |
- PerHostPeakMemUsage: 359.68 MB (377149769) | |
- RowsProduced: 110.04K (110039) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 6.604ms | |
- TotalStorageWaitTime: 84.908ms | |
- TotalThreadsInvoluntaryContextSwitches: 9 (9) | |
- TotalThreadsTotalWallClockTime: 2s582ms | |
- TotalThreadsSysTime: 352.000ms | |
- TotalThreadsUserTime: 1s564ms | |
- TotalThreadsVoluntaryContextSwitches: 2.81K (2812) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 407.260ms | |
- ExecTreeExecTime: 342.510ms | |
- OpenTime: 106.247ms | |
- ExecTreeOpenTime: 40.044us | |
- PrepareTime: 35.781ms | |
- ExecTreePrepareTime: 790.926us | |
DataStreamSender (dst_id=29):(Total: 41.570ms, non-child: 41.570ms, % non-child: 100.00%) | |
- BytesSent: 4.98 MB (5226642) | |
- NetworkThroughput(*): 322.68 MB/sec | |
- OverallThroughput: 119.91 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 110.04K (110039) | |
- SerializeBatchTime: 26.009ms | |
- TransmitDataRPCTime: 15.447ms | |
- UncompressedRowBatchSize: 6.82 MB (7153227) | |
CodeGen:(Total: 136.442ms, non-child: 136.442ms, % non-child: 100.00%) | |
- CodegenTime: 3.329ms | |
- CompileTime: 27.337ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.04K (1041) | |
- OptimizationTime: 77.622ms | |
- PeakMemoryUsage: 520.50 KB (532992) | |
- PrepareTime: 30.704ms | |
AGGREGATION_NODE (id=6):(Total: 343.295ms, non-child: 186.638ms, % non-child: 54.37%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 146.177us | |
- GetResultsTime: 4.137ms | |
- HTResizeTime: 6.246ms | |
- HashBuckets: 262.14K (262144) | |
- LargestPartitionPercent: 3 (3) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 21.09 MB (22118154) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 93.86 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 110.04K (110039) | |
- RowsReturnedRate: 320.54 K/sec | |
- StreamingTime: 179.721ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=5):(Total: 156.656ms, non-child: 156.656ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:27/2.46 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 27 out of 27 | |
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:81 | |
BytesRead(500.000ms): 0 | |
- FooterProcessingTime: (Avg: 12.799ms ; Min: 2.893ms ; Max: 49.555ms ; Number of samples: 27) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 0.00 | |
- BytesRead: 331.18 MB (347264442) | |
- BytesReadDataNodeCache: 322.86 MB (338539012) | |
- BytesReadLocal: 331.18 MB (347264442) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 331.18 MB (347264442) | |
- DecompressionTime: 651.733ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 27 (27) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 61.67 MB (64666212) | |
- PerReadThreadRawHdfsThroughput: 34.71 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 153.607ms | |
- RowBatchQueuePutWaitTime: 0.000ns | |
- RowsRead: 10.29M (10293228) | |
- RowsReturned: 191.42K (191421) | |
- RowsReturnedRate: 1.22 M/sec | |
- ScanRangesComplete: 27 (27) | |
- ScannerThreadsInvoluntaryContextSwitches: 8 (8) | |
- ScannerThreadsTotalWallClockTime: 2s068ms | |
- MaterializeTupleTime(*): 583.869ms | |
- ScannerThreadsSysTime: 228.000ms | |
- ScannerThreadsUserTime: 1s340ms | |
- ScannerThreadsVoluntaryContextSwitches: 2.45K (2453) | |
- TotalRawHdfsReadTime(*): 9.316ms | |
- TotalReadThroughput: 0.00 /sec | |
Instance 514ee9ab39cdc507:54 (host=cdh9.net.cuberonlabs.com:22000):(Total: 548.149ms, non-child: 29.599ms, % non-child: 5.40%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/3.02 GB | |
MemoryUsage(500.000ms): 1.88 MB | |
ThreadUsage(500.000ms): 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 74.45 MB (78071656) | |
- PerHostPeakMemUsage: 380.31 MB (398787248) | |
- RowsProduced: 126.30K (126296) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 3.960ms | |
- TotalStorageWaitTime: 124.489ms | |
- TotalThreadsInvoluntaryContextSwitches: 5 (5) | |
- TotalThreadsTotalWallClockTime: 2s783ms | |
- TotalThreadsSysTime: 376.000ms | |
- TotalThreadsUserTime: 1s804ms | |
- TotalThreadsVoluntaryContextSwitches: 3.00K (3003) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 407.614ms | |
- ExecTreeExecTime: 348.574ms | |
- OpenTime: 104.615ms | |
- ExecTreeOpenTime: 39.573us | |
- PrepareTime: 35.886ms | |
- ExecTreePrepareTime: 775.907us | |
DataStreamSender (dst_id=29):(Total: 34.399ms, non-child: 34.399ms, % non-child: 100.00%) | |
- BytesSent: 5.72 MB (5998810) | |
- NetworkThroughput(*): 893.70 MB/sec | |
- OverallThroughput: 166.31 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 126.30K (126296) | |
- SerializeBatchTime: 27.922ms | |
- TransmitDataRPCTime: 6.401ms | |
- UncompressedRowBatchSize: 7.83 MB (8210056) | |
CodeGen:(Total: 134.819ms, non-child: 134.819ms, % non-child: 100.00%) | |
- CodegenTime: 3.264ms | |
- CompileTime: 27.778ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.04K (1041) | |
- OptimizationTime: 75.685ms | |
- PeakMemoryUsage: 520.50 KB (532992) | |
- PrepareTime: 30.617ms | |
AGGREGATION_NODE (id=6):(Total: 349.330ms, non-child: 221.017ms, % non-child: 63.27%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 169.295us | |
- GetResultsTime: 4.111ms | |
- HTResizeTime: 6.953ms | |
- HashBuckets: 262.14K (262144) | |
- LargestPartitionPercent: 3 (3) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 21.13 MB (22155016) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 102.94 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 126.30K (126296) | |
- RowsReturnedRate: 361.54 K/sec | |
- StreamingTime: 214.048ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=5):(Total: 128.313ms, non-child: 128.313ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/3.02 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31 | |
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:93 | |
BytesRead(500.000ms): 0 | |
- FooterProcessingTime: (Avg: 8.548ms ; Min: 2.841ms ; Max: 33.365ms ; Number of samples: 31) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 0.00 | |
- BytesRead: 407.14 MB (426915606) | |
- BytesReadDataNodeCache: 397.58 MB (416888203) | |
- BytesReadLocal: 407.14 MB (426915606) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 407.14 MB (426915606) | |
- DecompressionTime: 754.335ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 31 (31) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 56.51 MB (59253309) | |
- PerReadThreadRawHdfsThroughput: 34.83 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 125.106ms | |
- RowBatchQueuePutWaitTime: 0.000ns | |
- RowsRead: 12.71M (12711965) | |
- RowsReturned: 237.09K (237087) | |
- RowsReturnedRate: 1.85 M/sec | |
- ScanRangesComplete: 31 (31) | |
- ScannerThreadsInvoluntaryContextSwitches: 3 (3) | |
- ScannerThreadsTotalWallClockTime: 2s271ms | |
- MaterializeTupleTime(*): 672.484ms | |
- ScannerThreadsSysTime: 288.000ms | |
- ScannerThreadsUserTime: 1s516ms | |
- ScannerThreadsVoluntaryContextSwitches: 2.59K (2588) | |
- TotalRawHdfsReadTime(*): 11.416ms | |
- TotalReadThroughput: 0.00 /sec | |
Instance 514ee9ab39cdc507:49 (host=cdh15.net.cuberonlabs.com:22000):(Total: 543.417ms, non-child: 28.174ms, % non-child: 5.18%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.66 GB | |
MemoryUsage(500.000ms): 1.36 MB, 6.26 MB | |
ThreadUsage(500.000ms): 1, 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 69.95 MB (73345882) | |
- PerHostPeakMemUsage: 345.60 MB (362388576) | |
- RowsProduced: 111.14K (111139) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 5.502ms | |
- TotalStorageWaitTime: 135.206ms | |
- TotalThreadsInvoluntaryContextSwitches: 3 (3) | |
- TotalThreadsTotalWallClockTime: 2s701ms | |
- TotalThreadsSysTime: 412.000ms | |
- TotalThreadsUserTime: 1s616ms | |
- TotalThreadsVoluntaryContextSwitches: 2.81K (2808) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 397.878ms | |
- ExecTreeExecTime: 342.782ms | |
- OpenTime: 108.406ms | |
- ExecTreeOpenTime: 46.881us | |
- PrepareTime: 37.083ms | |
- ExecTreePrepareTime: 768.778us | |
DataStreamSender (dst_id=29):(Total: 31.988ms, non-child: 31.988ms, % non-child: 100.00%) | |
- BytesSent: 5.03 MB (5277069) | |
- NetworkThroughput(*): 731.96 MB/sec | |
- OverallThroughput: 157.33 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 111.14K (111139) | |
- SerializeBatchTime: 25.061ms | |
- TransmitDataRPCTime: 6.875ms | |
- UncompressedRowBatchSize: 6.89 MB (7224739) | |
CodeGen:(Total: 139.727ms, non-child: 139.727ms, % non-child: 100.00%) | |
- CodegenTime: 3.515ms | |
- CompileTime: 28.366ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.04K (1041) | |
- OptimizationTime: 78.859ms | |
- PeakMemoryUsage: 520.50 KB (532992) | |
- PrepareTime: 31.750ms | |
AGGREGATION_NODE (id=6):(Total: 343.527ms, non-child: 190.709ms, % non-child: 55.52%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 134.288us | |
- GetResultsTime: 3.899ms | |
- HTResizeTime: 6.013ms | |
- HashBuckets: 262.14K (262144) | |
- LargestPartitionPercent: 3 (3) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 21.12 MB (22150937) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 94.09 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 111.14K (111139) | |
- RowsReturnedRate: 323.52 K/sec | |
- StreamingTime: 184.342ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=5):(Total: 152.817ms, non-child: 152.817ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.66 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30 | |
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:90 | |
BytesRead(500.000ms): 0 | |
- FooterProcessingTime: (Avg: 9.971ms ; Min: 2.690ms ; Max: 33.392ms ; Number of samples: 30) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 0.00 | |
- BytesRead: 359.86 MB (377336639) | |
- BytesReadDataNodeCache: 350.60 MB (367631328) | |
- BytesReadLocal: 359.86 MB (377336639) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 359.86 MB (377336639) | |
- DecompressionTime: 685.099ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 30 (30) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 54.30 MB (56938047) | |
- PerReadThreadRawHdfsThroughput: 34.47 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 149.344ms | |
- RowBatchQueuePutWaitTime: 0.000ns | |
- RowsRead: 11.11M (11113210) | |
- RowsReturned: 198.02K (198017) | |
- RowsReturnedRate: 1.30 M/sec | |
- ScanRangesComplete: 30 (30) | |
- ScannerThreadsInvoluntaryContextSwitches: 3 (3) | |
- ScannerThreadsTotalWallClockTime: 2s195ms | |
- MaterializeTupleTime(*): 623.552ms | |
- ScannerThreadsSysTime: 292.000ms | |
- ScannerThreadsUserTime: 1s392ms | |
- ScannerThreadsVoluntaryContextSwitches: 2.39K (2389) | |
- TotalRawHdfsReadTime(*): 10.196ms | |
- TotalReadThroughput: 0.00 /sec | |
Instance 514ee9ab39cdc507:52 (host=cdh8.net.cuberonlabs.com:22000):(Total: 542.254ms, non-child: 30.723ms, % non-child: 5.67%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.70 GB | |
MemoryUsage(500.000ms): 42.09 MB | |
ThreadUsage(500.000ms): 8 | |
- AverageThreadTokens: 8.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 82.28 MB (86276967) | |
- PerHostPeakMemUsage: 365.81 MB (383578250) | |
- RowsProduced: 112.08K (112083) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 5.252ms | |
- TotalStorageWaitTime: 89.659ms | |
- TotalThreadsInvoluntaryContextSwitches: 7 (7) | |
- TotalThreadsTotalWallClockTime: 2s546ms | |
- TotalThreadsSysTime: 360.000ms | |
- TotalThreadsUserTime: 1s520ms | |
- TotalThreadsVoluntaryContextSwitches: 3.91K (3913) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 389.554ms | |
- ExecTreeExecTime: 325.322ms | |
- OpenTime: 109.312ms | |
- ExecTreeOpenTime: 52.417us | |
- PrepareTime: 43.357ms | |
- ExecTreePrepareTime: 822.582us | |
DataStreamSender (dst_id=29):(Total: 39.330ms, non-child: 39.330ms, % non-child: 100.00%) | |
- BytesSent: 5.08 MB (5322384) | |
- NetworkThroughput(*): 434.67 MB/sec | |
- OverallThroughput: 129.06 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 112.08K (112083) | |
- SerializeBatchTime: 27.572ms | |
- TransmitDataRPCTime: 11.677ms | |
- UncompressedRowBatchSize: 6.95 MB (7286123) | |
CodeGen:(Total: 146.046ms, non-child: 146.046ms, % non-child: 100.00%) | |
- CodegenTime: 4.098ms | |
- CompileTime: 23.188ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.04K (1041) | |
- OptimizationTime: 84.736ms | |
- PeakMemoryUsage: 520.50 KB (532992) | |
- PrepareTime: 37.229ms | |
AGGREGATION_NODE (id=6):(Total: 326.153ms, non-child: 225.675ms, % non-child: 69.19%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 142.191us | |
- GetResultsTime: 4.214ms | |
- HTResizeTime: 8.608ms | |
- HashBuckets: 262.14K (262144) | |
- LargestPartitionPercent: 3 (3) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 21.12 MB (22141642) | |
- PinTime: 0.000ns | |
- ReductionFactorEstimate: 95.91 | |
- ReductionFactorThresholdToExpand: 2.00 | |
- RowsPassedThrough: 0 (0) | |
- RowsReturned: 112.08K (112083) | |
- RowsReturnedRate: 343.65 K/sec | |
- StreamingTime: 217.702ms | |
- UnpinTime: 0.000ns | |
HDFS_SCAN_NODE (id=5):(Total: 100.478ms, non-child: 100.478ms, % non-child: 100.00%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.70 GB | |
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 | |
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
File Formats: PARQUET/SNAPPY:84 | |
BytesRead(500.000ms): 329.47 MB | |
- FooterProcessingTime: (Avg: 11.387ms ; Min: 2.965ms ; Max: 41.363ms ; Number of samples: 28) | |
- AverageHdfsReadThreadConcurrency: 0.00 | |
- AverageScannerThreadConcurrency: 7.00 | |
- BytesRead: 362.83 MB (380457173) | |
- BytesReadDataNodeCache: 354.20 MB (371403734) | |
- BytesReadLocal: 362.83 MB (380457173) | |
- BytesReadRemoteUnexpected: 0 | |
- BytesReadShortCircuit: 362.83 MB (380457173) | |
- DecompressionTime: 671.769ms | |
- MaxCompressedTextFileLength: 0 | |
- NumColumns: 3 (3) | |
- NumDisksAccessed: 1 (1) | |
- NumRowGroups: 28 (28) | |
- NumScannerThreadsStarted: 7 (7) | |
- PeakMemoryUsage: 63.53 MB (66614002) | |
- PerReadThreadRawHdfsThroughput: 42.33 GB/sec | |
- RemoteScanRanges: 0 (0) | |
- RowBatchQueueGetWaitTime: 96.697ms | |
- RowBatchQueuePutWaitTime: 0.000ns | |
- RowsRead: 11.39M (11388046) | |
- RowsReturned: 207.74K (207744) | |
- RowsReturnedRate: 2.07 M/sec | |
- ScanRangesComplete: 28 (28) | |
- ScannerThreadsInvoluntaryContextSwitches: 5 (5) | |
- ScannerThreadsTotalWallClockTime: 2s047ms | |
- MaterializeTupleTime(*): 556.166ms | |
- ScannerThreadsSysTime: 248.000ms | |
- ScannerThreadsUserTime: 1s244ms | |
- ScannerThreadsVoluntaryContextSwitches: 3.63K (3627) | |
- TotalRawHdfsReadTime(*): 8.369ms | |
- TotalReadThroughput: 658.94 MB/sec | |
Instance 514ee9ab39cdc507:4c (host=cdh2.net.cuberonlabs.com:22000):(Total: 532.170ms, non-child: 34.810ms, % non-child: 6.54%) | |
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/3.00 GB | |
MemoryUsage(500.000ms): 1.88 MB | |
ThreadUsage(500.000ms): 1 | |
- AverageThreadTokens: 1.00 | |
- BloomFilterBytes: 0 | |
- PeakMemoryUsage: 71.15 MB (74603742) | |
- PerHostPeakMemUsage: 376.21 MB (394489170) | |
- RowsProduced: 129.24K (129236) | |
- TotalNetworkReceiveTime: 0.000ns | |
- TotalNetworkSendTime: 5.095ms | |
- TotalStorageWaitTime: 139.914ms | |
- TotalThreadsInvoluntaryContextSwitches: 2 (2) | |
- TotalThreadsTotalWallClockTime: 2s938ms | |
- TotalThreadsSysTime: 440.000ms | |
- TotalThreadsUserTime: 1s816ms | |
- TotalThreadsVoluntaryContextSwitches: 2.85K (2854) | |
Fragment Instance Lifecycle Timings: | |
- ExecTime: 437.013ms | |
- ExecTreeExecTime: 367.871ms | |
- OpenTime: 73.676ms | |
- ExecTreeOpenTime: 39.260us | |
- PrepareTime: 21.424ms | |
- ExecTreePrepareTime: 981.152us | |
DataStreamSender (dst_id=29):(Total: 39.108ms, non-child: 39.108ms, % non-child: 100.00%) | |
- BytesSent: 5.85 MB (6135785) | |
- NetworkThroughput(*): 813.87 MB/sec | |
- OverallThroughput: 149.62 MB/sec | |
- PeakMemoryUsage: 1.08 MB (1133560) | |
- RowsReturned: 129.24K (129236) | |
- SerializeBatchTime: 31.836ms | |
- TransmitDataRPCTime: 7.189ms | |
- UncompressedRowBatchSize: 8.01 MB (8401156) | |
CodeGen:(Total: 89.416ms, non-child: 89.416ms, % non-child: 100.00%) | |
- CodegenTime: 1.983ms | |
- CompileTime: 21.257ms | |
- LoadTime: 0.000ns | |
- ModuleBitcodeSize: 1.90 MB (1992760) | |
- NumFunctions: 56 (56) | |
- NumInstructions: 1.04K (1041) | |
- OptimizationTime: 51.691ms | |
- PeakMemoryUsage: 520.50 KB (532992) | |
- PrepareTime: 16.023ms | |
AGGREGATION_NODE (id=6):(Total: 368.835ms, non-child: 221.859ms, % non-child: 60.15%) | |
ExecOption: Streaming Preaggregation, Codegen Enabled | |
- GetNewBlockTime: 179.052us | |
- GetResultsTime: 4.681ms | |
- HTResizeTime: 6.629ms | |
- HashBuckets: 262.14K (262144) | |
- LargestPartitionPercent: 3 (3) | |
- PartitionsCreated: 16 (16) | |
- PeakMemoryUsage: 21.1 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment