Skip to content

Instantly share code, notes, and snippets.

/Fast query Secret

Created May 15, 2017 18:47
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save anonymous/2ef16a696527acd86795c3080edf3e91 to your computer and use it in GitHub Desktop.
Save anonymous/2ef16a696527acd86795c3080edf3e91 to your computer and use it in GitHub Desktop.
This file has been truncated, but you can view the full file.
Query (id=514ee9ab39cdc507:7b38551b00000000):
Summary:
Session ID: c44bdbae62c1e2cb:799ff15c4a08fb98
Session Type: HIVESERVER2
HiveServer2 Protocol Version: V6
Start Time: 2017-05-15 11:32:21.898800000
End Time: 2017-05-15 11:44:40.288157000
Query Type: QUERY
Query State: FINISHED
Query Status: OK
Impala Version: impalad version 2.7.0-cdh5.10.1 RELEASE (build 876895d2a90346e69f2aea02d5528c2125ae7a32)
User: hdfs
Connected User: hdfs
Delegated User:
Network Address: ::ffff:172.16.0.220:57996
Default Db: 24x7_prod
Sql Statement: SELECT `@associative_tag.Propensity`,
`@dataset_a.Device`,
`y`,
x_rank,
seg_rank
FROM
(SELECT `@associative_tag.Propensity`,
`@dataset_a.Device`,
`y`,
x_rank,
dense_rank() over(
ORDER BY `y__SUM` DESC, `@dataset_a.Device` ASC) seg_rank
FROM
(SELECT `@associative_tag.Propensity`,
`@dataset_a.Device`,
`y`,
x_rank,
sum(`y`) over(partition BY `@dataset_a.Device`) `y__SUM`
FROM
(SELECT `@associative_tag.Propensity`,
`@dataset_a.Device`,
`y`,
dense_rank() over(
ORDER BY `y__SUM` DESC, `@associative_tag.Propensity`) x_rank
FROM
(SELECT `@associative_tag.Propensity`,
`@dataset_a.Device`,
`y`,
sum(`y`) over(partition BY `@associative_tag.Propensity`) `y__SUM`
FROM
(SELECT `@dataset_a.Device`,
`@associative_tag.Propensity`,
count(DISTINCT if(1 = 1, `@dataset_a.header_associativetag__LEVEL`, NULL)) `y`
FROM
(SELECT `@dataset_a.header_associativetag`,
min(if(1 = 1, `@dataset_a.header_associativetag`, NULL)) `@dataset_a.header_associativetag__LEVEL`
FROM
(SELECT `header_associativetag` `@dataset_a.header_associativetag`
FROM dataset_a_batch
WHERE `cuberon_event_date` BETWEEN "2017-04-23" AND "2017-05-07") Q1
GROUP BY `@dataset_a.header_associativetag`) Q2
JOIN
(SELECT `@dataset_a.header_associativetag` __JOIN_KEY0__,
`@dataset_a.Device`,
`__LEVEL_EXISTS__`
FROM
(SELECT `@dataset_a.header_associativetag`,
`@dataset_a.Device`,
`__LEVEL_EXISTS__`
FROM
(SELECT `@dataset_a.header_associativetag`,
`@dataset_a.Device`,
sum(if(1 = 1, 1, 0)) > 0 `__LEVEL_EXISTS__`
FROM
(SELECT `header_associativetag` `@dataset_a.header_associativetag`,
`body_customproperties_devicedetails_value` `@dataset_a.Device`
FROM dataset_a_batch
WHERE `cuberon_event_date` BETWEEN "2017-04-23" AND "2017-05-07") Q1
GROUP BY `@dataset_a.header_associativetag`,
`@dataset_a.Device`) Q2) __JOIN_QUERY__) __subquery0__ ON Q2.`@dataset_a.header_associativetag` = __subquery0__.__JOIN_KEY0__
LEFT OUTER JOIN
(SELECT `@dataset_a.header_associativetag` __JOIN_KEY0__,
`@associative_tag.Propensity`
FROM
(SELECT `@dataset_a.header_associativetag`,
`@associative_tag.Propensity`
FROM
(SELECT `@dataset_a.header_associativetag`,
min(if(1 = 1, `@dataset_a.Propensity`, NULL)) `@associative_tag.Propensity`
FROM
(SELECT `header_associativetag` `@dataset_a.header_associativetag`,
`body_customproperties_eventdata_value_f_c_ops` `@dataset_a.Propensity`,
`cuberon_event_epoch_target` `@Event.Event Time`
FROM dataset_a_batch
WHERE `cuberon_event_date` BETWEEN "2017-04-23" AND "2017-05-07") Q1
JOIN
(SELECT `@dataset_a.header_associativetag` __JOIN_KEY0__,
`@associative_tag.Propensity__JOINER`
FROM
(SELECT `@dataset_a.header_associativetag`,
`@associative_tag.Propensity__JOINER`
FROM
(SELECT `@dataset_a.header_associativetag`,
max(if(1 = 1, `@Event.Event Time`, NULL)) `@associative_tag.Propensity__JOINER`
FROM
(SELECT `header_associativetag` `@dataset_a.header_associativetag`,
`body_customproperties_eventdata_value_f_c_ops` `@dataset_a.Propensity`,
`cuberon_event_epoch_target` `@Event.Event Time`
FROM dataset_a_batch
WHERE `cuberon_event_date` BETWEEN "2017-04-23" AND "2017-05-07") Q1
WHERE `@dataset_a.Propensity` IS NOT NULL
GROUP BY `@dataset_a.header_associativetag`) Q2) __JOIN_QUERY__) __subquery0__ ON Q1.`@dataset_a.header_associativetag` = __subquery0__.__JOIN_KEY0__
AND Q1.`@Event.Event Time` = __subquery0__.`@associative_tag.Propensity__JOINER`
GROUP BY `@dataset_a.header_associativetag`) Q2) __JOIN_QUERY__) __subquery1__ ON Q2.`@dataset_a.header_associativetag` = __subquery1__.__JOIN_KEY0__
WHERE (`@associative_tag.Propensity` = 'Business-Medium'
AND `@associative_tag.Propensity` IS NOT NULL)
GROUP BY `@dataset_a.Device`,
`@associative_tag.Propensity`) XR1) XR2 ) SR1
WHERE x_rank <= 10) SR2 ) SR3
WHERE seg_rank <= 20
ORDER BY seg_rank,
x_rank
Coordinator: cdh1.net.cuberonlabs.com:22000
Query Options (non default): QUERY_TIMEOUT_S=600,MT_DOP=0
Plan:
----------------
Estimated Per-Host Requirements: Memory=21.30GB VCores=3
PLAN-ROOT SINK
|
23:SORT
| order by: seg_rank ASC, x_rank ASC
| hosts=17 per-host-mem=unavailable
| tuple-ids=35 row-size=76B cardinality=23
|
22:SELECT
| predicates: dense_rank() <= 20
| hosts=17 per-host-mem=unavailable
| tuple-ids=48,47 row-size=92B cardinality=23
|
21:ANALYTIC
| functions: dense_rank()
| order by: sum(y) DESC, `@dataset_a.Device` ASC
| window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW
| hosts=17 per-host-mem=unavailable
| tuple-ids=48,47 row-size=92B cardinality=227
|
40:MERGING-EXCHANGE [UNPARTITIONED]
| order by: sum(y) DESC, `@dataset_a.Device` ASC
| hosts=17 per-host-mem=unavailable
| tuple-ids=48 row-size=84B cardinality=227
|
20:SORT
| order by: sum(y) DESC, `@dataset_a.Device` ASC
| hosts=17 per-host-mem=16.00MB
| tuple-ids=48 row-size=84B cardinality=227
|
19:ANALYTIC
| functions: sum(count(if(TRUE, `@dataset_a.header_associativetag__LEVEL`, NULL)))
| partition by: `@dataset_a.Device`
| hosts=17 per-host-mem=0B
| tuple-ids=44,43 row-size=84B cardinality=227
|
18:SORT
| order by: `@dataset_a.Device` ASC NULLS FIRST
| hosts=17 per-host-mem=16.00MB
| tuple-ids=44 row-size=76B cardinality=227
|
39:EXCHANGE [HASH(`@dataset_a.Device`)]
| hosts=17 per-host-mem=0B
| tuple-ids=41,40 row-size=76B cardinality=227
|
17:SELECT
| predicates: dense_rank() <= 10
| hosts=17 per-host-mem=unavailable
| tuple-ids=41,40 row-size=76B cardinality=227
|
16:ANALYTIC
| functions: dense_rank()
| order by: sum(y) DESC, `@associative_tag.Propensity` ASC
| window: RANGE BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW
| hosts=17 per-host-mem=unavailable
| tuple-ids=41,40 row-size=76B cardinality=2266
|
38:MERGING-EXCHANGE [UNPARTITIONED]
| order by: sum(y) DESC, `@associative_tag.Propensity` ASC
| hosts=17 per-host-mem=unavailable
| tuple-ids=41 row-size=68B cardinality=2266
|
15:SORT
| order by: sum(y) DESC, `@associative_tag.Propensity` ASC
| hosts=17 per-host-mem=16.00MB
| tuple-ids=41 row-size=68B cardinality=2266
|
14:ANALYTIC
| functions: sum(count(if(TRUE, `@dataset_a.header_associativetag__LEVEL`, NULL)))
| partition by: `@associative_tag.Propensity`
| hosts=17 per-host-mem=0B
| tuple-ids=37,36 row-size=68B cardinality=2266
|
13:SORT
| order by: `@associative_tag.Propensity` ASC NULLS FIRST
| hosts=17 per-host-mem=16.00MB
| tuple-ids=37 row-size=60B cardinality=2266
|
37:EXCHANGE [HASH(`@associative_tag.Propensity`)]
| hosts=17 per-host-mem=0B
| tuple-ids=23 row-size=60B cardinality=2266
|
12:AGGREGATE [FINALIZE]
| output: count(if(TRUE, `@dataset_a.header_associativetag__LEVEL`, NULL))
| group by: `@dataset_a.Device`, `@associative_tag.Propensity`
| hosts=17 per-host-mem=10.00MB
| tuple-ids=23 row-size=60B cardinality=2266
|
36:AGGREGATE
| group by: `@dataset_a.Device`, `@associative_tag.Propensity`, if(TRUE, `@dataset_a.header_associativetag__LEVEL`, NULL)
| hosts=17 per-host-mem=2.89GB
| tuple-ids=22 row-size=68B cardinality=41522992
|
35:EXCHANGE [HASH(`@dataset_a.Device`,`@associative_tag.Propensity`)]
| hosts=17 per-host-mem=0B
| tuple-ids=22 row-size=68B cardinality=41522992
|
11:AGGREGATE [STREAMING]
| group by: `@dataset_a.Device`, min(if(TRUE, `@dataset_a.Propensity`, NULL)), if(TRUE, min(if(TRUE, `@dataset_a.header_associativetag`, NULL)), NULL)
| hosts=17 per-host-mem=2.89GB
| tuple-ids=22 row-size=68B cardinality=41522992
|
10:HASH JOIN [LEFT OUTER JOIN, PARTITIONED]
| hash predicates: `@dataset_a.header_associativetag` = `@dataset_a.header_associativetag`
| other predicates: min(if(TRUE, `@dataset_a.Propensity`, NULL)) IS NOT NULL, min(if(TRUE, `@dataset_a.Propensity`, NULL)) = 'Business-Medium'
| hosts=17 per-host-mem=3.12MB
| tuple-ids=6,2,18N row-size=251B cardinality=41522992
|
|--34:AGGREGATE [FINALIZE]
| | output: min:merge(if(TRUE, `@dataset_a.Propensity`, NULL))
| | group by: `@dataset_a.header_associativetag`
| | having: min(if(TRUE, `@dataset_a.Propensity`, NULL)) IS NOT NULL, min(if(TRUE, `@dataset_a.Propensity`, NULL)) = 'Business-Medium'
| | hosts=17 per-host-mem=52.96MB
| | tuple-ids=18 row-size=77B cardinality=655319
| |
| 33:EXCHANGE [HASH(`@dataset_a.header_associativetag`)]
| | hosts=17 per-host-mem=0B
| | tuple-ids=18 row-size=77B cardinality=17897362
| |
| 08:AGGREGATE [STREAMING]
| | output: min(if(TRUE, body_customproperties_eventdata_value_f_c_ops, NULL))
| | group by: header_associativetag
| | hosts=17 per-host-mem=216.74MB
| | tuple-ids=18 row-size=77B cardinality=17897362
| |
| 07:HASH JOIN [INNER JOIN, PARTITIONED]
| | hash predicates: cuberon_event_epoch_target = max(if(TRUE, `@Event.Event Time`, NULL)), header_associativetag = `@dataset_a.header_associativetag`
| | runtime filters: RF001 <- max(if(TRUE, `@Event.Event Time`, NULL)), RF002 <- `@dataset_a.header_associativetag`
| | hosts=17 per-host-mem=83.72MB
| | tuple-ids=10,14 row-size=167B cardinality=17897362
| |
| |--32:EXCHANGE [HASH(max(if(TRUE, `@Event.Event Time`, NULL)),`@dataset_a.header_associativetag`)]
| | | hosts=17 per-host-mem=0B
| | | tuple-ids=14 row-size=69B cardinality=19650614
| | |
| | 30:AGGREGATE [FINALIZE]
| | | output: max:merge(if(TRUE, `@Event.Event Time`, NULL))
| | | group by: `@dataset_a.header_associativetag`
| | | hosts=17 per-host-mem=194.24MB
| | | tuple-ids=14 row-size=69B cardinality=19650614
| | |
| | 29:EXCHANGE [HASH(`@dataset_a.header_associativetag`)]
| | | hosts=17 per-host-mem=0B
| | | tuple-ids=14 row-size=69B cardinality=19650614
| | |
| | 06:AGGREGATE [STREAMING]
| | | output: max(if(TRUE, cuberon_event_epoch_target, NULL))
| | | group by: header_associativetag
| | | hosts=17 per-host-mem=1.39GB
| | | tuple-ids=14 row-size=69B cardinality=19650614
| | |
| | 05:SCAN HDFS [24x7_prod.dataset_a_batch, RANDOM]
| | partitions=7/8 files=503 size=46.87GB
| | predicates: 24x7_prod.dataset_a_batch.body_customproperties_eventdata_value_f_c_ops IS NOT NULL
| | table stats: 215756183 rows total
| | column stats: all
| | hosts=17 per-host-mem=264.00MB
| | tuple-ids=12 row-size=98B cardinality=19650614
| |
| 31:EXCHANGE [HASH(cuberon_event_epoch_target,header_associativetag)]
| | hosts=17 per-host-mem=0B
| | tuple-ids=10 row-size=98B cardinality=196506140
| |
| 04:SCAN HDFS [24x7_prod.dataset_a_batch, RANDOM]
| partitions=7/8 files=503 size=46.87GB
| runtime filters: RF001 -> cuberon_event_epoch_target, RF002 -> header_associativetag
| table stats: 215756183 rows total
| column stats: all
| hosts=17 per-host-mem=264.00MB
| tuple-ids=10 row-size=98B cardinality=196506140
|
09:HASH JOIN [INNER JOIN, PARTITIONED]
| hash predicates: `@dataset_a.header_associativetag` = `@dataset_a.header_associativetag`
| runtime filters: RF000 <- `@dataset_a.header_associativetag`
| hosts=17 per-host-mem=216.74MB
| tuple-ids=6,2 row-size=174B cardinality=41522992
|
|--27:AGGREGATE [FINALIZE]
| | output: min:merge(if(TRUE, `@dataset_a.header_associativetag`, NULL))
| | group by: `@dataset_a.header_associativetag`
| | hosts=17 per-host-mem=216.74MB
| | tuple-ids=2 row-size=77B cardinality=45590648
| |
| 26:EXCHANGE [HASH(`@dataset_a.header_associativetag`)]
| | hosts=17 per-host-mem=0B
| | tuple-ids=2 row-size=77B cardinality=45590648
| |
| 01:AGGREGATE [STREAMING]
| | output: min(if(TRUE, header_associativetag, NULL))
| | group by: header_associativetag
| | hosts=17 per-host-mem=3.60GB
| | tuple-ids=2 row-size=77B cardinality=45590648
| |
| 00:SCAN HDFS [24x7_prod.dataset_a_batch, RANDOM]
| partitions=7/8 files=503 size=46.87GB
| table stats: 215756183 rows total
| column stats: all
| hosts=17 per-host-mem=88.00MB
| tuple-ids=0 row-size=61B cardinality=196506140
|
28:EXCHANGE [HASH(`@dataset_a.header_associativetag`)]
| hosts=17 per-host-mem=0B
| tuple-ids=6 row-size=97B cardinality=196506140
|
25:AGGREGATE [FINALIZE]
| group by: `@dataset_a.header_associativetag`, `@dataset_a.Device`
| hosts=17 per-host-mem=1.60GB
| tuple-ids=6 row-size=97B cardinality=196506140
|
24:EXCHANGE [HASH(`@dataset_a.header_associativetag`,`@dataset_a.Device`)]
| hosts=17 per-host-mem=0B
| tuple-ids=6 row-size=97B cardinality=196506140
|
03:AGGREGATE [STREAMING]
| group by: header_associativetag, body_customproperties_devicedetails_value
| hosts=17 per-host-mem=19.53GB
| tuple-ids=6 row-size=97B cardinality=196506140
|
02:SCAN HDFS [24x7_prod.dataset_a_batch, RANDOM]
partitions=7/8 files=503 size=46.87GB
runtime filters: RF000 -> 24x7_prod.dataset_a_batch.header_associativetag
table stats: 215756183 rows total
column stats: all
hosts=17 per-host-mem=176.00MB
tuple-ids=4 row-size=97B cardinality=196506140
----------------
Estimated Per-Host Mem: 22872427775
Estimated Per-Host VCores: 3
Request Pool: root.hdfs
Admission result: Admitted immediately
ExecSummary:
Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail
----------------------------------------------------------------------------------------------------------------------------------
23:SORT 1 273.728us 273.728us 20 23 24.03 MB -1.00 B
22:SELECT 1 77.148us 77.148us 20 23 24.00 KB -1.00 B
21:ANALYTIC 1 344.908us 344.908us 52 227 8.03 MB -1.00 B
40:MERGING-EXCHANGE 1 443.832us 443.832us 52 227 0 -1.00 B UNPARTITIONED
20:SORT 1 396.724us 396.724us 52 227 24.03 MB 16.00 MB
19:ANALYTIC 1 179.456us 179.456us 52 227 8.03 MB 0
18:SORT 1 678.452us 678.452us 52 227 24.03 MB 16.00 MB
39:EXCHANGE 1 11.348us 11.348us 52 227 0 0 HASH(`@dataset_a.Device`)
17:SELECT 1 44.280us 44.280us 52 227 24.00 KB -1.00 B
16:ANALYTIC 1 170.736us 170.736us 52 2.27K 8.03 MB -1.00 B
38:MERGING-EXCHANGE 1 41.420us 41.420us 52 2.27K 0 -1.00 B UNPARTITIONED
15:SORT 17 101.031us 287.881us 52 2.27K 24.03 MB 16.00 MB
14:ANALYTIC 17 192.790us 529.572us 52 2.27K 8.03 MB 0
13:SORT 17 221.655us 559.936us 52 2.27K 24.08 MB 16.00 MB
37:EXCHANGE 17 12.627us 135.244us 52 2.27K 0 0 HASH(`@associative_tag.Prop...
12:AGGREGATE 17 1.898ms 4.211ms 52 2.27K 2.56 MB 10.00 MB FINALIZE
36:AGGREGATE 17 3.646ms 14.411ms 35.85K 41.52M 11.19 MB 2.89 GB
35:EXCHANGE 17 210.341us 1.386ms 35.85K 41.52M 0 0 HASH(`@dataset_a.Device`,`@...
11:AGGREGATE 17 71.502ms 80.600ms 35.85K 41.52M 9.44 MB 2.89 GB STREAMING
10:HASH JOIN 17 342.957ms 377.603ms 35.85K 41.52M 1.28 MB 3.12 MB LEFT OUTER JOIN, PARTITIONED
|--34:AGGREGATE 17 23.275ms 27.444ms 17.92K 655.32K 20.08 MB 52.96 MB FINALIZE
| 33:EXCHANGE 17 2.052ms 5.782ms 518.12K 17.90M 0 0 HASH(`@dataset_a.header_ass...
| 08:AGGREGATE 17 94.774ms 120.072ms 518.12K 17.90M 13.04 MB 216.74 MB STREAMING
| 07:HASH JOIN 17 215.970ms 258.952ms 1.36M 17.90M 10.18 MB 83.72 MB INNER JOIN, PARTITIONED
| |--32:EXCHANGE 17 1.122ms 1.351ms 518.12K 19.65M 0 0 HASH(max(if(TRUE, `@Event.E...
| | 30:AGGREGATE 17 24.420ms 29.346ms 518.12K 19.65M 11.13 MB 194.24 MB FINALIZE
| | 29:EXCHANGE 17 3.543ms 4.587ms 1.99M 19.65M 0 0 HASH(`@dataset_a.header_ass...
| | 06:AGGREGATE 17 223.177ms 314.593ms 1.99M 19.65M 21.14 MB 1.39 GB STREAMING
| | 05:SCAN HDFS 17 159.508ms 237.531ms 3.63M 19.65M 77.55 MB 264.00 MB 24x7_prod.dataset_a_batch
| 31:EXCHANGE 17 130.445ms 188.042ms 37.77M 196.51M 0 0 HASH(cuberon_event_epoch_ta...
| 04:SCAN HDFS 17 980.913ms 1s024ms 37.77M 196.51M 98.90 MB 264.00 MB 24x7_prod.dataset_a_batch
09:HASH JOIN 17 1s671ms 2s004ms 43.32M 41.52M 457.17 MB 216.74 MB INNER JOIN, PARTITIONED
|--27:AGGREGATE 17 2s587ms 2s868ms 41.76M 45.59M 530.16 MB 216.74 MB FINALIZE
| 26:EXCHANGE 17 198.242ms 222.558ms 73.99M 45.59M 0 0 HASH(`@dataset_a.header_ass...
| 01:AGGREGATE 17 5s439ms 7s140ms 73.99M 45.59M 1.07 GB 3.60 GB STREAMING
| 00:SCAN HDFS 17 80.893ms 146.873ms 196.51M 196.51M 27.62 MB 88.00 MB 24x7_prod.dataset_a_batch
28:EXCHANGE 17 152.883ms 206.050ms 43.32M 196.51M 0 0 HASH(`@dataset_a.header_ass...
25:AGGREGATE 17 1s544ms 1s796ms 43.32M 196.51M 330.17 MB 1.60 GB FINALIZE
24:EXCHANGE 17 202.057ms 234.085ms 76.67M 196.51M 0 0 HASH(`@dataset_a.header_ass...
03:AGGREGATE 17 2s677ms 3s556ms 76.67M 196.51M 652.25 MB 19.53 GB STREAMING
02:SCAN HDFS 17 905.576ms 943.004ms 196.51M 196.51M 40.59 MB 176.00 MB 24x7_prod.dataset_a_batch
Planner Timeline: 55.086ms
- Analysis finished: 7.378ms (7.378ms)
- Equivalence classes computed: 8.023ms (644.847us)
- Single node plan created: 24.813ms (16.790ms)
- Runtime filters computed: 25.174ms (360.534us)
- Distributed plan created: 26.995ms (1.821ms)
- Lineage info computed: 28.087ms (1.091ms)
- Planning finished: 55.086ms (26.999ms)
Query Timeline: 12m18s
- Query submitted: 57.136us (57.136us)
- Planning finished: 114.390ms (114.332ms)
- Submit for admission: 124.498ms (10.108ms)
- Completed admission: 124.554ms (56.176us)
- Ready to start 173 fragment instances: 126.245ms (1.690ms)
- All 173 fragment instances started: 185.952ms (59.707ms)
- First dynamic filter received: 933.984ms (748.032ms)
- Rows available: 14s019ms (13s085ms)
- First row fetched: 14s899ms (879.593ms)
- Unregister query: 12m18s (12m3s)
- ComputeScanRangeAssignmentTimer: 5.390ms
ImpalaServer:
- ClientFetchWaitTimer: 12m4s
- RowMaterializationTimer: 20.465ms
Execution Profile 514ee9ab39cdc507:7b38551b00000000:(Total: 13s912ms, non-child: 0.000ns, % non-child: 0.00%)
Number of filters: 3
Filter routing table:
ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled
----------------------------------------------------------------------------------------------------------------------------
2 7 4 17 REMOTE false 17 (17) N/A N/A true
1 7 4 17 REMOTE false 17 (17) N/A N/A true
0 9 2 17 REMOTE false 17 (17) N/A N/A true
Fragment instance start latencies: Count: 173, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 4ms, 90th %-ile: 5ms, 95th %-ile: 6ms, 99.9th %-ile: 10ms
Per Node Peak Memory Usage: cdh8.net.cuberonlabs.com:22000(1.63 GB) cdh7.net.cuberonlabs.com:22000(1.58 GB) cdh5.net.cuberonlabs.com:22000(2.15 GB) cdh12.net.cuberonlabs.com:22000(1.12 GB) cdh2.net.cuberonlabs.com:22000(1.74 GB) cdh10.net.cuberonlabs.com:22000(1.66 GB) cdh17.net.cuberonlabs.com:22000(1.75 GB) cdh3.net.cuberonlabs.com:22000(2.16 GB) cdh15.net.cuberonlabs.com:22000(1.57 GB) cdh14.net.cuberonlabs.com:22000(1.44 GB) cdh9.net.cuberonlabs.com:22000(1.69 GB) cdh6.net.cuberonlabs.com:22000(1.67 GB) cdh11.net.cuberonlabs.com:22000(1.48 GB) cdh13.net.cuberonlabs.com:22000(1.66 GB) cdh16.net.cuberonlabs.com:22000(1.64 GB) cdh4.net.cuberonlabs.com:22000(2.13 GB) cdh1.net.cuberonlabs.com:22000(1.81 GB)
Final filter table:
ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled
----------------------------------------------------------------------------------------------------------------------------
2 7 4 17 REMOTE false 0 (17) 948.745ms 1s286ms false
1 7 4 17 REMOTE false 0 (17) 933.986ms 1s291ms false
0 9 2 17 REMOTE false 0 (17) 11s613ms 12s251ms false
- FiltersReceived: 51 (51)
- FinalizationTimer: 0.000ns
Coordinator Fragment F13:
Instance 514ee9ab39cdc507:7b38551b00000000 (host=cdh1.net.cuberonlabs.com:22000):(Total: 14s771ms, non-child: 883.087ms, % non-child: 5.98%)
MemoryUsage(500.000ms): 24.56 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB, 24.02 MB
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 32.08 MB (33634378)
- PerHostPeakMemUsage: 1.81 GB (1939587581)
- RowsProduced: 20 (20)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 0.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 14s727ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 104.000ms
- TotalThreadsVoluntaryContextSwitches: 29 (29)
Fragment Instance Lifecycle Timings:
- ExecTime: 879.799ms
- ExecTreeExecTime: 10.040us
- OpenTime: 13s848ms
- ExecTreeOpenTime: 13s743ms
- PrepareTime: 43.208ms
- ExecTreePrepareTime: 341.064us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 408 (408)
- BlocksRecycled: 301 (301)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 48.00 GB (51539607552)
- PeakMemoryUsage: 1.34 GB (1443135488)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
PLAN_ROOT_SINK:
- PeakMemoryUsage: 0
CodeGen:(Total: 143.939ms, non-child: 143.939ms, % non-child: 100.00%)
- CodegenTime: 1.365ms
- CompileTime: 16.076ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 62 (62)
- NumInstructions: 1.13K (1129)
- OptimizationTime: 86.696ms
- PeakMemoryUsage: 564.50 KB (578048)
- PrepareTime: 40.096ms
SORT_NODE (id=23):(Total: 13s744ms, non-child: 273.728us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 12.720us
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.03 MB (25194496)
- RowsReturned: 20 (20)
- RowsReturnedRate: 1.00 /sec
- SortDataSize: 1.78 KB (1824)
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
SELECT_NODE (id=22):(Total: 13s743ms, non-child: 77.148us, % non-child: 0.00%)
- PeakMemoryUsage: 24.00 KB (24576)
- RowsReturned: 20 (20)
- RowsReturnedRate: 1.00 /sec
ANALYTIC_EVAL_NODE (id=21):(Total: 13s743ms, non-child: 344.908us, % non-child: 0.00%)
- EvaluationTime: 83.272us
- GetNewBlockTime: 1.612us
- PeakMemoryUsage: 8.03 MB (8422421)
- PinTime: 0.000ns
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=40):(Total: 13s743ms, non-child: 443.832us, % non-child: 0.00%)
ExecOption: Codegen Enabled
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 1.88 KB (1920)
- ConvertRowBatchTime: 0.000ns
- DeserializeRowBatchTimer: 23.304us
- FirstBatchArrivalWaitTime: 13s743ms
- MergeGetNext: 428.888us
- MergeGetNextBatch: 421.580us
- PeakMemoryUsage: 0
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Averaged Fragment F12:(Total: 13s890ms, non-child: 4.292ms, % non-child: 0.03%)
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:13s891ms max:13s891ms mean: 13s891ms stddev:0.000ns
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 56.06 MB (58784661)
- PerHostPeakMemUsage: 1.81 GB (1939587581)
- RowsProduced: 52 (52)
- TotalNetworkReceiveTime: 13s760ms
- TotalNetworkSendTime: 193.768us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 13s854ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 92.000ms
- TotalThreadsVoluntaryContextSwitches: 35 (35)
Fragment Instance Lifecycle Timings:
- ExecTime: 393.468us
- ExecTreeExecTime: 5.612us
- OpenTime: 13s854ms
- ExecTreeOpenTime: 13s761ms
- PrepareTime: 35.893ms
- ExecTreePrepareTime: 501.208us
DataStreamSender (dst_id=40):(Total: 117.204us, non-child: 117.204us, % non-child: 100.00%)
- BytesSent: 1.88 KB (1920)
- NetworkThroughput(*): 44.29 MB/sec
- OverallThroughput: 15.62 MB/sec
- PeakMemoryUsage: 1.97 KB (2016)
- RowsReturned: 52 (52)
- SerializeBatchTime: 42.220us
- TransmitDataRPCTime: 41.340us
- UncompressedRowBatchSize: 5.23 KB (5353)
CodeGen:(Total: 124.678ms, non-child: 124.678ms, % non-child: 100.00%)
- CodegenTime: 858.552us
- CompileTime: 14.428ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 75.882ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 33.847ms
SORT_NODE (id=20):(Total: 13s761ms, non-child: 396.724us, % non-child: 0.00%)
- InMemorySortTime: 30.228us
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.03 MB (25194496)
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
- SortDataSize: 5.02 KB (5141)
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=19):(Total: 13s761ms, non-child: 179.456us, % non-child: 0.00%)
- EvaluationTime: 43.688us
- GetNewBlockTime: 2.436us
- PeakMemoryUsage: 8.03 MB (8417280)
- PinTime: 0.000ns
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
- UnpinTime: 0.000ns
SORT_NODE (id=18):(Total: 13s760ms, non-child: 678.452us, % non-child: 0.00%)
- InMemorySortTime: 30.656us
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.03 MB (25194718)
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
- SortDataSize: 4.61 KB (4725)
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=39):(Total: 13s760ms, non-child: 13s760ms, % non-child: 100.00%)
- BytesReceived: 2.00 KB (2046)
- ConvertRowBatchTime: 2.744us
- DeserializeRowBatchTimer: 21.812us
- FirstBatchArrivalWaitTime: 13s760ms
- PeakMemoryUsage: 0
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Fragment F12:
Instance 514ee9ab39cdc507:ac (host=cdh1.net.cuberonlabs.com:22000):(Total: 13s890ms, non-child: 4.292ms, % non-child: 0.03%)
MemoryUsage(500.000ms): 48.45 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 56.06 MB (58784661)
- PerHostPeakMemUsage: 1.81 GB (1939587581)
- RowsProduced: 52 (52)
- TotalNetworkReceiveTime: 13s760ms
- TotalNetworkSendTime: 193.768us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 13s854ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 92.000ms
- TotalThreadsVoluntaryContextSwitches: 35 (35)
Fragment Instance Lifecycle Timings:
- ExecTime: 393.468us
- ExecTreeExecTime: 5.612us
- OpenTime: 13s854ms
- ExecTreeOpenTime: 13s761ms
- PrepareTime: 35.893ms
- ExecTreePrepareTime: 501.208us
DataStreamSender (dst_id=40):(Total: 117.204us, non-child: 117.204us, % non-child: 100.00%)
- BytesSent: 1.88 KB (1920)
- NetworkThroughput(*): 44.29 MB/sec
- OverallThroughput: 15.62 MB/sec
- PeakMemoryUsage: 1.97 KB (2016)
- RowsReturned: 52 (52)
- SerializeBatchTime: 42.220us
- TransmitDataRPCTime: 41.340us
- UncompressedRowBatchSize: 5.23 KB (5353)
CodeGen:(Total: 124.678ms, non-child: 124.678ms, % non-child: 100.00%)
- CodegenTime: 858.552us
- CompileTime: 14.428ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 75.882ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 33.847ms
SORT_NODE (id=20):(Total: 13s761ms, non-child: 396.724us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 30.228us
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.03 MB (25194496)
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
- SortDataSize: 5.02 KB (5141)
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=19):(Total: 13s761ms, non-child: 179.456us, % non-child: 0.00%)
- EvaluationTime: 43.688us
- GetNewBlockTime: 2.436us
- PeakMemoryUsage: 8.03 MB (8417280)
- PinTime: 0.000ns
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
- UnpinTime: 0.000ns
SORT_NODE (id=18):(Total: 13s760ms, non-child: 678.452us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 30.656us
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.03 MB (25194718)
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
- SortDataSize: 4.61 KB (4725)
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=39):(Total: 13s760ms, non-child: 11.348us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 2.00 KB (2046)
- ConvertRowBatchTime: 2.744us
- DeserializeRowBatchTimer: 21.812us
- FirstBatchArrivalWaitTime: 13s760ms
- PeakMemoryUsage: 0
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Averaged Fragment F11:(Total: 13s889ms, non-child: 2.336ms, % non-child: 0.02%)
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:13s890ms max:13s890ms mean: 13s890ms stddev:0.000ns
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 8.07 MB (8463866)
- PerHostPeakMemUsage: 1.81 GB (1939587581)
- RowsProduced: 52 (52)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 173.280us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 4 (4)
- TotalThreadsTotalWallClockTime: 13s864ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 92.000ms
- TotalThreadsVoluntaryContextSwitches: 33 (33)
Fragment Instance Lifecycle Timings:
- ExecTime: 377.648us
- ExecTreeExecTime: 51.992us
- OpenTime: 13s863ms
- ExecTreeOpenTime: 13s773ms
- PrepareTime: 25.368ms
- ExecTreePrepareTime: 101.656us
DataStreamSender (dst_id=39):(Total: 115.820us, non-child: 115.820us, % non-child: 100.00%)
- BytesSent: 2.00 KB (2046)
- NetworkThroughput(*): 54.93 MB/sec
- OverallThroughput: 16.85 MB/sec
- PeakMemoryUsage: 4.41 KB (4512)
- RowsReturned: 52 (52)
- SerializeBatchTime: 47.444us
- TransmitDataRPCTime: 35.520us
- UncompressedRowBatchSize: 4.63 KB (4742)
CodeGen:(Total: 113.753ms, non-child: 113.753ms, % non-child: 100.00%)
- CodegenTime: 718.952us
- CompileTime: 15.517ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 59 (59)
- NumInstructions: 1.03K (1032)
- OptimizationTime: 74.029ms
- PeakMemoryUsage: 516.00 KB (528384)
- PrepareTime: 23.655ms
SELECT_NODE (id=17):(Total: 13s773ms, non-child: 44.280us, % non-child: 0.00%)
- PeakMemoryUsage: 24.00 KB (24576)
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
ANALYTIC_EVAL_NODE (id=16):(Total: 13s773ms, non-child: 170.736us, % non-child: 0.00%)
- EvaluationTime: 29.696us
- GetNewBlockTime: 3.000us
- PeakMemoryUsage: 8.03 MB (8421589)
- PinTime: 0.000ns
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=38):(Total: 13s773ms, non-child: 13s773ms, % non-child: 100.00%)
- BytesReceived: 1.80 KB (1839)
- ConvertRowBatchTime: 0.000ns
- DeserializeRowBatchTimer: 22.136us
- FirstBatchArrivalWaitTime: 13s773ms
- MergeGetNext: 6.024us
- MergeGetNextBatch: 1.304us
- PeakMemoryUsage: 0
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Fragment F11:
Instance 514ee9ab39cdc507:ab (host=cdh1.net.cuberonlabs.com:22000):(Total: 13s889ms, non-child: 2.336ms, % non-child: 0.02%)
MemoryUsage(500.000ms): 24.41 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB, 29.29 KB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 8.07 MB (8463866)
- PerHostPeakMemUsage: 1.81 GB (1939587581)
- RowsProduced: 52 (52)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 173.280us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 4 (4)
- TotalThreadsTotalWallClockTime: 13s864ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 92.000ms
- TotalThreadsVoluntaryContextSwitches: 33 (33)
Fragment Instance Lifecycle Timings:
- ExecTime: 377.648us
- ExecTreeExecTime: 51.992us
- OpenTime: 13s863ms
- ExecTreeOpenTime: 13s773ms
- PrepareTime: 25.368ms
- ExecTreePrepareTime: 101.656us
DataStreamSender (dst_id=39):(Total: 115.820us, non-child: 115.820us, % non-child: 100.00%)
- BytesSent: 2.00 KB (2046)
- NetworkThroughput(*): 54.93 MB/sec
- OverallThroughput: 16.85 MB/sec
- PeakMemoryUsage: 4.41 KB (4512)
- RowsReturned: 52 (52)
- SerializeBatchTime: 47.444us
- TransmitDataRPCTime: 35.520us
- UncompressedRowBatchSize: 4.63 KB (4742)
CodeGen:(Total: 113.753ms, non-child: 113.753ms, % non-child: 100.00%)
- CodegenTime: 718.952us
- CompileTime: 15.517ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 59 (59)
- NumInstructions: 1.03K (1032)
- OptimizationTime: 74.029ms
- PeakMemoryUsage: 516.00 KB (528384)
- PrepareTime: 23.655ms
SELECT_NODE (id=17):(Total: 13s773ms, non-child: 44.280us, % non-child: 0.00%)
- PeakMemoryUsage: 24.00 KB (24576)
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
ANALYTIC_EVAL_NODE (id=16):(Total: 13s773ms, non-child: 170.736us, % non-child: 0.00%)
- EvaluationTime: 29.696us
- GetNewBlockTime: 3.000us
- PeakMemoryUsage: 8.03 MB (8421589)
- PinTime: 0.000ns
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=38):(Total: 13s773ms, non-child: 41.420us, % non-child: 0.00%)
ExecOption: Codegen Enabled
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 1.80 KB (1839)
- ConvertRowBatchTime: 0.000ns
- DeserializeRowBatchTimer: 22.136us
- FirstBatchArrivalWaitTime: 13s773ms
- MergeGetNext: 6.024us
- MergeGetNextBatch: 1.304us
- PeakMemoryUsage: 0
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Averaged Fragment F10:(Total: 13s887ms, non-child: 2.167ms, % non-child: 0.02%)
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:13s887ms max:13s888ms mean: 13s888ms stddev:393.332us
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 17
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 48.90 MB (51272600)
- PerHostPeakMemUsage: 1.70 GB (1824024877)
- RowsProduced: 3 (3)
- TotalNetworkReceiveTime: 13s754ms
- TotalNetworkSendTime: 19.125us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s852ms
- TotalThreadsSysTime: 705.882us
- TotalThreadsUserTime: 98.823ms
- TotalThreadsVoluntaryContextSwitches: 14 (14)
Fragment Instance Lifecycle Timings:
- ExecTime: 221.229us
- ExecTreeExecTime: 3.224us
- OpenTime: 13s852ms
- ExecTreeOpenTime: 13s755ms
- PrepareTime: 34.406ms
- ExecTreePrepareTime: 162.475us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 404 (404)
- BlocksRecycled: 297 (297)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 48.00 GB (51539607552)
- PeakMemoryUsage: 1.25 GB (1346116160)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=38):(Total: 21.176us, non-child: 21.176us, % non-child: 100.00%)
- BytesSent: 108.00 B (108)
- NetworkThroughput(*): 2.25 MB/sec
- OverallThroughput: 1.07 MB/sec
- PeakMemoryUsage: 2.61 KB (2672)
- RowsReturned: 3 (3)
- SerializeBatchTime: 2.069us
- TransmitDataRPCTime: 2.698us
- UncompressedRowBatchSize: 265.00 B (265)
CodeGen:(Total: 129.471ms, non-child: 129.471ms, % non-child: 100.00%)
- CodegenTime: 1.222ms
- CompileTime: 15.791ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 80.046ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 32.833ms
SORT_NODE (id=15):(Total: 13s755ms, non-child: 101.031us, % non-child: 0.00%)
- InMemorySortTime: 1.352us
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.02 MB (25182930)
- RowsReturned: 3 (3)
- RowsReturnedRate: 0
- SortDataSize: 253.00 B (253)
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=14):(Total: 13s755ms, non-child: 192.790us, % non-child: 0.00%)
- EvaluationTime: 3.068us
- GetNewBlockTime: 3.910us
- PeakMemoryUsage: 8.02 MB (8413424)
- PinTime: 0.000ns
- RowsReturned: 3 (3)
- RowsReturnedRate: 0
- UnpinTime: 0.000ns
SORT_NODE (id=13):(Total: 13s755ms, non-child: 221.656us, % non-child: 0.00%)
- InMemorySortTime: 1.817us
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.01 MB (25178593)
- RowsReturned: 3 (3)
- RowsReturnedRate: 0
- SortDataSize: 229.00 B (229)
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=37):(Total: 13s754ms, non-child: 13s754ms, % non-child: 100.00%)
- BytesReceived: 154.00 B (154)
- ConvertRowBatchTime: 1.851us
- DeserializeRowBatchTimer: 6.043us
- FirstBatchArrivalWaitTime: 13s754ms
- PeakMemoryUsage: 0
- RowsReturned: 3 (3)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Fragment F10:
Instance 514ee9ab39cdc507:a1 (host=cdh2.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.266ms, % non-child: 0.02%)
MemoryUsage(500.000ms): 48.01 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 48.45 MB (50803312)
- PerHostPeakMemUsage: 1.74 GB (1866918022)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 13s754ms
- TotalNetworkSendTime: 244.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s852ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 100.000ms
- TotalThreadsVoluntaryContextSwitches: 14 (14)
Fragment Instance Lifecycle Timings:
- ExecTime: 179.644us
- ExecTreeExecTime: 4.944us
- OpenTime: 13s852ms
- ExecTreeOpenTime: 13s755ms
- PrepareTime: 35.365ms
- ExecTreePrepareTime: 163.580us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 399 (399)
- BlocksRecycled: 314 (314)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 48.00 GB (51539607552)
- PeakMemoryUsage: 1.27 GB (1368162304)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=38):(Total: 15.112us, non-child: 15.112us, % non-child: 100.00%)
- BytesSent: 0
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 2.61 KB (2672)
- RowsReturned: 0 (0)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 0
CodeGen:(Total: 129.976ms, non-child: 129.976ms, % non-child: 100.00%)
- CodegenTime: 1.300ms
- CompileTime: 15.147ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 80.326ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 33.630ms
SORT_NODE (id=15):(Total: 13s755ms, non-child: 71.204us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 336.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.02 MB (25182208)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=14):(Total: 13s755ms, non-child: 529.572us, % non-child: 0.00%)
- EvaluationTime: 820.000ns
- GetNewBlockTime: 2.728us
- PeakMemoryUsage: 8.02 MB (8413184)
- PinTime: 0.000ns
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- UnpinTime: 0.000ns
SORT_NODE (id=13):(Total: 13s754ms, non-child: 108.228us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 732.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.01 MB (25174016)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=37):(Total: 13s754ms, non-child: 4.240us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 0
- ConvertRowBatchTime: 752.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 13s754ms
- PeakMemoryUsage: 0
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:a2 (host=cdh12.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.200ms, % non-child: 0.02%)
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 48.45 MB (50803312)
- PerHostPeakMemUsage: 1.12 GB (1201773720)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 13s761ms
- TotalNetworkSendTime: 255.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s855ms
- TotalThreadsSysTime: 4.000ms
- TotalThreadsUserTime: 92.000ms
- TotalThreadsVoluntaryContextSwitches: 16 (16)
Fragment Instance Lifecycle Timings:
- ExecTime: 208.105us
- ExecTreeExecTime: 5.252us
- OpenTime: 13s855ms
- ExecTreeOpenTime: 13s761ms
- PrepareTime: 32.264ms
- ExecTreePrepareTime: 161.288us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 383 (383)
- BlocksRecycled: 282 (282)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 48.00 GB (51539607552)
- PeakMemoryUsage: 836.78 MB (877430784)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=38):(Total: 15.763us, non-child: 15.763us, % non-child: 100.00%)
- BytesSent: 0
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 2.61 KB (2672)
- RowsReturned: 0 (0)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 0
CodeGen:(Total: 123.540ms, non-child: 123.540ms, % non-child: 100.00%)
- CodegenTime: 1.298ms
- CompileTime: 14.842ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 76.833ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 31.052ms
SORT_NODE (id=15):(Total: 13s761ms, non-child: 275.998us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 298.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.02 MB (25182208)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=14):(Total: 13s761ms, non-child: 100.546us, % non-child: 0.00%)
- EvaluationTime: 643.000ns
- GetNewBlockTime: 5.634us
- PeakMemoryUsage: 8.02 MB (8413184)
- PinTime: 0.000ns
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- UnpinTime: 0.000ns
SORT_NODE (id=13):(Total: 13s761ms, non-child: 100.313us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 941.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.01 MB (25174016)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=37):(Total: 13s761ms, non-child: 4.675us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 0
- ConvertRowBatchTime: 871.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 13s761ms
- PeakMemoryUsage: 0
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:a0 (host=cdh17.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.229ms, % non-child: 0.02%)
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 48.45 MB (50803312)
- PerHostPeakMemUsage: 1.75 GB (1879028559)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 13s758ms
- TotalNetworkSendTime: 223.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s852ms
- TotalThreadsSysTime: 4.000ms
- TotalThreadsUserTime: 96.000ms
- TotalThreadsVoluntaryContextSwitches: 16 (16)
Fragment Instance Lifecycle Timings:
- ExecTime: 314.273us
- ExecTreeExecTime: 2.460us
- OpenTime: 13s852ms
- ExecTreeOpenTime: 13s758ms
- PrepareTime: 34.559ms
- ExecTreePrepareTime: 178.652us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 386 (386)
- BlocksRecycled: 311 (311)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 48.00 GB (51539607552)
- PeakMemoryUsage: 1.31 GB (1410891776)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=38):(Total: 15.884us, non-child: 15.884us, % non-child: 100.00%)
- BytesSent: 0
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 2.61 KB (2672)
- RowsReturned: 0 (0)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 0
CodeGen:(Total: 126.143ms, non-child: 126.143ms, % non-child: 100.00%)
- CodegenTime: 1.183ms
- CompileTime: 15.014ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 77.520ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 32.831ms
SORT_NODE (id=15):(Total: 13s759ms, non-child: 72.300us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 177.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.02 MB (25182208)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=14):(Total: 13s759ms, non-child: 101.035us, % non-child: 0.00%)
- EvaluationTime: 1.051us
- GetNewBlockTime: 3.093us
- PeakMemoryUsage: 8.02 MB (8413184)
- PinTime: 0.000ns
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- UnpinTime: 0.000ns
SORT_NODE (id=13):(Total: 13s758ms, non-child: 208.052us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 790.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.01 MB (25174016)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=37):(Total: 13s758ms, non-child: 4.369us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 0
- ConvertRowBatchTime: 606.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 13s758ms
- PeakMemoryUsage: 0
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:aa (host=cdh10.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.186ms, % non-child: 0.02%)
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 48.45 MB (50803312)
- PerHostPeakMemUsage: 1.66 GB (1784016472)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 13s762ms
- TotalNetworkSendTime: 194.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s854ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 92.000ms
- TotalThreadsVoluntaryContextSwitches: 8 (8)
Fragment Instance Lifecycle Timings:
- ExecTime: 152.558us
- ExecTreeExecTime: 1.819us
- OpenTime: 13s853ms
- ExecTreeOpenTime: 13s763ms
- PrepareTime: 33.271ms
- ExecTreePrepareTime: 165.076us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 415 (415)
- BlocksRecycled: 282 (282)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 48.00 GB (51539607552)
- PeakMemoryUsage: 1.22 GB (1310228480)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=38):(Total: 15.973us, non-child: 15.973us, % non-child: 100.00%)
- BytesSent: 0
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 2.61 KB (2672)
- RowsReturned: 0 (0)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 0
CodeGen:(Total: 121.919ms, non-child: 121.919ms, % non-child: 100.00%)
- CodegenTime: 1.295ms
- CompileTime: 14.713ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 74.836ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 31.531ms
SORT_NODE (id=15):(Total: 13s763ms, non-child: 73.640us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 317.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.02 MB (25182208)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=14):(Total: 13s763ms, non-child: 95.851us, % non-child: 0.00%)
- EvaluationTime: 921.000ns
- GetNewBlockTime: 3.329us
- PeakMemoryUsage: 8.02 MB (8413184)
- PinTime: 0.000ns
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- UnpinTime: 0.000ns
SORT_NODE (id=13):(Total: 13s763ms, non-child: 194.088us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 966.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.01 MB (25174016)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=37):(Total: 13s762ms, non-child: 4.634us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 0
- ConvertRowBatchTime: 942.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 13s762ms
- PeakMemoryUsage: 0
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:a4 (host=cdh1.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.259ms, % non-child: 0.02%)
MemoryUsage(500.000ms): 48.45 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 48.45 MB (50803312)
- PerHostPeakMemUsage: 1.81 GB (1939587581)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 13s743ms
- TotalNetworkSendTime: 284.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 13s843ms
- TotalThreadsSysTime: 4.000ms
- TotalThreadsUserTime: 96.000ms
- TotalThreadsVoluntaryContextSwitches: 29 (29)
Fragment Instance Lifecycle Timings:
- ExecTime: 132.636us
- ExecTreeExecTime: 3.000us
- OpenTime: 13s843ms
- ExecTreeOpenTime: 13s743ms
- PrepareTime: 43.870ms
- ExecTreePrepareTime: 95.856us
DataStreamSender (dst_id=38):(Total: 9.224us, non-child: 9.224us, % non-child: 100.00%)
- BytesSent: 0
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 2.61 KB (2672)
- RowsReturned: 0 (0)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 0
CodeGen:(Total: 141.340ms, non-child: 141.340ms, % non-child: 100.00%)
- CodegenTime: 1.584ms
- CompileTime: 14.899ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 82.845ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 42.681ms
SORT_NODE (id=15):(Total: 13s743ms, non-child: 107.248us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 196.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.02 MB (25182208)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=14):(Total: 13s743ms, non-child: 78.972us, % non-child: 0.00%)
- EvaluationTime: 876.000ns
- GetNewBlockTime: 3.268us
- PeakMemoryUsage: 8.02 MB (8413184)
- PinTime: 0.000ns
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- UnpinTime: 0.000ns
SORT_NODE (id=13):(Total: 13s743ms, non-child: 434.984us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 844.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.01 MB (25174016)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=37):(Total: 13s743ms, non-child: 5.576us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 0
- ConvertRowBatchTime: 832.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 13s743ms
- PeakMemoryUsage: 0
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:9f (host=cdh3.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.015ms, % non-child: 0.01%)
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 48.45 MB (50803312)
- PerHostPeakMemUsage: 2.16 GB (2318232477)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 13s731ms
- TotalNetworkSendTime: 192.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 2 (2)
- TotalThreadsTotalWallClockTime: 13s853ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 124.000ms
- TotalThreadsVoluntaryContextSwitches: 15 (15)
Fragment Instance Lifecycle Timings:
- ExecTime: 172.296us
- ExecTreeExecTime: 2.400us
- OpenTime: 13s853ms
- ExecTreeOpenTime: 13s731ms
- PrepareTime: 33.753ms
- ExecTreePrepareTime: 202.768us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 413 (413)
- BlocksRecycled: 316 (316)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 48.00 GB (51539607552)
- PeakMemoryUsage: 1.60 GB (1720483840)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=38):(Total: 21.828us, non-child: 21.828us, % non-child: 100.00%)
- BytesSent: 0
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 2.61 KB (2672)
- RowsReturned: 0 (0)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 0
CodeGen:(Total: 153.101ms, non-child: 153.101ms, % non-child: 100.00%)
- CodegenTime: 1.044ms
- CompileTime: 20.172ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 99.970ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 32.286ms
SORT_NODE (id=15):(Total: 13s732ms, non-child: 77.284us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 176.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.02 MB (25182208)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=14):(Total: 13s732ms, non-child: 112.116us, % non-child: 0.00%)
- EvaluationTime: 656.000ns
- GetNewBlockTime: 2.832us
- PeakMemoryUsage: 8.02 MB (8413184)
- PinTime: 0.000ns
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- UnpinTime: 0.000ns
SORT_NODE (id=13):(Total: 13s731ms, non-child: 541.508us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 704.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.01 MB (25174016)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=37):(Total: 13s731ms, non-child: 4.988us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 0
- ConvertRowBatchTime: 1.032us
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 13s731ms
- PeakMemoryUsage: 0
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:a8 (host=cdh11.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.038ms, % non-child: 0.01%)
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 48.45 MB (50803312)
- PerHostPeakMemUsage: 1.48 GB (1591793359)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 13s762ms
- TotalNetworkSendTime: 237.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s854ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 92.000ms
- TotalThreadsVoluntaryContextSwitches: 13 (13)
Fragment Instance Lifecycle Timings:
- ExecTime: 184.537us
- ExecTreeExecTime: 2.060us
- OpenTime: 13s854ms
- ExecTreeOpenTime: 13s762ms
- PrepareTime: 32.424ms
- ExecTreePrepareTime: 167.987us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 399 (399)
- BlocksRecycled: 298 (298)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 48.00 GB (51539607552)
- PeakMemoryUsage: 1.12 GB (1197277184)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=38):(Total: 15.001us, non-child: 15.001us, % non-child: 100.00%)
- BytesSent: 0
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 2.61 KB (2672)
- RowsReturned: 0 (0)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 0
CodeGen:(Total: 122.295ms, non-child: 122.295ms, % non-child: 100.00%)
- CodegenTime: 1.281ms
- CompileTime: 15.189ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 75.483ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 30.817ms
SORT_NODE (id=15):(Total: 13s762ms, non-child: 67.132us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 291.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.02 MB (25182208)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=14):(Total: 13s762ms, non-child: 98.045us, % non-child: 0.00%)
- EvaluationTime: 583.000ns
- GetNewBlockTime: 3.225us
- PeakMemoryUsage: 8.02 MB (8413184)
- PinTime: 0.000ns
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- UnpinTime: 0.000ns
SORT_NODE (id=13):(Total: 13s762ms, non-child: 413.389us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 554.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.01 MB (25174016)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=37):(Total: 13s762ms, non-child: 4.013us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 0
- ConvertRowBatchTime: 754.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 13s762ms
- PeakMemoryUsage: 0
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:9d (host=cdh6.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.369ms, % non-child: 0.02%)
MemoryUsage(500.000ms): 48.01 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 56.06 MB (58781221)
- PerHostPeakMemUsage: 1.67 GB (1794839264)
- RowsProduced: 52 (52)
- TotalNetworkReceiveTime: 13s757ms
- TotalNetworkSendTime: 321.380us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s852ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 96.000ms
- TotalThreadsVoluntaryContextSwitches: 30 (30)
Fragment Instance Lifecycle Timings:
- ExecTime: 552.740us
- ExecTreeExecTime: 4.600us
- OpenTime: 13s852ms
- ExecTreeOpenTime: 13s758ms
- PrepareTime: 34.608ms
- ExecTreePrepareTime: 159.868us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 399 (399)
- BlocksRecycled: 298 (298)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 48.00 GB (51539607552)
- PeakMemoryUsage: 1.23 GB (1316126720)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=38):(Total: 96.696us, non-child: 96.696us, % non-child: 100.00%)
- BytesSent: 1.80 KB (1839)
- NetworkThroughput(*): 38.24 MB/sec
- OverallThroughput: 18.14 MB/sec
- PeakMemoryUsage: 2.61 KB (2672)
- RowsReturned: 52 (52)
- SerializeBatchTime: 35.176us
- TransmitDataRPCTime: 45.868us
- UncompressedRowBatchSize: 4.42 KB (4521)
CodeGen:(Total: 126.456ms, non-child: 126.456ms, % non-child: 100.00%)
- CodegenTime: 1.219ms
- CompileTime: 14.917ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 77.885ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 32.866ms
SORT_NODE (id=15):(Total: 13s758ms, non-child: 107.948us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 18.168us
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.03 MB (25194496)
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
- SortDataSize: 4.21 KB (4309)
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=14):(Total: 13s758ms, non-child: 130.644us, % non-child: 0.00%)
- EvaluationTime: 39.204us
- GetNewBlockTime: 2.752us
- PeakMemoryUsage: 8.03 MB (8417280)
- PinTime: 0.000ns
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
- UnpinTime: 0.000ns
SORT_NODE (id=13):(Total: 13s758ms, non-child: 559.936us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 18.764us
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.08 MB (25251840)
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
- SortDataSize: 3.80 KB (3893)
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=37):(Total: 13s757ms, non-child: 135.244us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 2.57 KB (2630)
- ConvertRowBatchTime: 17.864us
- DeserializeRowBatchTimer: 102.740us
- FirstBatchArrivalWaitTime: 13s747ms
- PeakMemoryUsage: 0
- RowsReturned: 52 (52)
- RowsReturnedRate: 3.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:a7 (host=cdh8.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.148ms, % non-child: 0.02%)
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 48.45 MB (50803312)
- PerHostPeakMemUsage: 1.63 GB (1748411303)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 13s761ms
- TotalNetworkSendTime: 250.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s853ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 92.000ms
- TotalThreadsVoluntaryContextSwitches: 7 (7)
Fragment Instance Lifecycle Timings:
- ExecTime: 220.069us
- ExecTreeExecTime: 3.457us
- OpenTime: 13s853ms
- ExecTreeOpenTime: 13s761ms
- PrepareTime: 33.111ms
- ExecTreePrepareTime: 167.440us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 399 (399)
- BlocksRecycled: 298 (298)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 48.00 GB (51539607552)
- PeakMemoryUsage: 1.22 GB (1309378560)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=38):(Total: 16.170us, non-child: 16.170us, % non-child: 100.00%)
- BytesSent: 0
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 2.61 KB (2672)
- RowsReturned: 0 (0)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 0
CodeGen:(Total: 123.349ms, non-child: 123.349ms, % non-child: 100.00%)
- CodegenTime: 1.340ms
- CompileTime: 14.830ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 76.406ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 31.310ms
SORT_NODE (id=15):(Total: 13s761ms, non-child: 84.438us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 524.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.02 MB (25182208)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=14):(Total: 13s761ms, non-child: 113.256us, % non-child: 0.00%)
- EvaluationTime: 978.000ns
- GetNewBlockTime: 4.260us
- PeakMemoryUsage: 8.02 MB (8413184)
- PinTime: 0.000ns
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- UnpinTime: 0.000ns
SORT_NODE (id=13):(Total: 13s761ms, non-child: 118.594us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 890.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.01 MB (25174016)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=37):(Total: 13s761ms, non-child: 4.757us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 0
- ConvertRowBatchTime: 873.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 13s761ms
- PeakMemoryUsage: 0
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:a9 (host=cdh9.net.cuberonlabs.com:22000):(Total: 13s887ms, non-child: 2.060ms, % non-child: 0.01%)
MemoryUsage(500.000ms): 48.01 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 48.45 MB (50803312)
- PerHostPeakMemUsage: 1.69 GB (1813107104)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 13s760ms
- TotalNetworkSendTime: 228.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s853ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 96.000ms
- TotalThreadsVoluntaryContextSwitches: 6 (6)
Fragment Instance Lifecycle Timings:
- ExecTime: 177.665us
- ExecTreeExecTime: 2.862us
- OpenTime: 13s853ms
- ExecTreeOpenTime: 13s760ms
- PrepareTime: 33.537ms
- ExecTreePrepareTime: 182.250us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 415 (415)
- BlocksRecycled: 282 (282)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 48.00 GB (51539607552)
- PeakMemoryUsage: 1.23 GB (1316128768)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=38):(Total: 15.120us, non-child: 15.120us, % non-child: 100.00%)
- BytesSent: 0
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 2.61 KB (2672)
- RowsReturned: 0 (0)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 0
CodeGen:(Total: 123.926ms, non-child: 123.926ms, % non-child: 100.00%)
- CodegenTime: 1.204ms
- CompileTime: 14.804ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 76.515ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 31.813ms
SORT_NODE (id=15):(Total: 13s761ms, non-child: 68.091us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 492.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.02 MB (25182208)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=14):(Total: 13s760ms, non-child: 113.028us, % non-child: 0.00%)
- EvaluationTime: 597.000ns
- GetNewBlockTime: 2.732us
- PeakMemoryUsage: 8.02 MB (8413184)
- PinTime: 0.000ns
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- UnpinTime: 0.000ns
SORT_NODE (id=13):(Total: 13s760ms, non-child: 116.665us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 785.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.01 MB (25174016)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=37):(Total: 13s760ms, non-child: 5.428us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 0
- ConvertRowBatchTime: 633.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 13s760ms
- PeakMemoryUsage: 0
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:a5 (host=cdh5.net.cuberonlabs.com:22000):(Total: 13s886ms, non-child: 2.233ms, % non-child: 0.02%)
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 48.45 MB (50803312)
- PerHostPeakMemUsage: 2.15 GB (2303708143)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 13s752ms
- TotalNetworkSendTime: 240.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s852ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 104.000ms
- TotalThreadsVoluntaryContextSwitches: 8 (8)
Fragment Instance Lifecycle Timings:
- ExecTime: 214.404us
- ExecTreeExecTime: 2.344us
- OpenTime: 13s852ms
- ExecTreeOpenTime: 13s752ms
- PrepareTime: 34.475ms
- ExecTreePrepareTime: 167.700us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 415 (415)
- BlocksRecycled: 314 (314)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 48.00 GB (51539607552)
- PeakMemoryUsage: 1.60 GB (1713143808)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=38):(Total: 14.668us, non-child: 14.668us, % non-child: 100.00%)
- BytesSent: 0
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 2.61 KB (2672)
- RowsReturned: 0 (0)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 0
CodeGen:(Total: 131.972ms, non-child: 131.972ms, % non-child: 100.00%)
- CodegenTime: 1.361ms
- CompileTime: 15.902ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 82.465ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 32.746ms
SORT_NODE (id=15):(Total: 13s752ms, non-child: 71.460us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 280.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.02 MB (25182208)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=14):(Total: 13s752ms, non-child: 344.756us, % non-child: 0.00%)
- EvaluationTime: 784.000ns
- GetNewBlockTime: 5.432us
- PeakMemoryUsage: 8.02 MB (8413184)
- PinTime: 0.000ns
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- UnpinTime: 0.000ns
SORT_NODE (id=13):(Total: 13s752ms, non-child: 101.388us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 568.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.01 MB (25174016)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=37):(Total: 13s752ms, non-child: 4.088us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 0
- ConvertRowBatchTime: 664.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 13s752ms
- PeakMemoryUsage: 0
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:a3 (host=cdh14.net.cuberonlabs.com:22000):(Total: 13s886ms, non-child: 2.484ms, % non-child: 0.02%)
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 48.45 MB (50803312)
- PerHostPeakMemUsage: 1.44 GB (1548652528)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 13s760ms
- TotalNetworkSendTime: 246.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s851ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 92.000ms
- TotalThreadsVoluntaryContextSwitches: 19 (19)
Fragment Instance Lifecycle Timings:
- ExecTime: 181.521us
- ExecTreeExecTime: 2.643us
- OpenTime: 13s851ms
- ExecTreeOpenTime: 13s760ms
- PrepareTime: 35.477ms
- ExecTreePrepareTime: 160.178us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 415 (415)
- BlocksRecycled: 282 (282)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 48.00 GB (51539607552)
- PeakMemoryUsage: 1.07 GB (1154154496)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=38):(Total: 22.010us, non-child: 22.010us, % non-child: 100.00%)
- BytesSent: 0
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 2.61 KB (2672)
- RowsReturned: 0 (0)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 0
CodeGen:(Total: 123.324ms, non-child: 123.324ms, % non-child: 100.00%)
- CodegenTime: 1.250ms
- CompileTime: 14.369ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 74.413ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 33.813ms
SORT_NODE (id=15):(Total: 13s761ms, non-child: 67.178us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 378.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.02 MB (25182208)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=14):(Total: 13s760ms, non-child: 421.495us, % non-child: 0.00%)
- EvaluationTime: 839.000ns
- GetNewBlockTime: 6.321us
- PeakMemoryUsage: 8.02 MB (8413184)
- PinTime: 0.000ns
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- UnpinTime: 0.000ns
SORT_NODE (id=13):(Total: 13s760ms, non-child: 101.616us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 533.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.01 MB (25174016)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=37):(Total: 13s760ms, non-child: 4.541us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 0
- ConvertRowBatchTime: 892.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 13s760ms
- PeakMemoryUsage: 0
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:9e (host=cdh15.net.cuberonlabs.com:22000):(Total: 13s886ms, non-child: 2.041ms, % non-child: 0.01%)
MemoryUsage(500.000ms): 48.45 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 48.45 MB (50803312)
- PerHostPeakMemUsage: 1.57 GB (1688553772)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 13s759ms
- TotalNetworkSendTime: 253.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s853ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 92.000ms
- TotalThreadsVoluntaryContextSwitches: 13 (13)
Fragment Instance Lifecycle Timings:
- ExecTime: 194.577us
- ExecTreeExecTime: 2.257us
- OpenTime: 13s853ms
- ExecTreeOpenTime: 13s760ms
- PrepareTime: 33.126ms
- ExecTreePrepareTime: 160.916us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 415 (415)
- BlocksRecycled: 282 (282)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 48.00 GB (51539607552)
- PeakMemoryUsage: 1.16 GB (1245904896)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=38):(Total: 15.837us, non-child: 15.837us, % non-child: 100.00%)
- BytesSent: 0
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 2.61 KB (2672)
- RowsReturned: 0 (0)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 0
CodeGen:(Total: 124.408ms, non-child: 124.408ms, % non-child: 100.00%)
- CodegenTime: 1.124ms
- CompileTime: 15.157ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 76.979ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 31.422ms
SORT_NODE (id=15):(Total: 13s760ms, non-child: 68.256us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 313.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.02 MB (25182208)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=14):(Total: 13s760ms, non-child: 293.524us, % non-child: 0.00%)
- EvaluationTime: 1.020us
- GetNewBlockTime: 3.136us
- PeakMemoryUsage: 8.02 MB (8413184)
- PinTime: 0.000ns
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- UnpinTime: 0.000ns
SORT_NODE (id=13):(Total: 13s760ms, non-child: 100.639us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 780.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.01 MB (25174016)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=37):(Total: 13s759ms, non-child: 5.234us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 0
- ConvertRowBatchTime: 1.107us
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 13s759ms
- PeakMemoryUsage: 0
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:9c (host=cdh13.net.cuberonlabs.com:22000):(Total: 13s886ms, non-child: 2.054ms, % non-child: 0.01%)
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 48.45 MB (50803312)
- PerHostPeakMemUsage: 1.66 GB (1782381748)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 13s757ms
- TotalNetworkSendTime: 206.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s852ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 100.000ms
- TotalThreadsVoluntaryContextSwitches: 12 (12)
Fragment Instance Lifecycle Timings:
- ExecTime: 205.436us
- ExecTreeExecTime: 6.160us
- OpenTime: 13s852ms
- ExecTreeOpenTime: 13s757ms
- PrepareTime: 34.197ms
- ExecTreePrepareTime: 158.355us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 415 (415)
- BlocksRecycled: 282 (282)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 48.00 GB (51539607552)
- PeakMemoryUsage: 1.22 GB (1308917760)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=38):(Total: 26.086us, non-child: 26.086us, % non-child: 100.00%)
- BytesSent: 0
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 2.61 KB (2672)
- RowsReturned: 0 (0)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 0
CodeGen:(Total: 126.891ms, non-child: 126.891ms, % non-child: 100.00%)
- CodegenTime: 1.199ms
- CompileTime: 15.256ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 78.210ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 32.655ms
SORT_NODE (id=15):(Total: 13s757ms, non-child: 287.881us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 219.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.02 MB (25182208)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=14):(Total: 13s757ms, non-child: 100.004us, % non-child: 0.00%)
- EvaluationTime: 834.000ns
- GetNewBlockTime: 3.136us
- PeakMemoryUsage: 8.02 MB (8413184)
- PinTime: 0.000ns
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- UnpinTime: 0.000ns
SORT_NODE (id=13):(Total: 13s757ms, non-child: 103.106us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 729.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.01 MB (25174016)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=37):(Total: 13s757ms, non-child: 4.783us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 0
- ConvertRowBatchTime: 1.058us
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 13s757ms
- PeakMemoryUsage: 0
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:a6 (host=cdh7.net.cuberonlabs.com:22000):(Total: 13s886ms, non-child: 2.144ms, % non-child: 0.02%)
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 48.45 MB (50803312)
- PerHostPeakMemUsage: 1.58 GB (1699637471)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 13s755ms
- TotalNetworkSendTime: 226.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 13s850ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 96.000ms
- TotalThreadsVoluntaryContextSwitches: 10 (10)
Fragment Instance Lifecycle Timings:
- ExecTime: 245.757us
- ExecTreeExecTime: 2.753us
- OpenTime: 13s850ms
- ExecTreeOpenTime: 13s755ms
- PrepareTime: 35.589ms
- ExecTreePrepareTime: 166.049us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 383 (383)
- BlocksRecycled: 314 (314)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 48.00 GB (51539607552)
- PeakMemoryUsage: 1.19 GB (1280214016)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=38):(Total: 15.738us, non-child: 15.738us, % non-child: 100.00%)
- BytesSent: 0
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 2.61 KB (2672)
- RowsReturned: 0 (0)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 0
CodeGen:(Total: 128.702ms, non-child: 128.702ms, % non-child: 100.00%)
- CodegenTime: 1.164ms
- CompileTime: 15.188ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 78.455ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 34.260ms
SORT_NODE (id=15):(Total: 13s755ms, non-child: 76.025us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 270.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.02 MB (25182208)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=14):(Total: 13s755ms, non-child: 97.360us, % non-child: 0.00%)
- EvaluationTime: 687.000ns
- GetNewBlockTime: 3.070us
- PeakMemoryUsage: 8.02 MB (8413184)
- PinTime: 0.000ns
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- UnpinTime: 0.000ns
SORT_NODE (id=13):(Total: 13s755ms, non-child: 109.671us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 1.040us
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.01 MB (25174016)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=37):(Total: 13s755ms, non-child: 9.185us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 0
- ConvertRowBatchTime: 1.053us
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 13s755ms
- PeakMemoryUsage: 0
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:9a (host=cdh4.net.cuberonlabs.com:22000):(Total: 13s886ms, non-child: 2.048ms, % non-child: 0.01%)
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 48.45 MB (50803312)
- PerHostPeakMemUsage: 2.13 GB (2284202661)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 13s744ms
- TotalNetworkSendTime: 224.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 7 (7)
- TotalThreadsTotalWallClockTime: 13s853ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 112.000ms
- TotalThreadsVoluntaryContextSwitches: 20 (20)
Fragment Instance Lifecycle Timings:
- ExecTime: 230.344us
- ExecTreeExecTime: 3.068us
- OpenTime: 13s853ms
- ExecTreeOpenTime: 13s745ms
- PrepareTime: 32.891ms
- ExecTreePrepareTime: 142.416us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 417 (417)
- BlocksRecycled: 312 (312)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 48.00 GB (51539607552)
- PeakMemoryUsage: 1.58 GB (1692174336)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=38):(Total: 13.820us, non-child: 13.820us, % non-child: 100.00%)
- BytesSent: 0
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 2.61 KB (2672)
- RowsReturned: 0 (0)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 0
CodeGen:(Total: 138.774ms, non-child: 138.774ms, % non-child: 100.00%)
- CodegenTime: 1.143ms
- CompileTime: 21.751ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 84.782ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 31.256ms
SORT_NODE (id=15):(Total: 13s745ms, non-child: 77.932us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 260.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.02 MB (25182208)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=14):(Total: 13s745ms, non-child: 425.152us, % non-child: 0.00%)
- EvaluationTime: 888.000ns
- GetNewBlockTime: 5.936us
- PeakMemoryUsage: 8.02 MB (8413184)
- PinTime: 0.000ns
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- UnpinTime: 0.000ns
SORT_NODE (id=13):(Total: 13s745ms, non-child: 97.580us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 632.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.01 MB (25174016)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=37):(Total: 13s744ms, non-child: 4.672us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 0
- ConvertRowBatchTime: 812.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 13s744ms
- PeakMemoryUsage: 0
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:9b (host=cdh16.net.cuberonlabs.com:22000):(Total: 13s886ms, non-child: 2.066ms, % non-child: 0.01%)
MemoryUsage(500.000ms): 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB, 48.02 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 48.45 MB (50803312)
- PerHostPeakMemUsage: 1.64 GB (1763578733)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 13s748ms
- TotalNetworkSendTime: 259.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 13s853ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 108.000ms
- TotalThreadsVoluntaryContextSwitches: 12 (12)
Fragment Instance Lifecycle Timings:
- ExecTime: 194.334us
- ExecTreeExecTime: 2.733us
- OpenTime: 13s853ms
- ExecTreeOpenTime: 13s749ms
- PrepareTime: 32.380ms
- ExecTreePrepareTime: 161.699us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 399 (399)
- BlocksRecycled: 298 (298)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 48.00 GB (51539607552)
- PeakMemoryUsage: 1.23 GB (1317240832)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=38):(Total: 15.074us, non-child: 15.074us, % non-child: 100.00%)
- BytesSent: 0
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 2.61 KB (2672)
- RowsReturned: 0 (0)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 0
CodeGen:(Total: 134.896ms, non-child: 134.896ms, % non-child: 100.00%)
- CodegenTime: 779.704us
- CompileTime: 16.301ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 46 (46)
- NumInstructions: 892 (892)
- OptimizationTime: 86.857ms
- PeakMemoryUsage: 446.00 KB (456704)
- PrepareTime: 31.199ms
SORT_NODE (id=15):(Total: 13s749ms, non-child: 63.516us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 301.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.02 MB (25182208)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
ANALYTIC_EVAL_NODE (id=14):(Total: 13s749ms, non-child: 122.081us, % non-child: 0.00%)
- EvaluationTime: 779.000ns
- GetNewBlockTime: 5.600us
- PeakMemoryUsage: 8.02 MB (8413184)
- PinTime: 0.000ns
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- UnpinTime: 0.000ns
SORT_NODE (id=13):(Total: 13s749ms, non-child: 358.391us, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InMemorySortTime: 637.000ns
- InitialRunsCreated: 1 (1)
- PeakMemoryUsage: 24.01 MB (25174016)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SortDataSize: 0
- SpilledRuns: 0 (0)
- TotalMergesPerformed: 0 (0)
EXCHANGE_NODE (id=37):(Total: 13s748ms, non-child: 4.234us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 0
- ConvertRowBatchTime: 737.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 13s748ms
- PeakMemoryUsage: 0
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Averaged Fragment F09:(Total: 13s880ms, non-child: 8.807ms, % non-child: 0.06%)
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:13s878ms max:13s886ms mean: 13s882ms stddev:2.535ms
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 17
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 5.89 MB (6175198)
- PerHostPeakMemUsage: 1.70 GB (1824024877)
- RowsProduced: 3 (3)
- TotalNetworkReceiveTime: 13s589ms
- TotalNetworkSendTime: 248.386us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s842ms
- TotalThreadsSysTime: 5.411ms
- TotalThreadsUserTime: 244.705ms
- TotalThreadsVoluntaryContextSwitches: 100 (100)
Fragment Instance Lifecycle Timings:
- ExecTime: 3.367ms
- ExecTreeExecTime: 160.482us
- OpenTime: 13s839ms
- ExecTreeOpenTime: 13s593ms
- PrepareTime: 37.924ms
- ExecTreePrepareTime: 1.258ms
DataStreamSender (dst_id=37):(Total: 97.659us, non-child: 97.659us, % non-child: 100.00%)
- BytesSent: 154.00 B (154)
- NetworkThroughput(*): 4.90 MB/sec
- OverallThroughput: 1.59 MB/sec
- PeakMemoryUsage: 56.99 KB (58360)
- RowsReturned: 3 (3)
- SerializeBatchTime: 20.743us
- TransmitDataRPCTime: 36.087us
- UncompressedRowBatchSize: 245.00 B (245)
CodeGen:(Total: 276.452ms, non-child: 276.452ms, % non-child: 100.00%)
- CodegenTime: 4.311ms
- CompileTime: 83.330ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.52K (1523)
- OptimizationTime: 160.782ms
- PeakMemoryUsage: 761.50 KB (779776)
- PrepareTime: 31.557ms
AGGREGATION_NODE (id=12):(Total: 13s595ms, non-child: 1.898ms, % non-child: 0.01%)
- BuildTime: 339.488us
- GetNewBlockTime: 164.748us
- GetResultsTime: 6.136us
- HTResizeTime: 26.735us
- HashBuckets: 2.95K (2951)
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.31 MB (2427008)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 3 (3)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 911.000ns
AGGREGATION_NODE (id=36):(Total: 13s593ms, non-child: 3.646ms, % non-child: 0.03%)
- BuildTime: 1.277ms
- GetNewBlockTime: 180.067us
- GetResultsTime: 176.689us
- HTResizeTime: 474.485us
- HashBuckets: 23.43K (23431)
- LargestPartitionPercent: 14 (14)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 3.00 MB (3146340)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.11K (2108)
- RowsReturnedRate: 154.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 998.000ns
EXCHANGE_NODE (id=35):(Total: 13s589ms, non-child: 13s589ms, % non-child: 100.00%)
- BytesReceived: 122.07 KB (124997)
- ConvertRowBatchTime: 64.458us
- DeserializeRowBatchTimer: 693.596us
- FirstBatchArrivalWaitTime: 13s575ms
- PeakMemoryUsage: 0
- RowsReturned: 2.11K (2108)
- RowsReturnedRate: 154.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Fragment F09:
Instance 514ee9ab39cdc507:98 (host=cdh9.net.cuberonlabs.com:22000):(Total: 13s885ms, non-child: 8.614ms, % non-child: 0.06%)
MemoryUsage(500.000ms): 5.40 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 5.40 MB (5660408)
- PerHostPeakMemUsage: 1.69 GB (1813107104)
- RowsProduced: 4 (4)
- TotalNetworkReceiveTime: 13s609ms
- TotalNetworkSendTime: 232.353us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s848ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 236.000ms
- TotalThreadsVoluntaryContextSwitches: 71 (71)
Fragment Instance Lifecycle Timings:
- ExecTime: 3.826ms
- ExecTreeExecTime: 312.368us
- OpenTime: 13s844ms
- ExecTreeOpenTime: 13s614ms
- PrepareTime: 37.348ms
- ExecTreePrepareTime: 1.243ms
DataStreamSender (dst_id=37):(Total: 90.018us, non-child: 90.018us, % non-child: 100.00%)
- BytesSent: 190.00 B (190)
- NetworkThroughput(*): 6.56 MB/sec
- OverallThroughput: 2.01 MB/sec
- PeakMemoryUsage: 56.99 KB (58360)
- RowsReturned: 4 (4)
- SerializeBatchTime: 16.477us
- TransmitDataRPCTime: 27.613us
- UncompressedRowBatchSize: 310.00 B (310)
CodeGen:(Total: 261.175ms, non-child: 261.175ms, % non-child: 100.00%)
- CodegenTime: 4.163ms
- CompileTime: 72.410ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.52K (1523)
- OptimizationTime: 156.852ms
- PeakMemoryUsage: 761.50 KB (779776)
- PrepareTime: 31.200ms
AGGREGATION_NODE (id=12):(Total: 13s615ms, non-child: 3.467ms, % non-child: 0.03%)
ExecOption: Codegen Enabled
- BuildTime: 257.464us
- GetNewBlockTime: 161.464us
- GetResultsTime: 11.696us
- HTResizeTime: 18.093us
- HashBuckets: 4.10K (4096)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.30 MB (2410624)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 4 (4)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 916.000ns
AGGREGATION_NODE (id=36):(Total: 13s612ms, non-child: 2.864ms, % non-child: 0.02%)
ExecOption: Codegen Enabled
- BuildTime: 1.151ms
- GetNewBlockTime: 196.156us
- GetResultsTime: 147.690us
- HTResizeTime: 740.979us
- HashBuckets: 32.77K (32768)
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.69 MB (2823492)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.10K (1097)
- RowsReturnedRate: 80.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 996.000ns
EXCHANGE_NODE (id=35):(Total: 13s609ms, non-child: 190.273us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 69.51 KB (71181)
- ConvertRowBatchTime: 45.897us
- DeserializeRowBatchTimer: 392.699us
- FirstBatchArrivalWaitTime: 13s593ms
- PeakMemoryUsage: 0
- RowsReturned: 1.10K (1097)
- RowsReturnedRate: 80.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:90 (host=cdh2.net.cuberonlabs.com:22000):(Total: 13s883ms, non-child: 8.754ms, % non-child: 0.06%)
MemoryUsage(500.000ms): 5.40 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 13.74 MB (14411849)
- PerHostPeakMemUsage: 1.74 GB (1866918022)
- RowsProduced: 5 (5)
- TotalNetworkReceiveTime: 13s581ms
- TotalNetworkSendTime: 256.612us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 13s845ms
- TotalThreadsSysTime: 4.000ms
- TotalThreadsUserTime: 252.000ms
- TotalThreadsVoluntaryContextSwitches: 161 (161)
Fragment Instance Lifecycle Timings:
- ExecTime: 3.524ms
- ExecTreeExecTime: 244.544us
- OpenTime: 13s841ms
- ExecTreeOpenTime: 13s599ms
- PrepareTime: 37.722ms
- ExecTreePrepareTime: 1.112ms
DataStreamSender (dst_id=37):(Total: 107.180us, non-child: 107.180us, % non-child: 100.00%)
- BytesSent: 228.00 B (228)
- NetworkThroughput(*): 4.01 MB/sec
- OverallThroughput: 2.03 MB/sec
- PeakMemoryUsage: 56.99 KB (58360)
- RowsReturned: 5 (5)
- SerializeBatchTime: 16.596us
- TransmitDataRPCTime: 54.288us
- UncompressedRowBatchSize: 380.00 B (380)
CodeGen:(Total: 273.326ms, non-child: 273.326ms, % non-child: 100.00%)
- CodegenTime: 4.245ms
- CompileTime: 81.004ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.52K (1523)
- OptimizationTime: 160.043ms
- PeakMemoryUsage: 761.50 KB (779776)
- PrepareTime: 31.470ms
AGGREGATION_NODE (id=12):(Total: 13s600ms, non-child: 4.211ms, % non-child: 0.03%)
ExecOption: Codegen Enabled
- BuildTime: 2.570ms
- GetNewBlockTime: 149.896us
- GetResultsTime: 8.644us
- HTResizeTime: 166.784us
- HashBuckets: 6.14K (6144)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.56 MB (2689152)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 5 (5)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 892.000ns
AGGREGATION_NODE (id=36):(Total: 13s596ms, non-child: 14.411ms, % non-child: 0.11%)
ExecOption: Codegen Enabled
- BuildTime: 11.368ms
- GetNewBlockTime: 189.796us
- GetResultsTime: 1.263ms
- HTResizeTime: 3.971ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 11.19 MB (11735748)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 21.13K (21130)
- RowsReturnedRate: 1.55 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 952.000ns
EXCHANGE_NODE (id=35):(Total: 13s582ms, non-child: 1.386ms, % non-child: 0.01%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 1.15 MB (1204724)
- ConvertRowBatchTime: 473.332us
- DeserializeRowBatchTimer: 5.090ms
- FirstBatchArrivalWaitTime: 13s572ms
- PeakMemoryUsage: 0
- RowsReturned: 21.13K (21130)
- RowsReturnedRate: 1.55 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:97 (host=cdh11.net.cuberonlabs.com:22000):(Total: 13s882ms, non-child: 8.696ms, % non-child: 0.06%)
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 5.40 MB (5660408)
- PerHostPeakMemUsage: 1.48 GB (1591793359)
- RowsProduced: 1 (1)
- TotalNetworkReceiveTime: 13s639ms
- TotalNetworkSendTime: 237.962us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s846ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 204.000ms
- TotalThreadsVoluntaryContextSwitches: 49 (49)
Fragment Instance Lifecycle Timings:
- ExecTime: 3.533ms
- ExecTreeExecTime: 122.911us
- OpenTime: 13s843ms
- ExecTreeOpenTime: 13s641ms
- PrepareTime: 35.769ms
- ExecTreePrepareTime: 1.210ms
DataStreamSender (dst_id=37):(Total: 96.748us, non-child: 96.748us, % non-child: 100.00%)
- BytesSent: 67.00 B (67)
- NetworkThroughput(*): 2.32 MB/sec
- OverallThroughput: 676.29 KB/sec
- PeakMemoryUsage: 56.99 KB (58360)
- RowsReturned: 1 (1)
- SerializeBatchTime: 29.650us
- TransmitDataRPCTime: 27.487us
- UncompressedRowBatchSize: 85.00 B (85)
CodeGen:(Total: 230.816ms, non-child: 230.816ms, % non-child: 100.00%)
- CodegenTime: 2.510ms
- CompileTime: 71.216ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.52K (1523)
- OptimizationTime: 129.548ms
- PeakMemoryUsage: 761.50 KB (779776)
- PrepareTime: 29.599ms
AGGREGATION_NODE (id=12):(Total: 13s643ms, non-child: 1.498ms, % non-child: 0.01%)
ExecOption: Codegen Enabled
- BuildTime: 17.327us
- GetNewBlockTime: 151.591us
- GetResultsTime: 3.034us
- HTResizeTime: 6.464us
- HashBuckets: 1.02K (1024)
- LargestPartitionPercent: 100 (100)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.30 MB (2410624)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1 (1)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 852.000ns
AGGREGATION_NODE (id=36):(Total: 13s641ms, non-child: 1.940ms, % non-child: 0.01%)
ExecOption: Codegen Enabled
- BuildTime: 11.892us
- GetNewBlockTime: 156.314us
- GetResultsTime: 929.000ns
- HTResizeTime: 4.189us
- HashBuckets: 1.02K (1024)
- LargestPartitionPercent: 100 (100)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.32 MB (2428032)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1 (1)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 1.012us
EXCHANGE_NODE (id=35):(Total: 13s639ms, non-child: 9.593us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 107.00 B (107)
- ConvertRowBatchTime: 651.000ns
- DeserializeRowBatchTimer: 11.520us
- FirstBatchArrivalWaitTime: 13s639ms
- PeakMemoryUsage: 0
- RowsReturned: 1 (1)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:96 (host=cdh8.net.cuberonlabs.com:22000):(Total: 13s882ms, non-child: 8.217ms, % non-child: 0.06%)
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 5.40 MB (5660408)
- PerHostPeakMemUsage: 1.63 GB (1748411303)
- RowsProduced: 2 (2)
- TotalNetworkReceiveTime: 13s594ms
- TotalNetworkSendTime: 275.496us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 13s841ms
- TotalThreadsSysTime: 8.000ms
- TotalThreadsUserTime: 236.000ms
- TotalThreadsVoluntaryContextSwitches: 118 (118)
Fragment Instance Lifecycle Timings:
- ExecTime: 3.549ms
- ExecTreeExecTime: 81.407us
- OpenTime: 13s838ms
- ExecTreeOpenTime: 13s597ms
- PrepareTime: 40.819ms
- ExecTreePrepareTime: 1.187ms
DataStreamSender (dst_id=37):(Total: 95.612us, non-child: 95.612us, % non-child: 100.00%)
- BytesSent: 110.00 B (110)
- NetworkThroughput(*): 3.79 MB/sec
- OverallThroughput: 1.10 MB/sec
- PeakMemoryUsage: 56.99 KB (58360)
- RowsReturned: 2 (2)
- SerializeBatchTime: 19.118us
- TransmitDataRPCTime: 27.675us
- UncompressedRowBatchSize: 157.00 B (157)
CodeGen:(Total: 275.628ms, non-child: 275.628ms, % non-child: 100.00%)
- CodegenTime: 4.009ms
- CompileTime: 78.155ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.52K (1523)
- OptimizationTime: 161.456ms
- PeakMemoryUsage: 761.50 KB (779776)
- PrepareTime: 35.313ms
AGGREGATION_NODE (id=12):(Total: 13s598ms, non-child: 1.445ms, % non-child: 0.01%)
ExecOption: Codegen Enabled
- BuildTime: 181.688us
- GetNewBlockTime: 151.726us
- GetResultsTime: 2.816us
- HTResizeTime: 18.660us
- HashBuckets: 2.05K (2048)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.30 MB (2410624)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2 (2)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 917.000ns
AGGREGATION_NODE (id=36):(Total: 13s597ms, non-child: 2.253ms, % non-child: 0.02%)
ExecOption: Codegen Enabled
- BuildTime: 467.935us
- GetNewBlockTime: 163.420us
- GetResultsTime: 91.996us
- HTResizeTime: 2.725us
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.40 MB (2516241)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 763 (763)
- RowsReturnedRate: 56.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 992.000ns
EXCHANGE_NODE (id=35):(Total: 13s595ms, non-child: 164.028us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 47.11 KB (48245)
- ConvertRowBatchTime: 39.573us
- DeserializeRowBatchTimer: 312.286us
- FirstBatchArrivalWaitTime: 13s579ms
- PeakMemoryUsage: 0
- RowsReturned: 763 (763)
- RowsReturnedRate: 56.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:99 (host=cdh10.net.cuberonlabs.com:22000):(Total: 13s882ms, non-child: 7.702ms, % non-child: 0.06%)
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 5.40 MB (5660408)
- PerHostPeakMemUsage: 1.66 GB (1784016472)
- RowsProduced: 3 (3)
- TotalNetworkReceiveTime: 13s506ms
- TotalNetworkSendTime: 190.386us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 13s846ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 332.000ms
- TotalThreadsVoluntaryContextSwitches: 163 (163)
Fragment Instance Lifecycle Timings:
- ExecTime: 3.185ms
- ExecTreeExecTime: 185.458us
- OpenTime: 13s843ms
- ExecTreeOpenTime: 13s507ms
- PrepareTime: 35.549ms
- ExecTreePrepareTime: 1.143ms
DataStreamSender (dst_id=37):(Total: 77.089us, non-child: 77.089us, % non-child: 100.00%)
- BytesSent: 147.00 B (147)
- NetworkThroughput(*): 6.22 MB/sec
- OverallThroughput: 1.82 MB/sec
- PeakMemoryUsage: 56.99 KB (58360)
- RowsReturned: 3 (3)
- SerializeBatchTime: 20.542us
- TransmitDataRPCTime: 22.544us
- UncompressedRowBatchSize: 242.00 B (242)
CodeGen:(Total: 365.398ms, non-child: 365.398ms, % non-child: 100.00%)
- CodegenTime: 4.171ms
- CompileTime: 138.960ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.52K (1523)
- OptimizationTime: 195.694ms
- PeakMemoryUsage: 761.50 KB (779776)
- PrepareTime: 30.004ms
AGGREGATION_NODE (id=12):(Total: 13s509ms, non-child: 1.265ms, % non-child: 0.01%)
ExecOption: Codegen Enabled
- BuildTime: 34.961us
- GetNewBlockTime: 147.273us
- GetResultsTime: 7.885us
- HTResizeTime: 9.716us
- HashBuckets: 3.07K (3072)
- LargestPartitionPercent: 2 (2)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.30 MB (2410624)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 3 (3)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 860.000ns
AGGREGATION_NODE (id=36):(Total: 13s507ms, non-child: 1.398ms, % non-child: 0.01%)
ExecOption: Codegen Enabled
- BuildTime: 30.200us
- GetNewBlockTime: 160.463us
- GetResultsTime: 23.751us
- HTResizeTime: 2.989us
- HashBuckets: 15.36K (15360)
- LargestPartitionPercent: 16 (16)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.37 MB (2485376)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 36 (36)
- RowsReturnedRate: 2.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 907.000ns
EXCHANGE_NODE (id=35):(Total: 13s506ms, non-child: 102.741us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 2.89 KB (2960)
- ConvertRowBatchTime: 15.733us
- DeserializeRowBatchTimer: 108.245us
- FirstBatchArrivalWaitTime: 13s490ms
- PeakMemoryUsage: 0
- RowsReturned: 36 (36)
- RowsReturnedRate: 2.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:91 (host=cdh12.net.cuberonlabs.com:22000):(Total: 13s881ms, non-child: 8.793ms, % non-child: 0.06%)
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 5.40 MB (5660408)
- PerHostPeakMemUsage: 1.12 GB (1201773720)
- RowsProduced: 4 (4)
- TotalNetworkReceiveTime: 13s572ms
- TotalNetworkSendTime: 216.962us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 13s841ms
- TotalThreadsSysTime: 4.000ms
- TotalThreadsUserTime: 264.000ms
- TotalThreadsVoluntaryContextSwitches: 124 (124)
Fragment Instance Lifecycle Timings:
- ExecTime: 2.944ms
- ExecTreeExecTime: 168.248us
- OpenTime: 13s838ms
- ExecTreeOpenTime: 13s576ms
- PrepareTime: 40.011ms
- ExecTreePrepareTime: 1.182ms
DataStreamSender (dst_id=37):(Total: 80.692us, non-child: 80.692us, % non-child: 100.00%)
- BytesSent: 188.00 B (188)
- NetworkThroughput(*): 8.64 MB/sec
- OverallThroughput: 2.22 MB/sec
- PeakMemoryUsage: 56.99 KB (58360)
- RowsReturned: 4 (4)
- SerializeBatchTime: 19.497us
- TransmitDataRPCTime: 20.748us
- UncompressedRowBatchSize: 323.00 B (323)
CodeGen:(Total: 294.492ms, non-child: 294.492ms, % non-child: 100.00%)
- CodegenTime: 5.458ms
- CompileTime: 88.551ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.52K (1523)
- OptimizationTime: 171.669ms
- PeakMemoryUsage: 761.50 KB (779776)
- PrepareTime: 33.334ms
AGGREGATION_NODE (id=12):(Total: 13s578ms, non-child: 1.539ms, % non-child: 0.01%)
ExecOption: Codegen Enabled
- BuildTime: 112.393us
- GetNewBlockTime: 160.937us
- GetResultsTime: 8.116us
- HTResizeTime: 17.632us
- HashBuckets: 4.10K (4096)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.30 MB (2410624)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 4 (4)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 914.000ns
AGGREGATION_NODE (id=36):(Total: 13s576ms, non-child: 4.215ms, % non-child: 0.03%)
ExecOption: Codegen Enabled
- BuildTime: 146.806us
- GetNewBlockTime: 159.658us
- GetResultsTime: 79.354us
- HTResizeTime: 3.427us
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 9 (9)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.38 MB (2493568)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 331 (331)
- RowsReturnedRate: 24.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 983.000ns
EXCHANGE_NODE (id=35):(Total: 13s572ms, non-child: 118.259us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 21.32 KB (21832)
- ConvertRowBatchTime: 26.232us
- DeserializeRowBatchTimer: 164.881us
- FirstBatchArrivalWaitTime: 13s556ms
- PeakMemoryUsage: 0
- RowsReturned: 331 (331)
- RowsReturnedRate: 24.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:92 (host=cdh14.net.cuberonlabs.com:22000):(Total: 13s881ms, non-child: 9.063ms, % non-child: 0.07%)
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.97 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 5.40 MB (5660408)
- PerHostPeakMemUsage: 1.44 GB (1548652528)
- RowsProduced: 1 (1)
- TotalNetworkReceiveTime: 13s550ms
- TotalNetworkSendTime: 286.486us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 3 (3)
- TotalThreadsTotalWallClockTime: 13s840ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 288.000ms
- TotalThreadsVoluntaryContextSwitches: 80 (80)
Fragment Instance Lifecycle Timings:
- ExecTime: 3.424ms
- ExecTreeExecTime: 123.922us
- OpenTime: 13s837ms
- ExecTreeOpenTime: 13s555ms
- PrepareTime: 40.369ms
- ExecTreePrepareTime: 1.193ms
DataStreamSender (dst_id=37):(Total: 177.401us, non-child: 177.401us, % non-child: 100.00%)
- BytesSent: 64.00 B (64)
- NetworkThroughput(*): 537.57 KB/sec
- OverallThroughput: 352.31 KB/sec
- PeakMemoryUsage: 56.99 KB (58360)
- RowsReturned: 1 (1)
- SerializeBatchTime: 15.842us
- TransmitDataRPCTime: 116.264us
- UncompressedRowBatchSize: 83.00 B (83)
CodeGen:(Total: 315.092ms, non-child: 315.092ms, % non-child: 100.00%)
- CodegenTime: 5.020ms
- CompileTime: 110.489ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.52K (1523)
- OptimizationTime: 169.851ms
- PeakMemoryUsage: 761.50 KB (779776)
- PrepareTime: 33.917ms
AGGREGATION_NODE (id=12):(Total: 13s556ms, non-child: 2.310ms, % non-child: 0.02%)
ExecOption: Codegen Enabled
- BuildTime: 680.135us
- GetNewBlockTime: 160.458us
- GetResultsTime: 2.003us
- HTResizeTime: 23.624us
- HashBuckets: 1.02K (1024)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.30 MB (2410624)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1 (1)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 912.000ns
AGGREGATION_NODE (id=36):(Total: 13s554ms, non-child: 4.292ms, % non-child: 0.03%)
ExecOption: Codegen Enabled
- BuildTime: 2.291ms
- GetNewBlockTime: 169.494us
- GetResultsTime: 283.952us
- HTResizeTime: 858.850us
- HashBuckets: 32.77K (32768)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.68 MB (2814600)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 3.68K (3678)
- RowsReturnedRate: 271.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 948.000ns
EXCHANGE_NODE (id=35):(Total: 13s550ms, non-child: 260.783us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 141.58 KB
- BytesReceived: 220.51 KB (225807)
- ConvertRowBatchTime: 101.429us
- DeserializeRowBatchTimer: 892.049us
- FirstBatchArrivalWaitTime: 13s536ms
- PeakMemoryUsage: 0
- RowsReturned: 3.68K (3678)
- RowsReturnedRate: 271.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:93 (host=cdh1.net.cuberonlabs.com:22000):(Total: 13s881ms, non-child: 16.344ms, % non-child: 0.12%)
MemoryUsage(500.000ms): 5.40 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 5.40 MB (5660408)
- PerHostPeakMemUsage: 1.81 GB (1939587581)
- RowsProduced: 6 (6)
- TotalNetworkReceiveTime: 13s574ms
- TotalNetworkSendTime: 243.892us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 2 (2)
- TotalThreadsTotalWallClockTime: 13s830ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 252.000ms
- TotalThreadsVoluntaryContextSwitches: 143 (143)
Fragment Instance Lifecycle Timings:
- ExecTime: 3.211ms
- ExecTreeExecTime: 222.648us
- OpenTime: 13s827ms
- ExecTreeOpenTime: 13s579ms
- PrepareTime: 50.194ms
- ExecTreePrepareTime: 2.042ms
DataStreamSender (dst_id=37):(Total: 100.024us, non-child: 100.024us, % non-child: 100.00%)
- BytesSent: 255.00 B (255)
- NetworkThroughput(*): 7.74 MB/sec
- OverallThroughput: 2.43 MB/sec
- PeakMemoryUsage: 56.99 KB (58360)
- RowsReturned: 6 (6)
- SerializeBatchTime: 14.572us
- TransmitDataRPCTime: 31.416us
- UncompressedRowBatchSize: 466.00 B (466)
CodeGen:(Total: 283.316ms, non-child: 283.316ms, % non-child: 100.00%)
- CodegenTime: 6.212ms
- CompileTime: 78.461ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.52K (1523)
- OptimizationTime: 166.174ms
- PeakMemoryUsage: 761.50 KB (779776)
- PrepareTime: 37.370ms
AGGREGATION_NODE (id=12):(Total: 13s581ms, non-child: 2.573ms, % non-child: 0.02%)
ExecOption: Codegen Enabled
- BuildTime: 666.564us
- GetNewBlockTime: 266.324us
- GetResultsTime: 11.796us
- HTResizeTime: 19.668us
- HashBuckets: 5.12K (5120)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.30 MB (2410624)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 6 (6)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 948.000ns
AGGREGATION_NODE (id=36):(Total: 13s578ms, non-child: 4.202ms, % non-child: 0.03%)
ExecOption: Codegen Enabled
- BuildTime: 2.095ms
- GetNewBlockTime: 392.116us
- GetResultsTime: 323.536us
- HTResizeTime: 497.768us
- HashBuckets: 32.77K (32768)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.69 MB (2818297)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 4.25K (4250)
- RowsReturnedRate: 312.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.016us
EXCHANGE_NODE (id=35):(Total: 13s574ms, non-child: 193.532us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 245.20 KB (251084)
- ConvertRowBatchTime: 100.500us
- DeserializeRowBatchTimer: 939.728us
- FirstBatchArrivalWaitTime: 13s560ms
- PeakMemoryUsage: 0
- RowsReturned: 4.25K (4250)
- RowsReturnedRate: 313.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:95 (host=cdh7.net.cuberonlabs.com:22000):(Total: 13s881ms, non-child: 7.566ms, % non-child: 0.05%)
MemoryUsage(500.000ms): 5.40 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 5.40 MB (5660408)
- PerHostPeakMemUsage: 1.58 GB (1699637471)
- RowsProduced: 3 (3)
- TotalNetworkReceiveTime: 13s622ms
- TotalNetworkSendTime: 248.472us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s846ms
- TotalThreadsSysTime: 8.000ms
- TotalThreadsUserTime: 216.000ms
- TotalThreadsVoluntaryContextSwitches: 77 (77)
Fragment Instance Lifecycle Timings:
- ExecTime: 3.137ms
- ExecTreeExecTime: 136.549us
- OpenTime: 13s843ms
- ExecTreeOpenTime: 13s624ms
- PrepareTime: 34.345ms
- ExecTreePrepareTime: 1.126ms
DataStreamSender (dst_id=37):(Total: 90.547us, non-child: 90.547us, % non-child: 100.00%)
- BytesSent: 170.00 B (170)
- NetworkThroughput(*): 5.93 MB/sec
- OverallThroughput: 1.79 MB/sec
- PeakMemoryUsage: 56.99 KB (58360)
- RowsReturned: 3 (3)
- SerializeBatchTime: 18.963us
- TransmitDataRPCTime: 27.324us
- UncompressedRowBatchSize: 246.00 B (246)
CodeGen:(Total: 247.421ms, non-child: 247.421ms, % non-child: 100.00%)
- CodegenTime: 3.932ms
- CompileTime: 74.371ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.52K (1523)
- OptimizationTime: 143.416ms
- PeakMemoryUsage: 761.50 KB (779776)
- PrepareTime: 28.784ms
AGGREGATION_NODE (id=12):(Total: 13s625ms, non-child: 1.316ms, % non-child: 0.01%)
ExecOption: Codegen Enabled
- BuildTime: 77.969us
- GetNewBlockTime: 144.905us
- GetResultsTime: 5.336us
- HTResizeTime: 19.932us
- HashBuckets: 3.07K (3072)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.30 MB (2410624)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 3 (3)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 855.000ns
AGGREGATION_NODE (id=36):(Total: 13s624ms, non-child: 1.816ms, % non-child: 0.01%)
ExecOption: Codegen Enabled
- BuildTime: 44.147us
- GetNewBlockTime: 152.022us
- GetResultsTime: 62.466us
- HTResizeTime: 3.589us
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 9 (9)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.38 MB (2493568)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 62 (62)
- RowsReturnedRate: 4.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 906.000ns
EXCHANGE_NODE (id=35):(Total: 13s622ms, non-child: 102.849us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 5.15 KB (5272)
- ConvertRowBatchTime: 18.121us
- DeserializeRowBatchTimer: 128.354us
- FirstBatchArrivalWaitTime: 13s607ms
- PeakMemoryUsage: 0
- RowsReturned: 62 (62)
- RowsReturnedRate: 4.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:94 (host=cdh5.net.cuberonlabs.com:22000):(Total: 13s880ms, non-child: 6.809ms, % non-child: 0.05%)
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.71 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 5.40 MB (5660408)
- PerHostPeakMemUsage: 2.15 GB (2303708143)
- RowsProduced: 2 (2)
- TotalNetworkReceiveTime: 13s673ms
- TotalNetworkSendTime: 178.928us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s861ms
- TotalThreadsSysTime: 12.000ms
- TotalThreadsUserTime: 176.000ms
- TotalThreadsVoluntaryContextSwitches: 68 (68)
Fragment Instance Lifecycle Timings:
- ExecTime: 3.226ms
- ExecTreeExecTime: 69.304us
- OpenTime: 13s858ms
- ExecTreeOpenTime: 13s675ms
- PrepareTime: 19.093ms
- ExecTreePrepareTime: 1.183ms
DataStreamSender (dst_id=37):(Total: 74.508us, non-child: 74.508us, % non-child: 100.00%)
- BytesSent: 127.00 B (127)
- NetworkThroughput(*): 4.30 MB/sec
- OverallThroughput: 1.63 MB/sec
- PeakMemoryUsage: 56.99 KB (58360)
- RowsReturned: 2 (2)
- SerializeBatchTime: 22.064us
- TransmitDataRPCTime: 28.184us
- UncompressedRowBatchSize: 173.00 B (173)
CodeGen:(Total: 197.430ms, non-child: 197.430ms, % non-child: 100.00%)
- CodegenTime: 2.370ms
- CompileTime: 62.005ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.52K (1523)
- OptimizationTime: 120.517ms
- PeakMemoryUsage: 761.50 KB (779776)
- PrepareTime: 14.422ms
AGGREGATION_NODE (id=12):(Total: 13s676ms, non-child: 1.251ms, % non-child: 0.01%)
ExecOption: Codegen Enabled
- BuildTime: 62.580us
- GetNewBlockTime: 160.500us
- GetResultsTime: 2.232us
- HTResizeTime: 16.648us
- HashBuckets: 1.02K (1024)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.30 MB (2410624)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2 (2)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 988.000ns
AGGREGATION_NODE (id=36):(Total: 13s675ms, non-child: 1.975ms, % non-child: 0.01%)
ExecOption: Codegen Enabled
- BuildTime: 59.964us
- GetNewBlockTime: 163.332us
- GetResultsTime: 46.120us
- HTResizeTime: 3.524us
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 11 (11)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.38 MB (2493568)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 126 (126)
- RowsReturnedRate: 9.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.024us
EXCHANGE_NODE (id=35):(Total: 13s673ms, non-child: 111.828us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.96 KB
- BytesReceived: 9.08 KB (9300)
- ConvertRowBatchTime: 20.876us
- DeserializeRowBatchTimer: 131.044us
- FirstBatchArrivalWaitTime: 13s657ms
- PeakMemoryUsage: 0
- RowsReturned: 126 (126)
- RowsReturnedRate: 9.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:89 (host=cdh4.net.cuberonlabs.com:22000):(Total: 13s880ms, non-child: 8.192ms, % non-child: 0.06%)
MemoryUsage(500.000ms): 4.65 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 5.40 MB (5660408)
- PerHostPeakMemUsage: 2.13 GB (2284202661)
- RowsProduced: 2 (2)
- TotalNetworkReceiveTime: 13s563ms
- TotalNetworkSendTime: 201.208us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s845ms
- TotalThreadsSysTime: 20.000ms
- TotalThreadsUserTime: 260.000ms
- TotalThreadsVoluntaryContextSwitches: 120 (120)
Fragment Instance Lifecycle Timings:
- ExecTime: 3.667ms
- ExecTreeExecTime: 108.668us
- OpenTime: 13s841ms
- ExecTreeOpenTime: 13s571ms
- PrepareTime: 35.043ms
- ExecTreePrepareTime: 1.133ms
DataStreamSender (dst_id=37):(Total: 89.264us, non-child: 89.264us, % non-child: 100.00%)
- BytesSent: 113.00 B (113)
- NetworkThroughput(*): 3.91 MB/sec
- OverallThroughput: 1.21 MB/sec
- PeakMemoryUsage: 56.99 KB (58360)
- RowsReturned: 2 (2)
- SerializeBatchTime: 24.512us
- TransmitDataRPCTime: 27.560us
- UncompressedRowBatchSize: 159.00 B (159)
CodeGen:(Total: 299.754ms, non-child: 299.754ms, % non-child: 100.00%)
- CodegenTime: 3.957ms
- CompileTime: 86.357ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.52K (1523)
- OptimizationTime: 182.807ms
- PeakMemoryUsage: 761.50 KB (779776)
- PrepareTime: 29.826ms
AGGREGATION_NODE (id=12):(Total: 13s572ms, non-child: 1.771ms, % non-child: 0.01%)
ExecOption: Codegen Enabled
- BuildTime: 353.928us
- GetNewBlockTime: 155.068us
- GetResultsTime: 2.836us
- HTResizeTime: 40.332us
- HashBuckets: 2.05K (2048)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.30 MB (2410624)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2 (2)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 884.000ns
AGGREGATION_NODE (id=36):(Total: 13s570ms, non-child: 6.859ms, % non-child: 0.05%)
ExecOption: Codegen Enabled
- BuildTime: 1.255ms
- GetNewBlockTime: 158.952us
- GetResultsTime: 194.656us
- HTResizeTime: 564.256us
- HashBuckets: 32.77K (32768)
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.69 MB (2825783)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.46K (1455)
- RowsReturnedRate: 107.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 980.000ns
EXCHANGE_NODE (id=35):(Total: 13s563ms, non-child: 167.612us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 89.46 KB (91604)
- ConvertRowBatchTime: 62.008us
- DeserializeRowBatchTimer: 427.780us
- FirstBatchArrivalWaitTime: 13s548ms
- PeakMemoryUsage: 0
- RowsReturned: 1.46K (1455)
- RowsReturnedRate: 107.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:8d (host=cdh15.net.cuberonlabs.com:22000):(Total: 13s878ms, non-child: 8.438ms, % non-child: 0.06%)
MemoryUsage(500.000ms): 5.40 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 5.40 MB (5660408)
- PerHostPeakMemUsage: 1.57 GB (1688553772)
- RowsProduced: 4 (4)
- TotalNetworkReceiveTime: 13s613ms
- TotalNetworkSendTime: 284.353us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s843ms
- TotalThreadsSysTime: 12.000ms
- TotalThreadsUserTime: 216.000ms
- TotalThreadsVoluntaryContextSwitches: 89 (89)
Fragment Instance Lifecycle Timings:
- ExecTime: 3.579ms
- ExecTreeExecTime: 127.782us
- OpenTime: 13s839ms
- ExecTreeOpenTime: 13s616ms
- PrepareTime: 35.455ms
- ExecTreePrepareTime: 1.220ms
DataStreamSender (dst_id=37):(Total: 104.800us, non-child: 104.800us, % non-child: 100.00%)
- BytesSent: 206.00 B (206)
- NetworkThroughput(*): 3.98 MB/sec
- OverallThroughput: 1.87 MB/sec
- PeakMemoryUsage: 56.99 KB (58360)
- RowsReturned: 4 (4)
- SerializeBatchTime: 16.090us
- TransmitDataRPCTime: 49.313us
- UncompressedRowBatchSize: 334.00 B (334)
CodeGen:(Total: 252.746ms, non-child: 252.746ms, % non-child: 100.00%)
- CodegenTime: 4.026ms
- CompileTime: 72.621ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.52K (1523)
- OptimizationTime: 149.796ms
- PeakMemoryUsage: 761.50 KB (779776)
- PrepareTime: 29.653ms
AGGREGATION_NODE (id=12):(Total: 13s617ms, non-child: 1.338ms, % non-child: 0.01%)
ExecOption: Codegen Enabled
- BuildTime: 119.455us
- GetNewBlockTime: 143.159us
- GetResultsTime: 9.015us
- HTResizeTime: 18.597us
- HashBuckets: 3.07K (3072)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.30 MB (2410624)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 4 (4)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 838.000ns
AGGREGATION_NODE (id=36):(Total: 13s616ms, non-child: 2.595ms, % non-child: 0.02%)
ExecOption: Codegen Enabled
- BuildTime: 136.495us
- GetNewBlockTime: 158.426us
- GetResultsTime: 84.000us
- HTResizeTime: 2.738us
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 8 (8)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.38 MB (2493568)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 362 (362)
- RowsReturnedRate: 26.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.322us
EXCHANGE_NODE (id=35):(Total: 13s613ms, non-child: 122.236us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 24.04 KB (24613)
- ConvertRowBatchTime: 31.311us
- DeserializeRowBatchTimer: 199.540us
- FirstBatchArrivalWaitTime: 13s597ms
- PeakMemoryUsage: 0
- RowsReturned: 362 (362)
- RowsReturnedRate: 26.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:8f (host=cdh17.net.cuberonlabs.com:22000):(Total: 13s878ms, non-child: 8.312ms, % non-child: 0.06%)
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 5.40 MB (5660408)
- PerHostPeakMemUsage: 1.75 GB (1879028559)
- RowsProduced: 3 (3)
- TotalNetworkReceiveTime: 13s604ms
- TotalNetworkSendTime: 256.079us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s840ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 232.000ms
- TotalThreadsVoluntaryContextSwitches: 66 (66)
Fragment Instance Lifecycle Timings:
- ExecTime: 3.402ms
- ExecTreeExecTime: 131.973us
- OpenTime: 13s837ms
- ExecTreeOpenTime: 13s606ms
- PrepareTime: 38.317ms
- ExecTreePrepareTime: 1.470ms
DataStreamSender (dst_id=37):(Total: 121.523us, non-child: 121.523us, % non-child: 100.00%)
- BytesSent: 149.00 B (149)
- NetworkThroughput(*): 2.80 MB/sec
- OverallThroughput: 1.17 MB/sec
- PeakMemoryUsage: 56.99 KB (58360)
- RowsReturned: 3 (3)
- SerializeBatchTime: 25.783us
- TransmitDataRPCTime: 50.734us
- UncompressedRowBatchSize: 247.00 B (247)
CodeGen:(Total: 261.866ms, non-child: 261.866ms, % non-child: 100.00%)
- CodegenTime: 4.491ms
- CompileTime: 69.562ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.52K (1523)
- OptimizationTime: 159.521ms
- PeakMemoryUsage: 761.50 KB (779776)
- PrepareTime: 32.042ms
AGGREGATION_NODE (id=12):(Total: 13s608ms, non-child: 1.663ms, % non-child: 0.01%)
ExecOption: Codegen Enabled
- BuildTime: 162.576us
- GetNewBlockTime: 193.587us
- GetResultsTime: 8.575us
- HTResizeTime: 15.851us
- HashBuckets: 3.07K (3072)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.30 MB (2410624)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 3 (3)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 909.000ns
AGGREGATION_NODE (id=36):(Total: 13s606ms, non-child: 2.609ms, % non-child: 0.02%)
ExecOption: Codegen Enabled
- BuildTime: 973.775us
- GetNewBlockTime: 172.046us
- GetResultsTime: 105.891us
- HTResizeTime: 445.566us
- HashBuckets: 32.77K (32768)
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.68 MB (2809307)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 883 (883)
- RowsReturnedRate: 64.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 998.000ns
EXCHANGE_NODE (id=35):(Total: 13s604ms, non-child: 213.183us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 56.00 KB (57342)
- ConvertRowBatchTime: 55.169us
- DeserializeRowBatchTimer: 2.297ms
- FirstBatchArrivalWaitTime: 13s588ms
- PeakMemoryUsage: 0
- RowsReturned: 883 (883)
- RowsReturnedRate: 64.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:8c (host=cdh6.net.cuberonlabs.com:22000):(Total: 13s878ms, non-child: 7.805ms, % non-child: 0.06%)
MemoryUsage(500.000ms): 5.40 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 5.40 MB (5660408)
- PerHostPeakMemUsage: 1.67 GB (1794839264)
- RowsProduced: 2 (2)
- TotalNetworkReceiveTime: 13s573ms
- TotalNetworkSendTime: 162.608us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s840ms
- TotalThreadsSysTime: 4.000ms
- TotalThreadsUserTime: 264.000ms
- TotalThreadsVoluntaryContextSwitches: 75 (75)
Fragment Instance Lifecycle Timings:
- ExecTime: 2.785ms
- ExecTreeExecTime: 93.556us
- OpenTime: 13s838ms
- ExecTreeOpenTime: 13s576ms
- PrepareTime: 37.561ms
- ExecTreePrepareTime: 1.236ms
DataStreamSender (dst_id=37):(Total: 104.728us, non-child: 104.728us, % non-child: 100.00%)
- BytesSent: 123.00 B (123)
- NetworkThroughput(*): 3.53 MB/sec
- OverallThroughput: 1.12 MB/sec
- PeakMemoryUsage: 56.99 KB (58360)
- RowsReturned: 2 (2)
- SerializeBatchTime: 28.968us
- TransmitDataRPCTime: 33.184us
- UncompressedRowBatchSize: 169.00 B (169)
CodeGen:(Total: 292.623ms, non-child: 292.623ms, % non-child: 100.00%)
- CodegenTime: 4.257ms
- CompileTime: 91.739ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.52K (1523)
- OptimizationTime: 168.706ms
- PeakMemoryUsage: 761.50 KB (779776)
- PrepareTime: 31.378ms
AGGREGATION_NODE (id=12):(Total: 13s578ms, non-child: 1.463ms, % non-child: 0.01%)
ExecOption: Codegen Enabled
- BuildTime: 66.856us
- GetNewBlockTime: 164.044us
- GetResultsTime: 2.896us
- HTResizeTime: 17.568us
- HashBuckets: 2.05K (2048)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.30 MB (2410624)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2 (2)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 984.000ns
AGGREGATION_NODE (id=36):(Total: 13s576ms, non-child: 3.369ms, % non-child: 0.02%)
ExecOption: Codegen Enabled
- BuildTime: 58.984us
- GetNewBlockTime: 169.364us
- GetResultsTime: 60.196us
- HTResizeTime: 3.728us
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 11 (11)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.38 MB (2493568)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 98 (98)
- RowsReturnedRate: 7.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.008us
EXCHANGE_NODE (id=35):(Total: 13s573ms, non-child: 141.024us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 6.80 KB (6962)
- ConvertRowBatchTime: 20.588us
- DeserializeRowBatchTimer: 134.564us
- FirstBatchArrivalWaitTime: 13s557ms
- PeakMemoryUsage: 0
- RowsReturned: 98 (98)
- RowsReturnedRate: 7.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:8e (host=cdh3.net.cuberonlabs.com:22000):(Total: 13s878ms, non-child: 8.430ms, % non-child: 0.06%)
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.67 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 5.40 MB (5660408)
- PerHostPeakMemUsage: 2.16 GB (2318232477)
- RowsProduced: 1 (1)
- TotalNetworkReceiveTime: 13s570ms
- TotalNetworkSendTime: 311.624us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 2 (2)
- TotalThreadsTotalWallClockTime: 13s844ms
- TotalThreadsSysTime: 4.000ms
- TotalThreadsUserTime: 264.000ms
- TotalThreadsVoluntaryContextSwitches: 74 (74)
Fragment Instance Lifecycle Timings:
- ExecTime: 3.517ms
- ExecTreeExecTime: 112.248us
- OpenTime: 13s840ms
- ExecTreeOpenTime: 13s573ms
- PrepareTime: 34.242ms
- ExecTreePrepareTime: 1.250ms
DataStreamSender (dst_id=37):(Total: 79.460us, non-child: 79.460us, % non-child: 100.00%)
- BytesSent: 71.00 B (71)
- NetworkThroughput(*): 4.04 MB/sec
- OverallThroughput: 872.59 KB/sec
- PeakMemoryUsage: 56.99 KB (58360)
- RowsReturned: 1 (1)
- SerializeBatchTime: 25.200us
- TransmitDataRPCTime: 16.776us
- UncompressedRowBatchSize: 87.00 B (87)
CodeGen:(Total: 295.347ms, non-child: 295.347ms, % non-child: 100.00%)
- CodegenTime: 4.187ms
- CompileTime: 89.712ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.52K (1523)
- OptimizationTime: 176.178ms
- PeakMemoryUsage: 761.50 KB (779776)
- PrepareTime: 28.739ms
AGGREGATION_NODE (id=12):(Total: 13s574ms, non-child: 1.784ms, % non-child: 0.01%)
ExecOption: Codegen Enabled
- BuildTime: 20.980us
- GetNewBlockTime: 163.308us
- GetResultsTime: 2.660us
- HTResizeTime: 7.712us
- HashBuckets: 1.02K (1024)
- LargestPartitionPercent: 20 (20)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.30 MB (2410624)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1 (1)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 932.000ns
AGGREGATION_NODE (id=36):(Total: 13s572ms, non-child: 1.874ms, % non-child: 0.01%)
ExecOption: Codegen Enabled
- BuildTime: 18.284us
- GetNewBlockTime: 163.352us
- GetResultsTime: 13.048us
- HTResizeTime: 3.492us
- HashBuckets: 5.12K (5120)
- LargestPartitionPercent: 20 (20)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.33 MB (2444416)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 5 (5)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 1.036us
EXCHANGE_NODE (id=35):(Total: 13s570ms, non-child: 39.772us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 111.00 B
- BytesReceived: 555.00 B (555)
- ConvertRowBatchTime: 5.684us
- DeserializeRowBatchTimer: 24.192us
- FirstBatchArrivalWaitTime: 13s557ms
- PeakMemoryUsage: 0
- RowsReturned: 5 (5)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:8b (host=cdh13.net.cuberonlabs.com:22000):(Total: 13s877ms, non-child: 8.107ms, % non-child: 0.06%)
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.78 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 5.40 MB (5660408)
- PerHostPeakMemUsage: 1.66 GB (1782381748)
- RowsProduced: 6 (6)
- TotalNetworkReceiveTime: 13s607ms
- TotalNetworkSendTime: 321.986us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 13s841ms
- TotalThreadsSysTime: 8.000ms
- TotalThreadsUserTime: 224.000ms
- TotalThreadsVoluntaryContextSwitches: 81 (81)
Fragment Instance Lifecycle Timings:
- ExecTime: 3.227ms
- ExecTreeExecTime: 245.903us
- OpenTime: 13s838ms
- ExecTreeOpenTime: 13s611ms
- PrepareTime: 35.911ms
- ExecTreePrepareTime: 1.237ms
DataStreamSender (dst_id=37):(Total: 82.623us, non-child: 82.623us, % non-child: 100.00%)
- BytesSent: 272.00 B (272)
- NetworkThroughput(*): 8.62 MB/sec
- OverallThroughput: 3.14 MB/sec
- PeakMemoryUsage: 56.99 KB (58360)
- RowsReturned: 6 (6)
- SerializeBatchTime: 17.147us
- TransmitDataRPCTime: 30.100us
- UncompressedRowBatchSize: 477.00 B (477)
CodeGen:(Total: 256.069ms, non-child: 256.069ms, % non-child: 100.00%)
- CodegenTime: 4.144ms
- CompileTime: 75.788ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.52K (1523)
- OptimizationTime: 149.689ms
- PeakMemoryUsage: 761.50 KB (779776)
- PrepareTime: 29.903ms
AGGREGATION_NODE (id=12):(Total: 13s612ms, non-child: 1.772ms, % non-child: 0.01%)
ExecOption: Codegen Enabled
- BuildTime: 286.830us
- GetNewBlockTime: 163.400us
- GetResultsTime: 9.966us
- HTResizeTime: 17.858us
- HashBuckets: 5.12K (5120)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.30 MB (2410624)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 6 (6)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 976.000ns
AGGREGATION_NODE (id=36):(Total: 13s611ms, non-child: 3.193ms, % non-child: 0.02%)
ExecOption: Codegen Enabled
- BuildTime: 1.506ms
- GetNewBlockTime: 158.182us
- GetResultsTime: 149.138us
- HTResizeTime: 953.867us
- HashBuckets: 32.77K (32768)
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.69 MB (2825090)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.37K (1367)
- RowsReturnedRate: 100.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 910.000ns
EXCHANGE_NODE (id=35):(Total: 13s607ms, non-child: 132.529us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 59.79 KB
- BytesReceived: 87.04 KB (89127)
- ConvertRowBatchTime: 53.813us
- DeserializeRowBatchTimer: 381.546us
- FirstBatchArrivalWaitTime: 13s593ms
- PeakMemoryUsage: 0
- RowsReturned: 1.37K (1367)
- RowsReturnedRate: 100.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:8a (host=cdh16.net.cuberonlabs.com:22000):(Total: 13s877ms, non-child: 9.872ms, % non-child: 0.07%)
MemoryUsage(500.000ms): 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB, 4.66 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 5.40 MB (5660408)
- PerHostPeakMemUsage: 1.64 GB (1763578733)
- RowsProduced: 3 (3)
- TotalNetworkReceiveTime: 13s566ms
- TotalNetworkSendTime: 317.163us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 13s820ms
- TotalThreadsSysTime: 8.000ms
- TotalThreadsUserTime: 244.000ms
- TotalThreadsVoluntaryContextSwitches: 151 (151)
Fragment Instance Lifecycle Timings:
- ExecTime: 3.503ms
- ExecTreeExecTime: 240.713us
- OpenTime: 13s816ms
- ExecTreeOpenTime: 13s568ms
- PrepareTime: 56.961ms
- ExecTreePrepareTime: 1.219ms
DataStreamSender (dst_id=37):(Total: 87.999us, non-child: 87.999us, % non-child: 100.00%)
- BytesSent: 150.00 B (150)
- NetworkThroughput(*): 6.42 MB/sec
- OverallThroughput: 1.63 MB/sec
- PeakMemoryUsage: 56.99 KB (58360)
- RowsReturned: 3 (3)
- SerializeBatchTime: 21.613us
- TransmitDataRPCTime: 22.269us
- UncompressedRowBatchSize: 231.00 B (231)
CodeGen:(Total: 297.186ms, non-child: 297.186ms, % non-child: 100.00%)
- CodegenTime: 6.129ms
- CompileTime: 75.215ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.52K (1523)
- OptimizationTime: 171.379ms
- PeakMemoryUsage: 761.50 KB (779776)
- PrepareTime: 49.513ms
AGGREGATION_NODE (id=12):(Total: 13s569ms, non-child: 1.603ms, % non-child: 0.01%)
ExecOption: Codegen Enabled
- BuildTime: 98.865us
- GetNewBlockTime: 163.088us
- GetResultsTime: 4.814us
- HTResizeTime: 19.364us
- HashBuckets: 3.07K (3072)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.30 MB (2410624)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 3 (3)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 918.000ns
AGGREGATION_NODE (id=36):(Total: 13s568ms, non-child: 2.117ms, % non-child: 0.02%)
ExecOption: Codegen Enabled
- BuildTime: 102.335us
- GetNewBlockTime: 178.047us
- GetResultsTime: 73.086us
- HTResizeTime: 3.082us
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 8 (8)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.38 MB (2493568)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 207 (207)
- RowsReturnedRate: 15.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 982.000ns
EXCHANGE_NODE (id=35):(Total: 13s566ms, non-child: 119.547us, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 13.91 KB (14242)
- ConvertRowBatchTime: 24.881us
- DeserializeRowBatchTimer: 155.148us
- FirstBatchArrivalWaitTime: 13s550ms
- PeakMemoryUsage: 0
- RowsReturned: 207 (207)
- RowsReturnedRate: 15.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Averaged Fragment F03:(Total: 13s868ms, non-child: 27.780ms, % non-child: 0.20%)
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:13s865ms max:13s877ms mean: 13s870ms stddev:4.933ms
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 17
- AverageThreadTokens: 1.93
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 599.33 MB (628440875)
- PerHostPeakMemUsage: 1.70 GB (1824024877)
- RowsProduced: 2.11K (2108)
- TotalNetworkReceiveTime: 16s844ms
- TotalNetworkSendTime: 6.175ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 28 (28)
- TotalThreadsTotalWallClockTime: 26s633ms
- TotalThreadsSysTime: 518.352ms
- TotalThreadsUserTime: 5s393ms
- TotalThreadsVoluntaryContextSwitches: 7.79K (7794)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s074ms
- ExecTreeExecTime: 2s062ms
- OpenTime: 11s739ms
- ExecTreeOpenTime: 10s800ms
- PrepareTime: 54.508ms
- ExecTreePrepareTime: 2.257ms
DataStreamSender (dst_id=35):(Total: 3.185ms, non-child: 3.185ms, % non-child: 100.00%)
- BytesSent: 122.07 KB (124997)
- NetworkThroughput(*): 135.20 MB/sec
- OverallThroughput: 42.46 MB/sec
- PeakMemoryUsage: 293.54 KB (300580)
- RowsReturned: 2.11K (2108)
- SerializeBatchTime: 1.662ms
- TransmitDataRPCTime: 1.472ms
- UncompressedRowBatchSize: 234.05 KB (239667)
CodeGen:(Total: 972.289ms, non-child: 972.289ms, % non-child: 100.00%)
- CodegenTime: 7.651ms
- CompileTime: 286.241ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 142 (142)
- NumInstructions: 7.08K (7077)
- OptimizationTime: 650.888ms
- PeakMemoryUsage: 3.46 MB (3623424)
- PrepareTime: 34.391ms
AGGREGATION_NODE (id=11):(Total: 12s865ms, non-child: 71.502ms, % non-child: 0.56%)
- GetNewBlockTime: 77.200us
- GetResultsTime: 149.285us
- HTResizeTime: 0.000ns
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 6 (6)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 9.42 MB (9877224)
- PinTime: 0.000ns
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 2.11K (2108)
- RowsReturnedRate: 163.00 /sec
- StreamingTime: 68.405ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=10):(Total: 12s793ms, non-child: 342.957ms, % non-child: 2.68%)
- BuildRows: 1.05K (1054)
- BuildTime: 686.658us
- PeakMemoryUsage: 1.24 MB (1301756)
- ProbeRows: 2.55M (2548430)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 333.282ms
- RowsReturned: 2.11K (2108)
- RowsReturnedRate: 164.00 /sec
Hash Join Builder (join_node_id=10):
- BuildRowsPartitionTime: 210.852us
- BuildRowsPartitioned: 1.05K (1054)
- GetNewBlockTime: 233.832us
- HashBuckets: 2.08K (2081)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 160.642us
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.06 MB (1111710)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=34):(Total: 2s019ms, non-child: 23.275ms, % non-child: 1.15%)
- BuildTime: 11.578ms
- GetNewBlockTime: 555.838us
- GetResultsTime: 8.696ms
- HTResizeTime: 1.448ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 20.07 MB (21041401)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.05K (1054)
- RowsReturnedRate: 522.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 973.000ns
EXCHANGE_NODE (id=33):(Total: 1s996ms, non-child: 1s996ms, % non-child: 100.00%)
- BytesReceived: 1.64 MB (1714946)
- ConvertRowBatchTime: 682.797us
- DeserializeRowBatchTimer: 6.380ms
- FirstBatchArrivalWaitTime: 1s950ms
- PeakMemoryUsage: 0
- RowsReturned: 30.48K (30477)
- RowsReturnedRate: 15.29 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=9):(Total: 12s450ms, non-child: 1s671ms, % non-child: 13.42%)
- BuildRows: 2.46M (2456476)
- BuildTime: 771.770ms
- PeakMemoryUsage: 457.17 MB (479379495)
- ProbeRows: 2.55M (2548431)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 881.608ms
- RowsReturned: 2.55M (2548430)
- RowsReturnedRate: 204.69 K/sec
Hash Join Builder (join_node_id=9):
- BuildRowsPartitionTime: 604.332ms
- BuildRowsPartitioned: 2.46M (2456476)
- GetNewBlockTime: 402.924us
- HashBuckets: 4.19M (4194304)
- HashCollisions: 1.39K (1392)
- HashTablesBuildTime: 146.951ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 457.03 MB (479229056)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=27):(Total: 10s026ms, non-child: 2s587ms, % non-child: 25.81%)
- BuildTime: 1s957ms
- GetNewBlockTime: 1.130ms
- GetResultsTime: 543.198ms
- HTResizeTime: 159.775ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 530.12 MB (555876123)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.46M (2456476)
- RowsReturnedRate: 245.04 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.022us
EXCHANGE_NODE (id=26):(Total: 7s439ms, non-child: 7s439ms, % non-child: 100.00%)
- BytesReceived: 268.10 MB (281124560)
- ConvertRowBatchTime: 88.184ms
- DeserializeRowBatchTimer: 752.570ms
- FirstBatchArrivalWaitTime: 1s756ms
- PeakMemoryUsage: 0
- RowsReturned: 4.35M (4352060)
- RowsReturnedRate: 585.24 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=28):(Total: 7s560ms, non-child: 7s560ms, % non-child: 100.00%)
- BytesReceived: 122.13 MB (128060777)
- ConvertRowBatchTime: 46.682ms
- DeserializeRowBatchTimer: 466.461ms
- FirstBatchArrivalWaitTime: 6s807ms
- PeakMemoryUsage: 0
- RowsReturned: 2.55M (2548431)
- RowsReturnedRate: 337.36 K/sec
- SendersBlockedTimer: 3s923ms
- SendersBlockedTotalTimer(*): 58s885ms
Fragment F03:
Instance 514ee9ab39cdc507:86 (host=cdh11.net.cuberonlabs.com:22000):(Total: 13s875ms, non-child: 30.137ms, % non-child: 0.22%)
MemoryUsage(500.000ms): 25.48 MB, 22.06 MB, 22.06 MB, 22.06 MB, 22.06 MB, 45.36 MB, 67.31 MB, 112.51 MB, 160.30 MB, 246.73 MB, 305.67 MB, 346.67 MB, 387.86 MB, 428.67 MB, 465.80 MB, 516.03 MB, 544.90 MB, 550.90 MB, 554.97 MB, 557.03 MB, 591.33 MB, 542.60 MB, 477.75 MB, 492.18 MB, 493.40 MB, 497.90 MB, 492.58 MB
ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1
- AverageThreadTokens: 2.00
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 599.33 MB (628440337)
- PerHostPeakMemUsage: 1.48 GB (1591793359)
- RowsProduced: 2.20K (2203)
- TotalNetworkReceiveTime: 16s716ms
- TotalNetworkSendTime: 8.271ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 41 (41)
- TotalThreadsTotalWallClockTime: 26s760ms
- TotalThreadsSysTime: 548.000ms
- TotalThreadsUserTime: 5s576ms
- TotalThreadsVoluntaryContextSwitches: 7.48K (7484)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s027ms
- ExecTreeExecTime: 2s013ms
- OpenTime: 11s792ms
- ExecTreeOpenTime: 10s886ms
- PrepareTime: 55.541ms
- ExecTreePrepareTime: 2.509ms
DataStreamSender (dst_id=35):(Total: 2.617ms, non-child: 2.617ms, % non-child: 100.00%)
- BytesSent: 127.15 KB (130201)
- NetworkThroughput(*): 169.79 MB/sec
- OverallThroughput: 47.44 MB/sec
- PeakMemoryUsage: 312.36 KB (319856)
- RowsReturned: 2.20K (2203)
- SerializeBatchTime: 1.843ms
- TransmitDataRPCTime: 731.315us
- UncompressedRowBatchSize: 244.40 KB (250261)
CodeGen:(Total: 940.925ms, non-child: 940.925ms, % non-child: 100.00%)
- CodegenTime: 7.385ms
- CompileTime: 283.468ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 142 (142)
- NumInstructions: 7.08K (7077)
- OptimizationTime: 621.226ms
- PeakMemoryUsage: 3.46 MB (3623424)
- PrepareTime: 35.425ms
AGGREGATION_NODE (id=11):(Total: 12s902ms, non-child: 70.781ms, % non-child: 0.55%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 81.439us
- GetResultsTime: 145.616us
- HTResizeTime: 0.000ns
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 6 (6)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 9.42 MB (9873877)
- PinTime: 0.000ns
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 2.20K (2203)
- RowsReturnedRate: 170.00 /sec
- StreamingTime: 68.476ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=10):(Total: 12s831ms, non-child: 362.454ms, % non-child: 2.82%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.10K (1101)
- BuildTime: 417.754us
- PeakMemoryUsage: 1.24 MB (1299474)
- ProbeRows: 2.55M (2549124)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 351.627ms
- RowsReturned: 2.20K (2203)
- RowsReturnedRate: 171.00 /sec
Hash Join Builder (join_node_id=10):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- BuildRowsPartitionTime: 170.674us
- BuildRowsPartitioned: 1.10K (1101)
- GetNewBlockTime: 46.126us
- HashBuckets: 2.05K (2048)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 124.240us
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.06 MB (1111168)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=34):(Total: 2s055ms, non-child: 23.052ms, % non-child: 1.12%)
ExecOption: Codegen Enabled
- BuildTime: 11.229ms
- GetNewBlockTime: 645.384us
- GetResultsTime: 8.804ms
- HTResizeTime: 844.363us
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 20.06 MB (21038912)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.10K (1101)
- RowsReturnedRate: 535.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.010us
EXCHANGE_NODE (id=33):(Total: 2s032ms, non-child: 1.661ms, % non-child: 0.08%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.54 MB
- BytesReceived: 1.64 MB (1717846)
- ConvertRowBatchTime: 699.950us
- DeserializeRowBatchTimer: 6.187ms
- FirstBatchArrivalWaitTime: 1s980ms
- PeakMemoryUsage: 0
- RowsReturned: 30.52K (30523)
- RowsReturnedRate: 15.02 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=9):(Total: 12s467ms, non-child: 1s749ms, % non-child: 14.03%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 2.46M (2457112)
- BuildTime: 816.699ms
- PeakMemoryUsage: 457.17 MB (479379706)
- ProbeRows: 2.55M (2549124)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 914.461ms
- RowsReturned: 2.55M (2549124)
- RowsReturnedRate: 204.46 K/sec
Hash Join Builder (join_node_id=9):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 648.987ms
- BuildRowsPartitioned: 2.46M (2457112)
- GetNewBlockTime: 211.111us
- HashBuckets: 4.19M (4194304)
- HashCollisions: 1.44K (1437)
- HashTablesBuildTime: 146.497ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 457.03 MB (479229056)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=27):(Total: 10s067ms, non-child: 2s717ms, % non-child: 26.99%)
ExecOption: Codegen Enabled
- BuildTime: 2s081ms
- GetNewBlockTime: 3.151ms
- GetResultsTime: 546.092ms
- HTResizeTime: 165.843ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 530.10 MB (555847530)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.46M (2457112)
- RowsReturnedRate: 244.06 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 955.000ns
EXCHANGE_NODE (id=26):(Total: 7s350ms, non-child: 192.132ms, % non-child: 2.61%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.68 MB, 6.50 MB, 18.21 MB, 41.04 MB, 67.98 MB, 98.02 MB, 128.06 MB, 158.14 MB, 186.57 MB, 211.01 MB, 232.13 MB, 248.58 MB, 257.20 MB, 263.15 MB, 267.03 MB
- BytesReceived: 268.18 MB (281207629)
- ConvertRowBatchTime: 91.199ms
- DeserializeRowBatchTimer: 772.311ms
- FirstBatchArrivalWaitTime: 1s785ms
- PeakMemoryUsage: 0
- RowsReturned: 4.35M (4353676)
- RowsReturnedRate: 592.31 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=28):(Total: 7s490ms, non-child: 154.377ms, % non-child: 2.06%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.61 MB, 26.66 MB, 65.27 MB, 103.10 MB
- BytesReceived: 122.11 MB (128041068)
- ConvertRowBatchTime: 49.744ms
- DeserializeRowBatchTimer: 474.158ms
- FirstBatchArrivalWaitTime: 6s839ms
- PeakMemoryUsage: 0
- RowsReturned: 2.55M (2549124)
- RowsReturnedRate: 340.30 K/sec
- SendersBlockedTimer: 3s905ms
- SendersBlockedTotalTimer(*): 1m2s
Instance 514ee9ab39cdc507:85 (host=cdh8.net.cuberonlabs.com:22000):(Total: 13s875ms, non-child: 36.336ms, % non-child: 0.26%)
MemoryUsage(500.000ms): 25.48 MB, 22.03 MB, 22.06 MB, 22.06 MB, 22.06 MB, 37.81 MB, 66.39 MB, 111.42 MB, 159.17 MB, 228.17 MB, 302.30 MB, 345.74 MB, 386.80 MB, 426.67 MB, 463.73 MB, 516.03 MB, 544.96 MB, 550.90 MB, 554.90 MB, 556.90 MB, 591.33 MB, 518.36 MB, 469.51 MB, 491.96 MB, 496.72 MB, 492.99 MB, 496.40 MB
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.93
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 599.33 MB (628437982)
- PerHostPeakMemUsage: 1.63 GB (1748411303)
- RowsProduced: 2.13K (2129)
- TotalNetworkReceiveTime: 17s128ms
- TotalNetworkSendTime: 8.439ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 37 (37)
- TotalThreadsTotalWallClockTime: 26s467ms
- TotalThreadsSysTime: 492.000ms
- TotalThreadsUserTime: 5s140ms
- TotalThreadsVoluntaryContextSwitches: 7.44K (7439)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s260ms
- ExecTreeExecTime: 2s246ms
- OpenTime: 11s543ms
- ExecTreeOpenTime: 10s630ms
- PrepareTime: 71.068ms
- ExecTreePrepareTime: 2.582ms
DataStreamSender (dst_id=35):(Total: 5.414ms, non-child: 5.414ms, % non-child: 100.00%)
- BytesSent: 123.62 KB (126588)
- NetworkThroughput(*): 33.51 MB/sec
- OverallThroughput: 22.30 MB/sec
- PeakMemoryUsage: 312.36 KB (319856)
- RowsReturned: 2.13K (2129)
- SerializeBatchTime: 1.754ms
- TransmitDataRPCTime: 3.602ms
- UncompressedRowBatchSize: 236.23 KB (241896)
CodeGen:(Total: 954.458ms, non-child: 954.458ms, % non-child: 100.00%)
- CodegenTime: 11.292ms
- CompileTime: 274.953ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 142 (142)
- NumInstructions: 7.08K (7077)
- OptimizationTime: 636.280ms
- PeakMemoryUsage: 3.46 MB (3623424)
- PrepareTime: 42.111ms
AGGREGATION_NODE (id=11):(Total: 12s879ms, non-child: 78.469ms, % non-child: 0.61%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 97.847us
- GetResultsTime: 155.422us
- HTResizeTime: 0.000ns
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 7 (7)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 9.42 MB (9874124)
- PinTime: 0.000ns
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 2.13K (2129)
- RowsReturnedRate: 165.00 /sec
- StreamingTime: 74.550ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=10):(Total: 12s800ms, non-child: 342.762ms, % non-child: 2.68%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.06K (1064)
- BuildTime: 528.403us
- PeakMemoryUsage: 1.25 MB (1307612)
- ProbeRows: 2.54M (2543404)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 332.311ms
- RowsReturned: 2.13K (2129)
- RowsReturnedRate: 166.00 /sec
Hash Join Builder (join_node_id=10):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- BuildRowsPartitionTime: 181.079us
- BuildRowsPartitioned: 1.06K (1064)
- GetNewBlockTime: 81.823us
- HashBuckets: 2.18K (2176)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 170.193us
- LargestPartitionPercent: 8 (8)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.06 MB (1113216)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=34):(Total: 2s034ms, non-child: 25.942ms, % non-child: 1.28%)
ExecOption: Codegen Enabled
- BuildTime: 12.464ms
- GetNewBlockTime: 244.235us
- GetResultsTime: 10.374ms
- HTResizeTime: 1.303ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 20.07 MB (21047601)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.06K (1064)
- RowsReturnedRate: 523.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.398us
EXCHANGE_NODE (id=33):(Total: 2s008ms, non-child: 1.969ms, % non-child: 0.10%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 462.81 KB
- BytesReceived: 1.62 MB (1700254)
- ConvertRowBatchTime: 815.474us
- DeserializeRowBatchTimer: 5.198ms
- FirstBatchArrivalWaitTime: 1s958ms
- PeakMemoryUsage: 0
- RowsReturned: 30.22K (30219)
- RowsReturnedRate: 15.05 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=9):(Total: 12s457ms, non-child: 1s604ms, % non-child: 12.88%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 2.45M (2452220)
- BuildTime: 706.359ms
- PeakMemoryUsage: 457.17 MB (479378844)
- ProbeRows: 2.54M (2543404)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 880.757ms
- RowsReturned: 2.54M (2543404)
- RowsReturnedRate: 204.17 K/sec
Hash Join Builder (join_node_id=9):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 549.146ms
- BuildRowsPartitioned: 2.45M (2452220)
- GetNewBlockTime: 217.890us
- HashBuckets: 4.19M (4194304)
- HashCollisions: 1.38K (1380)
- HashTablesBuildTime: 138.693ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 457.03 MB (479229056)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=27):(Total: 9s921ms, non-child: 2s395ms, % non-child: 24.15%)
ExecOption: Codegen Enabled
- BuildTime: 1s882ms
- GetNewBlockTime: 782.570us
- GetResultsTime: 442.122ms
- HTResizeTime: 155.854ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 530.11 MB (555856755)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.45M (2452220)
- RowsReturnedRate: 247.16 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.347us
EXCHANGE_NODE (id=26):(Total: 7s525ms, non-child: 208.158ms, % non-child: 2.77%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.43 MB, 6.00 MB, 17.08 MB, 38.88 MB, 65.79 MB, 95.50 MB, 125.29 MB, 155.35 MB, 184.03 MB, 208.69 MB, 229.91 MB, 246.91 MB, 255.94 MB, 262.16 MB, 266.14 MB
- BytesReceived: 267.48 MB (280477246)
- ConvertRowBatchTime: 87.770ms
- DeserializeRowBatchTimer: 720.920ms
- FirstBatchArrivalWaitTime: 1s763ms
- PeakMemoryUsage: 0
- RowsReturned: 4.34M (4341417)
- RowsReturnedRate: 576.87 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=28):(Total: 7s746ms, non-child: 168.274ms, % non-child: 2.17%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.37 MB, 10.46 MB, 23.69 MB, 62.31 MB, 100.38 MB
- BytesReceived: 121.89 MB (127805884)
- ConvertRowBatchTime: 47.952ms
- DeserializeRowBatchTimer: 461.153ms
- FirstBatchArrivalWaitTime: 6s815ms
- PeakMemoryUsage: 0
- RowsReturned: 2.54M (2543404)
- RowsReturnedRate: 328.31 K/sec
- SendersBlockedTimer: 3s672ms
- SendersBlockedTotalTimer(*): 55s039ms
Instance 514ee9ab39cdc507:87 (host=cdh9.net.cuberonlabs.com:22000):(Total: 13s874ms, non-child: 25.731ms, % non-child: 0.19%)
MemoryUsage(500.000ms): 25.48 MB, 25.48 MB, 22.06 MB, 22.06 MB, 22.06 MB, 22.06 MB, 45.56 MB, 80.03 MB, 127.11 MB, 178.92 MB, 265.73 MB, 316.33 MB, 360.07 MB, 396.73 MB, 437.06 MB, 473.07 MB, 517.97 MB, 546.97 MB, 551.97 MB, 554.90 MB, 556.90 MB, 567.09 MB, 518.36 MB, 461.51 MB, 492.22 MB, 500.25 MB, 496.10 MB, 499.91 MB
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.93
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 599.33 MB (628442328)
- PerHostPeakMemUsage: 1.69 GB (1813107104)
- RowsProduced: 2.15K (2146)
- TotalNetworkReceiveTime: 16s994ms
- TotalNetworkSendTime: 4.288ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 29 (29)
- TotalThreadsTotalWallClockTime: 26s761ms
- TotalThreadsSysTime: 496.000ms
- TotalThreadsUserTime: 5s356ms
- TotalThreadsVoluntaryContextSwitches: 7.94K (7936)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s045ms
- ExecTreeExecTime: 2s035ms
- OpenTime: 11s775ms
- ExecTreeOpenTime: 10s876ms
- PrepareTime: 53.861ms
- ExecTreePrepareTime: 2.212ms
DataStreamSender (dst_id=35):(Total: 2.326ms, non-child: 2.326ms, % non-child: 100.00%)
- BytesSent: 125.20 KB (128204)
- NetworkThroughput(*): 189.50 MB/sec
- OverallThroughput: 52.56 MB/sec
- PeakMemoryUsage: 296.36 KB (303472)
- RowsReturned: 2.15K (2146)
- SerializeBatchTime: 1.636ms
- TransmitDataRPCTime: 645.203us
- UncompressedRowBatchSize: 238.41 KB (244127)
CodeGen:(Total: 932.990ms, non-child: 932.990ms, % non-child: 100.00%)
- CodegenTime: 7.061ms
- CompileTime: 282.450ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 142 (142)
- NumInstructions: 7.08K (7077)
- OptimizationTime: 615.438ms
- PeakMemoryUsage: 3.46 MB (3623424)
- PrepareTime: 34.324ms
AGGREGATION_NODE (id=11):(Total: 12s913ms, non-child: 68.140ms, % non-child: 0.53%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 83.546us
- GetResultsTime: 170.126us
- HTResizeTime: 0.000ns
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 7 (7)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 9.44 MB (9895006)
- PinTime: 0.000ns
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 2.15K (2146)
- RowsReturnedRate: 166.00 /sec
- StreamingTime: 64.728ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=10):(Total: 12s845ms, non-child: 294.551ms, % non-child: 2.29%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.07K (1073)
- BuildTime: 537.066us
- PeakMemoryUsage: 1.25 MB (1312956)
- ProbeRows: 2.55M (2550338)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 285.979ms
- RowsReturned: 2.15K (2146)
- RowsReturnedRate: 167.00 /sec
Hash Join Builder (join_node_id=10):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- BuildRowsPartitionTime: 227.441us
- BuildRowsPartitioned: 1.07K (1073)
- GetNewBlockTime: 54.327us
- HashBuckets: 2.18K (2176)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 144.273us
- LargestPartitionPercent: 8 (8)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.06 MB (1113216)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=34):(Total: 2s065ms, non-child: 21.247ms, % non-child: 1.03%)
ExecOption: Codegen Enabled
- BuildTime: 9.786ms
- GetNewBlockTime: 202.766us
- GetResultsTime: 9.136ms
- HTResizeTime: 652.839us
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 20.07 MB (21042589)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.07K (1073)
- RowsReturnedRate: 519.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.038us
EXCHANGE_NODE (id=33):(Total: 2s044ms, non-child: 1.466ms, % non-child: 0.07%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0
- BytesReceived: 1.64 MB (1723545)
- ConvertRowBatchTime: 537.923us
- DeserializeRowBatchTimer: 4.360ms
- FirstBatchArrivalWaitTime: 1s989ms
- PeakMemoryUsage: 0
- RowsReturned: 30.64K (30639)
- RowsReturnedRate: 14.99 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=9):(Total: 12s550ms, non-child: 1s615ms, % non-child: 12.87%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 2.46M (2458152)
- BuildTime: 788.426ms
- PeakMemoryUsage: 457.17 MB (479379341)
- ProbeRows: 2.55M (2550338)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 807.848ms
- RowsReturned: 2.55M (2550338)
- RowsReturnedRate: 203.20 K/sec
Hash Join Builder (join_node_id=9):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 634.577ms
- BuildRowsPartitioned: 2.46M (2458152)
- GetNewBlockTime: 266.138us
- HashBuckets: 4.19M (4194304)
- HashCollisions: 1.34K (1340)
- HashTablesBuildTime: 132.708ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 457.03 MB (479229056)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=27):(Total: 10s085ms, non-child: 2s680ms, % non-child: 26.58%)
ExecOption: Codegen Enabled
- BuildTime: 2s036ms
- GetNewBlockTime: 678.520us
- GetResultsTime: 549.141ms
- HTResizeTime: 162.483ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 530.16 MB (555914780)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.46M (2458152)
- RowsReturnedRate: 243.74 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.050us
EXCHANGE_NODE (id=26):(Total: 7s404ms, non-child: 191.244ms, % non-child: 2.58%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.74 MB, 8.44 MB, 22.87 MB, 47.84 MB, 75.28 MB, 105.77 MB, 136.44 MB, 165.85 MB, 193.19 MB, 216.64 MB, 236.94 MB, 251.70 MB, 259.23 MB, 264.62 MB, 267.82 MB
- BytesReceived: 268.57 MB (281619247)
- ConvertRowBatchTime: 94.307ms
- DeserializeRowBatchTimer: 694.065ms
- FirstBatchArrivalWaitTime: 1s793ms
- PeakMemoryUsage: 0
- RowsReturned: 4.36M (4358139)
- RowsReturnedRate: 588.59 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=28):(Total: 7s697ms, non-child: 133.979ms, % non-child: 1.74%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.37 MB, 10.64 MB, 36.19 MB, 74.62 MB, 112.95 MB
- BytesReceived: 122.31 MB (128246800)
- ConvertRowBatchTime: 41.476ms
- DeserializeRowBatchTimer: 450.692ms
- FirstBatchArrivalWaitTime: 6s847ms
- PeakMemoryUsage: 0
- RowsReturned: 2.55M (2550338)
- RowsReturnedRate: 331.31 K/sec
- SendersBlockedTimer: 3s889ms
- SendersBlockedTotalTimer(*): 55s034ms
Instance 514ee9ab39cdc507:84 (host=cdh7.net.cuberonlabs.com:22000):(Total: 13s874ms, non-child: 28.167ms, % non-child: 0.20%)
MemoryUsage(500.000ms): 25.48 MB, 25.48 MB, 22.06 MB, 22.06 MB, 22.06 MB, 22.06 MB, 45.48 MB, 81.09 MB, 127.67 MB, 181.49 MB, 266.67 MB, 313.79 MB, 362.20 MB, 397.80 MB, 437.80 MB, 473.26 MB, 524.24 MB, 546.98 MB, 551.91 MB, 555.98 MB, 556.91 MB, 567.10 MB, 534.49 MB, 485.77 MB, 492.11 MB, 493.72 MB, 497.59 MB, 493.43 MB
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.93
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 599.34 MB (628454356)
- PerHostPeakMemUsage: 1.58 GB (1699637471)
- RowsProduced: 2.08K (2078)
- TotalNetworkReceiveTime: 16s542ms
- TotalNetworkSendTime: 7.845ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 29 (29)
- TotalThreadsTotalWallClockTime: 26s749ms
- TotalThreadsSysTime: 512.000ms
- TotalThreadsUserTime: 5s640ms
- TotalThreadsVoluntaryContextSwitches: 7.46K (7461)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s896ms
- ExecTreeExecTime: 1s883ms
- OpenTime: 11s921ms
- ExecTreeOpenTime: 10s945ms
- PrepareTime: 56.280ms
- ExecTreePrepareTime: 1.948ms
DataStreamSender (dst_id=35):(Total: 4.618ms, non-child: 4.618ms, % non-child: 100.00%)
- BytesSent: 119.78 KB (122653)
- NetworkThroughput(*): 40.10 MB/sec
- OverallThroughput: 25.33 MB/sec
- PeakMemoryUsage: 288.36 KB (295280)
- RowsReturned: 2.08K (2078)
- SerializeBatchTime: 1.655ms
- TransmitDataRPCTime: 2.916ms
- UncompressedRowBatchSize: 230.81 KB (236348)
CodeGen:(Total: 1s010ms, non-child: 1s010ms, % non-child: 100.00%)
- CodegenTime: 7.784ms
- CompileTime: 352.717ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 142 (142)
- NumInstructions: 7.08K (7077)
- OptimizationTime: 621.239ms
- PeakMemoryUsage: 3.46 MB (3623424)
- PrepareTime: 35.963ms
AGGREGATION_NODE (id=11):(Total: 12s831ms, non-child: 72.983ms, % non-child: 0.57%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 104.392us
- GetResultsTime: 106.570us
- HTResizeTime: 0.000ns
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 7 (7)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 9.42 MB (9882439)
- PinTime: 0.000ns
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 2.08K (2078)
- RowsReturnedRate: 161.00 /sec
- StreamingTime: 68.843ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=10):(Total: 12s758ms, non-child: 299.173ms, % non-child: 2.34%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.04K (1039)
- BuildTime: 553.488us
- PeakMemoryUsage: 1.24 MB (1299160)
- ProbeRows: 2.55M (2548097)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 290.307ms
- RowsReturned: 2.08K (2078)
- RowsReturnedRate: 162.00 /sec
Hash Join Builder (join_node_id=10):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- BuildRowsPartitionTime: 248.856us
- BuildRowsPartitioned: 1.04K (1039)
- GetNewBlockTime: 74.674us
- HashBuckets: 2.11K (2112)
- HashCollisions: 3 (3)
- HashTablesBuildTime: 145.855us
- LargestPartitionPercent: 8 (8)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.06 MB (1112192)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=34):(Total: 1s987ms, non-child: 27.444ms, % non-child: 1.38%)
ExecOption: Codegen Enabled
- BuildTime: 13.062ms
- GetNewBlockTime: 1.801ms
- GetResultsTime: 9.487ms
- HTResizeTime: 1.119ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 20.07 MB (21049741)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.04K (1039)
- RowsReturnedRate: 522.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 900.000ns
EXCHANGE_NODE (id=33):(Total: 1s959ms, non-child: 2.469ms, % non-child: 0.13%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0
- BytesReceived: 1.64 MB (1716186)
- ConvertRowBatchTime: 805.893us
- DeserializeRowBatchTimer: 5.658ms
- FirstBatchArrivalWaitTime: 1s913ms
- PeakMemoryUsage: 0
- RowsReturned: 30.49K (30492)
- RowsReturnedRate: 15.56 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=9):(Total: 12s458ms, non-child: 1s717ms, % non-child: 13.79%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 2.46M (2456036)
- BuildTime: 842.804ms
- PeakMemoryUsage: 457.17 MB (479379897)
- ProbeRows: 2.55M (2548097)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 858.191ms
- RowsReturned: 2.55M (2548097)
- RowsReturnedRate: 204.53 K/sec
Hash Join Builder (join_node_id=9):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 668.746ms
- BuildRowsPartitioned: 2.46M (2456036)
- GetNewBlockTime: 249.693us
- HashBuckets: 4.19M (4194304)
- HashCollisions: 1.35K (1351)
- HashTablesBuildTime: 152.507ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 457.03 MB (479229056)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=27):(Total: 10s100ms, non-child: 2s777ms, % non-child: 27.50%)
ExecOption: Codegen Enabled
- BuildTime: 2s038ms
- GetNewBlockTime: 800.709us
- GetResultsTime: 641.708ms
- HTResizeTime: 164.929ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 530.10 MB (555849270)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.46M (2456036)
- RowsReturnedRate: 243.17 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 966.000ns
EXCHANGE_NODE (id=26):(Total: 7s322ms, non-child: 221.423ms, % non-child: 3.02%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.87 MB, 8.71 MB, 23.51 MB, 48.88 MB, 76.20 MB, 106.43 MB, 137.19 MB, 166.61 MB, 193.70 MB, 217.10 MB, 237.12 MB, 251.49 MB, 259.02 MB, 264.35 MB, 267.55 MB
- BytesReceived: 268.23 MB (281257036)
- ConvertRowBatchTime: 90.362ms
- DeserializeRowBatchTimer: 759.823ms
- FirstBatchArrivalWaitTime: 1s716ms
- PeakMemoryUsage: 0
- RowsReturned: 4.35M (4353326)
- RowsReturnedRate: 594.52 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=28):(Total: 7s407ms, non-child: 170.999ms, % non-child: 2.31%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.38 MB, 10.59 MB, 37.25 MB, 75.56 MB, 113.80 MB
- BytesReceived: 122.15 MB (128087416)
- ConvertRowBatchTime: 41.176ms
- DeserializeRowBatchTimer: 479.423ms
- FirstBatchArrivalWaitTime: 6s767ms
- PeakMemoryUsage: 0
- RowsReturned: 2.55M (2548097)
- RowsReturnedRate: 343.97 K/sec
- SendersBlockedTimer: 4s037ms
- SendersBlockedTotalTimer(*): 57s028ms
Instance 514ee9ab39cdc507:82 (host=cdh1.net.cuberonlabs.com:22000):(Total: 13s874ms, non-child: 34.109ms, % non-child: 0.25%)
MemoryUsage(500.000ms): 25.48 MB, 25.48 MB, 22.06 MB, 22.06 MB, 22.06 MB, 22.06 MB, 45.48 MB, 72.07 MB, 126.98 MB, 178.66 MB, 265.79 MB, 311.93 MB, 351.67 MB, 394.67 MB, 433.99 MB, 468.67 MB, 517.97 MB, 546.91 MB, 551.91 MB, 554.97 MB, 556.91 MB, 567.09 MB, 534.49 MB, 485.76 MB, 492.21 MB, 498.91 MB, 494.67 MB, 498.44 MB
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.93
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 599.33 MB (628446093)
- PerHostPeakMemUsage: 1.81 GB (1939587581)
- RowsProduced: 2.08K (2076)
- TotalNetworkReceiveTime: 16s519ms
- TotalNetworkSendTime: 7.864ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 43 (43)
- TotalThreadsTotalWallClockTime: 26s765ms
- TotalThreadsSysTime: 608.000ms
- TotalThreadsUserTime: 5s600ms
- TotalThreadsVoluntaryContextSwitches: 7.71K (7705)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s916ms
- ExecTreeExecTime: 1s902ms
- OpenTime: 11s900ms
- ExecTreeOpenTime: 10s946ms
- PrepareTime: 57.688ms
- ExecTreePrepareTime: 3.704ms
DataStreamSender (dst_id=35):(Total: 4.590ms, non-child: 4.590ms, % non-child: 100.00%)
- BytesSent: 119.63 KB (122500)
- NetworkThroughput(*): 40.24 MB/sec
- OverallThroughput: 25.45 MB/sec
- PeakMemoryUsage: 280.36 KB (287088)
- RowsReturned: 2.08K (2076)
- SerializeBatchTime: 1.646ms
- TransmitDataRPCTime: 2.902ms
- UncompressedRowBatchSize: 230.25 KB (235778)
CodeGen:(Total: 983.089ms, non-child: 983.089ms, % non-child: 100.00%)
- CodegenTime: 11.500ms
- CompileTime: 304.235ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 142 (142)
- NumInstructions: 7.08K (7077)
- OptimizationTime: 647.488ms
- PeakMemoryUsage: 3.46 MB (3623424)
- PrepareTime: 30.731ms
AGGREGATION_NODE (id=11):(Total: 12s852ms, non-child: 79.960ms, % non-child: 0.62%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 46.128us
- GetResultsTime: 155.840us
- HTResizeTime: 0.000ns
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 7 (7)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 9.41 MB (9864024)
- PinTime: 0.000ns
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 2.08K (2076)
- RowsReturnedRate: 161.00 /sec
- StreamingTime: 76.743ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=10):(Total: 12s772ms, non-child: 358.771ms, % non-child: 2.81%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.04K (1038)
- BuildTime: 448.304us
- PeakMemoryUsage: 1.28 MB (1345396)
- ProbeRows: 2.55M (2547701)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 346.473ms
- RowsReturned: 2.08K (2076)
- RowsReturnedRate: 162.00 /sec
Hash Join Builder (join_node_id=10):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- BuildRowsPartitionTime: 186.700us
- BuildRowsPartitioned: 1.04K (1038)
- GetNewBlockTime: 35.128us
- HashBuckets: 2.05K (2048)
- HashCollisions: 1 (1)
- HashTablesBuildTime: 157.372us
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.06 MB (1111168)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=34):(Total: 2s004ms, non-child: 22.477ms, % non-child: 1.12%)
ExecOption: Codegen Enabled
- BuildTime: 9.153ms
- GetNewBlockTime: 714.276us
- GetResultsTime: 8.838ms
- HTResizeTime: 848.720us
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 20.06 MB (21029694)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.04K (1038)
- RowsReturnedRate: 517.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.012us
EXCHANGE_NODE (id=33):(Total: 1s982ms, non-child: 1.443ms, % non-child: 0.07%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0
- BytesReceived: 1.62 MB (1697477)
- ConvertRowBatchTime: 565.368us
- DeserializeRowBatchTimer: 5.560ms
- FirstBatchArrivalWaitTime: 1s932ms
- PeakMemoryUsage: 0
- RowsReturned: 30.18K (30176)
- RowsReturnedRate: 15.22 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=9):(Total: 12s411ms, non-child: 1s809ms, % non-child: 14.58%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 2.46M (2455964)
- BuildTime: 859.088ms
- PeakMemoryUsage: 457.17 MB (479378907)
- ProbeRows: 2.55M (2547701)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 930.683ms
- RowsReturned: 2.55M (2547701)
- RowsReturnedRate: 205.27 K/sec
Hash Join Builder (join_node_id=9):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 659.011ms
- BuildRowsPartitioned: 2.46M (2455964)
- GetNewBlockTime: 290.796us
- HashBuckets: 4.19M (4194304)
- HashCollisions: 1.43K (1432)
- HashTablesBuildTime: 178.992ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 457.03 MB (479229056)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=27):(Total: 10s084ms, non-child: 2s700ms, % non-child: 26.78%)
ExecOption: Codegen Enabled
- BuildTime: 1s994ms
- GetNewBlockTime: 616.900us
- GetResultsTime: 609.114ms
- HTResizeTime: 165.669ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 530.10 MB (555848576)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.46M (2455964)
- RowsReturnedRate: 243.53 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.172us
EXCHANGE_NODE (id=26):(Total: 7s384ms, non-child: 197.641ms, % non-child: 2.68%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.68 MB, 8.27 MB, 22.40 MB, 47.20 MB, 74.43 MB, 104.91 MB, 135.31 MB, 164.79 MB, 192.12 MB, 215.69 MB, 235.91 MB, 250.87 MB, 258.42 MB, 263.91 MB, 267.11 MB
- BytesReceived: 267.91 MB (280921803)
- ConvertRowBatchTime: 90.014ms
- DeserializeRowBatchTimer: 731.674ms
- FirstBatchArrivalWaitTime: 1s737ms
- PeakMemoryUsage: 0
- RowsReturned: 4.35M (4350001)
- RowsReturnedRate: 589.09 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=28):(Total: 7s306ms, non-child: 166.089ms, % non-child: 2.27%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.37 MB, 10.60 MB, 35.26 MB, 73.50 MB, 111.85 MB
- BytesReceived: 122.06 MB (127989053)
- ConvertRowBatchTime: 47.108ms
- DeserializeRowBatchTimer: 470.253ms
- FirstBatchArrivalWaitTime: 6s789ms
- PeakMemoryUsage: 0
- RowsReturned: 2.55M (2547701)
- RowsReturnedRate: 348.68 K/sec
- SendersBlockedTimer: 4s019ms
- SendersBlockedTotalTimer(*): 57s235ms
Instance 514ee9ab39cdc507:88 (host=cdh10.net.cuberonlabs.com:22000):(Total: 13s874ms, non-child: 25.836ms, % non-child: 0.19%)
MemoryUsage(500.000ms): 25.48 MB, 22.03 MB, 22.06 MB, 22.06 MB, 22.06 MB, 35.56 MB, 66.47 MB, 111.39 MB, 159.23 MB, 230.63 MB, 302.37 MB, 345.74 MB, 385.67 MB, 425.86 MB, 463.61 MB, 514.89 MB, 545.96 MB, 550.97 MB, 554.90 MB, 556.96 MB, 583.32 MB, 526.47 MB, 461.50 MB, 492.10 MB, 496.20 MB, 492.55 MB, 496.08 MB
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.93
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 599.32 MB (628433302)
- PerHostPeakMemUsage: 1.66 GB (1784016472)
- RowsProduced: 2.09K (2094)
- TotalNetworkReceiveTime: 17s095ms
- TotalNetworkSendTime: 7.469ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 27 (27)
- TotalThreadsTotalWallClockTime: 26s566ms
- TotalThreadsSysTime: 520.000ms
- TotalThreadsUserTime: 5s228ms
- TotalThreadsVoluntaryContextSwitches: 7.51K (7506)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s230ms
- ExecTreeExecTime: 2s217ms
- OpenTime: 11s588ms
- ExecTreeOpenTime: 10s687ms
- PrepareTime: 55.231ms
- ExecTreePrepareTime: 1.885ms
DataStreamSender (dst_id=35):(Total: 6.559ms, non-child: 6.559ms, % non-child: 100.00%)
- BytesSent: 120.75 KB (123650)
- NetworkThroughput(*): 23.50 MB/sec
- OverallThroughput: 17.98 MB/sec
- PeakMemoryUsage: 252.36 KB (258416)
- RowsReturned: 2.09K (2094)
- SerializeBatchTime: 1.494ms
- TransmitDataRPCTime: 5.018ms
- UncompressedRowBatchSize: 232.48 KB (238062)
CodeGen:(Total: 935.062ms, non-child: 935.062ms, % non-child: 100.00%)
- CodegenTime: 7.678ms
- CompileTime: 259.095ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 142 (142)
- NumInstructions: 7.08K (7077)
- OptimizationTime: 640.706ms
- PeakMemoryUsage: 3.46 MB (3623424)
- PrepareTime: 34.466ms
AGGREGATION_NODE (id=11):(Total: 12s906ms, non-child: 79.948ms, % non-child: 0.62%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 77.107us
- GetResultsTime: 129.997us
- HTResizeTime: 0.000ns
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 7 (7)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 9.42 MB (9881298)
- PinTime: 0.000ns
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 2.09K (2094)
- RowsReturnedRate: 162.00 /sec
- StreamingTime: 75.016ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=10):(Total: 12s827ms, non-child: 342.423ms, % non-child: 2.67%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.05K (1048)
- BuildTime: 1.413ms
- PeakMemoryUsage: 1.21 MB (1273910)
- ProbeRows: 2.55M (2548865)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 332.448ms
- RowsReturned: 2.09K (2094)
- RowsReturnedRate: 163.00 /sec
Hash Join Builder (join_node_id=10):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- BuildRowsPartitionTime: 232.335us
- BuildRowsPartitioned: 1.05K (1048)
- GetNewBlockTime: 923.424us
- HashBuckets: 2.05K (2048)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 159.762us
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.06 MB (1111168)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=34):(Total: 2s060ms, non-child: 20.154ms, % non-child: 0.98%)
ExecOption: Codegen Enabled
- BuildTime: 9.958ms
- GetNewBlockTime: 227.629us
- GetResultsTime: 8.014ms
- HTResizeTime: 1.011ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 20.06 MB (21038543)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.05K (1048)
- RowsReturnedRate: 508.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 972.000ns
EXCHANGE_NODE (id=33):(Total: 2s040ms, non-child: 2.056ms, % non-child: 0.10%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 217.44 KB
- BytesReceived: 1.63 MB (1710714)
- ConvertRowBatchTime: 640.230us
- DeserializeRowBatchTimer: 5.694ms
- FirstBatchArrivalWaitTime: 1s985ms
- PeakMemoryUsage: 0
- RowsReturned: 30.40K (30397)
- RowsReturnedRate: 14.89 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=9):(Total: 12s484ms, non-child: 1s496ms, % non-child: 11.98%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 2.46M (2457221)
- BuildTime: 674.887ms
- PeakMemoryUsage: 457.17 MB (479379510)
- ProbeRows: 2.55M (2548865)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 804.670ms
- RowsReturned: 2.55M (2548865)
- RowsReturnedRate: 204.17 K/sec
Hash Join Builder (join_node_id=9):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 524.303ms
- BuildRowsPartitioned: 2.46M (2457221)
- GetNewBlockTime: 223.984us
- HashBuckets: 4.19M (4194304)
- HashCollisions: 1.31K (1308)
- HashTablesBuildTime: 131.465ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 457.03 MB (479229056)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=27):(Total: 10s009ms, non-child: 2s613ms, % non-child: 26.12%)
ExecOption: Codegen Enabled
- BuildTime: 2s042ms
- GetNewBlockTime: 805.026us
- GetResultsTime: 489.253ms
- HTResizeTime: 169.180ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 530.16 MB (555909662)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.46M (2457221)
- RowsReturnedRate: 245.49 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.008us
EXCHANGE_NODE (id=26):(Total: 7s395ms, non-child: 216.878ms, % non-child: 2.93%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.43 MB, 5.98 MB, 17.09 MB, 38.88 MB, 65.69 MB, 95.23 MB, 125.28 MB, 155.31 MB, 184.11 MB, 208.73 MB, 229.84 MB, 247.01 MB, 256.15 MB, 262.42 MB, 266.44 MB
- BytesReceived: 267.80 MB (280805267)
- ConvertRowBatchTime: 96.023ms
- DeserializeRowBatchTimer: 766.879ms
- FirstBatchArrivalWaitTime: 1s793ms
- PeakMemoryUsage: 0
- RowsReturned: 4.35M (4347516)
- RowsReturnedRate: 587.87 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=28):(Total: 7s821ms, non-child: 177.626ms, % non-child: 2.27%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.41 MB, 10.55 MB, 23.31 MB, 62.11 MB, 100.28 MB
- BytesReceived: 122.16 MB (128093107)
- ConvertRowBatchTime: 48.038ms
- DeserializeRowBatchTimer: 478.045ms
- FirstBatchArrivalWaitTime: 6s842ms
- PeakMemoryUsage: 0
- RowsReturned: 2.55M (2548865)
- RowsReturnedRate: 325.89 K/sec
- SendersBlockedTimer: 3s703ms
- SendersBlockedTotalTimer(*): 1m2s
Instance 514ee9ab39cdc507:80 (host=cdh12.net.cuberonlabs.com:22000):(Total: 13s868ms, non-child: 19.368ms, % non-child: 0.14%)
MemoryUsage(500.000ms): 25.48 MB, 22.03 MB, 22.06 MB, 22.06 MB, 22.06 MB, 25.52 MB, 64.15 MB, 94.73 MB, 144.49 MB, 205.61 MB, 288.81 MB, 323.73 MB, 367.61 MB, 408.87 MB, 453.61 MB, 482.15 MB, 527.98 MB, 549.92 MB, 552.98 MB, 555.91 MB, 557.98 MB, 550.86 MB, 518.25 MB, 452.91 MB, 496.85 MB, 493.95 MB, 497.06 MB, 498.27 MB
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.93
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 599.34 MB (628453865)
- PerHostPeakMemUsage: 1.12 GB (1201773720)
- RowsProduced: 2.19K (2186)
- TotalNetworkReceiveTime: 16s542ms
- TotalNetworkSendTime: 4.774ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 23 (23)
- TotalThreadsTotalWallClockTime: 26s928ms
- TotalThreadsSysTime: 528.000ms
- TotalThreadsUserTime: 5s816ms
- TotalThreadsVoluntaryContextSwitches: 7.45K (7453)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s888ms
- ExecTreeExecTime: 1s877ms
- OpenTime: 11s947ms
- ExecTreeOpenTime: 11s028ms
- PrepareTime: 33.110ms
- ExecTreePrepareTime: 1.588ms
DataStreamSender (dst_id=35):(Total: 2.630ms, non-child: 2.630ms, % non-child: 100.00%)
- BytesSent: 126.59 KB (129625)
- NetworkThroughput(*): 139.98 MB/sec
- OverallThroughput: 47.00 MB/sec
- PeakMemoryUsage: 312.36 KB (319856)
- RowsReturned: 2.19K (2186)
- SerializeBatchTime: 1.716ms
- TransmitDataRPCTime: 883.104us
- UncompressedRowBatchSize: 242.57 KB (248396)
CodeGen:(Total: 938.778ms, non-child: 938.778ms, % non-child: 100.00%)
- CodegenTime: 4.548ms
- CompileTime: 296.734ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 142 (142)
- NumInstructions: 7.08K (7077)
- OptimizationTime: 620.695ms
- PeakMemoryUsage: 3.46 MB (3623424)
- PrepareTime: 20.881ms
AGGREGATION_NODE (id=11):(Total: 12s907ms, non-child: 69.431ms, % non-child: 0.54%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 52.142us
- GetResultsTime: 162.524us
- HTResizeTime: 0.000ns
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 7 (7)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 9.41 MB (9862845)
- PinTime: 0.000ns
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 2.19K (2186)
- RowsReturnedRate: 169.00 /sec
- StreamingTime: 65.804ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=10):(Total: 12s838ms, non-child: 351.565ms, % non-child: 2.74%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.09K (1092)
- BuildTime: 625.825us
- PeakMemoryUsage: 1.22 MB (1277664)
- ProbeRows: 2.55M (2549251)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 343.088ms
- RowsReturned: 2.19K (2186)
- RowsReturnedRate: 170.00 /sec
Hash Join Builder (join_node_id=10):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- BuildRowsPartitionTime: 239.227us
- BuildRowsPartitioned: 1.09K (1092)
- GetNewBlockTime: 83.416us
- HashBuckets: 2.18K (2176)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 209.905us
- LargestPartitionPercent: 8 (8)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.06 MB (1113216)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=34):(Total: 2s065ms, non-child: 27.250ms, % non-child: 1.32%)
ExecOption: Codegen Enabled
- BuildTime: 11.425ms
- GetNewBlockTime: 164.961us
- GetResultsTime: 9.479ms
- HTResizeTime: 2.529ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 20.07 MB (21041169)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.09K (1092)
- RowsReturnedRate: 528.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 441.000ns
EXCHANGE_NODE (id=33):(Total: 2s038ms, non-child: 5.782ms, % non-child: 0.28%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0
- BytesReceived: 1.62 MB (1703730)
- ConvertRowBatchTime: 596.745us
- DeserializeRowBatchTimer: 9.345ms
- FirstBatchArrivalWaitTime: 1s992ms
- PeakMemoryUsage: 0
- RowsReturned: 30.27K (30272)
- RowsReturnedRate: 14.85 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=9):(Total: 12s486ms, non-child: 1s807ms, % non-child: 14.48%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 2.46M (2457325)
- BuildTime: 861.372ms
- PeakMemoryUsage: 457.17 MB (479379734)
- ProbeRows: 2.55M (2549251)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 927.097ms
- RowsReturned: 2.55M (2549251)
- RowsReturnedRate: 204.16 K/sec
Hash Join Builder (join_node_id=9):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 682.159ms
- BuildRowsPartitioned: 2.46M (2457325)
- GetNewBlockTime: 353.148us
- HashBuckets: 4.19M (4194304)
- HashCollisions: 1.45K (1447)
- HashTablesBuildTime: 157.639ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 457.03 MB (479229056)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=27):(Total: 10s164ms, non-child: 2s868ms, % non-child: 28.22%)
ExecOption: Codegen Enabled
- BuildTime: 2s141ms
- GetNewBlockTime: 487.600us
- GetResultsTime: 626.696ms
- HTResizeTime: 163.520ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 530.16 MB (555913420)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.46M (2457325)
- RowsReturnedRate: 241.75 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 505.000ns
EXCHANGE_NODE (id=26):(Total: 7s296ms, non-child: 207.746ms, % non-child: 2.85%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 686.04 KB, 4.57 MB, 12.89 MB, 32.67 MB, 58.98 MB, 88.31 MB, 118.64 MB, 148.74 MB, 177.94 MB, 203.60 MB, 225.50 MB, 243.69 MB, 254.67 MB, 261.28 MB, 265.61 MB, 267.70 MB
- BytesReceived: 267.81 MB (280820208)
- ConvertRowBatchTime: 91.598ms
- DeserializeRowBatchTimer: 796.908ms
- FirstBatchArrivalWaitTime: 1s796ms
- PeakMemoryUsage: 0
- RowsReturned: 4.35M (4350242)
- RowsReturnedRate: 596.20 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=28):(Total: 7s362ms, non-child: 146.639ms, % non-child: 1.99%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.40 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.42 MB, 13.56 MB, 52.71 MB, 90.55 MB, 122.10 MB
- BytesReceived: 122.12 MB (128047318)
- ConvertRowBatchTime: 48.066ms
- DeserializeRowBatchTimer: 464.441ms
- FirstBatchArrivalWaitTime: 6s849ms
- PeakMemoryUsage: 0
- RowsReturned: 2.55M (2549251)
- RowsReturnedRate: 346.23 K/sec
- SendersBlockedTimer: 4s041ms
- SendersBlockedTotalTimer(*): 1m4s
Instance 514ee9ab39cdc507:83 (host=cdh5.net.cuberonlabs.com:22000):(Total: 13s867ms, non-child: 21.241ms, % non-child: 0.15%)
MemoryUsage(500.000ms): 25.48 MB, 22.03 MB, 22.06 MB, 22.06 MB, 22.06 MB, 34.02 MB, 64.45 MB, 106.20 MB, 145.85 MB, 206.91 MB, 289.61 MB, 333.67 MB, 370.19 MB, 417.61 MB, 455.60 MB, 495.51 MB, 535.94 MB, 550.95 MB, 555.07 MB, 556.00 MB, 557.88 MB, 534.58 MB, 469.61 MB, 492.11 MB, 492.89 MB, 499.20 MB, 494.30 MB
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.93
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 599.31 MB (628417860)
- PerHostPeakMemUsage: 2.15 GB (2303708143)
- RowsProduced: 2.07K (2073)
- TotalNetworkReceiveTime: 17s343ms
- TotalNetworkSendTime: 5.401ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 23 (23)
- TotalThreadsTotalWallClockTime: 26s575ms
- TotalThreadsSysTime: 572.000ms
- TotalThreadsUserTime: 4s956ms
- TotalThreadsVoluntaryContextSwitches: 8.26K (8258)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s255ms
- ExecTreeExecTime: 2s243ms
- OpenTime: 11s574ms
- ExecTreeOpenTime: 10s673ms
- PrepareTime: 37.732ms
- ExecTreePrepareTime: 2.167ms
DataStreamSender (dst_id=35):(Total: 2.608ms, non-child: 2.608ms, % non-child: 100.00%)
- BytesSent: 120.24 KB (123124)
- NetworkThroughput(*): 155.51 MB/sec
- OverallThroughput: 45.02 MB/sec
- PeakMemoryUsage: 268.36 KB (274800)
- RowsReturned: 2.07K (2073)
- SerializeBatchTime: 1.784ms
- TransmitDataRPCTime: 755.080us
- UncompressedRowBatchSize: 230.03 KB (235555)
CodeGen:(Total: 923.949ms, non-child: 923.949ms, % non-child: 100.00%)
- CodegenTime: 4.665ms
- CompileTime: 291.484ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 142 (142)
- NumInstructions: 7.08K (7077)
- OptimizationTime: 608.204ms
- PeakMemoryUsage: 3.46 MB (3623424)
- PrepareTime: 23.759ms
AGGREGATION_NODE (id=11):(Total: 12s919ms, non-child: 71.566ms, % non-child: 0.55%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 72.848us
- GetResultsTime: 145.432us
- HTResizeTime: 0.000ns
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 6 (6)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 9.41 MB (9868017)
- PinTime: 0.000ns
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 2.07K (2073)
- RowsReturnedRate: 160.00 /sec
- StreamingTime: 69.080ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=10):(Total: 12s848ms, non-child: 356.252ms, % non-child: 2.77%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.04K (1036)
- BuildTime: 369.836us
- PeakMemoryUsage: 1.21 MB (1273570)
- ProbeRows: 2.55M (2549973)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 346.939ms
- RowsReturned: 2.07K (2073)
- RowsReturnedRate: 161.00 /sec
Hash Join Builder (join_node_id=10):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- BuildRowsPartitionTime: 136.252us
- BuildRowsPartitioned: 1.04K (1036)
- GetNewBlockTime: 67.288us
- HashBuckets: 2.05K (2048)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 108.652us
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.06 MB (1111168)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=34):(Total: 2s073ms, non-child: 24.719ms, % non-child: 1.19%)
ExecOption: Codegen Enabled
- BuildTime: 16.440ms
- GetNewBlockTime: 2.436ms
- GetResultsTime: 6.133ms
- HTResizeTime: 5.761ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 20.06 MB (21034997)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.04K (1036)
- RowsReturnedRate: 499.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.004us
EXCHANGE_NODE (id=33):(Total: 2s048ms, non-child: 1.737ms, % non-child: 0.08%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0
- BytesReceived: 1.64 MB (1719100)
- ConvertRowBatchTime: 585.116us
- DeserializeRowBatchTimer: 8.125ms
- FirstBatchArrivalWaitTime: 2s005ms
- PeakMemoryUsage: 0
- RowsReturned: 30.56K (30557)
- RowsReturnedRate: 14.91 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=9):(Total: 12s491ms, non-child: 1s530ms, % non-child: 12.25%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 2.46M (2457678)
- BuildTime: 687.007ms
- PeakMemoryUsage: 457.17 MB (479379170)
- ProbeRows: 2.55M (2549973)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 824.659ms
- RowsReturned: 2.55M (2549973)
- RowsReturnedRate: 204.14 K/sec
Hash Join Builder (join_node_id=9):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 535.131ms
- BuildRowsPartitioned: 2.46M (2457678)
- GetNewBlockTime: 214.616us
- HashBuckets: 4.19M (4194304)
- HashCollisions: 1.45K (1452)
- HashTablesBuildTime: 131.859ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 457.03 MB (479229056)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=27):(Total: 9s984ms, non-child: 2s382ms, % non-child: 23.86%)
ExecOption: Codegen Enabled
- BuildTime: 1s851ms
- GetNewBlockTime: 965.408us
- GetResultsTime: 451.765ms
- HTResizeTime: 160.273ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 530.16 MB (555908250)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.46M (2457678)
- RowsReturnedRate: 246.15 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.020us
EXCHANGE_NODE (id=26):(Total: 7s602ms, non-child: 189.640ms, % non-child: 2.49%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 996.99 KB, 5.06 MB, 14.12 MB, 34.63 MB, 61.09 MB, 90.02 MB, 120.66 MB, 150.80 MB, 179.96 MB, 205.18 MB, 227.17 MB, 245.10 MB, 255.53 MB, 262.01 MB, 266.25 MB, 268.10 MB
- BytesReceived: 268.12 MB (281145244)
- ConvertRowBatchTime: 81.700ms
- DeserializeRowBatchTimer: 720.942ms
- FirstBatchArrivalWaitTime: 1s811ms
- PeakMemoryUsage: 0
- RowsReturned: 4.35M (4354770)
- RowsReturnedRate: 572.81 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=28):(Total: 7s837ms, non-child: 154.478ms, % non-child: 1.97%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.92 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.56 MB, 16.20 MB, 56.11 MB, 93.93 MB
- BytesReceived: 122.17 MB (128102898)
- ConvertRowBatchTime: 47.284ms
- DeserializeRowBatchTimer: 487.288ms
- FirstBatchArrivalWaitTime: 6s861ms
- PeakMemoryUsage: 0
- RowsReturned: 2.55M (2549973)
- RowsReturnedRate: 325.35 K/sec
- SendersBlockedTimer: 3s671ms
- SendersBlockedTotalTimer(*): 55s016ms
Instance 514ee9ab39cdc507:7c (host=cdh15.net.cuberonlabs.com:22000):(Total: 13s866ms, non-child: 28.888ms, % non-child: 0.21%)
MemoryUsage(500.000ms): 22.03 MB, 25.48 MB, 22.06 MB, 22.06 MB, 22.06 MB, 22.06 MB, 43.98 MB, 69.98 MB, 123.58 MB, 178.00 MB, 251.92 MB, 307.10 MB, 349.60 MB, 392.73 MB, 429.60 MB, 467.73 MB, 518.03 MB, 547.04 MB, 551.97 MB, 554.97 MB, 556.97 MB, 575.21 MB, 526.48 MB, 485.76 MB, 492.22 MB, 493.70 MB, 497.62 MB, 492.20 MB
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.93
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 599.33 MB (628444782)
- PerHostPeakMemUsage: 1.57 GB (1688553772)
- RowsProduced: 2.09K (2094)
- TotalNetworkReceiveTime: 16s748ms
- TotalNetworkSendTime: 5.074ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 14 (14)
- TotalThreadsTotalWallClockTime: 26s713ms
- TotalThreadsSysTime: 480.000ms
- TotalThreadsUserTime: 5s536ms
- TotalThreadsVoluntaryContextSwitches: 7.85K (7847)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s017ms
- ExecTreeExecTime: 2s006ms
- OpenTime: 11s791ms
- ExecTreeOpenTime: 10s873ms
- PrepareTime: 58.206ms
- ExecTreePrepareTime: 2.242ms
DataStreamSender (dst_id=35):(Total: 2.759ms, non-child: 2.759ms, % non-child: 100.00%)
- BytesSent: 121.07 KB (123973)
- NetworkThroughput(*): 150.97 MB/sec
- OverallThroughput: 42.84 MB/sec
- PeakMemoryUsage: 300.36 KB (307568)
- RowsReturned: 2.09K (2094)
- SerializeBatchTime: 1.931ms
- TransmitDataRPCTime: 783.128us
- UncompressedRowBatchSize: 232.48 KB (238056)
CodeGen:(Total: 953.009ms, non-child: 953.009ms, % non-child: 100.00%)
- CodegenTime: 8.333ms
- CompileTime: 272.713ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 142 (142)
- NumInstructions: 7.08K (7077)
- OptimizationTime: 643.108ms
- PeakMemoryUsage: 3.46 MB (3623424)
- PrepareTime: 36.332ms
AGGREGATION_NODE (id=11):(Total: 12s882ms, non-child: 67.898ms, % non-child: 0.53%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 81.204us
- GetResultsTime: 163.828us
- HTResizeTime: 0.000ns
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 7 (7)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 9.43 MB (9890721)
- PinTime: 0.000ns
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 2.09K (2094)
- RowsReturnedRate: 162.00 /sec
- StreamingTime: 64.761ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=10):(Total: 12s814ms, non-child: 345.785ms, % non-child: 2.70%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.05K (1047)
- BuildTime: 552.359us
- PeakMemoryUsage: 1.25 MB (1310297)
- ProbeRows: 2.55M (2545548)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 336.867ms
- RowsReturned: 2.09K (2094)
- RowsReturnedRate: 163.00 /sec
Hash Join Builder (join_node_id=10):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- BuildRowsPartitionTime: 184.494us
- BuildRowsPartitioned: 1.05K (1047)
- GetNewBlockTime: 60.860us
- HashBuckets: 2.05K (2048)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 233.097us
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.06 MB (1111168)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=34):(Total: 2s031ms, non-child: 22.230ms, % non-child: 1.09%)
ExecOption: Codegen Enabled
- BuildTime: 11.686ms
- GetNewBlockTime: 1.065ms
- GetResultsTime: 8.183ms
- HTResizeTime: 1.129ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 20.06 MB (21039609)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.05K (1047)
- RowsReturnedRate: 515.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 978.000ns
EXCHANGE_NODE (id=33):(Total: 2s009ms, non-child: 1.858ms, % non-child: 0.09%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0
- BytesReceived: 1.64 MB (1720365)
- ConvertRowBatchTime: 600.698us
- DeserializeRowBatchTimer: 5.615ms
- FirstBatchArrivalWaitTime: 1s967ms
- PeakMemoryUsage: 0
- RowsReturned: 30.58K (30583)
- RowsReturnedRate: 15.22 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=9):(Total: 12s467ms, non-child: 1s749ms, % non-child: 14.03%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 2.45M (2453766)
- BuildTime: 820.989ms
- PeakMemoryUsage: 457.17 MB (479379261)
- ProbeRows: 2.55M (2545549)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 908.479ms
- RowsReturned: 2.55M (2545548)
- RowsReturnedRate: 204.17 K/sec
Hash Join Builder (join_node_id=9):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 667.101ms
- BuildRowsPartitioned: 2.45M (2453766)
- GetNewBlockTime: 248.424us
- HashBuckets: 4.19M (4194304)
- HashCollisions: 1.44K (1439)
- HashTablesBuildTime: 133.855ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 457.03 MB (479229056)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=27):(Total: 10s050ms, non-child: 2s653ms, % non-child: 26.40%)
ExecOption: Codegen Enabled
- BuildTime: 2s016ms
- GetNewBlockTime: 568.576us
- GetResultsTime: 560.883ms
- HTResizeTime: 155.158ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 530.12 MB (555876161)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.45M (2453766)
- RowsReturnedRate: 244.15 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.032us
EXCHANGE_NODE (id=26):(Total: 7s396ms, non-child: 195.902ms, % non-child: 2.65%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.25 MB, 7.35 MB, 20.71 MB, 44.38 MB, 71.61 MB, 102.12 MB, 132.29 MB, 162.17 MB, 190.06 MB, 214.00 MB, 234.44 MB, 250.01 MB, 257.92 MB, 263.57 MB, 266.99 MB
- BytesReceived: 268.01 MB (281026310)
- ConvertRowBatchTime: 89.516ms
- DeserializeRowBatchTimer: 797.379ms
- FirstBatchArrivalWaitTime: 1s775ms
- PeakMemoryUsage: 0
- RowsReturned: 4.35M (4349728)
- RowsReturnedRate: 588.07 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=28):(Total: 7s494ms, non-child: 129.272ms, % non-child: 1.72%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.35 MB, 10.64 MB, 32.00 MB, 70.37 MB, 108.03 MB
- BytesReceived: 122.01 MB (127934534)
- ConvertRowBatchTime: 46.915ms
- DeserializeRowBatchTimer: 441.577ms
- FirstBatchArrivalWaitTime: 6s826ms
- PeakMemoryUsage: 0
- RowsReturned: 2.55M (2545549)
- RowsReturnedRate: 339.65 K/sec
- SendersBlockedTimer: 3s908ms
- SendersBlockedTotalTimer(*): 55s331ms
Instance 514ee9ab39cdc507:7b (host=cdh6.net.cuberonlabs.com:22000):(Total: 13s865ms, non-child: 27.117ms, % non-child: 0.20%)
MemoryUsage(500.000ms): 25.48 MB, 25.48 MB, 22.06 MB, 22.06 MB, 22.06 MB, 22.06 MB, 45.37 MB, 81.00 MB, 127.18 MB, 179.11 MB, 266.67 MB, 312.73 MB, 357.20 MB, 396.80 MB, 440.27 MB, 469.73 MB, 522.10 MB, 546.97 MB, 552.04 MB, 555.97 MB, 556.91 MB, 567.09 MB, 518.36 MB, 469.64 MB, 492.22 MB, 492.28 MB, 496.13 MB, 500.02 MB
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.93
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 599.33 MB (628446184)
- PerHostPeakMemUsage: 1.67 GB (1794839264)
- RowsProduced: 2.05K (2053)
- TotalNetworkReceiveTime: 16s761ms
- TotalNetworkSendTime: 4.961ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 23 (23)
- TotalThreadsTotalWallClockTime: 26s744ms
- TotalThreadsSysTime: 452.000ms
- TotalThreadsUserTime: 5s536ms
- TotalThreadsVoluntaryContextSwitches: 8.11K (8106)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s955ms
- ExecTreeExecTime: 1s945ms
- OpenTime: 11s854ms
- ExecTreeOpenTime: 10s918ms
- PrepareTime: 55.408ms
- ExecTreePrepareTime: 1.913ms
DataStreamSender (dst_id=35):(Total: 2.608ms, non-child: 2.608ms, % non-child: 100.00%)
- BytesSent: 118.70 KB (121546)
- NetworkThroughput(*): 149.80 MB/sec
- OverallThroughput: 44.44 MB/sec
- PeakMemoryUsage: 300.36 KB (307568)
- RowsReturned: 2.05K (2053)
- SerializeBatchTime: 1.788ms
- TransmitDataRPCTime: 773.776us
- UncompressedRowBatchSize: 227.70 KB (233163)
CodeGen:(Total: 970.174ms, non-child: 970.174ms, % non-child: 100.00%)
- CodegenTime: 7.585ms
- CompileTime: 260.359ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 142 (142)
- NumInstructions: 7.08K (7077)
- OptimizationTime: 673.860ms
- PeakMemoryUsage: 3.46 MB (3623424)
- PrepareTime: 35.151ms
AGGREGATION_NODE (id=11):(Total: 12s865ms, non-child: 63.641ms, % non-child: 0.49%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 77.692us
- GetResultsTime: 161.224us
- HTResizeTime: 0.000ns
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 7 (7)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 9.41 MB (9869973)
- PinTime: 0.000ns
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 2.05K (2053)
- RowsReturnedRate: 159.00 /sec
- StreamingTime: 60.294ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=10):(Total: 12s802ms, non-child: 330.547ms, % non-child: 2.58%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.03K (1027)
- BuildTime: 764.052us
- PeakMemoryUsage: 1.25 MB (1310260)
- ProbeRows: 2.55M (2549383)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 321.238ms
- RowsReturned: 2.05K (2053)
- RowsReturnedRate: 160.00 /sec
Hash Join Builder (join_node_id=10):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- BuildRowsPartitionTime: 404.704us
- BuildRowsPartitioned: 1.03K (1027)
- GetNewBlockTime: 105.108us
- HashBuckets: 2.05K (2048)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 157.400us
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.06 MB (1111168)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=34):(Total: 2s016ms, non-child: 22.717ms, % non-child: 1.13%)
ExecOption: Codegen Enabled
- BuildTime: 12.190ms
- GetNewBlockTime: 180.956us
- GetResultsTime: 8.220ms
- HTResizeTime: 1.248ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 20.06 MB (21035388)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.03K (1027)
- RowsReturnedRate: 509.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 948.000ns
EXCHANGE_NODE (id=33):(Total: 1s993ms, non-child: 2.019ms, % non-child: 0.10%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0
- BytesReceived: 1.63 MB (1707637)
- ConvertRowBatchTime: 756.240us
- DeserializeRowBatchTimer: 5.908ms
- FirstBatchArrivalWaitTime: 1s952ms
- PeakMemoryUsage: 0
- RowsReturned: 30.35K (30348)
- RowsReturnedRate: 15.22 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=9):(Total: 12s471ms, non-child: 1s651ms, % non-child: 13.24%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 2.46M (2458183)
- BuildTime: 768.362ms
- PeakMemoryUsage: 457.17 MB (479380600)
- ProbeRows: 2.55M (2549383)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 864.032ms
- RowsReturned: 2.55M (2549383)
- RowsReturnedRate: 204.42 K/sec
Hash Join Builder (join_node_id=9):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 592.109ms
- BuildRowsPartitioned: 2.46M (2458183)
- GetNewBlockTime: 252.924us
- HashBuckets: 4.19M (4194304)
- HashCollisions: 1.35K (1349)
- HashTablesBuildTime: 156.327ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 457.03 MB (479229056)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=27):(Total: 10s148ms, non-child: 2s714ms, % non-child: 26.75%)
ExecOption: Codegen Enabled
- BuildTime: 1s963ms
- GetNewBlockTime: 1.182ms
- GetResultsTime: 658.587ms
- HTResizeTime: 154.319ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 530.10 MB (555847584)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.46M (2458183)
- RowsReturnedRate: 242.23 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.004us
EXCHANGE_NODE (id=26):(Total: 7s433ms, non-child: 187.637ms, % non-child: 2.52%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.72 MB, 8.37 MB, 22.90 MB, 47.88 MB, 75.12 MB, 105.39 MB, 136.07 MB, 165.49 MB, 192.56 MB, 216.05 MB, 236.27 MB, 250.90 MB, 258.55 MB, 263.95 MB, 267.15 MB
- BytesReceived: 267.89 MB (280906071)
- ConvertRowBatchTime: 88.572ms
- DeserializeRowBatchTimer: 731.500ms
- FirstBatchArrivalWaitTime: 1s761ms
- PeakMemoryUsage: 0
- RowsReturned: 4.35M (4348148)
- RowsReturnedRate: 584.95 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=28):(Total: 7s482ms, non-child: 123.805ms, % non-child: 1.65%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.60 MB, 36.20 MB, 74.59 MB, 112.87 MB
- BytesReceived: 122.12 MB (128057344)
- ConvertRowBatchTime: 43.406ms
- DeserializeRowBatchTimer: 436.316ms
- FirstBatchArrivalWaitTime: 6s810ms
- PeakMemoryUsage: 0
- RowsReturned: 2.55M (2549383)
- RowsReturnedRate: 340.69 K/sec
- SendersBlockedTimer: 3s968ms
- SendersBlockedTotalTimer(*): 56s263ms
Instance 514ee9ab39cdc507:78 (host=cdh4.net.cuberonlabs.com:22000):(Total: 13s865ms, non-child: 27.196ms, % non-child: 0.20%)
MemoryUsage(500.000ms): 25.48 MB, 25.48 MB, 22.06 MB, 22.06 MB, 22.06 MB, 22.20 MB, 55.40 MB, 93.08 MB, 133.36 MB, 202.74 MB, 274.80 MB, 321.67 MB, 363.67 MB, 406.80 MB, 444.74 MB, 477.80 MB, 526.97 MB, 548.91 MB, 551.97 MB, 555.97 MB, 557.97 MB, 542.73 MB, 501.88 MB, 491.99 MB, 492.21 MB, 494.58 MB, 497.64 MB, 497.25 MB
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.89
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 599.33 MB (628445051)
- PerHostPeakMemUsage: 2.13 GB (2284202661)
- RowsProduced: 2.16K (2163)
- TotalNetworkReceiveTime: 16s767ms
- TotalNetworkSendTime: 6.691ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 25 (25)
- TotalThreadsTotalWallClockTime: 26s257ms
- TotalThreadsSysTime: 592.000ms
- TotalThreadsUserTime: 5s260ms
- TotalThreadsVoluntaryContextSwitches: 7.47K (7467)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s284ms
- ExecTreeExecTime: 2s271ms
- OpenTime: 11s528ms
- ExecTreeOpenTime: 10s511ms
- PrepareTime: 53.296ms
- ExecTreePrepareTime: 2.176ms
DataStreamSender (dst_id=35):(Total: 3.960ms, non-child: 3.960ms, % non-child: 100.00%)
- BytesSent: 125.57 KB (128585)
- NetworkThroughput(*): 54.83 MB/sec
- OverallThroughput: 30.96 MB/sec
- PeakMemoryUsage: 316.36 KB (323952)
- RowsReturned: 2.16K (2163)
- SerializeBatchTime: 1.682ms
- TransmitDataRPCTime: 2.236ms
- UncompressedRowBatchSize: 240.04 KB (245798)
CodeGen:(Total: 1s049ms, non-child: 1s049ms, % non-child: 100.00%)
- CodegenTime: 7.265ms
- CompileTime: 292.919ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 142 (142)
- NumInstructions: 7.08K (7077)
- OptimizationTime: 722.168ms
- PeakMemoryUsage: 3.46 MB (3623424)
- PrepareTime: 33.722ms
AGGREGATION_NODE (id=11):(Total: 12s784ms, non-child: 80.600ms, % non-child: 0.63%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 76.820us
- GetResultsTime: 159.344us
- HTResizeTime: 0.000ns
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 6 (6)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 9.42 MB (9878493)
- PinTime: 0.000ns
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 2.16K (2163)
- RowsReturnedRate: 169.00 /sec
- StreamingTime: 76.608ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=10):(Total: 12s704ms, non-child: 363.359ms, % non-child: 2.86%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.08K (1081)
- BuildTime: 455.708us
- PeakMemoryUsage: 1.24 MB (1300947)
- ProbeRows: 2.55M (2551133)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 353.774ms
- RowsReturned: 2.16K (2163)
- RowsReturnedRate: 170.00 /sec
Hash Join Builder (join_node_id=10):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- BuildRowsPartitionTime: 189.520us
- BuildRowsPartitioned: 1.08K (1081)
- GetNewBlockTime: 43.268us
- HashBuckets: 2.18K (2176)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 155.952us
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.06 MB (1113216)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=34):(Total: 1s935ms, non-child: 21.425ms, % non-child: 1.11%)
ExecOption: Codegen Enabled
- BuildTime: 10.187ms
- GetNewBlockTime: 223.688us
- GetResultsTime: 8.643ms
- HTResizeTime: 919.172us
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 20.08 MB (21050280)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.08K (1081)
- RowsReturnedRate: 558.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 964.000ns
EXCHANGE_NODE (id=33):(Total: 1s913ms, non-child: 1.857ms, % non-child: 0.10%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0
- BytesReceived: 1.64 MB (1724541)
- ConvertRowBatchTime: 715.220us
- DeserializeRowBatchTimer: 8.704ms
- FirstBatchArrivalWaitTime: 1s876ms
- PeakMemoryUsage: 0
- RowsReturned: 30.63K (30633)
- RowsReturnedRate: 16.01 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=9):(Total: 12s340ms, non-child: 1s548ms, % non-child: 12.55%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 2.46M (2458732)
- BuildTime: 679.854ms
- PeakMemoryUsage: 457.17 MB (479380240)
- ProbeRows: 2.55M (2551133)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 851.796ms
- RowsReturned: 2.55M (2551133)
- RowsReturnedRate: 206.73 K/sec
Hash Join Builder (join_node_id=9):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 527.995ms
- BuildRowsPartitioned: 2.46M (2458732)
- GetNewBlockTime: 224.384us
- HashBuckets: 4.19M (4194304)
- HashCollisions: 1.36K (1363)
- HashTablesBuildTime: 131.905ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 457.03 MB (479229056)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=27):(Total: 9s829ms, non-child: 2s507ms, % non-child: 25.51%)
ExecOption: Codegen Enabled
- BuildTime: 1s993ms
- GetNewBlockTime: 1.693ms
- GetResultsTime: 443.601ms
- HTResizeTime: 172.432ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 530.10 MB (555853396)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.46M (2458732)
- RowsReturnedRate: 250.14 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.032us
EXCHANGE_NODE (id=26):(Total: 7s321ms, non-child: 222.558ms, % non-child: 3.04%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 63.44 KB, 3.96 MB, 11.53 MB, 29.45 MB, 55.45 MB, 84.40 MB, 114.35 MB, 144.96 MB, 174.75 MB, 201.19 MB, 223.51 MB, 242.28 MB, 254.39 MB, 261.23 MB, 265.89 MB, 268.42 MB
- BytesReceived: 268.72 MB (281777063)
- ConvertRowBatchTime: 94.226ms
- DeserializeRowBatchTimer: 772.667ms
- FirstBatchArrivalWaitTime: 1s682ms
- PeakMemoryUsage: 0
- RowsReturned: 4.36M (4361857)
- RowsReturnedRate: 595.75 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=28):(Total: 7s694ms, non-child: 162.326ms, % non-child: 2.11%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.42 MB, 10.49 MB, 10.63 MB, 48.02 MB, 85.92 MB, 121.46 MB
- BytesReceived: 122.26 MB (128196375)
- ConvertRowBatchTime: 48.651ms
- DeserializeRowBatchTimer: 476.452ms
- FirstBatchArrivalWaitTime: 6s732ms
- PeakMemoryUsage: 0
- RowsReturned: 2.55M (2551133)
- RowsReturnedRate: 331.56 K/sec
- SendersBlockedTimer: 3s640ms
- SendersBlockedTotalTimer(*): 1m1s
Instance 514ee9ab39cdc507:7f (host=cdh2.net.cuberonlabs.com:22000):(Total: 13s865ms, non-child: 27.345ms, % non-child: 0.20%)
MemoryUsage(500.000ms): 25.48 MB, 25.48 MB, 22.06 MB, 22.06 MB, 22.06 MB, 22.06 MB, 45.46 MB, 81.03 MB, 127.23 MB, 179.85 MB, 265.67 MB, 316.93 MB, 356.33 MB, 396.73 MB, 433.80 MB, 471.00 MB, 519.95 MB, 546.89 MB, 552.01 MB, 554.95 MB, 556.95 MB, 575.07 MB, 510.10 MB, 508.76 MB, 492.07 MB, 492.38 MB, 496.58 MB, 492.26 MB
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.89
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 599.31 MB (628424536)
- PerHostPeakMemUsage: 1.74 GB (1866918022)
- RowsProduced: 2.01K (2008)
- TotalNetworkReceiveTime: 17s177ms
- TotalNetworkSendTime: 4.342ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 40 (40)
- TotalThreadsTotalWallClockTime: 26s468ms
- TotalThreadsSysTime: 536.000ms
- TotalThreadsUserTime: 5s128ms
- TotalThreadsVoluntaryContextSwitches: 7.84K (7845)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s294ms
- ExecTreeExecTime: 2s283ms
- OpenTime: 11s514ms
- ExecTreeOpenTime: 10s611ms
- PrepareTime: 56.262ms
- ExecTreePrepareTime: 2.220ms
DataStreamSender (dst_id=35):(Total: 2.390ms, non-child: 2.390ms, % non-child: 100.00%)
- BytesSent: 116.46 KB (119259)
- NetworkThroughput(*): 183.00 MB/sec
- OverallThroughput: 47.58 MB/sec
- PeakMemoryUsage: 256.36 KB (262512)
- RowsReturned: 2.01K (2008)
- SerializeBatchTime: 1.723ms
- TransmitDataRPCTime: 621.508us
- UncompressedRowBatchSize: 222.91 KB (228262)
CodeGen:(Total: 938.516ms, non-child: 938.516ms, % non-child: 100.00%)
- CodegenTime: 7.644ms
- CompileTime: 257.087ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 142 (142)
- NumInstructions: 7.08K (7077)
- OptimizationTime: 644.413ms
- PeakMemoryUsage: 3.46 MB (3623424)
- PrepareTime: 36.227ms
AGGREGATION_NODE (id=11):(Total: 12s896ms, non-child: 70.683ms, % non-child: 0.55%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 66.372us
- GetResultsTime: 180.968us
- HTResizeTime: 0.000ns
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 7 (7)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 9.42 MB (9876237)
- PinTime: 0.000ns
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 2.01K (2008)
- RowsReturnedRate: 155.00 /sec
- StreamingTime: 67.650ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=10):(Total: 12s826ms, non-child: 377.603ms, % non-child: 2.94%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.00K (1003)
- BuildTime: 448.568us
- PeakMemoryUsage: 1.25 MB (1311792)
- ProbeRows: 2.55M (2548486)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 366.772ms
- RowsReturned: 2.01K (2008)
- RowsReturnedRate: 156.00 /sec
Hash Join Builder (join_node_id=10):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- BuildRowsPartitionTime: 168.164us
- BuildRowsPartitioned: 1.00K (1003)
- GetNewBlockTime: 64.331us
- HashBuckets: 2.05K (2048)
- HashCollisions: 2 (2)
- HashTablesBuildTime: 147.156us
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.06 MB (1111168)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=34):(Total: 2s050ms, non-child: 20.484ms, % non-child: 1.00%)
ExecOption: Codegen Enabled
- BuildTime: 11.236ms
- GetNewBlockTime: 235.232us
- GetResultsTime: 7.089ms
- HTResizeTime: 943.804us
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 20.05 MB (21027602)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.00K (1003)
- RowsReturnedRate: 489.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.040us
EXCHANGE_NODE (id=33):(Total: 2s029ms, non-child: 1.920ms, % non-child: 0.09%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0
- BytesReceived: 1.64 MB (1717014)
- ConvertRowBatchTime: 690.552us
- DeserializeRowBatchTimer: 5.847ms
- FirstBatchArrivalWaitTime: 1s984ms
- PeakMemoryUsage: 0
- RowsReturned: 30.51K (30514)
- RowsReturnedRate: 15.03 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=9):(Total: 12s447ms, non-child: 1s524ms, % non-child: 12.24%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 2.46M (2456009)
- BuildTime: 665.258ms
- PeakMemoryUsage: 457.17 MB (479379789)
- ProbeRows: 2.55M (2548486)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 840.595ms
- RowsReturned: 2.55M (2548486)
- RowsReturnedRate: 204.73 K/sec
Hash Join Builder (join_node_id=9):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 510.127ms
- BuildRowsPartitioned: 2.46M (2456009)
- GetNewBlockTime: 214.024us
- HashBuckets: 4.19M (4194304)
- HashCollisions: 1.41K (1410)
- HashTablesBuildTime: 136.052ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 457.03 MB (479229056)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=27):(Total: 9s943ms, non-child: 2s456ms, % non-child: 24.70%)
ExecOption: Codegen Enabled
- BuildTime: 1s941ms
- GetNewBlockTime: 667.948us
- GetResultsTime: 442.045ms
- HTResizeTime: 173.507ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 530.10 MB (555846876)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.46M (2456009)
- RowsReturnedRate: 247.00 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.104us
EXCHANGE_NODE (id=26):(Total: 7s487ms, non-child: 205.633ms, % non-child: 2.75%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.77 MB, 8.54 MB, 23.04 MB, 48.14 MB, 75.44 MB, 105.71 MB, 136.44 MB, 165.82 MB, 193.03 MB, 216.39 MB, 236.67 MB, 251.26 MB, 258.81 MB, 264.18 MB, 267.39 MB
- BytesReceived: 268.12 MB (281144206)
- ConvertRowBatchTime: 91.322ms
- DeserializeRowBatchTimer: 754.514ms
- FirstBatchArrivalWaitTime: 1s789ms
- PeakMemoryUsage: 0
- RowsReturned: 4.35M (4353561)
- RowsReturnedRate: 581.47 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=28):(Total: 7s820ms, non-child: 154.210ms, % non-child: 1.97%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.36 MB, 10.53 MB, 36.35 MB, 74.86 MB, 113.07 MB
- BytesReceived: 122.12 MB (128053775)
- ConvertRowBatchTime: 50.666ms
- DeserializeRowBatchTimer: 486.582ms
- FirstBatchArrivalWaitTime: 6s839ms
- PeakMemoryUsage: 0
- RowsReturned: 2.55M (2548486)
- RowsReturnedRate: 325.88 K/sec
- SendersBlockedTimer: 3s628ms
- SendersBlockedTotalTimer(*): 50s752ms
Instance 514ee9ab39cdc507:81 (host=cdh14.net.cuberonlabs.com:22000):(Total: 13s864ms, non-child: 26.592ms, % non-child: 0.19%)
MemoryUsage(500.000ms): 25.48 MB, 22.03 MB, 22.06 MB, 22.06 MB, 22.06 MB, 33.77 MB, 64.40 MB, 105.17 MB, 145.85 MB, 206.92 MB, 289.67 MB, 333.60 MB, 377.61 MB, 416.74 MB, 455.67 MB, 494.96 MB, 536.01 MB, 550.95 MB, 552.88 MB, 555.95 MB, 557.88 MB, 542.70 MB, 493.98 MB, 500.88 MB, 492.46 MB, 498.66 MB, 493.68 MB
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1
- AverageThreadTokens: 1.96
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 599.31 MB (628421213)
- PerHostPeakMemUsage: 1.44 GB (1548652528)
- RowsProduced: 2.19K (2191)
- TotalNetworkReceiveTime: 17s247ms
- TotalNetworkSendTime: 4.728ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 18 (18)
- TotalThreadsTotalWallClockTime: 26s922ms
- TotalThreadsSysTime: 396.000ms
- TotalThreadsUserTime: 5s296ms
- TotalThreadsVoluntaryContextSwitches: 8.18K (8178)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s974ms
- ExecTreeExecTime: 1s963ms
- OpenTime: 11s834ms
- ExecTreeOpenTime: 10s995ms
- PrepareTime: 54.882ms
- ExecTreePrepareTime: 2.340ms
DataStreamSender (dst_id=35):(Total: 2.232ms, non-child: 2.232ms, % non-child: 100.00%)
- BytesSent: 126.76 KB (129807)
- NetworkThroughput(*): 262.98 MB/sec
- OverallThroughput: 55.46 MB/sec
- PeakMemoryUsage: 324.36 KB (332144)
- RowsReturned: 2.19K (2191)
- SerializeBatchTime: 1.710ms
- TransmitDataRPCTime: 470.730us
- UncompressedRowBatchSize: 243.13 KB (248964)
CodeGen:(Total: 873.970ms, non-child: 873.970ms, % non-child: 100.00%)
- CodegenTime: 7.510ms
- CompileTime: 254.196ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 142 (142)
- NumInstructions: 7.08K (7077)
- OptimizationTime: 583.487ms
- PeakMemoryUsage: 3.46 MB (3623424)
- PrepareTime: 35.522ms
AGGREGATION_NODE (id=11):(Total: 12s961ms, non-child: 62.986ms, % non-child: 0.49%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 72.869us
- GetResultsTime: 174.335us
- HTResizeTime: 0.000ns
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 6 (6)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 9.42 MB (9880671)
- PinTime: 0.000ns
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 2.19K (2191)
- RowsReturnedRate: 169.00 /sec
- StreamingTime: 60.677ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=10):(Total: 12s898ms, non-child: 353.551ms, % non-child: 2.74%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.09K (1095)
- BuildTime: 518.756us
- PeakMemoryUsage: 1.25 MB (1310664)
- ProbeRows: 2.55M (2547420)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 343.718ms
- RowsReturned: 2.19K (2191)
- RowsReturnedRate: 169.00 /sec
Hash Join Builder (join_node_id=10):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- BuildRowsPartitionTime: 198.234us
- BuildRowsPartitioned: 1.09K (1095)
- GetNewBlockTime: 109.928us
- HashBuckets: 2.05K (2048)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 135.552us
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.06 MB (1111168)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=34):(Total: 2s119ms, non-child: 21.327ms, % non-child: 1.01%)
ExecOption: Codegen Enabled
- BuildTime: 10.793ms
- GetNewBlockTime: 206.518us
- GetResultsTime: 8.152ms
- HTResizeTime: 1.232ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 20.08 MB (21052345)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.09K (1095)
- RowsReturnedRate: 516.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 968.000ns
EXCHANGE_NODE (id=33):(Total: 2s097ms, non-child: 1.753ms, % non-child: 0.08%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0
- BytesReceived: 1.64 MB (1717744)
- ConvertRowBatchTime: 751.977us
- DeserializeRowBatchTimer: 6.137ms
- FirstBatchArrivalWaitTime: 2s048ms
- PeakMemoryUsage: 0
- RowsReturned: 30.54K (30536)
- RowsReturnedRate: 14.56 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=9):(Total: 12s544ms, non-child: 1s609ms, % non-child: 12.83%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 2.46M (2455417)
- BuildTime: 748.806ms
- PeakMemoryUsage: 457.17 MB (479379847)
- ProbeRows: 2.55M (2547420)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 845.172ms
- RowsReturned: 2.55M (2547420)
- RowsReturnedRate: 203.07 K/sec
Hash Join Builder (join_node_id=9):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 574.657ms
- BuildRowsPartitioned: 2.46M (2455417)
- GetNewBlockTime: 188.132us
- HashBuckets: 4.19M (4194304)
- HashCollisions: 1.34K (1342)
- HashTablesBuildTime: 156.125ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 457.03 MB (479229056)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=27):(Total: 10s244ms, non-child: 2s547ms, % non-child: 24.87%)
ExecOption: Codegen Enabled
- BuildTime: 1s802ms
- GetNewBlockTime: 639.923us
- GetResultsTime: 652.004ms
- HTResizeTime: 141.768ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 530.16 MB (555910742)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.46M (2455417)
- RowsReturnedRate: 239.68 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.075us
EXCHANGE_NODE (id=26):(Total: 7s697ms, non-child: 190.388ms, % non-child: 2.47%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 940.15 KB, 4.98 MB, 13.96 MB, 34.39 MB, 61.00 MB, 89.80 MB, 120.58 MB, 150.66 MB, 179.86 MB, 205.14 MB, 227.04 MB, 244.95 MB, 255.48 MB, 261.95 MB, 266.29 MB, 268.14 MB
- BytesReceived: 268.17 MB (281193674)
- ConvertRowBatchTime: 81.594ms
- DeserializeRowBatchTimer: 808.094ms
- FirstBatchArrivalWaitTime: 1s856ms
- PeakMemoryUsage: 0
- RowsReturned: 4.35M (4351888)
- RowsReturnedRate: 565.39 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=28):(Total: 7s596ms, non-child: 134.553ms, % non-child: 1.77%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.64 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.34 MB, 10.41 MB, 15.88 MB, 55.64 MB, 93.53 MB
- BytesReceived: 122.10 MB (128030436)
- ConvertRowBatchTime: 47.535ms
- DeserializeRowBatchTimer: 455.165ms
- FirstBatchArrivalWaitTime: 6s906ms
- PeakMemoryUsage: 0
- RowsReturned: 2.55M (2547420)
- RowsReturnedRate: 335.35 K/sec
- SendersBlockedTimer: 3s948ms
- SendersBlockedTotalTimer(*): 56s061ms
Instance 514ee9ab39cdc507:7d (host=cdh3.net.cuberonlabs.com:22000):(Total: 13s863ms, non-child: 35.325ms, % non-child: 0.25%)
MemoryUsage(500.000ms): 25.48 MB, 22.03 MB, 22.06 MB, 22.06 MB, 22.06 MB, 33.65 MB, 64.32 MB, 97.04 MB, 144.79 MB, 206.86 MB, 289.67 MB, 333.60 MB, 377.80 MB, 416.67 MB, 455.73 MB, 492.95 MB, 535.91 MB, 550.91 MB, 552.91 MB, 555.91 MB, 557.91 MB, 534.61 MB, 485.76 MB, 491.99 MB, 499.49 MB, 497.60 MB, 500.75 MB, 16.17 MB
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.89
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 599.33 MB (628445182)
- PerHostPeakMemUsage: 2.16 GB (2318232477)
- RowsProduced: 2.17K (2170)
- TotalNetworkReceiveTime: 16s498ms
- TotalNetworkSendTime: 6.220ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 39 (39)
- TotalThreadsTotalWallClockTime: 26s101ms
- TotalThreadsSysTime: 596.000ms
- TotalThreadsUserTime: 5s252ms
- TotalThreadsVoluntaryContextSwitches: 8.03K (8033)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s199ms
- ExecTreeExecTime: 2s186ms
- OpenTime: 11s597ms
- ExecTreeOpenTime: 10s481ms
- PrepareTime: 67.328ms
- ExecTreePrepareTime: 2.259ms
DataStreamSender (dst_id=35):(Total: 2.303ms, non-child: 2.303ms, % non-child: 100.00%)
- BytesSent: 125.85 KB (128867)
- NetworkThroughput(*): 187.37 MB/sec
- OverallThroughput: 53.35 MB/sec
- PeakMemoryUsage: 328.36 KB (336240)
- RowsReturned: 2.17K (2170)
- SerializeBatchTime: 1.594ms
- TransmitDataRPCTime: 655.916us
- UncompressedRowBatchSize: 240.96 KB (246741)
CodeGen:(Total: 1s155ms, non-child: 1s155ms, % non-child: 100.00%)
- CodegenTime: 10.886ms
- CompileTime: 360.241ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 142 (142)
- NumInstructions: 7.08K (7077)
- OptimizationTime: 752.649ms
- PeakMemoryUsage: 3.46 MB (3623424)
- PrepareTime: 41.962ms
AGGREGATION_NODE (id=11):(Total: 12s670ms, non-child: 76.125ms, % non-child: 0.60%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 81.880us
- GetResultsTime: 161.068us
- HTResizeTime: 0.000ns
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 6 (6)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 9.43 MB (9889062)
- PinTime: 0.000ns
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 2.17K (2170)
- RowsReturnedRate: 171.00 /sec
- StreamingTime: 74.128ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=10):(Total: 12s594ms, non-child: 354.637ms, % non-child: 2.82%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.08K (1085)
- BuildTime: 505.468us
- PeakMemoryUsage: 1.25 MB (1305910)
- ProbeRows: 2.55M (2550342)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 344.518ms
- RowsReturned: 2.17K (2170)
- RowsReturnedRate: 172.00 /sec
Hash Join Builder (join_node_id=10):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- BuildRowsPartitionTime: 205.156us
- BuildRowsPartitioned: 1.08K (1085)
- GetNewBlockTime: 81.928us
- HashBuckets: 2.05K (2048)
- HashCollisions: 3 (3)
- HashTablesBuildTime: 129.440us
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.06 MB (1111168)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=34):(Total: 1s824ms, non-child: 21.307ms, % non-child: 1.17%)
ExecOption: Codegen Enabled
- BuildTime: 11.480ms
- GetNewBlockTime: 247.480us
- GetResultsTime: 7.417ms
- HTResizeTime: 1.417ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 20.07 MB (21041393)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.08K (1085)
- RowsReturnedRate: 594.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1000.000ns
EXCHANGE_NODE (id=33):(Total: 1s803ms, non-child: 1.512ms, % non-child: 0.08%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0
- BytesReceived: 1.64 MB (1724321)
- ConvertRowBatchTime: 681.196us
- DeserializeRowBatchTimer: 5.169ms
- FirstBatchArrivalWaitTime: 1s761ms
- PeakMemoryUsage: 0
- RowsReturned: 30.64K (30643)
- RowsReturnedRate: 16.99 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=9):(Total: 12s238ms, non-child: 1s690ms, % non-child: 13.81%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 2.46M (2458211)
- BuildTime: 736.275ms
- PeakMemoryUsage: 457.17 MB (479379055)
- ProbeRows: 2.55M (2550342)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 938.161ms
- RowsReturned: 2.55M (2550342)
- RowsReturnedRate: 208.38 K/sec
Hash Join Builder (join_node_id=9):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 566.600ms
- BuildRowsPartitioned: 2.46M (2458211)
- GetNewBlockTime: 2.988ms
- HashBuckets: 4.19M (4194304)
- HashCollisions: 1.50K (1501)
- HashTablesBuildTime: 148.388ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 457.03 MB (479229056)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=27):(Total: 9s742ms, non-child: 2s327ms, % non-child: 23.89%)
ExecOption: Codegen Enabled
- BuildTime: 1s790ms
- GetNewBlockTime: 1.211ms
- GetResultsTime: 456.278ms
- HTResizeTime: 148.069ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 530.16 MB (555910716)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.46M (2458211)
- RowsReturnedRate: 252.31 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.048us
EXCHANGE_NODE (id=26):(Total: 7s415ms, non-child: 167.831ms, % non-child: 2.26%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 880.08 KB, 4.86 MB, 13.69 MB, 34.06 MB, 60.55 MB, 89.46 MB, 120.30 MB, 150.38 MB, 179.62 MB, 204.99 MB, 227.07 MB, 244.94 MB, 255.74 MB, 262.17 MB, 266.52 MB, 268.48 MB
- BytesReceived: 268.50 MB (281543378)
- ConvertRowBatchTime: 77.471ms
- DeserializeRowBatchTimer: 633.982ms
- FirstBatchArrivalWaitTime: 1s565ms
- PeakMemoryUsage: 0
- RowsReturned: 4.36M (4355774)
- RowsReturnedRate: 587.39 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=28):(Total: 7s422ms, non-child: 135.595ms, % non-child: 1.83%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.00 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.40 MB, 10.50 MB, 15.28 MB, 54.98 MB, 92.84 MB
- BytesReceived: 122.23 MB (128167552)
- ConvertRowBatchTime: 47.972ms
- DeserializeRowBatchTimer: 438.822ms
- FirstBatchArrivalWaitTime: 6s616ms
- PeakMemoryUsage: 0
- RowsReturned: 2.55M (2550342)
- RowsReturnedRate: 343.61 K/sec
- SendersBlockedTimer: 3s722ms
- SendersBlockedTotalTimer(*): 59s505ms
Instance 514ee9ab39cdc507:7a (host=cdh13.net.cuberonlabs.com:22000):(Total: 13s863ms, non-child: 29.045ms, % non-child: 0.21%)
MemoryUsage(500.000ms): 25.48 MB, 22.03 MB, 22.06 MB, 22.06 MB, 22.06 MB, 33.77 MB, 64.46 MB, 97.10 MB, 144.80 MB, 206.86 MB, 289.60 MB, 333.67 MB, 377.93 MB, 417.67 MB, 454.67 MB, 493.63 MB, 535.98 MB, 550.98 MB, 553.04 MB, 556.05 MB, 557.92 MB, 534.62 MB, 485.77 MB, 491.95 MB, 492.21 MB, 498.47 MB, 493.48 MB
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.93
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 599.34 MB (628455845)
- PerHostPeakMemUsage: 1.66 GB (1782381748)
- RowsProduced: 2.12K (2125)
- TotalNetworkReceiveTime: 17s461ms
- TotalNetworkSendTime: 4.764ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 10 (10)
- TotalThreadsTotalWallClockTime: 26s586ms
- TotalThreadsSysTime: 424.000ms
- TotalThreadsUserTime: 4s936ms
- TotalThreadsVoluntaryContextSwitches: 8.31K (8312)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s191ms
- ExecTreeExecTime: 2s178ms
- OpenTime: 11s617ms
- ExecTreeOpenTime: 10s722ms
- PrepareTime: 54.859ms
- ExecTreePrepareTime: 2.114ms
DataStreamSender (dst_id=35):(Total: 2.629ms, non-child: 2.629ms, % non-child: 100.00%)
- BytesSent: 122.77 KB (125714)
- NetworkThroughput(*): 163.65 MB/sec
- OverallThroughput: 45.59 MB/sec
- PeakMemoryUsage: 312.36 KB (319856)
- RowsReturned: 2.12K (2125)
- SerializeBatchTime: 1.788ms
- TransmitDataRPCTime: 732.597us
- UncompressedRowBatchSize: 235.52 KB (241168)
CodeGen:(Total: 929.721ms, non-child: 929.721ms, % non-child: 100.00%)
- CodegenTime: 7.247ms
- CompileTime: 272.979ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 142 (142)
- NumInstructions: 7.08K (7077)
- OptimizationTime: 620.886ms
- PeakMemoryUsage: 3.46 MB (3623424)
- PrepareTime: 35.066ms
AGGREGATION_NODE (id=11):(Total: 12s902ms, non-child: 65.188ms, % non-child: 0.51%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 76.895us
- GetResultsTime: 141.050us
- HTResizeTime: 0.000ns
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 7 (7)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 9.40 MB (9857229)
- PinTime: 0.000ns
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 2.12K (2125)
- RowsReturnedRate: 164.00 /sec
- StreamingTime: 62.627ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=10):(Total: 12s837ms, non-child: 321.034ms, % non-child: 2.50%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.06K (1062)
- BuildTime: 2.352ms
- PeakMemoryUsage: 1.21 MB (1273383)
- ProbeRows: 2.55M (2549900)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 312.815ms
- RowsReturned: 2.12K (2125)
- RowsReturnedRate: 165.00 /sec
Hash Join Builder (join_node_id=10):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- BuildRowsPartitionTime: 155.906us
- BuildRowsPartitioned: 1.06K (1062)
- GetNewBlockTime: 1.996ms
- HashBuckets: 2.05K (2048)
- HashCollisions: 1 (1)
- HashTablesBuildTime: 132.733us
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.06 MB (1111168)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=34):(Total: 2s054ms, non-child: 20.733ms, % non-child: 1.01%)
ExecOption: Codegen Enabled
- BuildTime: 10.637ms
- GetNewBlockTime: 221.485us
- GetResultsTime: 7.667ms
- HTResizeTime: 971.813us
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 20.06 MB (21035254)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.06K (1062)
- RowsReturnedRate: 516.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 987.000ns
EXCHANGE_NODE (id=33):(Total: 2s034ms, non-child: 1.536ms, % non-child: 0.08%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0
- BytesReceived: 1.63 MB (1713684)
- ConvertRowBatchTime: 686.907us
- DeserializeRowBatchTimer: 5.361ms
- FirstBatchArrivalWaitTime: 1s996ms
- PeakMemoryUsage: 0
- RowsReturned: 30.47K (30466)
- RowsReturnedRate: 14.98 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=9):(Total: 12s515ms, non-child: 1s628ms, % non-child: 13.01%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 2.46M (2457753)
- BuildTime: 737.735ms
- PeakMemoryUsage: 457.17 MB (479378983)
- ProbeRows: 2.55M (2549900)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 875.252ms
- RowsReturned: 2.55M (2549900)
- RowsReturnedRate: 203.74 K/sec
Hash Join Builder (join_node_id=9):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 572.101ms
- BuildRowsPartitioned: 2.46M (2457753)
- GetNewBlockTime: 203.562us
- HashBuckets: 4.19M (4194304)
- HashCollisions: 1.37K (1370)
- HashTablesBuildTime: 146.459ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 457.03 MB (479229056)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=27):(Total: 9s982ms, non-child: 2s182ms, % non-child: 21.86%)
ExecOption: Codegen Enabled
- BuildTime: 1s639ms
- GetNewBlockTime: 744.612us
- GetResultsTime: 476.627ms
- HTResizeTime: 121.088ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 530.10 MB (555847006)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.46M (2457753)
- RowsReturnedRate: 246.21 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.084us
EXCHANGE_NODE (id=26):(Total: 7s799ms, non-child: 171.067ms, % non-child: 2.19%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 939.45 KB, 5.01 MB, 13.91 MB, 34.39 MB, 60.82 MB, 89.82 MB, 120.67 MB, 150.77 MB, 179.93 MB, 205.18 MB, 227.15 MB, 245.02 MB, 255.65 MB, 262.12 MB, 266.46 MB, 268.35 MB
- BytesReceived: 268.37 MB (281409782)
- ConvertRowBatchTime: 72.198ms
- DeserializeRowBatchTimer: 733.777ms
- FirstBatchArrivalWaitTime: 1s800ms
- PeakMemoryUsage: 0
- RowsReturned: 4.36M (4356599)
- RowsReturnedRate: 558.56 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=28):(Total: 7s757ms, non-child: 136.069ms, % non-child: 1.75%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.42 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.36 MB, 10.45 MB, 15.70 MB, 55.58 MB, 93.42 MB
- BytesReceived: 122.22 MB (128158512)
- ConvertRowBatchTime: 43.275ms
- DeserializeRowBatchTimer: 468.428ms
- FirstBatchArrivalWaitTime: 6s852ms
- PeakMemoryUsage: 0
- RowsReturned: 2.55M (2549900)
- RowsReturnedRate: 328.70 K/sec
- SendersBlockedTimer: 3s730ms
- SendersBlockedTotalTimer(*): 52s255ms
Instance 514ee9ab39cdc507:79 (host=cdh16.net.cuberonlabs.com:22000):(Total: 13s863ms, non-child: 28.465ms, % non-child: 0.21%)
MemoryUsage(500.000ms): 25.48 MB, 22.03 MB, 22.06 MB, 22.06 MB, 22.06 MB, 46.81 MB, 67.37 MB, 112.65 MB, 160.35 MB, 238.67 MB, 305.74 MB, 347.73 MB, 387.67 MB, 428.79 MB, 465.61 MB, 515.94 MB, 545.94 MB, 551.01 MB, 554.94 MB, 556.94 MB, 591.30 MB, 521.83 MB, 448.87 MB, 492.14 MB, 501.68 MB, 497.56 MB, 492.67 MB
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.93
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 599.30 MB (628415300)
- PerHostPeakMemUsage: 1.64 GB (1763578733)
- RowsProduced: 2.03K (2032)
- TotalNetworkReceiveTime: 16s468ms
- TotalNetworkSendTime: 7.077ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 30 (30)
- TotalThreadsTotalWallClockTime: 26s243ms
- TotalThreadsSysTime: 536.000ms
- TotalThreadsUserTime: 5s516ms
- TotalThreadsVoluntaryContextSwitches: 7.51K (7512)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s241ms
- ExecTreeExecTime: 2s228ms
- OpenTime: 11s551ms
- ExecTreeOpenTime: 10s533ms
- PrepareTime: 71.181ms
- ExecTreePrepareTime: 2.793ms
DataStreamSender (dst_id=35):(Total: 2.133ms, non-child: 2.133ms, % non-child: 100.00%)
- BytesSent: 117.66 KB (120483)
- NetworkThroughput(*): 162.57 MB/sec
- OverallThroughput: 53.86 MB/sec
- PeakMemoryUsage: 248.36 KB (254320)
- RowsReturned: 2.03K (2032)
- SerializeBatchTime: 1.376ms
- TransmitDataRPCTime: 706.772us
- UncompressedRowBatchSize: 225.61 KB (231024)
CodeGen:(Total: 1s067ms, non-child: 1s067ms, % non-child: 100.00%)
- CodegenTime: 6.900ms
- CompileTime: 272.413ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 142 (142)
- NumInstructions: 7.08K (7077)
- OptimizationTime: 743.491ms
- PeakMemoryUsage: 3.46 MB (3623424)
- PrepareTime: 51.080ms
AGGREGATION_NODE (id=11):(Total: 12s765ms, non-child: 71.256ms, % non-child: 0.56%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 109.874us
- GetResultsTime: 135.072us
- HTResizeTime: 0.000ns
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 7 (7)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 9.43 MB (9889395)
- PinTime: 0.000ns
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 2.03K (2032)
- RowsReturnedRate: 159.00 /sec
- StreamingTime: 68.962ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=10):(Total: 12s694ms, non-child: 337.990ms, % non-child: 2.66%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.02K (1016)
- BuildTime: 518.958us
- PeakMemoryUsage: 1.28 MB (1343333)
- ProbeRows: 2.55M (2547567)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 328.702ms
- RowsReturned: 2.03K (2032)
- RowsReturnedRate: 160.00 /sec
Hash Join Builder (join_node_id=10):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- BuildRowsPartitionTime: 210.439us
- BuildRowsPartitioned: 1.02K (1016)
- GetNewBlockTime: 70.706us
- HashBuckets: 2.05K (2048)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 168.096us
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.06 MB (1111168)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=34):(Total: 1s918ms, non-child: 25.742ms, % non-child: 1.34%)
ExecOption: Codegen Enabled
- BuildTime: 12.470ms
- GetNewBlockTime: 308.928us
- GetResultsTime: 10.217ms
- HTResizeTime: 1.209ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 20.07 MB (21046178)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.02K (1016)
- RowsReturnedRate: 529.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.422us
EXCHANGE_NODE (id=33):(Total: 1s893ms, non-child: 1.903ms, % non-child: 0.10%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0
- BytesReceived: 1.64 MB (1715662)
- ConvertRowBatchTime: 733.758us
- DeserializeRowBatchTimer: 7.496ms
- FirstBatchArrivalWaitTime: 1s855ms
- PeakMemoryUsage: 0
- RowsReturned: 30.48K (30484)
- RowsReturnedRate: 16.10 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=9):(Total: 12s355ms, non-child: 1s669ms, % non-child: 13.51%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 2.46M (2455776)
- BuildTime: 692.651ms
- PeakMemoryUsage: 457.17 MB (479379398)
- ProbeRows: 2.55M (2547567)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 959.383ms
- RowsReturned: 2.55M (2547567)
- RowsReturnedRate: 206.19 K/sec
Hash Join Builder (join_node_id=9):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 544.056ms
- BuildRowsPartitioned: 2.46M (2455776)
- GetNewBlockTime: 258.603us
- HashBuckets: 4.19M (4194304)
- HashCollisions: 1.38K (1383)
- HashTablesBuildTime: 128.655ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 457.03 MB (479229056)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=27):(Total: 9s838ms, non-child: 2s670ms, % non-child: 27.14%)
ExecOption: Codegen Enabled
- BuildTime: 2s129ms
- GetNewBlockTime: 3.409ms
- GetResultsTime: 466.938ms
- HTResizeTime: 176.324ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 530.15 MB (555906614)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.46M (2455776)
- RowsReturnedRate: 249.61 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.493us
EXCHANGE_NODE (id=26):(Total: 7s168ms, non-child: 194.698ms, % non-child: 2.72%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.70 MB, 6.53 MB, 18.35 MB, 41.09 MB, 67.99 MB, 97.91 MB, 127.85 MB, 157.80 MB, 186.27 MB, 210.77 MB, 231.84 MB, 248.34 MB, 256.97 MB, 262.90 MB, 266.81 MB
- BytesReceived: 267.96 MB (280976170)
- ConvertRowBatchTime: 89.923ms
- DeserializeRowBatchTimer: 762.906ms
- FirstBatchArrivalWaitTime: 1s661ms
- PeakMemoryUsage: 0
- RowsReturned: 4.35M (4348908)
- RowsReturnedRate: 606.70 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=28):(Total: 7s560ms, non-child: 144.668ms, % non-child: 1.91%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.39 MB, 10.62 MB, 26.83 MB, 65.38 MB, 103.28 MB
- BytesReceived: 122.13 MB (128065338)
- ConvertRowBatchTime: 46.951ms
- DeserializeRowBatchTimer: 486.020ms
- FirstBatchArrivalWaitTime: 6s712ms
- PeakMemoryUsage: 0
- RowsReturned: 2.55M (2547567)
- RowsReturnedRate: 336.98 K/sec
- SendersBlockedTimer: 3s681ms
- SendersBlockedTotalTimer(*): 58s830ms
Instance 514ee9ab39cdc507:7e (host=cdh17.net.cuberonlabs.com:22000):(Total: 13s863ms, non-child: 21.360ms, % non-child: 0.15%)
MemoryUsage(500.000ms): 25.48 MB, 22.03 MB, 22.06 MB, 22.06 MB, 22.06 MB, 23.31 MB, 55.53 MB, 94.17 MB, 142.54 MB, 203.73 MB, 274.73 MB, 321.67 MB, 364.67 MB, 405.73 MB, 441.86 MB, 478.73 MB, 526.99 MB, 548.05 MB, 551.93 MB, 555.93 MB, 557.99 MB, 558.99 MB, 542.51 MB, 469.78 MB, 509.99 MB, 514.00 MB, 516.60 MB, 506.28 MB
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.93
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 599.36 MB (628470660)
- PerHostPeakMemUsage: 1.75 GB (1879028559)
- RowsProduced: 2.03K (2030)
- TotalNetworkReceiveTime: 16s336ms
- TotalNetworkSendTime: 6.776ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 28 (28)
- TotalThreadsTotalWallClockTime: 27s151ms
- TotalThreadsSysTime: 524.000ms
- TotalThreadsUserTime: 5s912ms
- TotalThreadsVoluntaryContextSwitches: 7.96K (7956)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s588ms
- ExecTreeExecTime: 1s577ms
- OpenTime: 12s240ms
- ExecTreeOpenTime: 11s291ms
- PrepareTime: 34.698ms
- ExecTreePrepareTime: 1.720ms
DataStreamSender (dst_id=35):(Total: 1.770ms, non-child: 1.770ms, % non-child: 100.00%)
- BytesSent: 117.36 KB (120178)
- NetworkThroughput(*): 191.14 MB/sec
- OverallThroughput: 64.73 MB/sec
- PeakMemoryUsage: 280.36 KB (287088)
- RowsReturned: 2.03K (2030)
- SerializeBatchTime: 1.141ms
- TransmitDataRPCTime: 599.609us
- UncompressedRowBatchSize: 225.35 KB (230756)
CodeGen:(Total: 970.251ms, non-child: 970.251ms, % non-child: 100.00%)
- CodegenTime: 4.791ms
- CompileTime: 278.054ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 142 (142)
- NumInstructions: 7.08K (7077)
- OptimizationTime: 669.759ms
- PeakMemoryUsage: 3.46 MB (3623424)
- PrepareTime: 21.917ms
AGGREGATION_NODE (id=11):(Total: 12s870ms, non-child: 65.883ms, % non-child: 0.51%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 53.360us
- GetResultsTime: 89.435us
- HTResizeTime: 0.000ns
- HashBuckets: 16.38K (16384)
- LargestPartitionPercent: 6 (6)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 9.42 MB (9879405)
- PinTime: 0.000ns
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 2.03K (2030)
- RowsReturnedRate: 157.00 /sec
- StreamingTime: 63.940ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=10):(Total: 12s804ms, non-child: 337.820ms, % non-child: 2.64%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 1.01K (1015)
- BuildTime: 662.624us
- PeakMemoryUsage: 1.21 MB (1273535)
- ProbeRows: 2.55M (2546794)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 328.229ms
- RowsReturned: 2.03K (2030)
- RowsReturnedRate: 158.00 /sec
Hash Join Builder (join_node_id=10):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
- BuildRowsPartitionTime: 245.315us
- BuildRowsPartitioned: 1.01K (1015)
- GetNewBlockTime: 76.283us
- HashBuckets: 2.05K (2048)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 251.251us
- LargestPartitionPercent: 7 (7)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.06 MB (1111168)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=34):(Total: 2s032ms, non-child: 27.423ms, % non-child: 1.35%)
ExecOption: Codegen Enabled
- BuildTime: 12.637ms
- GetNewBlockTime: 321.457us
- GetResultsTime: 11.976ms
- HTResizeTime: 1.473ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 20.08 MB (21052529)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 1.01K (1015)
- RowsReturnedRate: 499.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 466.000ns
EXCHANGE_NODE (id=33):(Total: 2s004ms, non-child: 1.938ms, % non-child: 0.10%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0
- BytesReceived: 1.64 MB (1724264)
- ConvertRowBatchTime: 744.314us
- DeserializeRowBatchTimer: 8.095ms
- FirstBatchArrivalWaitTime: 1s960ms
- PeakMemoryUsage: 0
- RowsReturned: 30.64K (30641)
- RowsReturnedRate: 15.28 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HASH_JOIN_NODE (id=9):(Total: 12s466ms, non-child: 2s004ms, % non-child: 16.08%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 2.45M (2454541)
- BuildTime: 1s033ms
- PeakMemoryUsage: 457.17 MB (479379135)
- ProbeRows: 2.55M (2546794)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 956.100ms
- RowsReturned: 2.55M (2546794)
- RowsReturnedRate: 204.30 K/sec
Hash Join Builder (join_node_id=9):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 816.837ms
- BuildRowsPartitioned: 2.45M (2454541)
- GetNewBlockTime: 244.241us
- HashBuckets: 4.19M (4194304)
- HashCollisions: 1.37K (1368)
- HashTablesBuildTime: 190.045ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 457.03 MB (479229056)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=27):(Total: 10s255ms, non-child: 2s788ms, % non-child: 27.19%)
ExecOption: Codegen Enabled
- BuildTime: 1s939ms
- GetNewBlockTime: 814.766us
- GetResultsTime: 721.507ms
- HTResizeTime: 165.754ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 530.10 MB (555846758)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.45M (2454541)
- RowsReturnedRate: 239.34 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 509.000ns
EXCHANGE_NODE (id=26):(Total: 7s466ms, non-child: 209.541ms, % non-child: 2.81%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 217.32 KB, 4.06 MB, 11.78 MB, 30.29 MB, 56.28 MB, 85.18 MB, 115.14 MB, 145.68 MB, 175.24 MB, 201.48 MB, 223.56 MB, 242.12 MB, 253.89 MB, 260.69 MB, 265.22 MB, 267.63 MB
- BytesReceived: 267.87 MB (280887188)
- ConvertRowBatchTime: 91.336ms
- DeserializeRowBatchTimer: 835.341ms
- FirstBatchArrivalWaitTime: 1s764ms
- PeakMemoryUsage: 0
- RowsReturned: 4.35M (4349479)
- RowsReturnedRate: 582.55 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=28):(Total: 7s022ms, non-child: 206.050ms, % non-child: 2.93%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.38 MB, 10.41 MB, 10.88 MB, 49.40 MB, 86.92 MB, 121.54 MB
- BytesReceived: 122.03 MB (127955815)
- ConvertRowBatchTime: 47.378ms
- DeserializeRowBatchTimer: 475.027ms
- FirstBatchArrivalWaitTime: 6s816ms
- PeakMemoryUsage: 0
- RowsReturned: 2.55M (2546794)
- RowsReturnedRate: 362.66 K/sec
- SendersBlockedTimer: 5s527ms
- SendersBlockedTotalTimer(*): 1m20s
Averaged Fragment F02:(Total: 8s042ms, non-child: 722.514ms, % non-child: 8.98%)
split sizes: min: 1.81 GB, max: 3.59 GB, avg: 2.76 GB, stddev: 468.16 MB
completion times: min:5s537ms max:10s399ms mean: 8s044ms stddev:1s249ms
execution rates: min:297.29 MB/sec max:397.72 MB/sec mean:351.49 MB/sec stddev:29.51 MB/sec
num instances: 17
- AverageThreadTokens: 4.21
- BloomFilterBytes: 0
- PeakMemoryUsage: 916.04 MB (960537167)
- PerHostPeakMemUsage: 1.70 GB (1824024877)
- RowsProduced: 4.35M (4352060)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 8.995ms
- TotalStorageWaitTime: 22.462ms
- TotalThreadsInvoluntaryContextSwitches: 34 (34)
- TotalThreadsTotalWallClockTime: 33s997ms
- TotalThreadsSysTime: 884.705ms
- TotalThreadsUserTime: 8s881ms
- TotalThreadsVoluntaryContextSwitches: 12.39K (12391)
Fragment Instance Lifecycle Timings:
- ExecTime: 7s844ms
- ExecTreeExecTime: 5s522ms
- OpenTime: 158.619ms
- ExecTreeOpenTime: 41.856us
- PrepareTime: 39.314ms
- ExecTreePrepareTime: 790.149us
DataStreamSender (dst_id=26):(Total: 1s607ms, non-child: 1s607ms, % non-child: 100.00%)
- BytesSent: 268.10 MB (281124560)
- NetworkThroughput(*): 635.27 MB/sec
- OverallThroughput: 168.85 MB/sec
- PeakMemoryUsage: 2.03 MB (2128225)
- RowsReturned: 4.35M (4352060)
- SerializeBatchTime: 1s147ms
- TransmitDataRPCTime: 458.944ms
- UncompressedRowBatchSize: 569.17 MB (596812778)
CodeGen:(Total: 192.096ms, non-child: 192.096ms, % non-child: 100.00%)
- CodegenTime: 4.272ms
- CompileTime: 38.533ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 61 (61)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 118.583ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 34.137ms
AGGREGATION_NODE (id=1):(Total: 5s520ms, non-child: 5s439ms, % non-child: 98.53%)
- GetNewBlockTime: 1.787ms
- GetResultsTime: 1s265ms
- HTResizeTime: 200.480ms
- HashBuckets: 8.14M (8141884)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 906.58 MB (950622860)
- PinTime: 0.000ns
- ReductionFactorEstimate: 39.03
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.35M (4352060)
- RowsReturnedRate: 795.56 K/sec
- StreamingTime: 3s697ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 80.893ms, non-child: 80.893ms, % non-child: 100.00%)
- AverageHdfsReadThreadConcurrency: 0.01
- AverageScannerThreadConcurrency: 6.85
- BytesRead: 353.32 MB (370479642)
- BytesReadDataNodeCache: 344.19 MB (360909235)
- BytesReadLocal: 353.32 MB (370479642)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 353.32 MB (370479642)
- DecompressionTime: 826.122ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 29 (29)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 24.26 MB (25442666)
- PerReadThreadRawHdfsThroughput: 33.00 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 27.130ms
- RowBatchQueuePutWaitTime: 24s001ms
- RowsRead: 11.56M (11559184)
- RowsReturned: 11.56M (11559184)
- RowsReturnedRate: 147.32 M/sec
- ScanRangesComplete: 29 (29)
- ScannerThreadsInvoluntaryContextSwitches: 20 (20)
- ScannerThreadsTotalWallClockTime: 25s994ms
- MaterializeTupleTime(*): 388.420ms
- ScannerThreadsSysTime: 192.705ms
- ScannerThreadsUserTime: 1s631ms
- ScannerThreadsVoluntaryContextSwitches: 11.74K (11741)
- TotalRawHdfsReadTime(*): 10.545ms
- TotalReadThroughput: 90.22 MB/sec
Fragment F02:
Instance 514ee9ab39cdc507:6 (host=cdh3.net.cuberonlabs.com:22000):(Total: 10s397ms, non-child: 1s039ms, % non-child: 10.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.39 GB
MemoryUsage(500.000ms): 35.58 MB, 236.55 MB, 316.52 MB, 508.75 MB, 557.21 MB, 600.09 MB, 685.82 MB, 860.35 MB, 892.84 MB, 923.72 MB, 950.86 MB, 1.02 GB, 946.95 MB, 811.77 MB, 744.16 MB, 609.03 MB, 473.70 MB, 406.28 MB, 271.27 MB, 136.02 MB, 27.84 MB
ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 5, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 4.52
- BloomFilterBytes: 0
- PeakMemoryUsage: 1.06 GB (1138074612)
- PerHostPeakMemUsage: 2.16 GB (2318232477)
- RowsProduced: 5.03M (5032625)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 8.924ms
- TotalStorageWaitTime: 50.227ms
- TotalThreadsInvoluntaryContextSwitches: 50 (50)
- TotalThreadsTotalWallClockTime: 45s756ms
- TotalThreadsSysTime: 1s092ms
- TotalThreadsUserTime: 11s380ms
- TotalThreadsVoluntaryContextSwitches: 15.35K (15345)
Fragment Instance Lifecycle Timings:
- ExecTime: 10s154ms
- ExecTreeExecTime: 7s252ms
- OpenTime: 202.177ms
- ExecTreeOpenTime: 64.480us
- PrepareTime: 41.468ms
- ExecTreePrepareTime: 679.356us
DataStreamSender (dst_id=26):(Total: 1s872ms, non-child: 1s872ms, % non-child: 100.00%)
- BytesSent: 308.21 MB (323179035)
- NetworkThroughput(*): 722.72 MB/sec
- OverallThroughput: 164.59 MB/sec
- PeakMemoryUsage: 2.06 MB (2160512)
- RowsReturned: 5.03M (5032625)
- SerializeBatchTime: 1s445ms
- TransmitDataRPCTime: 426.457ms
- UncompressedRowBatchSize: 654.99 MB (686805201)
CodeGen:(Total: 236.255ms, non-child: 236.255ms, % non-child: 100.00%)
- CodegenTime: 6.093ms
- CompileTime: 58.023ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 61 (61)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 141.744ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 35.406ms
AGGREGATION_NODE (id=1):(Total: 7s249ms, non-child: 7s140ms, % non-child: 98.50%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 1.911ms
- GetResultsTime: 1s436ms
- HTResizeTime: 228.270ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.06 GB (1135617555)
- PinTime: 0.000ns
- ReductionFactorEstimate: 38.40
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 5.03M (5032625)
- RowsReturnedRate: 694.23 K/sec
- StreamingTime: 5s153ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 109.099ms, non-child: 109.099ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.39 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:35
BytesRead(500.000ms): 73.80 MB, 100.67 MB, 109.64 MB, 175.06 MB, 198.24 MB, 262.05 MB, 288.69 MB, 354.31 MB, 378.79 MB, 431.49 MB, 431.49 MB
- FooterProcessingTime: (Avg: 8.624ms ; Min: 2.894ms ; Max: 43.545ms ; Number of samples: 35)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.73
- BytesRead: 431.49 MB (452453563)
- BytesReadDataNodeCache: 420.69 MB (441128504)
- BytesReadLocal: 431.49 MB (452453563)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 431.49 MB (452453563)
- DecompressionTime: 932.507ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 35 (35)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 23.24 MB (24368009)
- PerReadThreadRawHdfsThroughput: 32.66 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 33.260ms
- RowBatchQueuePutWaitTime: 33s048ms
- RowsRead: 14.44M (14439291)
- RowsReturned: 14.44M (14439291)
- RowsReturnedRate: 132.35 M/sec
- ScanRangesComplete: 35 (35)
- ScannerThreadsInvoluntaryContextSwitches: 35 (35)
- ScannerThreadsTotalWallClockTime: 35s400ms
- MaterializeTupleTime(*): 489.876ms
- ScannerThreadsSysTime: 260.000ms
- ScannerThreadsUserTime: 1s912ms
- ScannerThreadsVoluntaryContextSwitches: 14.74K (14740)
- TotalRawHdfsReadTime(*): 12.900ms
- TotalReadThroughput: 78.45 MB/sec
Instance 514ee9ab39cdc507:c (host=cdh5.net.cuberonlabs.com:22000):(Total: 9s921ms, non-child: 886.272ms, % non-child: 8.93%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.36 GB
MemoryUsage(500.000ms): 195.21 MB, 287.49 MB, 365.74 MB, 559.11 MB, 592.05 MB, 674.99 MB, 851.33 MB, 893.52 MB, 943.05 MB, 1.07 GB, 1.01 GB, 960.78 MB, 823.63 MB, 755.19 MB, 617.96 MB, 549.25 MB, 412.64 MB, 275.28 MB, 138.06 MB, 69.37 MB
ThreadUsage(500.000ms): 8, 9, 9, 9, 9, 9, 9, 9, 9, 5, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 4.75
- BloomFilterBytes: 0
- PeakMemoryUsage: 1.08 GB (1162495743)
- PerHostPeakMemUsage: 2.15 GB (2303708143)
- RowsProduced: 5.19M (5191617)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 8.682ms
- TotalStorageWaitTime: 15.389ms
- TotalThreadsInvoluntaryContextSwitches: 30 (30)
- TotalThreadsTotalWallClockTime: 46s408ms
- TotalThreadsSysTime: 1s060ms
- TotalThreadsUserTime: 11s120ms
- TotalThreadsVoluntaryContextSwitches: 15.12K (15122)
Fragment Instance Lifecycle Timings:
- ExecTime: 9s744ms
- ExecTreeExecTime: 6s870ms
- OpenTime: 140.751ms
- ExecTreeOpenTime: 39.876us
- PrepareTime: 36.978ms
- ExecTreePrepareTime: 783.064us
DataStreamSender (dst_id=26):(Total: 1s995ms, non-child: 1s995ms, % non-child: 100.00%)
- BytesSent: 322.34 MB (337995400)
- NetworkThroughput(*): 552.51 MB/sec
- OverallThroughput: 161.57 MB/sec
- PeakMemoryUsage: 2.06 MB (2160512)
- RowsReturned: 5.19M (5191617)
- SerializeBatchTime: 1s410ms
- TransmitDataRPCTime: 583.407ms
- UncompressedRowBatchSize: 686.26 MB (719597467)
CodeGen:(Total: 172.197ms, non-child: 172.197ms, % non-child: 100.00%)
- CodegenTime: 3.758ms
- CompileTime: 33.814ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 61 (61)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 105.559ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 31.906ms
AGGREGATION_NODE (id=1):(Total: 6s868ms, non-child: 6s777ms, % non-child: 98.68%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 2.040ms
- GetResultsTime: 1s469ms
- HTResizeTime: 226.065ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.07 GB (1152428072)
- PinTime: 0.000ns
- ReductionFactorEstimate: 36.13
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 5.19M (5191617)
- RowsReturnedRate: 755.87 K/sec
- StreamingTime: 4s730ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 90.722ms, non-child: 90.722ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.36 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:35
BytesRead(500.000ms): 91.05 MB, 104.56 MB, 184.09 MB, 197.68 MB, 224.56 MB, 299.78 MB, 313.12 MB, 378.80 MB, 432.23 MB, 433.15 MB
- FooterProcessingTime: (Avg: 9.210ms ; Min: 3.479ms ; Max: 45.485ms ; Number of samples: 35)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.50
- BytesRead: 433.15 MB (454191043)
- BytesReadDataNodeCache: 422.35 MB (442869728)
- BytesReadLocal: 433.15 MB (454191043)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 433.15 MB (454191043)
- DecompressionTime: 1s123ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 35 (35)
- NumScannerThreadsStarted: 8 (8)
- PeakMemoryUsage: 26.76 MB (28064098)
- PerReadThreadRawHdfsThroughput: 33.71 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 20.862ms
- RowBatchQueuePutWaitTime: 33s940ms
- RowsRead: 13.95M (13952334)
- RowsReturned: 13.95M (13952334)
- RowsReturnedRate: 153.79 M/sec
- ScanRangesComplete: 35 (35)
- ScannerThreadsInvoluntaryContextSwitches: 17 (17)
- ScannerThreadsTotalWallClockTime: 36s523ms
- MaterializeTupleTime(*): 505.447ms
- ScannerThreadsSysTime: 272.000ms
- ScannerThreadsUserTime: 2s108ms
- ScannerThreadsVoluntaryContextSwitches: 14.11K (14108)
- TotalRawHdfsReadTime(*): 12.548ms
- TotalReadThroughput: 86.63 MB/sec
Instance 514ee9ab39cdc507:1 (host=cdh4.net.cuberonlabs.com:22000):(Total: 9s415ms, non-child: 622.549ms, % non-child: 6.61%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:40/3.59 GB
MemoryUsage(500.000ms): 35.91 MB, 268.64 MB, 314.76 MB, 540.64 MB, 588.18 MB, 685.85 MB, 860.01 MB, 909.49 MB, 939.55 MB, 1.07 GB, 1.07 GB, 960.59 MB, 823.71 MB, 686.57 MB, 577.58 MB, 480.74 MB, 343.97 MB, 206.44 MB, 69.61 MB
ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 4.63
- BloomFilterBytes: 0
- PeakMemoryUsage: 1.09 GB (1169194720)
- PerHostPeakMemUsage: 2.13 GB (2284202661)
- RowsProduced: 5.40M (5395957)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 9.968ms
- TotalStorageWaitTime: 12.018ms
- TotalThreadsInvoluntaryContextSwitches: 43 (43)
- TotalThreadsTotalWallClockTime: 42s143ms
- TotalThreadsSysTime: 1s052ms
- TotalThreadsUserTime: 10s796ms
- TotalThreadsVoluntaryContextSwitches: 15.84K (15836)
Fragment Instance Lifecycle Timings:
- ExecTime: 9s224ms
- ExecTreeExecTime: 6s654ms
- OpenTime: 151.997ms
- ExecTreeOpenTime: 40.624us
- PrepareTime: 38.476ms
- ExecTreePrepareTime: 853.460us
DataStreamSender (dst_id=26):(Total: 1s955ms, non-child: 1s955ms, % non-child: 100.00%)
- BytesSent: 330.06 MB (346095116)
- NetworkThroughput(*): 488.15 MB/sec
- OverallThroughput: 168.80 MB/sec
- PeakMemoryUsage: 1.94 MB (2037632)
- RowsReturned: 5.40M (5395957)
- SerializeBatchTime: 1s278ms
- TransmitDataRPCTime: 676.151ms
- UncompressedRowBatchSize: 702.82 MB (736960845)
CodeGen:(Total: 184.735ms, non-child: 184.735ms, % non-child: 100.00%)
- CodegenTime: 4.025ms
- CompileTime: 36.702ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 61 (61)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 114.048ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 33.223ms
AGGREGATION_NODE (id=1):(Total: 6s652ms, non-child: 6s547ms, % non-child: 98.42%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 1.387ms
- GetResultsTime: 1s329ms
- HTResizeTime: 194.594ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.07 GB (1152451065)
- PinTime: 0.000ns
- ReductionFactorEstimate: 37.19
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 5.40M (5395957)
- RowsReturnedRate: 811.12 K/sec
- StreamingTime: 4s694ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 104.998ms, non-child: 104.998ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:40/3.59 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 40 out of 40
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:40
BytesRead(500.000ms): 75.05 MB, 98.28 MB, 149.28 MB, 194.32 MB, 270.85 MB, 281.46 MB, 348.14 MB, 374.51 MB, 446.38 MB, 459.20 MB
- FooterProcessingTime: (Avg: 8.559ms ; Min: 3.065ms ; Max: 33.227ms ; Number of samples: 40)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.90
- BytesRead: 459.20 MB (481508738)
- BytesReadDataNodeCache: 446.86 MB (468570610)
- BytesReadLocal: 459.20 MB (481508738)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 459.20 MB (481508738)
- DecompressionTime: 1s088ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 40 (40)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 23.16 MB (24282212)
- PerReadThreadRawHdfsThroughput: 32.44 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 27.110ms
- RowBatchQueuePutWaitTime: 30s158ms
- RowsRead: 15.04M (15041855)
- RowsReturned: 15.04M (15041855)
- RowsReturnedRate: 143.26 M/sec
- ScanRangesComplete: 40 (40)
- ScannerThreadsInvoluntaryContextSwitches: 29 (29)
- ScannerThreadsTotalWallClockTime: 32s767ms
- MaterializeTupleTime(*): 496.995ms
- ScannerThreadsSysTime: 264.000ms
- ScannerThreadsUserTime: 2s264ms
- ScannerThreadsVoluntaryContextSwitches: 15.20K (15201)
- TotalRawHdfsReadTime(*): 13.823ms
- TotalReadThroughput: 91.84 MB/sec
Instance 514ee9ab39cdc507:7 (host=cdh17.net.cuberonlabs.com:22000):(Total: 8s889ms, non-child: 834.575ms, % non-child: 9.39%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.58 GB
MemoryUsage(500.000ms): 174.32 MB, 239.17 MB, 318.88 MB, 510.34 MB, 559.26 MB, 591.22 MB, 669.60 MB, 846.87 MB, 874.50 MB, 819.26 MB, 764.71 MB, 655.64 MB, 546.73 MB, 492.19 MB, 382.77 MB, 273.57 MB, 164.65 MB, 55.62 MB
ThreadUsage(500.000ms): 8, 9, 9, 9, 9, 9, 9, 9, 7, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 4.83
- BloomFilterBytes: 0
- PeakMemoryUsage: 886.37 MB (929430134)
- PerHostPeakMemUsage: 1.75 GB (1879028559)
- RowsProduced: 4.13M (4128370)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 8.360ms
- TotalStorageWaitTime: 18.132ms
- TotalThreadsInvoluntaryContextSwitches: 28 (28)
- TotalThreadsTotalWallClockTime: 41s512ms
- TotalThreadsSysTime: 904.000ms
- TotalThreadsUserTime: 9s720ms
- TotalThreadsVoluntaryContextSwitches: 11.37K (11365)
Fragment Instance Lifecycle Timings:
- ExecTime: 8s731ms
- ExecTreeExecTime: 6s319ms
- OpenTime: 127.071ms
- ExecTreeOpenTime: 37.924us
- PrepareTime: 30.108ms
- ExecTreePrepareTime: 585.343us
DataStreamSender (dst_id=26):(Total: 1s583ms, non-child: 1s583ms, % non-child: 100.00%)
- BytesSent: 254.70 MB (267076759)
- NetworkThroughput(*): 647.72 MB/sec
- OverallThroughput: 160.83 MB/sec
- PeakMemoryUsage: 1.94 MB (2037632)
- RowsReturned: 4.13M (4128370)
- SerializeBatchTime: 1s189ms
- TransmitDataRPCTime: 393.230ms
- UncompressedRowBatchSize: 539.72 MB (565933834)
CodeGen:(Total: 152.840ms, non-child: 152.840ms, % non-child: 100.00%)
- CodegenTime: 3.087ms
- CompileTime: 34.399ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 61 (61)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 91.456ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 26.326ms
AGGREGATION_NODE (id=1):(Total: 6s317ms, non-child: 6s255ms, % non-child: 99.01%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 1.682ms
- GetResultsTime: 1s473ms
- HTResizeTime: 247.588ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 874.96 MB (917459737)
- PinTime: 0.000ns
- ReductionFactorEstimate: 37.51
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.13M (4128370)
- RowsReturnedRate: 653.44 K/sec
- StreamingTime: 4s226ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 62.533ms, non-child: 62.533ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.58 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 26 out of 26
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:26
BytesRead(500.000ms): 93.52 MB, 106.60 MB, 119.63 MB, 195.12 MB, 205.30 MB, 223.99 MB, 317.23 MB, 330.40 MB, 330.40 MB
- FooterProcessingTime: (Avg: 6.142ms ; Min: 3.323ms ; Max: 15.676ms ; Number of samples: 26)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.67
- BytesRead: 330.40 MB (346453211)
- BytesReadDataNodeCache: 322.38 MB (338038438)
- BytesReadLocal: 330.40 MB (346453211)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 330.40 MB (346453211)
- DecompressionTime: 855.040ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 26 (26)
- NumScannerThreadsStarted: 8 (8)
- PeakMemoryUsage: 25.99 MB (27254128)
- PerReadThreadRawHdfsThroughput: 35.94 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 16.266ms
- RowBatchQueuePutWaitTime: 30s783ms
- RowsRead: 10.92M (10919165)
- RowsReturned: 10.92M (10919165)
- RowsReturnedRate: 174.61 M/sec
- ScanRangesComplete: 26 (26)
- ScannerThreadsInvoluntaryContextSwitches: 16 (16)
- ScannerThreadsTotalWallClockTime: 32s653ms
- MaterializeTupleTime(*): 411.726ms
- ScannerThreadsSysTime: 132.000ms
- ScannerThreadsUserTime: 1s672ms
- ScannerThreadsVoluntaryContextSwitches: 10.97K (10966)
- TotalRawHdfsReadTime(*): 8.978ms
- TotalReadThroughput: 73.42 MB/sec
Instance 514ee9ab39cdc507:8 (host=cdh2.net.cuberonlabs.com:22000):(Total: 8s652ms, non-child: 959.568ms, % non-child: 11.09%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/3.00 GB
MemoryUsage(500.000ms): 1.90 MB, 237.26 MB, 300.59 MB, 509.19 MB, 561.61 MB, 622.14 MB, 844.83 MB, 892.92 MB, 924.24 MB, 864.23 MB, 749.26 MB, 634.15 MB, 576.40 MB, 461.26 MB, 346.22 MB, 256.35 MB, 173.72 MB, 58.31 MB
ThreadUsage(500.000ms): 1, 8, 8, 8, 8, 8, 8, 8, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 3.83
- BloomFilterBytes: 0
- PeakMemoryUsage: 930.31 MB (975497574)
- PerHostPeakMemUsage: 1.74 GB (1866918022)
- RowsProduced: 4.68M (4682424)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 8.402ms
- TotalStorageWaitTime: 24.077ms
- TotalThreadsInvoluntaryContextSwitches: 35 (35)
- TotalThreadsTotalWallClockTime: 35s164ms
- TotalThreadsSysTime: 976.000ms
- TotalThreadsUserTime: 9s544ms
- TotalThreadsVoluntaryContextSwitches: 13.50K (13500)
Fragment Instance Lifecycle Timings:
- ExecTime: 8s453ms
- ExecTreeExecTime: 5s763ms
- OpenTime: 150.652ms
- ExecTreeOpenTime: 38.912us
- PrepareTime: 48.797ms
- ExecTreePrepareTime: 746.536us
DataStreamSender (dst_id=26):(Total: 1s738ms, non-child: 1s738ms, % non-child: 100.00%)
- BytesSent: 287.56 MB (301527079)
- NetworkThroughput(*): 758.74 MB/sec
- OverallThroughput: 165.45 MB/sec
- PeakMemoryUsage: 2.06 MB (2160512)
- RowsReturned: 4.68M (4682424)
- SerializeBatchTime: 1s358ms
- TransmitDataRPCTime: 378.992ms
- UncompressedRowBatchSize: 610.83 MB (640500454)
CodeGen:(Total: 193.108ms, non-child: 193.108ms, % non-child: 100.00%)
- CodegenTime: 6.098ms
- CompileTime: 36.267ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 61 (61)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 112.578ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 43.232ms
AGGREGATION_NODE (id=1):(Total: 5s761ms, non-child: 5s674ms, % non-child: 98.49%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 755.156us
- GetResultsTime: 1s312ms
- HTResizeTime: 199.435ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 922.91 MB (967738275)
- PinTime: 0.000ns
- ReductionFactorEstimate: 37.30
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.68M (4682424)
- RowsReturnedRate: 812.67 K/sec
- StreamingTime: 3s878ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 87.062ms, non-child: 87.062ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/3.00 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:32
BytesRead(500.000ms): 0, 85.73 MB, 117.11 MB, 181.41 MB, 205.88 MB, 270.84 MB, 311.08 MB, 357.92 MB, 384.06 MB
- FooterProcessingTime: (Avg: 7.899ms ; Min: 3.033ms ; Max: 29.805ms ; Number of samples: 32)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.38
- BytesRead: 384.06 MB (402711533)
- BytesReadDataNodeCache: 374.18 MB (392358247)
- BytesReadLocal: 384.06 MB (402711533)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 384.06 MB (402711533)
- DecompressionTime: 879.952ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 32 (32)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 23.78 MB (24937978)
- PerReadThreadRawHdfsThroughput: 31.68 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 26.962ms
- RowBatchQueuePutWaitTime: 24s456ms
- RowsRead: 12.59M (12593336)
- RowsReturned: 12.59M (12593336)
- RowsReturnedRate: 144.65 M/sec
- ScanRangesComplete: 32 (32)
- ScannerThreadsInvoluntaryContextSwitches: 22 (22)
- ScannerThreadsTotalWallClockTime: 26s560ms
- MaterializeTupleTime(*): 421.765ms
- ScannerThreadsSysTime: 240.000ms
- ScannerThreadsUserTime: 1s728ms
- ScannerThreadsVoluntaryContextSwitches: 12.84K (12842)
- TotalRawHdfsReadTime(*): 11.840ms
- TotalReadThroughput: 85.35 MB/sec
Instance 514ee9ab39cdc507:e (host=cdh8.net.cuberonlabs.com:22000):(Total: 8s561ms, non-child: 578.525ms, % non-child: 6.76%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.70 GB
MemoryUsage(500.000ms): 196.96 MB, 284.77 MB, 365.30 MB, 541.48 MB, 588.15 MB, 684.95 MB, 861.42 MB, 873.67 MB, 764.74 MB, 710.23 MB, 601.25 MB, 546.66 MB, 437.47 MB, 328.64 MB, 241.33 MB, 164.68 MB, 55.53 MB
ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 8, 8, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 3.88
- BloomFilterBytes: 0
- PeakMemoryUsage: 887.07 MB (930159200)
- PerHostPeakMemUsage: 1.63 GB (1748411303)
- RowsProduced: 4.19M (4194750)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 11.720ms
- TotalStorageWaitTime: 8.427ms
- TotalThreadsInvoluntaryContextSwitches: 36 (36)
- TotalThreadsTotalWallClockTime: 32s894ms
- TotalThreadsSysTime: 996.000ms
- TotalThreadsUserTime: 9s264ms
- TotalThreadsVoluntaryContextSwitches: 12.19K (12193)
Fragment Instance Lifecycle Timings:
- ExecTime: 8s374ms
- ExecTreeExecTime: 5s655ms
- OpenTime: 147.050ms
- ExecTreeOpenTime: 39.802us
- PrepareTime: 39.798ms
- ExecTreePrepareTime: 987.720us
DataStreamSender (dst_id=26):(Total: 2s148ms, non-child: 2s148ms, % non-child: 100.00%)
- BytesSent: 256.90 MB (269377139)
- NetworkThroughput(*): 306.85 MB/sec
- OverallThroughput: 119.59 MB/sec
- PeakMemoryUsage: 2.06 MB (2160512)
- RowsReturned: 4.19M (4194750)
- SerializeBatchTime: 1s309ms
- TransmitDataRPCTime: 837.202ms
- UncompressedRowBatchSize: 545.61 MB (572113510)
CodeGen:(Total: 180.924ms, non-child: 180.924ms, % non-child: 100.00%)
- CodegenTime: 3.765ms
- CompileTime: 33.172ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 61 (61)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 112.378ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 34.490ms
AGGREGATION_NODE (id=1):(Total: 5s653ms, non-child: 5s579ms, % non-child: 98.68%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 1.296ms
- GetResultsTime: 1s493ms
- HTResizeTime: 213.329ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 875.22 MB (917732884)
- PinTime: 0.000ns
- ReductionFactorEstimate: 37.20
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.19M (4194750)
- RowsReturnedRate: 741.92 K/sec
- StreamingTime: 3s519ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 74.773ms, non-child: 74.773ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.70 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:28
BytesRead(500.000ms): 92.58 MB, 92.99 MB, 180.41 MB, 193.57 MB, 251.93 MB, 291.60 MB, 344.86 MB
- FooterProcessingTime: (Avg: 9.267ms ; Min: 3.212ms ; Max: 40.424ms ; Number of samples: 28)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.00
- BytesRead: 344.86 MB (361616139)
- BytesReadDataNodeCache: 336.23 MB (352562700)
- BytesReadLocal: 344.86 MB (361616139)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 344.86 MB (361616139)
- DecompressionTime: 850.125ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 28 (28)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 23.35 MB (24482151)
- PerReadThreadRawHdfsThroughput: 38.12 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 20.697ms
- RowBatchQueuePutWaitTime: 22s420ms
- RowsRead: 11.39M (11388046)
- RowsReturned: 11.39M (11388046)
- RowsReturnedRate: 152.30 M/sec
- ScanRangesComplete: 28 (28)
- ScannerThreadsInvoluntaryContextSwitches: 22 (22)
- ScannerThreadsTotalWallClockTime: 24s372ms
- MaterializeTupleTime(*): 391.356ms
- ScannerThreadsSysTime: 208.000ms
- ScannerThreadsUserTime: 1s604ms
- ScannerThreadsVoluntaryContextSwitches: 11.58K (11578)
- TotalRawHdfsReadTime(*): 8.833ms
- TotalReadThroughput: 98.53 MB/sec
Instance 514ee9ab39cdc507:3 (host=cdh13.net.cuberonlabs.com:22000):(Total: 8s454ms, non-child: 912.990ms, % non-child: 10.80%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/2.80 GB
MemoryUsage(500.000ms): 195.79 MB, 301.57 MB, 508.51 MB, 556.38 MB, 605.52 MB, 844.37 MB, 892.86 MB, 905.80 MB, 849.37 MB, 736.16 MB, 623.01 MB, 534.10 MB, 453.36 MB, 340.08 MB, 226.97 MB, 138.30 MB, 57.45 MB
ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 8, 8, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 3.88
- BloomFilterBytes: 0
- PeakMemoryUsage: 919.03 MB (963677514)
- PerHostPeakMemUsage: 1.66 GB (1782381748)
- RowsProduced: 4.47M (4471844)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 8.373ms
- TotalStorageWaitTime: 15.552ms
- TotalThreadsInvoluntaryContextSwitches: 20 (20)
- TotalThreadsTotalWallClockTime: 32s870ms
- TotalThreadsSysTime: 984.000ms
- TotalThreadsUserTime: 9s220ms
- TotalThreadsVoluntaryContextSwitches: 12.40K (12401)
Fragment Instance Lifecycle Timings:
- ExecTime: 8s268ms
- ExecTreeExecTime: 5s732ms
- OpenTime: 147.745ms
- ExecTreeOpenTime: 35.125us
- PrepareTime: 37.780ms
- ExecTreePrepareTime: 793.784us
DataStreamSender (dst_id=26):(Total: 1s631ms, non-child: 1s631ms, % non-child: 100.00%)
- BytesSent: 276.91 MB (290357905)
- NetworkThroughput(*): 734.40 MB/sec
- OverallThroughput: 169.76 MB/sec
- PeakMemoryUsage: 2.06 MB (2160512)
- RowsReturned: 4.47M (4471844)
- SerializeBatchTime: 1s253ms
- TransmitDataRPCTime: 377.049ms
- UncompressedRowBatchSize: 588.13 MB (616695202)
CodeGen:(Total: 180.025ms, non-child: 180.025ms, % non-child: 100.00%)
- CodegenTime: 4.123ms
- CompileTime: 35.375ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 61 (61)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 111.072ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 32.832ms
AGGREGATION_NODE (id=1):(Total: 5s730ms, non-child: 5s662ms, % non-child: 98.81%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 524.014us
- GetResultsTime: 1s546ms
- HTResizeTime: 194.043ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 907.09 MB (951156314)
- PinTime: 0.000ns
- ReductionFactorEstimate: 36.83
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.47M (4471844)
- RowsReturnedRate: 780.38 K/sec
- StreamingTime: 3s528ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 68.296ms, non-child: 68.296ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/2.80 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:31
BytesRead(500.000ms): 85.93 MB, 90.23 MB, 185.48 MB, 199.58 MB, 276.22 MB, 302.55 MB, 360.06 MB
- FooterProcessingTime: (Avg: 8.709ms ; Min: 2.373ms ; Max: 39.726ms ; Number of samples: 31)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.00
- BytesRead: 360.06 MB (377552261)
- BytesReadDataNodeCache: 350.50 MB (367530199)
- BytesReadLocal: 360.06 MB (377552261)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 360.06 MB (377552261)
- DecompressionTime: 821.310ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 31 (31)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 23.45 MB (24587476)
- PerReadThreadRawHdfsThroughput: 34.52 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 19.831ms
- RowBatchQueuePutWaitTime: 22s510ms
- RowsRead: 11.68M (11677391)
- RowsReturned: 11.68M (11677391)
- RowsReturnedRate: 170.98 M/sec
- ScanRangesComplete: 31 (31)
- ScannerThreadsInvoluntaryContextSwitches: 11 (11)
- ScannerThreadsTotalWallClockTime: 24s454ms
- MaterializeTupleTime(*): 383.257ms
- ScannerThreadsSysTime: 212.000ms
- ScannerThreadsUserTime: 1s612ms
- ScannerThreadsVoluntaryContextSwitches: 11.77K (11767)
- TotalRawHdfsReadTime(*): 10.184ms
- TotalReadThroughput: 102.87 MB/sec
Instance 514ee9ab39cdc507:10 (host=cdh9.net.cuberonlabs.com:22000):(Total: 8s410ms, non-child: 833.751ms, % non-child: 9.91%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/3.02 GB
MemoryUsage(500.000ms): 1.90 MB, 236.88 MB, 330.18 MB, 540.62 MB, 571.55 MB, 645.92 MB, 844.38 MB, 893.16 MB, 929.90 MB, 864.48 MB, 749.04 MB, 691.83 MB, 576.70 MB, 461.55 MB, 346.42 MB, 231.17 MB, 116.26 MB
ThreadUsage(500.000ms): 1, 8, 8, 8, 8, 8, 8, 8, 2, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 3.94
- BloomFilterBytes: 0
- PeakMemoryUsage: 930.38 MB (975570334)
- PerHostPeakMemUsage: 1.69 GB (1813107104)
- RowsProduced: 4.68M (4677809)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 7.647ms
- TotalStorageWaitTime: 23.652ms
- TotalThreadsInvoluntaryContextSwitches: 17 (17)
- TotalThreadsTotalWallClockTime: 34s442ms
- TotalThreadsSysTime: 868.000ms
- TotalThreadsUserTime: 9s276ms
- TotalThreadsVoluntaryContextSwitches: 13.65K (13647)
Fragment Instance Lifecycle Timings:
- ExecTime: 8s168ms
- ExecTreeExecTime: 5s768ms
- OpenTime: 197.137ms
- ExecTreeOpenTime: 43.207us
- PrepareTime: 44.481ms
- ExecTreePrepareTime: 719.817us
DataStreamSender (dst_id=26):(Total: 1s573ms, non-child: 1s573ms, % non-child: 100.00%)
- BytesSent: 288.14 MB (302137057)
- NetworkThroughput(*): 781.23 MB/sec
- OverallThroughput: 183.10 MB/sec
- PeakMemoryUsage: 1.94 MB (2037632)
- RowsReturned: 4.68M (4677809)
- SerializeBatchTime: 1s203ms
- TransmitDataRPCTime: 368.829ms
- UncompressedRowBatchSize: 612.07 MB (641798913)
CodeGen:(Total: 235.964ms, non-child: 235.964ms, % non-child: 100.00%)
- CodegenTime: 4.722ms
- CompileTime: 43.825ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 61 (61)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 151.663ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 39.428ms
AGGREGATION_NODE (id=1):(Total: 5s766ms, non-child: 5s700ms, % non-child: 98.85%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 1.107ms
- GetResultsTime: 1s373ms
- HTResizeTime: 188.437ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 923.11 MB (967947247)
- PinTime: 0.000ns
- ReductionFactorEstimate: 37.49
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.68M (4677809)
- RowsReturnedRate: 811.18 K/sec
- StreamingTime: 3s816ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 66.312ms, non-child: 66.312ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/3.02 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:31
BytesRead(500.000ms): 0, 88.16 MB, 178.11 MB, 178.11 MB, 267.20 MB, 267.20 MB, 333.80 MB, 360.96 MB, 386.75 MB
- FooterProcessingTime: (Avg: 6.881ms ; Min: 2.773ms ; Max: 23.083ms ; Number of samples: 31)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.25
- BytesRead: 386.75 MB (405532185)
- BytesReadDataNodeCache: 377.18 MB (395504782)
- BytesReadLocal: 386.75 MB (405532185)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 386.75 MB (405532185)
- DecompressionTime: 851.102ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 31 (31)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 24.80 MB (26004005)
- PerReadThreadRawHdfsThroughput: 33.79 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 18.685ms
- RowBatchQueuePutWaitTime: 24s152ms
- RowsRead: 12.71M (12711965)
- RowsReturned: 12.71M (12711965)
- RowsReturnedRate: 191.70 M/sec
- ScanRangesComplete: 31 (31)
- ScannerThreadsInvoluntaryContextSwitches: 7 (7)
- ScannerThreadsTotalWallClockTime: 26s077ms
- MaterializeTupleTime(*): 395.181ms
- ScannerThreadsSysTime: 176.000ms
- ScannerThreadsUserTime: 1s640ms
- ScannerThreadsVoluntaryContextSwitches: 13.04K (13036)
- TotalRawHdfsReadTime(*): 11.177ms
- TotalReadThroughput: 85.94 MB/sec
Instance 514ee9ab39cdc507:11 (host=cdh10.net.cuberonlabs.com:22000):(Total: 8s269ms, non-child: 516.904ms, % non-child: 6.25%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.75 GB
MemoryUsage(500.000ms): 196.80 MB, 286.47 MB, 510.54 MB, 558.68 MB, 606.61 MB, 847.20 MB, 877.73 MB, 905.66 MB, 849.45 MB, 736.20 MB, 623.20 MB, 510.12 MB, 421.01 MB, 307.64 MB, 227.22 MB, 114.10 MB
ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 8, 7, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 4.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 916.47 MB (960991926)
- PerHostPeakMemUsage: 1.66 GB (1784016472)
- RowsProduced: 4.43M (4425508)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 10.681ms
- TotalStorageWaitTime: 24.456ms
- TotalThreadsInvoluntaryContextSwitches: 72 (72)
- TotalThreadsTotalWallClockTime: 32s693ms
- TotalThreadsSysTime: 964.000ms
- TotalThreadsUserTime: 8s896ms
- TotalThreadsVoluntaryContextSwitches: 12.59K (12594)
Fragment Instance Lifecycle Timings:
- ExecTime: 8s073ms
- ExecTreeExecTime: 5s747ms
- OpenTime: 150.812ms
- ExecTreeOpenTime: 41.373us
- PrepareTime: 45.084ms
- ExecTreePrepareTime: 817.662us
DataStreamSender (dst_id=26):(Total: 1s815ms, non-child: 1s815ms, % non-child: 100.00%)
- BytesSent: 273.57 MB (286860434)
- NetworkThroughput(*): 377.07 MB/sec
- OverallThroughput: 150.67 MB/sec
- PeakMemoryUsage: 2.12 MB (2226048)
- RowsReturned: 4.43M (4425508)
- SerializeBatchTime: 1s089ms
- TransmitDataRPCTime: 725.523ms
- UncompressedRowBatchSize: 581.02 MB (609248552)
CodeGen:(Total: 190.336ms, non-child: 190.336ms, % non-child: 100.00%)
- CodegenTime: 3.867ms
- CompileTime: 36.775ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 61 (61)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 112.697ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 40.089ms
AGGREGATION_NODE (id=1):(Total: 5s746ms, non-child: 5s664ms, % non-child: 98.59%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 3.590ms
- GetResultsTime: 1s469ms
- HTResizeTime: 191.673ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 907.05 MB (951111449)
- PinTime: 0.000ns
- ReductionFactorEstimate: 37.23
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.43M (4425508)
- RowsReturnedRate: 770.15 K/sec
- StreamingTime: 3s617ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 81.291ms, non-child: 81.291ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.75 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0%
File Formats: PARQUET/SNAPPY:30
BytesRead(500.000ms): 86.90 MB, 106.56 MB, 182.45 MB, 205.93 MB, 273.35 MB, 299.23 MB, 353.50 MB
- FooterProcessingTime: (Avg: 12.704ms ; Min: 2.661ms ; Max: 59.732ms ; Number of samples: 30)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.86
- BytesRead: 353.50 MB (370670701)
- BytesReadDataNodeCache: 344.24 MB (360966202)
- BytesReadLocal: 353.50 MB (370670701)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 353.50 MB (370670701)
- DecompressionTime: 792.979ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 30 (30)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 26.09 MB (27362478)
- PerReadThreadRawHdfsThroughput: 37.29 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 26.485ms
- RowBatchQueuePutWaitTime: 22s431ms
- RowsRead: 11.46M (11459388)
- RowsReturned: 11.46M (11459388)
- RowsReturnedRate: 140.97 M/sec
- ScanRangesComplete: 30 (30)
- ScannerThreadsInvoluntaryContextSwitches: 48 (48)
- ScannerThreadsTotalWallClockTime: 24s469ms
- MaterializeTupleTime(*): 362.713ms
- ScannerThreadsSysTime: 224.000ms
- ScannerThreadsUserTime: 1s500ms
- ScannerThreadsVoluntaryContextSwitches: 11.74K (11742)
- TotalRawHdfsReadTime(*): 9.256ms
- TotalReadThroughput: 101.00 MB/sec
Instance 514ee9ab39cdc507:b (host=cdh1.net.cuberonlabs.com:22000):(Total: 8s011ms, non-child: 724.430ms, % non-child: 9.04%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/2.99 GB
MemoryUsage(500.000ms): 1.90 MB, 234.84 MB, 315.00 MB, 507.79 MB, 552.22 MB, 602.26 MB, 769.44 MB, 874.63 MB, 920.68 MB, 857.50 MB, 742.15 MB, 628.12 MB, 514.13 MB, 400.01 MB, 254.29 MB, 115.06 MB
ThreadUsage(500.000ms): 1, 7, 7, 7, 7, 7, 7, 7, 5, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 3.88
- BloomFilterBytes: 0
- PeakMemoryUsage: 920.68 MB (965399238)
- PerHostPeakMemUsage: 1.81 GB (1939587581)
- RowsProduced: 4.62M (4622415)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 8.061ms
- TotalStorageWaitTime: 29.624ms
- TotalThreadsInvoluntaryContextSwitches: 48 (48)
- TotalThreadsTotalWallClockTime: 31s737ms
- TotalThreadsSysTime: 1s000ms
- TotalThreadsUserTime: 8s992ms
- TotalThreadsVoluntaryContextSwitches: 13.48K (13480)
Fragment Instance Lifecycle Timings:
- ExecTime: 7s826ms
- ExecTreeExecTime: 5s651ms
- OpenTime: 153.542ms
- ExecTreeOpenTime: 45.388us
- PrepareTime: 31.684ms
- ExecTreePrepareTime: 920.168us
DataStreamSender (dst_id=26):(Total: 1s460ms, non-child: 1s460ms, % non-child: 100.00%)
- BytesSent: 283.71 MB (297494080)
- NetworkThroughput(*): 745.94 MB/sec
- OverallThroughput: 194.23 MB/sec
- PeakMemoryUsage: 2.12 MB (2226048)
- RowsReturned: 4.62M (4622415)
- SerializeBatchTime: 1s079ms
- TransmitDataRPCTime: 380.340ms
- UncompressedRowBatchSize: 602.49 MB (631760477)
CodeGen:(Total: 176.298ms, non-child: 176.298ms, % non-child: 100.00%)
- CodegenTime: 3.870ms
- CompileTime: 35.464ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 61 (61)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 115.965ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 24.165ms
AGGREGATION_NODE (id=1):(Total: 5s650ms, non-child: 5s562ms, % non-child: 98.44%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 681.640us
- GetResultsTime: 1s153ms
- HTResizeTime: 229.148ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 914.91 MB (959353038)
- PinTime: 0.000ns
- ReductionFactorEstimate: 37.82
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.62M (4622415)
- RowsReturnedRate: 818.11 K/sec
- StreamingTime: 3s980ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 88.063ms, non-child: 88.063ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/2.99 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:35
BytesRead(500.000ms): 0, 87.42 MB, 137.28 MB, 174.40 MB, 219.84 MB, 258.57 MB, 312.01 MB, 341.77 MB, 383.02 MB
- FooterProcessingTime: (Avg: 7.965ms ; Min: 3.214ms ; Max: 25.064ms ; Number of samples: 35)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 5.75
- BytesRead: 383.02 MB (401624666)
- BytesReadDataNodeCache: 372.23 MB (390306397)
- BytesReadLocal: 383.02 MB (401624666)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 383.02 MB (401624666)
- DecompressionTime: 886.275ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 35 (35)
- NumScannerThreadsStarted: 6 (6)
- PeakMemoryUsage: 20.70 MB (21706639)
- PerReadThreadRawHdfsThroughput: 29.32 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 23.897ms
- RowBatchQueuePutWaitTime: 21s585ms
- RowsRead: 12.55M (12550697)
- RowsReturned: 12.55M (12550697)
- RowsReturnedRate: 142.52 M/sec
- ScanRangesComplete: 35 (35)
- ScannerThreadsInvoluntaryContextSwitches: 25 (25)
- ScannerThreadsTotalWallClockTime: 23s758ms
- MaterializeTupleTime(*): 431.481ms
- ScannerThreadsSysTime: 244.000ms
- ScannerThreadsUserTime: 1s820ms
- ScannerThreadsVoluntaryContextSwitches: 12.84K (12842)
- TotalRawHdfsReadTime(*): 12.757ms
- TotalReadThroughput: 85.12 MB/sec
Instance 514ee9ab39cdc507:4 (host=cdh6.net.cuberonlabs.com:22000):(Total: 7s777ms, non-child: 701.380ms, % non-child: 9.02%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/2.89 GB
MemoryUsage(500.000ms): 1.90 MB, 236.50 MB, 315.80 MB, 516.39 MB, 556.74 MB, 605.03 MB, 829.37 MB, 876.41 MB, 905.94 MB, 792.87 MB, 679.75 MB, 566.78 MB, 453.35 MB, 340.36 MB, 170.74 MB, 57.58 MB
ThreadUsage(500.000ms): 1, 8, 8, 8, 8, 8, 8, 7, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 4.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 918.52 MB (963133620)
- PerHostPeakMemUsage: 1.67 GB (1794839264)
- RowsProduced: 4.50M (4499298)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 8.311ms
- TotalStorageWaitTime: 19.551ms
- TotalThreadsInvoluntaryContextSwitches: 29 (29)
- TotalThreadsTotalWallClockTime: 33s872ms
- TotalThreadsSysTime: 832.000ms
- TotalThreadsUserTime: 8s628ms
- TotalThreadsVoluntaryContextSwitches: 12.94K (12937)
Fragment Instance Lifecycle Timings:
- ExecTime: 7s606ms
- ExecTreeExecTime: 5s490ms
- OpenTime: 132.894ms
- ExecTreeOpenTime: 36.728us
- PrepareTime: 37.972ms
- ExecTreePrepareTime: 803.900us
DataStreamSender (dst_id=26):(Total: 1s422ms, non-child: 1s422ms, % non-child: 100.00%)
- BytesSent: 276.96 MB (290417254)
- NetworkThroughput(*): 757.02 MB/sec
- OverallThroughput: 194.69 MB/sec
- PeakMemoryUsage: 1.94 MB (2029440)
- RowsReturned: 4.50M (4499298)
- SerializeBatchTime: 1s056ms
- TransmitDataRPCTime: 365.861ms
- UncompressedRowBatchSize: 587.82 MB (616378366)
CodeGen:(Total: 165.347ms, non-child: 165.347ms, % non-child: 100.00%)
- CodegenTime: 4.346ms
- CompileTime: 34.084ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 61 (61)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 97.141ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 33.317ms
AGGREGATION_NODE (id=1):(Total: 5s488ms, non-child: 5s341ms, % non-child: 97.32%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 973.192us
- GetResultsTime: 1s173ms
- HTResizeTime: 186.294ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 907.04 MB (951101755)
- PinTime: 0.000ns
- ReductionFactorEstimate: 37.13
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.50M (4499298)
- RowsReturnedRate: 819.80 K/sec
- StreamingTime: 3s726ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 146.873ms, non-child: 146.873ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/2.89 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:32
BytesRead(500.000ms): 0, 78.30 MB, 142.41 MB, 170.01 MB, 223.32 MB, 263.74 MB, 304.71 MB, 371.24 MB
- FooterProcessingTime: (Avg: 8.393ms ; Min: 2.917ms ; Max: 83.208ms ; Number of samples: 32)
- AverageHdfsReadThreadConcurrency: 0.14
- AverageScannerThreadConcurrency: 6.86
- BytesRead: 371.24 MB (389277893)
- BytesReadDataNodeCache: 361.37 MB (378927166)
- BytesReadLocal: 371.24 MB (389277893)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 371.24 MB (389277893)
- DecompressionTime: 839.129ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 32 (32)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 22.22 MB (23303732)
- PerReadThreadRawHdfsThroughput: 36.14 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 91.533ms
- RowBatchQueuePutWaitTime: 23s736ms
- RowsRead: 12.15M (12150960)
- RowsReturned: 12.15M (12150960)
- RowsReturnedRate: 82.73 M/sec
- ScanRangesComplete: 32 (32)
- ScannerThreadsInvoluntaryContextSwitches: 17 (17)
- ScannerThreadsTotalWallClockTime: 26s133ms
- MaterializeTupleTime(*): 393.822ms
- ScannerThreadsSysTime: 188.000ms
- ScannerThreadsUserTime: 1s648ms
- ScannerThreadsVoluntaryContextSwitches: 12.29K (12287)
- TotalRawHdfsReadTime(*): 10.032ms
- TotalReadThroughput: 92.81 MB/sec
Instance 514ee9ab39cdc507:d (host=cdh7.net.cuberonlabs.com:22000):(Total: 7s336ms, non-child: 421.549ms, % non-child: 5.75%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:27/2.46 GB
MemoryUsage(500.000ms): 1.90 MB, 238.99 MB, 302.55 MB, 511.33 MB, 559.89 MB, 607.70 MB, 692.27 MB, 858.52 MB, 804.35 MB, 697.04 MB, 590.08 MB, 482.89 MB, 343.29 MB, 215.59 MB, 75.39 MB
ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 10, 7, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 4.67
- BloomFilterBytes: 0
- PeakMemoryUsage: 874.58 MB (917064013)
- PerHostPeakMemUsage: 1.58 GB (1699637471)
- RowsProduced: 4.01M (4009348)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 10.534ms
- TotalStorageWaitTime: 16.151ms
- TotalThreadsInvoluntaryContextSwitches: 53 (53)
- TotalThreadsTotalWallClockTime: 35s321ms
- TotalThreadsSysTime: 820.000ms
- TotalThreadsUserTime: 8s148ms
- TotalThreadsVoluntaryContextSwitches: 11.12K (11124)
Fragment Instance Lifecycle Timings:
- ExecTime: 7s158ms
- ExecTreeExecTime: 5s104ms
- OpenTime: 143.282ms
- ExecTreeOpenTime: 42.075us
- PrepareTime: 34.931ms
- ExecTreePrepareTime: 663.698us
DataStreamSender (dst_id=26):(Total: 1s638ms, non-child: 1s638ms, % non-child: 100.00%)
- BytesSent: 246.34 MB (258306556)
- NetworkThroughput(*): 367.57 MB/sec
- OverallThroughput: 150.30 MB/sec
- PeakMemoryUsage: 2.06 MB (2160512)
- RowsReturned: 4.01M (4009348)
- SerializeBatchTime: 968.204ms
- TransmitDataRPCTime: 670.177ms
- UncompressedRowBatchSize: 522.07 MB (547432694)
CodeGen:(Total: 173.001ms, non-child: 173.001ms, % non-child: 100.00%)
- CodegenTime: 3.962ms
- CompileTime: 34.944ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 61 (61)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 107.257ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 29.965ms
AGGREGATION_NODE (id=1):(Total: 5s102ms, non-child: 5s032ms, % non-child: 98.63%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 2.822ms
- GetResultsTime: 1s088ms
- HTResizeTime: 218.390ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 858.99 MB (900719081)
- PinTime: 0.000ns
- ReductionFactorEstimate: 36.43
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.01M (4009348)
- RowsReturnedRate: 785.72 K/sec
- StreamingTime: 3s559ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 70.079ms, non-child: 70.079ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:27/2.46 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 27 out of 27
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:27
BytesRead(500.000ms): 0, 88.90 MB, 121.42 MB, 201.89 MB, 201.89 MB, 274.87 MB, 314.43 MB, 314.43 MB
- FooterProcessingTime: (Avg: 9.811ms ; Min: 3.240ms ; Max: 40.813ms ; Number of samples: 27)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.86
- BytesRead: 314.43 MB (329708824)
- BytesReadDataNodeCache: 306.11 MB (320983394)
- BytesReadLocal: 314.43 MB (329708824)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 314.43 MB (329708824)
- DecompressionTime: 798.207ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 27 (27)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 27.62 MB (28959987)
- PerReadThreadRawHdfsThroughput: 33.52 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 18.898ms
- RowBatchQueuePutWaitTime: 26s113ms
- RowsRead: 10.29M (10293228)
- RowsReturned: 10.29M (10293228)
- RowsReturnedRate: 146.88 M/sec
- ScanRangesComplete: 27 (27)
- ScannerThreadsInvoluntaryContextSwitches: 44 (44)
- ScannerThreadsTotalWallClockTime: 28s020ms
- MaterializeTupleTime(*): 376.312ms
- ScannerThreadsSysTime: 140.000ms
- ScannerThreadsUserTime: 1s596ms
- ScannerThreadsVoluntaryContextSwitches: 10.45K (10446)
- TotalRawHdfsReadTime(*): 9.159ms
- TotalReadThroughput: 78.61 MB/sec
Instance 514ee9ab39cdc507:5 (host=cdh15.net.cuberonlabs.com:22000):(Total: 7s244ms, non-child: 705.627ms, % non-child: 9.74%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.66 GB
MemoryUsage(500.000ms): 1.34 MB, 220.78 MB, 312.90 MB, 510.60 MB, 574.57 MB, 623.05 MB, 862.69 MB, 890.95 MB, 778.88 MB, 667.76 MB, 556.51 MB, 445.47 MB, 334.21 MB, 190.56 MB, 56.72 MB
ThreadUsage(500.000ms): 1, 8, 9, 9, 9, 9, 9, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 4.13
- BloomFilterBytes: 0
- PeakMemoryUsage: 900.09 MB (943817303)
- PerHostPeakMemUsage: 1.57 GB (1688553772)
- RowsProduced: 4.26M (4264338)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 8.585ms
- TotalStorageWaitTime: 21.626ms
- TotalThreadsInvoluntaryContextSwitches: 24 (24)
- TotalThreadsTotalWallClockTime: 31s600ms
- TotalThreadsSysTime: 840.000ms
- TotalThreadsUserTime: 7s920ms
- TotalThreadsVoluntaryContextSwitches: 12.21K (12214)
Fragment Instance Lifecycle Timings:
- ExecTime: 6s985ms
- ExecTreeExecTime: 4s864ms
- OpenTime: 206.475ms
- ExecTreeOpenTime: 43.371us
- PrepareTime: 52.447ms
- ExecTreePrepareTime: 739.688us
DataStreamSender (dst_id=26):(Total: 1s422ms, non-child: 1s422ms, % non-child: 100.00%)
- BytesSent: 264.18 MB (277017219)
- NetworkThroughput(*): 737.14 MB/sec
- OverallThroughput: 185.68 MB/sec
- PeakMemoryUsage: 2.01 MB (2103168)
- RowsReturned: 4.26M (4264338)
- SerializeBatchTime: 1s063ms
- TransmitDataRPCTime: 358.389ms
- UncompressedRowBatchSize: 560.56 MB (587785096)
CodeGen:(Total: 252.858ms, non-child: 252.858ms, % non-child: 100.00%)
- CodegenTime: 5.440ms
- CompileTime: 45.724ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 61 (61)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 159.145ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 46.994ms
AGGREGATION_NODE (id=1):(Total: 4s862ms, non-child: 4s796ms, % non-child: 98.64%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 1.651ms
- GetResultsTime: 1s147ms
- HTResizeTime: 182.996ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 891.07 MB (934354560)
- PinTime: 0.000ns
- ReductionFactorEstimate: 37.68
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.26M (4264338)
- RowsReturnedRate: 876.93 K/sec
- StreamingTime: 3s212ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 66.123ms, non-child: 66.123ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.66 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:30
BytesRead(500.000ms): 0, 83.55 MB, 133.66 MB, 170.04 MB, 236.55 MB, 288.81 MB, 341.91 MB, 341.91 MB
- FooterProcessingTime: (Avg: 6.848ms ; Min: 2.723ms ; Max: 20.857ms ; Number of samples: 30)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.71
- BytesRead: 341.91 MB (358518861)
- BytesReadDataNodeCache: 332.65 MB (348813550)
- BytesReadLocal: 341.91 MB (358518861)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 341.91 MB (358518861)
- DecompressionTime: 719.576ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 30 (30)
- NumScannerThreadsStarted: 8 (8)
- PeakMemoryUsage: 25.51 MB (26746433)
- PerReadThreadRawHdfsThroughput: 27.89 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 18.606ms
- RowBatchQueuePutWaitTime: 22s692ms
- RowsRead: 11.11M (11113210)
- RowsReturned: 11.11M (11113210)
- RowsReturnedRate: 168.07 M/sec
- ScanRangesComplete: 30 (30)
- ScannerThreadsInvoluntaryContextSwitches: 15 (15)
- ScannerThreadsTotalWallClockTime: 24s408ms
- MaterializeTupleTime(*): 352.323ms
- ScannerThreadsSysTime: 192.000ms
- ScannerThreadsUserTime: 1s420ms
- ScannerThreadsVoluntaryContextSwitches: 11.44K (11441)
- TotalRawHdfsReadTime(*): 11.973ms
- TotalReadThroughput: 85.48 MB/sec
Instance 514ee9ab39cdc507:f (host=cdh11.net.cuberonlabs.com:22000):(Total: 6s842ms, non-child: 713.592ms, % non-child: 10.43%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:21/2.18 GB
MemoryUsage(500.000ms): 223.03 MB, 302.24 MB, 510.28 MB, 558.22 MB, 606.48 MB, 751.05 MB, 842.24 MB, 683.97 MB, 579.01 MB, 421.48 MB, 316.39 MB, 211.28 MB, 106.31 MB
ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 8, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 4.23
- BloomFilterBytes: 0
- PeakMemoryUsage: 853.94 MB (895418488)
- PerHostPeakMemUsage: 1.48 GB (1591793359)
- RowsProduced: 3.65M (3647743)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 8.444ms
- TotalStorageWaitTime: 14.284ms
- TotalThreadsInvoluntaryContextSwitches: 26 (26)
- TotalThreadsTotalWallClockTime: 28s118ms
- TotalThreadsSysTime: 684.000ms
- TotalThreadsUserTime: 7s440ms
- TotalThreadsVoluntaryContextSwitches: 9.48K (9480)
Fragment Instance Lifecycle Timings:
- ExecTime: 6s666ms
- ExecTreeExecTime: 4s631ms
- OpenTime: 140.860ms
- ExecTreeOpenTime: 38.673us
- PrepareTime: 34.947ms
- ExecTreePrepareTime: 807.890us
DataStreamSender (dst_id=26):(Total: 1s327ms, non-child: 1s327ms, % non-child: 100.00%)
- BytesSent: 226.79 MB (237809909)
- NetworkThroughput(*): 733.81 MB/sec
- OverallThroughput: 170.80 MB/sec
- PeakMemoryUsage: 2.00 MB (2094976)
- RowsReturned: 3.65M (3647743)
- SerializeBatchTime: 1s018ms
- TransmitDataRPCTime: 309.062ms
- UncompressedRowBatchSize: 480.34 MB (503673659)
CodeGen:(Total: 170.626ms, non-child: 170.626ms, % non-child: 100.00%)
- CodegenTime: 3.655ms
- CompileTime: 35.020ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 61 (61)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 104.745ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 30.106ms
AGGREGATION_NODE (id=1):(Total: 4s630ms, non-child: 4s567ms, % non-child: 98.64%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 2.324ms
- GetResultsTime: 1s110ms
- HTResizeTime: 218.593ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 843.15 MB (884106972)
- PinTime: 0.000ns
- ReductionFactorEstimate: 36.34
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 3.65M (3647743)
- RowsReturnedRate: 787.73 K/sec
- StreamingTime: 3s038ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 63.034ms, non-child: 63.034ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:21/2.18 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 21 out of 21
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0%
File Formats: PARQUET/SNAPPY:21
BytesRead(500.000ms): 94.40 MB, 107.82 MB, 187.60 MB, 187.60 MB, 280.52 MB, 280.52 MB
- FooterProcessingTime: (Avg: 12.273ms ; Min: 2.943ms ; Max: 45.347ms ; Number of samples: 21)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.00
- BytesRead: 280.52 MB (294151608)
- BytesReadDataNodeCache: 274.04 MB (287356214)
- BytesReadLocal: 280.52 MB (294151608)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 280.52 MB (294151608)
- DecompressionTime: 640.142ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 21 (21)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 24.27 MB (25451362)
- PerReadThreadRawHdfsThroughput: 36.43 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 24.091ms
- RowBatchQueuePutWaitTime: 19s780ms
- RowsRead: 8.99M (8989956)
- RowsReturned: 8.99M (8989956)
- RowsReturnedRate: 142.62 M/sec
- ScanRangesComplete: 21 (21)
- ScannerThreadsInvoluntaryContextSwitches: 13 (13)
- ScannerThreadsTotalWallClockTime: 21s310ms
- MaterializeTupleTime(*): 289.478ms
- ScannerThreadsSysTime: 116.000ms
- ScannerThreadsUserTime: 1s252ms
- ScannerThreadsVoluntaryContextSwitches: 9.00K (8996)
- TotalRawHdfsReadTime(*): 7.519ms
- TotalReadThroughput: 93.51 MB/sec
Instance 514ee9ab39cdc507:2 (host=cdh16.net.cuberonlabs.com:22000):(Total: 6s797ms, non-child: 620.421ms, % non-child: 9.13%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.64 GB
MemoryUsage(500.000ms): 202.44 MB, 301.15 MB, 508.97 MB, 556.67 MB, 608.05 MB, 844.20 MB, 887.85 MB, 778.83 MB, 667.64 MB, 501.19 MB, 390.10 MB, 222.85 MB, 112.17 MB
ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 8, 4, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 4.46
- BloomFilterBytes: 0
- PeakMemoryUsage: 897.24 MB (940825028)
- PerHostPeakMemUsage: 1.64 GB (1763578733)
- RowsProduced: 4.24M (4235020)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 9.226ms
- TotalStorageWaitTime: 19.494ms
- TotalThreadsInvoluntaryContextSwitches: 23 (23)
- TotalThreadsTotalWallClockTime: 28s676ms
- TotalThreadsSysTime: 716.000ms
- TotalThreadsUserTime: 7s844ms
- TotalThreadsVoluntaryContextSwitches: 11.83K (11833)
Fragment Instance Lifecycle Timings:
- ExecTime: 6s596ms
- ExecTreeExecTime: 4s643ms
- OpenTime: 163.870ms
- ExecTreeOpenTime: 33.295us
- PrepareTime: 36.623ms
- ExecTreePrepareTime: 1.160ms
DataStreamSender (dst_id=26):(Total: 1s339ms, non-child: 1s339ms, % non-child: 100.00%)
- BytesSent: 261.14 MB (273825491)
- NetworkThroughput(*): 742.48 MB/sec
- OverallThroughput: 194.90 MB/sec
- PeakMemoryUsage: 2.01 MB (2103168)
- RowsReturned: 4.24M (4235020)
- SerializeBatchTime: 987.286ms
- TransmitDataRPCTime: 351.712ms
- UncompressedRowBatchSize: 554.20 MB (581121446)
CodeGen:(Total: 194.797ms, non-child: 194.797ms, % non-child: 100.00%)
- CodegenTime: 3.620ms
- CompileTime: 37.106ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 61 (61)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 125.333ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 31.593ms
AGGREGATION_NODE (id=1):(Total: 4s642ms, non-child: 4s566ms, % non-child: 98.37%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 3.155ms
- GetResultsTime: 969.958ms
- HTResizeTime: 193.184ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 891.19 MB (934477432)
- PinTime: 0.000ns
- ReductionFactorEstimate: 37.30
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.24M (4235020)
- RowsReturnedRate: 912.25 K/sec
- StreamingTime: 3s241ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 75.856ms, non-child: 75.856ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.64 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:28
BytesRead(500.000ms): 83.82 MB, 101.45 MB, 177.31 MB, 204.51 MB, 284.13 MB, 311.16 MB, 337.87 MB
- FooterProcessingTime: (Avg: 9.426ms ; Min: 3.022ms ; Max: 34.360ms ; Number of samples: 28)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.43
- BytesRead: 337.87 MB (354285165)
- BytesReadDataNodeCache: 329.24 MB (345228228)
- BytesReadLocal: 337.87 MB (354285165)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 337.87 MB (354285165)
- DecompressionTime: 849.925ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 28 (28)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 22.51 MB (23601579)
- PerReadThreadRawHdfsThroughput: 26.38 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 28.324ms
- RowBatchQueuePutWaitTime: 19s917ms
- RowsRead: 11.05M (11051815)
- RowsReturned: 11.05M (11051815)
- RowsReturnedRate: 145.69 M/sec
- ScanRangesComplete: 28 (28)
- ScannerThreadsInvoluntaryContextSwitches: 12 (12)
- ScannerThreadsTotalWallClockTime: 21s915ms
- MaterializeTupleTime(*): 407.267ms
- ScannerThreadsSysTime: 184.000ms
- ScannerThreadsUserTime: 1s672ms
- ScannerThreadsVoluntaryContextSwitches: 11.09K (11093)
- TotalRawHdfsReadTime(*): 12.509ms
- TotalReadThroughput: 96.54 MB/sec
Instance 514ee9ab39cdc507:9 (host=cdh12.net.cuberonlabs.com:22000):(Total: 6s204ms, non-child: 664.855ms, % non-child: 10.72%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:20/1.81 GB
MemoryUsage(500.000ms): 36.88 MB, 259.20 MB, 317.62 MB, 526.06 MB, 574.16 MB, 601.89 MB, 526.56 MB, 414.37 MB, 339.03 MB, 263.89 MB, 168.46 MB, 76.13 MB
ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 3.92
- BloomFilterBytes: 0
- PeakMemoryUsage: 603.84 MB (633173165)
- PerHostPeakMemUsage: 1.12 GB (1201773720)
- RowsProduced: 3.08M (3081902)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 8.981ms
- TotalStorageWaitTime: 44.796ms
- TotalThreadsInvoluntaryContextSwitches: 45 (45)
- TotalThreadsTotalWallClockTime: 22s457ms
- TotalThreadsSysTime: 600.000ms
- TotalThreadsUserTime: 6s724ms
- TotalThreadsVoluntaryContextSwitches: 8.53K (8532)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s973ms
- ExecTreeExecTime: 4s042ms
- OpenTime: 193.221ms
- ExecTreeOpenTime: 50.038us
- PrepareTime: 38.327ms
- ExecTreePrepareTime: 597.137us
DataStreamSender (dst_id=26):(Total: 1s271ms, non-child: 1s271ms, % non-child: 100.00%)
- BytesSent: 189.79 MB (199013583)
- NetworkThroughput(*): 591.57 MB/sec
- OverallThroughput: 149.21 MB/sec
- PeakMemoryUsage: 2.06 MB (2160512)
- RowsReturned: 3.08M (3081902)
- SerializeBatchTime: 950.550ms
- TransmitDataRPCTime: 320.829ms
- UncompressedRowBatchSize: 401.16 MB (420646138)
CodeGen:(Total: 226.403ms, non-child: 226.403ms, % non-child: 100.00%)
- CodegenTime: 4.175ms
- CompileTime: 49.544ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 61 (61)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 142.261ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 33.804ms
AGGREGATION_NODE (id=1):(Total: 4s041ms, non-child: 3s977ms, % non-child: 98.42%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 3.521ms
- GetResultsTime: 1s129ms
- HTResizeTime: 112.241ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 603.03 MB (632327306)
- PinTime: 0.000ns
- ReductionFactorEstimate: 68.86
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 3.08M (3081902)
- RowsReturnedRate: 762.55 K/sec
- StreamingTime: 2s426ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 63.761ms, non-child: 63.761ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:20/1.81 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 20 out of 20
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0%
File Formats: PARQUET/SNAPPY:20
BytesRead(500.000ms): 81.29 MB, 94.48 MB, 151.99 MB, 191.93 MB, 231.94 MB
- FooterProcessingTime: (Avg: 8.643ms ; Min: 3.553ms ; Max: 25.891ms ; Number of samples: 20)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.00
- BytesRead: 231.94 MB (243208286)
- BytesReadDataNodeCache: 225.77 MB (236739599)
- BytesReadLocal: 231.94 MB (243208286)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 231.94 MB (243208286)
- DecompressionTime: 537.122ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 20 (20)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 25.09 MB (26308726)
- PerReadThreadRawHdfsThroughput: 28.90 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 22.834ms
- RowBatchQueuePutWaitTime: 14s940ms
- RowsRead: 7.62M (7619211)
- RowsReturned: 7.62M (7619211)
- RowsReturnedRate: 119.50 M/sec
- ScanRangesComplete: 20 (20)
- ScannerThreadsInvoluntaryContextSwitches: 13 (13)
- ScannerThreadsTotalWallClockTime: 16s291ms
- MaterializeTupleTime(*): 244.923ms
- ScannerThreadsSysTime: 112.000ms
- ScannerThreadsUserTime: 1s120ms
- ScannerThreadsVoluntaryContextSwitches: 7.90K (7897)
- TotalRawHdfsReadTime(*): 7.836ms
- TotalReadThroughput: 92.78 MB/sec
Instance 514ee9ab39cdc507:a (host=cdh14.net.cuberonlabs.com:22000):(Total: 5s535ms, non-child: 545.901ms, % non-child: 9.86%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:22/2.04 GB
MemoryUsage(500.000ms): 194.65 MB, 285.42 MB, 509.51 MB, 575.28 MB, 617.00 MB, 810.01 MB, 658.19 MB, 506.96 MB, 354.90 MB, 203.14 MB, 51.53 MB
ThreadUsage(500.000ms): 8, 8, 8, 8, 6, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 4.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 825.13 MB (865209229)
- PerHostPeakMemUsage: 1.44 GB (1548652528)
- RowsProduced: 3.42M (3424061)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 8.017ms
- TotalStorageWaitTime: 24.394ms
- TotalThreadsInvoluntaryContextSwitches: 10 (10)
- TotalThreadsTotalWallClockTime: 22s284ms
- TotalThreadsSysTime: 652.000ms
- TotalThreadsUserTime: 6s076ms
- TotalThreadsVoluntaryContextSwitches: 9.05K (9046)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s350ms
- ExecTreeExecTime: 3s680ms
- OpenTime: 146.984ms
- ExecTreeOpenTime: 40.674us
- PrepareTime: 38.442ms
- ExecTreePrepareTime: 772.667us
DataStreamSender (dst_id=26):(Total: 1s130ms, non-child: 1s130ms, % non-child: 100.00%)
- BytesSent: 210.41 MB (220627506)
- NetworkThroughput(*): 754.58 MB/sec
- OverallThroughput: 186.19 MB/sec
- PeakMemoryUsage: 2.06 MB (2160512)
- RowsReturned: 3.42M (3424061)
- SerializeBatchTime: 850.720ms
- TransmitDataRPCTime: 278.838ms
- UncompressedRowBatchSize: 445.71 MB (467365383)
CodeGen:(Total: 179.914ms, non-child: 179.914ms, % non-child: 100.00%)
- CodegenTime: 4.023ms
- CompileTime: 34.829ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 61 (61)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 110.872ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 33.453ms
AGGREGATION_NODE (id=1):(Total: 3s680ms, non-child: 3s623ms, % non-child: 98.47%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 960.062us
- GetResultsTime: 827.189ms
- HTResizeTime: 183.887ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 811.11 MB (850505881)
- PinTime: 0.000ns
- ReductionFactorEstimate: 36.60
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 3.42M (3424061)
- RowsReturnedRate: 930.44 K/sec
- StreamingTime: 2s502ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 56.314ms, non-child: 56.314ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:22/2.04 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 22 out of 22
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:22
BytesRead(500.000ms): 87.26 MB, 99.83 MB, 170.40 MB, 198.03 MB, 261.96 MB
- FooterProcessingTime: (Avg: 11.487ms ; Min: 3.426ms ; Max: 31.722ms ; Number of samples: 22)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.60
- BytesRead: 261.96 MB (274689241)
- BytesReadDataNodeCache: 255.18 MB (267573052)
- BytesReadLocal: 261.96 MB (274689241)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 261.96 MB (274689241)
- DecompressionTime: 578.864ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 22 (22)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 23.94 MB (25104339)
- PerReadThreadRawHdfsThroughput: 32.21 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 22.869ms
- RowBatchQueuePutWaitTime: 15s356ms
- RowsRead: 8.55M (8554292)
- RowsReturned: 8.55M (8554292)
- RowsReturnedRate: 151.90 M/sec
- ScanRangesComplete: 22 (22)
- ScannerThreadsInvoluntaryContextSwitches: 4 (4)
- ScannerThreadsTotalWallClockTime: 16s787ms
- MaterializeTupleTime(*): 249.220ms
- ScannerThreadsSysTime: 112.000ms
- ScannerThreadsUserTime: 1s160ms
- ScannerThreadsVoluntaryContextSwitches: 8.62K (8624)
- TotalRawHdfsReadTime(*): 7.943ms
- TotalReadThroughput: 104.79 MB/sec
Averaged Fragment F01:(Total: 13s726ms, non-child: 4s969ms, % non-child: 36.21%)
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:13s624ms max:13s834ms mean: 13s727ms stddev:56.614ms
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 17
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 331.11 MB (347191915)
- PerHostPeakMemUsage: 1.70 GB (1824024877)
- RowsProduced: 2.55M (2548431)
- TotalNetworkReceiveTime: 6s061ms
- TotalNetworkSendTime: 4s491ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 19 (19)
- TotalThreadsTotalWallClockTime: 13s689ms
- TotalThreadsSysTime: 234.588ms
- TotalThreadsUserTime: 2s992ms
- TotalThreadsVoluntaryContextSwitches: 5.85K (5854)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s939ms
- ExecTreeExecTime: 85.276ms
- OpenTime: 7s749ms
- ExecTreeOpenTime: 7s621ms
- PrepareTime: 37.593ms
- ExecTreePrepareTime: 775.004us
DataStreamSender (dst_id=28):(Total: 889.222ms, non-child: 889.222ms, % non-child: 100.00%)
- BytesSent: 122.13 MB (128060777)
- NetworkThroughput(*): 534.40 MB/sec
- OverallThroughput: 138.88 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 2.55M (2548431)
- SerializeBatchTime: 641.970ms
- TransmitDataRPCTime: 246.651ms
- UncompressedRowBatchSize: 201.24 MB (211012369)
CodeGen:(Total: 161.085ms, non-child: 161.085ms, % non-child: 100.00%)
- CodegenTime: 2.801ms
- CompileTime: 34.656ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 43 (43)
- NumInstructions: 836 (836)
- OptimizationTime: 92.213ms
- PeakMemoryUsage: 418.00 KB (428032)
- PrepareTime: 33.443ms
AGGREGATION_NODE (id=25):(Total: 7s706ms, non-child: 1s544ms, % non-child: 20.04%)
- BuildTime: 1s451ms
- GetNewBlockTime: 949.679us
- GetResultsTime: 73.484ms
- HTResizeTime: 163.056ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 330.17 MB (346203611)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.55M (2548431)
- RowsReturnedRate: 330.69 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.031us
EXCHANGE_NODE (id=24):(Total: 6s162ms, non-child: 6s162ms, % non-child: 100.00%)
- BytesReceived: 239.28 MB (250900204)
- ConvertRowBatchTime: 89.411ms
- DeserializeRowBatchTimer: 593.271ms
- FirstBatchArrivalWaitTime: 2s703ms
- PeakMemoryUsage: 0
- RowsReturned: 4.51M (4509900)
- RowsReturnedRate: 732.05 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Fragment F01:
Instance 514ee9ab39cdc507:25 (host=cdh13.net.cuberonlabs.com:22000):(Total: 13s834ms, non-child: 5s062ms, % non-child: 36.60%)
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 43.45 MB, 116.74 MB, 170.28 MB, 212.29 MB, 254.20 MB, 294.24 MB, 322.20 MB, 330.16 MB, 330.16 MB, 330.41 MB, 309.91 MB, 309.91 MB, 309.91 MB, 309.91 MB, 309.91 MB, 309.91 MB, 309.91 MB, 309.91 MB, 289.30 MB, 190.56 MB, 103.79 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 331.11 MB (347191915)
- PerHostPeakMemUsage: 1.66 GB (1782381748)
- RowsProduced: 2.55M (2545858)
- TotalNetworkReceiveTime: 6s165ms
- TotalNetworkSendTime: 4s457ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 9 (9)
- TotalThreadsTotalWallClockTime: 13s793ms
- TotalThreadsSysTime: 224.000ms
- TotalThreadsUserTime: 3s028ms
- TotalThreadsVoluntaryContextSwitches: 6.18K (6184)
Fragment Instance Lifecycle Timings:
- ExecTime: 6s049ms
- ExecTreeExecTime: 94.365ms
- OpenTime: 7s744ms
- ExecTreeOpenTime: 7s629ms
- PrepareTime: 41.090ms
- ExecTreePrepareTime: 598.355us
DataStreamSender (dst_id=28):(Total: 897.509ms, non-child: 897.509ms, % non-child: 100.00%)
- BytesSent: 122.05 MB (127983603)
- NetworkThroughput(*): 619.07 MB/sec
- OverallThroughput: 135.99 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 2.55M (2545858)
- SerializeBatchTime: 699.668ms
- TransmitDataRPCTime: 197.159ms
- UncompressedRowBatchSize: 201.09 MB (210857238)
CodeGen:(Total: 151.213ms, non-child: 151.213ms, % non-child: 100.00%)
- CodegenTime: 3.965ms
- CompileTime: 30.895ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 43 (43)
- NumInstructions: 836 (836)
- OptimizationTime: 82.451ms
- PeakMemoryUsage: 418.00 KB (428032)
- PrepareTime: 36.841ms
AGGREGATION_NODE (id=25):(Total: 7s723ms, non-child: 1s460ms, % non-child: 18.90%)
ExecOption: Codegen Enabled
- BuildTime: 1s358ms
- GetNewBlockTime: 688.695us
- GetResultsTime: 81.743ms
- HTResizeTime: 152.101ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 330.17 MB (346204015)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.55M (2545858)
- RowsReturnedRate: 329.63 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 982.000ns
EXCHANGE_NODE (id=24):(Total: 6s263ms, non-child: 195.667ms, % non-child: 3.12%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 6.09 MB, 26.90 MB, 66.69 MB, 111.87 MB, 153.46 MB, 190.92 MB, 214.04 MB, 228.12 MB, 236.42 MB
- BytesReceived: 239.42 MB (251054598)
- ConvertRowBatchTime: 86.491ms
- DeserializeRowBatchTimer: 620.925ms
- FirstBatchArrivalWaitTime: 2s716ms
- PeakMemoryUsage: 0
- RowsReturned: 4.51M (4510403)
- RowsReturnedRate: 720.14 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:29 (host=cdh17.net.cuberonlabs.com:22000):(Total: 13s817ms, non-child: 5s037ms, % non-child: 36.46%)
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 34.26 MB, 100.37 MB, 162.63 MB, 206.42 MB, 248.16 MB, 282.20 MB, 322.16 MB, 330.24 MB, 330.21 MB, 330.20 MB, 310.30 MB, 310.30 MB, 310.30 MB, 310.30 MB, 310.30 MB, 310.30 MB, 310.30 MB, 309.93 MB, 309.87 MB, 206.96 MB, 124.34 MB, 21.36 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 331.11 MB (347191915)
- PerHostPeakMemUsage: 1.75 GB (1879028559)
- RowsProduced: 2.55M (2545751)
- TotalNetworkReceiveTime: 5s822ms
- TotalNetworkSendTime: 4s454ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 18 (18)
- TotalThreadsTotalWallClockTime: 13s782ms
- TotalThreadsSysTime: 332.000ms
- TotalThreadsUserTime: 3s256ms
- TotalThreadsVoluntaryContextSwitches: 5.14K (5138)
Fragment Instance Lifecycle Timings:
- ExecTime: 6s031ms
- ExecTreeExecTime: 92.666ms
- OpenTime: 7s751ms
- ExecTreeOpenTime: 7s634ms
- PrepareTime: 34.269ms
- ExecTreePrepareTime: 656.903us
DataStreamSender (dst_id=28):(Total: 906.236ms, non-child: 906.236ms, % non-child: 100.00%)
- BytesSent: 121.93 MB (127852534)
- NetworkThroughput(*): 584.58 MB/sec
- OverallThroughput: 134.55 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 2.55M (2545751)
- SerializeBatchTime: 697.040ms
- TransmitDataRPCTime: 208.577ms
- UncompressedRowBatchSize: 200.93 MB (210685957)
CodeGen:(Total: 147.198ms, non-child: 147.198ms, % non-child: 100.00%)
- CodegenTime: 2.501ms
- CompileTime: 32.034ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 43 (43)
- NumInstructions: 836 (836)
- OptimizationTime: 84.094ms
- PeakMemoryUsage: 418.00 KB (428032)
- PrepareTime: 30.362ms
AGGREGATION_NODE (id=25):(Total: 7s726ms, non-child: 1s796ms, % non-child: 23.26%)
ExecOption: Codegen Enabled
- BuildTime: 1s697ms
- GetNewBlockTime: 1.533ms
- GetResultsTime: 80.040ms
- HTResizeTime: 186.796ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 330.16 MB (346203091)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.55M (2545751)
- RowsReturnedRate: 329.49 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.020us
EXCHANGE_NODE (id=24):(Total: 5s929ms, non-child: 208.399ms, % non-child: 3.51%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 4.76 MB, 21.92 MB, 59.55 MB, 105.02 MB, 147.13 MB, 185.51 MB, 210.99 MB, 226.34 MB, 235.14 MB, 239.21 MB
- BytesReceived: 239.27 MB (250896243)
- ConvertRowBatchTime: 94.801ms
- DeserializeRowBatchTimer: 636.433ms
- FirstBatchArrivalWaitTime: 2s718ms
- PeakMemoryUsage: 0
- RowsReturned: 4.51M (4511526)
- RowsReturnedRate: 760.86 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:2e (host=cdh5.net.cuberonlabs.com:22000):(Total: 13s777ms, non-child: 4s984ms, % non-child: 36.18%)
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 43.49 MB, 108.83 MB, 170.29 MB, 212.28 MB, 254.20 MB, 294.16 MB, 322.28 MB, 330.24 MB, 330.16 MB, 330.55 MB, 310.19 MB, 310.19 MB, 310.19 MB, 310.19 MB, 310.19 MB, 310.19 MB, 310.19 MB, 309.99 MB, 289.33 MB, 186.30 MB, 83.11 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 331.11 MB (347191915)
- PerHostPeakMemUsage: 2.15 GB (2303708143)
- RowsProduced: 2.55M (2547960)
- TotalNetworkReceiveTime: 6s126ms
- TotalNetworkSendTime: 4s439ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 27 (27)
- TotalThreadsTotalWallClockTime: 13s737ms
- TotalThreadsSysTime: 316.000ms
- TotalThreadsUserTime: 2s944ms
- TotalThreadsVoluntaryContextSwitches: 5.63K (5628)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s988ms
- ExecTreeExecTime: 93.192ms
- OpenTime: 7s749ms
- ExecTreeOpenTime: 7s633ms
- PrepareTime: 39.938ms
- ExecTreePrepareTime: 741.056us
DataStreamSender (dst_id=28):(Total: 916.697ms, non-child: 916.697ms, % non-child: 100.00%)
- BytesSent: 122.13 MB (128058591)
- NetworkThroughput(*): 603.69 MB/sec
- OverallThroughput: 133.22 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 2.55M (2547960)
- SerializeBatchTime: 713.704ms
- TransmitDataRPCTime: 202.300ms
- UncompressedRowBatchSize: 201.24 MB (211019463)
CodeGen:(Total: 150.845ms, non-child: 150.845ms, % non-child: 100.00%)
- CodegenTime: 3.465ms
- CompileTime: 31.038ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 43 (43)
- NumInstructions: 836 (836)
- OptimizationTime: 83.358ms
- PeakMemoryUsage: 418.00 KB (428032)
- PrepareTime: 35.518ms
AGGREGATION_NODE (id=25):(Total: 7s725ms, non-child: 1s501ms, % non-child: 19.44%)
ExecOption: Codegen Enabled
- BuildTime: 1s401ms
- GetNewBlockTime: 2.578ms
- GetResultsTime: 81.372ms
- HTResizeTime: 162.506ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 330.17 MB (346203427)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.55M (2547960)
- RowsReturnedRate: 329.80 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.064us
EXCHANGE_NODE (id=24):(Total: 6s223ms, non-child: 210.557ms, % non-child: 3.38%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 6.22 MB, 27.40 MB, 67.26 MB, 112.32 MB, 153.87 MB, 191.24 MB, 214.12 MB, 228.08 MB, 236.30 MB
- BytesReceived: 239.15 MB (250768424)
- ConvertRowBatchTime: 86.755ms
- DeserializeRowBatchTimer: 564.807ms
- FirstBatchArrivalWaitTime: 2s712ms
- PeakMemoryUsage: 0
- RowsReturned: 4.51M (4506249)
- RowsReturnedRate: 724.03 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:30 (host=cdh8.net.cuberonlabs.com:22000):(Total: 13s770ms, non-child: 4s814ms, % non-child: 34.96%)
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 12.77 MB, 52.42 MB, 136.49 MB, 186.63 MB, 222.16 MB, 254.20 MB, 294.20 MB, 330.16 MB, 330.20 MB, 330.16 MB, 310.01 MB, 310.01 MB, 310.01 MB, 310.01 MB, 310.01 MB, 310.01 MB, 310.01 MB, 310.01 MB, 309.90 MB, 289.33 MB, 186.34 MB, 83.33 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 331.11 MB (347191915)
- PerHostPeakMemUsage: 1.63 GB (1748411303)
- RowsProduced: 2.55M (2547991)
- TotalNetworkReceiveTime: 6s140ms
- TotalNetworkSendTime: 4s475ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 39 (39)
- TotalThreadsTotalWallClockTime: 13s731ms
- TotalThreadsSysTime: 192.000ms
- TotalThreadsUserTime: 3s016ms
- TotalThreadsVoluntaryContextSwitches: 5.63K (5630)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s980ms
- ExecTreeExecTime: 84.672ms
- OpenTime: 7s750ms
- ExecTreeOpenTime: 7s590ms
- PrepareTime: 39.418ms
- ExecTreePrepareTime: 674.265us
DataStreamSender (dst_id=28):(Total: 1s086ms, non-child: 1s086ms, % non-child: 100.00%)
- BytesSent: 122.10 MB (128026679)
- NetworkThroughput(*): 296.83 MB/sec
- OverallThroughput: 112.34 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 2.55M (2547991)
- SerializeBatchTime: 674.942ms
- TransmitDataRPCTime: 411.325ms
- UncompressedRowBatchSize: 201.23 MB (211004361)
CodeGen:(Total: 194.824ms, non-child: 194.824ms, % non-child: 100.00%)
- CodegenTime: 2.688ms
- CompileTime: 48.121ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 43 (43)
- NumInstructions: 836 (836)
- OptimizationTime: 110.837ms
- PeakMemoryUsage: 418.00 KB (428032)
- PrepareTime: 35.069ms
AGGREGATION_NODE (id=25):(Total: 7s674ms, non-child: 1s435ms, % non-child: 18.70%)
ExecOption: Codegen Enabled
- BuildTime: 1s344ms
- GetNewBlockTime: 736.416us
- GetResultsTime: 74.292ms
- HTResizeTime: 146.047ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 330.17 MB (346203373)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.55M (2547991)
- RowsReturnedRate: 332.02 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 979.000ns
EXCHANGE_NODE (id=24):(Total: 6s238ms, non-child: 212.358ms, % non-child: 3.40%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 779.70 KB, 8.15 MB, 33.79 MB, 74.82 MB, 120.09 MB, 160.69 MB, 196.19 MB, 217.09 MB, 229.50 MB, 236.89 MB
- BytesReceived: 238.87 MB (250468708)
- ConvertRowBatchTime: 86.847ms
- DeserializeRowBatchTimer: 554.125ms
- FirstBatchArrivalWaitTime: 2s668ms
- PeakMemoryUsage: 0
- RowsReturned: 4.50M (4502256)
- RowsReturnedRate: 721.66 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:33 (host=cdh10.net.cuberonlabs.com:22000):(Total: 13s763ms, non-child: 4s829ms, % non-child: 35.09%)
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 4.44 MB, 52.42 MB, 136.45 MB, 182.33 MB, 222.29 MB, 254.29 MB, 294.20 MB, 330.16 MB, 330.24 MB, 330.16 MB, 310.11 MB, 310.11 MB, 310.11 MB, 310.11 MB, 310.11 MB, 310.11 MB, 310.11 MB, 310.11 MB, 309.89 MB, 289.48 MB, 186.33 MB, 83.11 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 331.11 MB (347191915)
- PerHostPeakMemUsage: 1.66 GB (1784016472)
- RowsProduced: 2.55M (2546423)
- TotalNetworkReceiveTime: 6s083ms
- TotalNetworkSendTime: 4s500ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 27 (27)
- TotalThreadsTotalWallClockTime: 13s727ms
- TotalThreadsSysTime: 272.000ms
- TotalThreadsUserTime: 2s964ms
- TotalThreadsVoluntaryContextSwitches: 5.52K (5516)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s972ms
- ExecTreeExecTime: 88.216ms
- OpenTime: 7s755ms
- ExecTreeOpenTime: 7s634ms
- PrepareTime: 35.800ms
- ExecTreePrepareTime: 619.232us
DataStreamSender (dst_id=28):(Total: 1s059ms, non-child: 1s059ms, % non-child: 100.00%)
- BytesSent: 121.96 MB (127882212)
- NetworkThroughput(*): 312.02 MB/sec
- OverallThroughput: 115.11 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 2.55M (2546423)
- SerializeBatchTime: 668.096ms
- TransmitDataRPCTime: 390.860ms
- UncompressedRowBatchSize: 200.98 MB (210747941)
CodeGen:(Total: 153.389ms, non-child: 153.389ms, % non-child: 100.00%)
- CodegenTime: 2.617ms
- CompileTime: 33.456ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 43 (43)
- NumInstructions: 836 (836)
- OptimizationTime: 87.213ms
- PeakMemoryUsage: 418.00 KB (428032)
- PrepareTime: 31.984ms
AGGREGATION_NODE (id=25):(Total: 7s721ms, non-child: 1s535ms, % non-child: 19.88%)
ExecOption: Codegen Enabled
- BuildTime: 1s439ms
- GetNewBlockTime: 830.669us
- GetResultsTime: 74.471ms
- HTResizeTime: 165.796ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 330.17 MB (346204008)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.55M (2546423)
- RowsReturnedRate: 329.77 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 906.000ns
EXCHANGE_NODE (id=24):(Total: 6s186ms, non-child: 223.785ms, % non-child: 3.62%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 724.09 KB, 8.04 MB, 33.39 MB, 74.49 MB, 119.60 MB, 160.26 MB, 195.87 MB, 216.88 MB, 229.47 MB, 236.90 MB
- BytesReceived: 238.93 MB (250540557)
- ConvertRowBatchTime: 91.709ms
- DeserializeRowBatchTimer: 597.168ms
- FirstBatchArrivalWaitTime: 2s711ms
- PeakMemoryUsage: 0
- RowsReturned: 4.50M (4504253)
- RowsReturnedRate: 728.07 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:32 (host=cdh9.net.cuberonlabs.com:22000):(Total: 13s756ms, non-child: 5s055ms, % non-child: 36.75%)
MemoryUsage(500.000ms): 2.77 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 22.80 MB, 63.49 MB, 154.20 MB, 201.66 MB, 238.25 MB, 266.28 MB, 306.21 MB, 330.16 MB, 330.20 MB, 330.20 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.14 MB, 248.02 MB, 145.08 MB, 41.96 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 331.11 MB (347191915)
- PerHostPeakMemUsage: 1.69 GB (1813107104)
- RowsProduced: 2.55M (2546435)
- TotalNetworkReceiveTime: 6s145ms
- TotalNetworkSendTime: 4s488ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 16 (16)
- TotalThreadsTotalWallClockTime: 13s714ms
- TotalThreadsSysTime: 212.000ms
- TotalThreadsUserTime: 2s944ms
- TotalThreadsVoluntaryContextSwitches: 6.30K (6303)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s966ms
- ExecTreeExecTime: 86.882ms
- OpenTime: 7s748ms
- ExecTreeOpenTime: 7s576ms
- PrepareTime: 41.653ms
- ExecTreePrepareTime: 591.149us
DataStreamSender (dst_id=28):(Total: 828.389ms, non-child: 828.389ms, % non-child: 100.00%)
- BytesSent: 122.06 MB (127991044)
- NetworkThroughput(*): 656.44 MB/sec
- OverallThroughput: 147.35 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 2.55M (2546435)
- SerializeBatchTime: 641.861ms
- TransmitDataRPCTime: 185.946ms
- UncompressedRowBatchSize: 201.09 MB (210862375)
CodeGen:(Total: 208.899ms, non-child: 208.899ms, % non-child: 100.00%)
- CodegenTime: 3.285ms
- CompileTime: 50.097ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 43 (43)
- NumInstructions: 836 (836)
- OptimizationTime: 120.196ms
- PeakMemoryUsage: 418.00 KB (428032)
- PrepareTime: 37.724ms
AGGREGATION_NODE (id=25):(Total: 7s662ms, non-child: 1s425ms, % non-child: 18.60%)
ExecOption: Codegen Enabled
- BuildTime: 1s332ms
- GetNewBlockTime: 570.191us
- GetResultsTime: 74.496ms
- HTResizeTime: 144.974ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 330.17 MB (346204270)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.55M (2546435)
- RowsReturnedRate: 332.30 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 868.000ns
EXCHANGE_NODE (id=24):(Total: 6s237ms, non-child: 174.852ms, % non-child: 2.80%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.22 MB, 12.92 MB, 45.84 MB, 89.50 MB, 134.24 MB, 173.76 MB, 204.70 MB, 222.59 MB, 232.54 MB, 238.46 MB
- BytesReceived: 239.41 MB (251041676)
- ConvertRowBatchTime: 82.587ms
- DeserializeRowBatchTimer: 557.356ms
- FirstBatchArrivalWaitTime: 2s655ms
- PeakMemoryUsage: 0
- RowsReturned: 4.51M (4510936)
- RowsReturnedRate: 723.17 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:2f (host=cdh7.net.cuberonlabs.com:22000):(Total: 13s755ms, non-child: 4s856ms, % non-child: 35.31%)
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 22.66 MB, 72.16 MB, 154.20 MB, 201.75 MB, 238.29 MB, 266.20 MB, 306.28 MB, 330.20 MB, 330.20 MB, 330.20 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 309.98 MB, 227.61 MB, 145.06 MB, 41.95 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 331.11 MB (347191915)
- PerHostPeakMemUsage: 1.58 GB (1699637471)
- RowsProduced: 2.55M (2549555)
- TotalNetworkReceiveTime: 5s995ms
- TotalNetworkSendTime: 4s497ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 19 (19)
- TotalThreadsTotalWallClockTime: 13s721ms
- TotalThreadsSysTime: 252.000ms
- TotalThreadsUserTime: 3s076ms
- TotalThreadsVoluntaryContextSwitches: 5.32K (5318)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s965ms
- ExecTreeExecTime: 85.357ms
- OpenTime: 7s756ms
- ExecTreeOpenTime: 7s644ms
- PrepareTime: 33.089ms
- ExecTreePrepareTime: 637.794us
DataStreamSender (dst_id=28):(Total: 1s028ms, non-child: 1s028ms, % non-child: 100.00%)
- BytesSent: 122.20 MB (128136545)
- NetworkThroughput(*): 316.94 MB/sec
- OverallThroughput: 118.79 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 2.55M (2549555)
- SerializeBatchTime: 642.603ms
- TransmitDataRPCTime: 385.566ms
- UncompressedRowBatchSize: 201.32 MB (211096033)
CodeGen:(Total: 140.736ms, non-child: 140.736ms, % non-child: 100.00%)
- CodegenTime: 2.287ms
- CompileTime: 30.755ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 43 (43)
- NumInstructions: 836 (836)
- OptimizationTime: 80.056ms
- PeakMemoryUsage: 418.00 KB (428032)
- PrepareTime: 29.253ms
AGGREGATION_NODE (id=25):(Total: 7s729ms, non-child: 1s627ms, % non-child: 21.06%)
ExecOption: Codegen Enabled
- BuildTime: 1s534ms
- GetNewBlockTime: 621.812us
- GetResultsTime: 73.021ms
- HTResizeTime: 171.976ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 330.17 MB (346203524)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.55M (2549555)
- RowsReturnedRate: 329.87 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 984.000ns
EXCHANGE_NODE (id=24):(Total: 6s101ms, non-child: 234.085ms, % non-child: 3.84%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.40 MB, 13.58 MB, 46.98 MB, 90.92 MB, 135.47 MB, 175.03 MB, 205.56 MB, 223.33 MB, 233.02 MB, 238.72 MB
- BytesReceived: 239.57 MB (251205496)
- ConvertRowBatchTime: 94.868ms
- DeserializeRowBatchTimer: 615.295ms
- FirstBatchArrivalWaitTime: 2s723ms
- PeakMemoryUsage: 0
- RowsReturned: 4.52M (4516222)
- RowsReturnedRate: 740.18 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:2d (host=cdh1.net.cuberonlabs.com:22000):(Total: 13s734ms, non-child: 4s924ms, % non-child: 35.85%)
MemoryUsage(500.000ms): 2.77 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 22.67 MB, 62.92 MB, 154.16 MB, 201.70 MB, 238.24 MB, 266.20 MB, 306.20 MB, 330.20 MB, 330.20 MB, 330.20 MB, 310.02 MB, 310.02 MB, 310.02 MB, 310.02 MB, 310.02 MB, 310.02 MB, 310.02 MB, 310.02 MB, 309.90 MB, 248.31 MB, 145.18 MB, 41.95 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 331.11 MB (347191915)
- PerHostPeakMemUsage: 1.81 GB (1939587581)
- RowsProduced: 2.55M (2550846)
- TotalNetworkReceiveTime: 6s128ms
- TotalNetworkSendTime: 4s485ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 28 (28)
- TotalThreadsTotalWallClockTime: 13s695ms
- TotalThreadsSysTime: 256.000ms
- TotalThreadsUserTime: 2s924ms
- TotalThreadsVoluntaryContextSwitches: 6.12K (6123)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s945ms
- ExecTreeExecTime: 84.059ms
- OpenTime: 7s749ms
- ExecTreeOpenTime: 7s652ms
- PrepareTime: 39.111ms
- ExecTreePrepareTime: 1.009ms
DataStreamSender (dst_id=28):(Total: 944.396ms, non-child: 944.396ms, % non-child: 100.00%)
- BytesSent: 122.27 MB (128208569)
- NetworkThroughput(*): 422.12 MB/sec
- OverallThroughput: 129.47 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 2.55M (2550846)
- SerializeBatchTime: 654.152ms
- TransmitDataRPCTime: 289.653ms
- UncompressedRowBatchSize: 201.46 MB (211243517)
CodeGen:(Total: 129.455ms, non-child: 129.455ms, % non-child: 100.00%)
- CodegenTime: 2.459ms
- CompileTime: 28.860ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 43 (43)
- NumInstructions: 836 (836)
- OptimizationTime: 66.480ms
- PeakMemoryUsage: 418.00 KB (428032)
- PrepareTime: 33.510ms
AGGREGATION_NODE (id=25):(Total: 7s736ms, non-child: 1s507ms, % non-child: 19.48%)
ExecOption: Codegen Enabled
- BuildTime: 1s415ms
- GetNewBlockTime: 1.134ms
- GetResultsTime: 72.969ms
- HTResizeTime: 161.097ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 330.17 MB (346203486)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.55M (2550846)
- RowsReturnedRate: 329.73 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 880.000ns
EXCHANGE_NODE (id=24):(Total: 6s228ms, non-child: 198.522ms, % non-child: 3.19%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.10 MB, 12.43 MB, 45.11 MB, 88.42 MB, 133.36 MB, 173.10 MB, 204.50 MB, 222.56 MB, 232.77 MB, 238.78 MB
- BytesReceived: 239.80 MB (251444005)
- ConvertRowBatchTime: 89.013ms
- DeserializeRowBatchTimer: 579.985ms
- FirstBatchArrivalWaitTime: 2s732ms
- PeakMemoryUsage: 0
- RowsReturned: 4.52M (4518297)
- RowsReturnedRate: 725.37 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:24 (host=cdh16.net.cuberonlabs.com:22000):(Total: 13s730ms, non-child: 5s009ms, % non-child: 36.49%)
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 12.57 MB, 53.12 MB, 144.83 MB, 184.25 MB, 222.20 MB, 258.33 MB, 298.37 MB, 330.20 MB, 330.28 MB, 330.16 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.04 MB, 268.90 MB, 165.66 MB, 62.76 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 331.11 MB (347191915)
- PerHostPeakMemUsage: 1.64 GB (1763578733)
- RowsProduced: 2.55M (2547411)
- TotalNetworkReceiveTime: 6s000ms
- TotalNetworkSendTime: 4s456ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 15 (15)
- TotalThreadsTotalWallClockTime: 13s693ms
- TotalThreadsSysTime: 220.000ms
- TotalThreadsUserTime: 3s100ms
- TotalThreadsVoluntaryContextSwitches: 5.77K (5769)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s944ms
- ExecTreeExecTime: 87.174ms
- OpenTime: 7s748ms
- ExecTreeOpenTime: 7s626ms
- PrepareTime: 37.147ms
- ExecTreePrepareTime: 672.650us
DataStreamSender (dst_id=28):(Total: 853.243ms, non-child: 853.243ms, % non-child: 100.00%)
- BytesSent: 122.03 MB (127953529)
- NetworkThroughput(*): 591.59 MB/sec
- OverallThroughput: 143.01 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 2.55M (2547411)
- SerializeBatchTime: 646.327ms
- TransmitDataRPCTime: 206.269ms
- UncompressedRowBatchSize: 201.11 MB (210876135)
CodeGen:(Total: 154.041ms, non-child: 154.041ms, % non-child: 100.00%)
- CodegenTime: 2.886ms
- CompileTime: 32.717ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 43 (43)
- NumInstructions: 836 (836)
- OptimizationTime: 87.551ms
- PeakMemoryUsage: 418.00 KB (428032)
- PrepareTime: 32.990ms
AGGREGATION_NODE (id=25):(Total: 7s713ms, non-child: 1s608ms, % non-child: 20.86%)
ExecOption: Codegen Enabled
- BuildTime: 1s514ms
- GetNewBlockTime: 783.956us
- GetResultsTime: 74.871ms
- HTResizeTime: 172.970ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 330.17 MB (346203584)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.55M (2547411)
- RowsReturnedRate: 330.25 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.030us
EXCHANGE_NODE (id=24):(Total: 6s104ms, non-child: 195.056ms, % non-child: 3.20%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.05 MB, 9.05 MB, 36.55 MB, 78.11 MB, 123.44 MB, 163.76 MB, 198.42 MB, 218.41 MB, 230.31 MB, 237.49 MB
- BytesReceived: 239.08 MB (250691253)
- ConvertRowBatchTime: 93.131ms
- DeserializeRowBatchTimer: 597.085ms
- FirstBatchArrivalWaitTime: 2s713ms
- PeakMemoryUsage: 0
- RowsReturned: 4.51M (4508418)
- RowsReturnedRate: 738.50 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:27 (host=cdh15.net.cuberonlabs.com:22000):(Total: 13s705ms, non-child: 5s001ms, % non-child: 36.49%)
MemoryUsage(500.000ms): 2.35 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 13.73 MB, 54.39 MB, 154.00 MB, 201.24 MB, 230.29 MB, 258.21 MB, 298.20 MB, 330.24 MB, 330.20 MB, 330.24 MB, 310.05 MB, 310.05 MB, 310.05 MB, 310.05 MB, 310.05 MB, 310.05 MB, 310.05 MB, 310.05 MB, 310.22 MB, 248.03 MB, 145.02 MB, 41.80 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 331.11 MB (347191915)
- PerHostPeakMemUsage: 1.57 GB (1688553772)
- RowsProduced: 2.55M (2548467)
- TotalNetworkReceiveTime: 6s038ms
- TotalNetworkSendTime: 4s473ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 7 (7)
- TotalThreadsTotalWallClockTime: 13s655ms
- TotalThreadsSysTime: 168.000ms
- TotalThreadsUserTime: 3s052ms
- TotalThreadsVoluntaryContextSwitches: 6.13K (6129)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s920ms
- ExecTreeExecTime: 88.673ms
- OpenTime: 7s735ms
- ExecTreeOpenTime: 7s559ms
- PrepareTime: 49.981ms
- ExecTreePrepareTime: 839.692us
DataStreamSender (dst_id=28):(Total: 835.568ms, non-child: 835.568ms, % non-child: 100.00%)
- BytesSent: 122.15 MB (128082129)
- NetworkThroughput(*): 611.50 MB/sec
- OverallThroughput: 146.19 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 2.55M (2548467)
- SerializeBatchTime: 635.228ms
- TransmitDataRPCTime: 199.751ms
- UncompressedRowBatchSize: 201.25 MB (211029213)
CodeGen:(Total: 221.075ms, non-child: 221.075ms, % non-child: 100.00%)
- CodegenTime: 3.385ms
- CompileTime: 49.583ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 43 (43)
- NumInstructions: 836 (836)
- OptimizationTime: 125.028ms
- PeakMemoryUsage: 418.00 KB (428032)
- PrepareTime: 45.481ms
AGGREGATION_NODE (id=25):(Total: 7s647ms, non-child: 1s510ms, % non-child: 19.75%)
ExecOption: Codegen Enabled
- BuildTime: 1s415ms
- GetNewBlockTime: 591.406us
- GetResultsTime: 76.710ms
- HTResizeTime: 153.288ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 330.17 MB (346204095)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.55M (2548467)
- RowsReturnedRate: 333.24 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.365us
EXCHANGE_NODE (id=24):(Total: 6s137ms, non-child: 190.923ms, % non-child: 3.11%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 1.60 MB, 10.80 MB, 41.47 MB, 83.95 MB, 129.05 MB, 168.85 MB, 201.56 MB, 220.43 MB, 231.31 MB, 237.81 MB
- BytesReceived: 239.04 MB (250655156)
- ConvertRowBatchTime: 88.193ms
- DeserializeRowBatchTimer: 613.579ms
- FirstBatchArrivalWaitTime: 2s643ms
- PeakMemoryUsage: 0
- RowsReturned: 4.51M (4506480)
- RowsReturnedRate: 734.31 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:26 (host=cdh6.net.cuberonlabs.com:22000):(Total: 13s702ms, non-child: 5s032ms, % non-child: 36.72%)
MemoryUsage(500.000ms): 2.77 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 22.80 MB, 63.96 MB, 154.16 MB, 201.70 MB, 238.20 MB, 266.21 MB, 306.20 MB, 330.20 MB, 330.20 MB, 330.16 MB, 310.14 MB, 310.14 MB, 310.14 MB, 310.14 MB, 310.14 MB, 310.14 MB, 310.14 MB, 310.14 MB, 310.12 MB, 227.64 MB, 124.36 MB, 21.27 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 331.11 MB (347191915)
- PerHostPeakMemUsage: 1.67 GB (1794839264)
- RowsProduced: 2.55M (2552581)
- TotalNetworkReceiveTime: 6s141ms
- TotalNetworkSendTime: 4s528ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 10 (10)
- TotalThreadsTotalWallClockTime: 13s670ms
- TotalThreadsSysTime: 180.000ms
- TotalThreadsUserTime: 2s904ms
- TotalThreadsVoluntaryContextSwitches: 6.34K (6337)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s917ms
- ExecTreeExecTime: 84.563ms
- OpenTime: 7s752ms
- ExecTreeOpenTime: 7s620ms
- PrepareTime: 31.960ms
- ExecTreePrepareTime: 683.048us
DataStreamSender (dst_id=28):(Total: 805.509ms, non-child: 805.509ms, % non-child: 100.00%)
- BytesSent: 122.35 MB (128292617)
- NetworkThroughput(*): 627.66 MB/sec
- OverallThroughput: 151.89 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 2.55M (2552581)
- SerializeBatchTime: 610.043ms
- TransmitDataRPCTime: 194.929ms
- UncompressedRowBatchSize: 201.61 MB (211400848)
CodeGen:(Total: 160.350ms, non-child: 160.350ms, % non-child: 100.00%)
- CodegenTime: 2.124ms
- CompileTime: 31.211ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 43 (43)
- NumInstructions: 836 (836)
- OptimizationTime: 99.871ms
- PeakMemoryUsage: 418.00 KB (428032)
- PrepareTime: 28.807ms
AGGREGATION_NODE (id=25):(Total: 7s704ms, non-child: 1s467ms, % non-child: 19.05%)
ExecOption: Codegen Enabled
- BuildTime: 1s377ms
- GetNewBlockTime: 833.012us
- GetResultsTime: 72.171ms
- HTResizeTime: 149.208ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 330.17 MB (346203265)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.55M (2552581)
- RowsReturnedRate: 331.31 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.032us
EXCHANGE_NODE (id=24):(Total: 6s236ms, non-child: 186.348ms, % non-child: 2.99%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.26 MB, 13.01 MB, 46.07 MB, 89.58 MB, 134.08 MB, 173.66 MB, 204.69 MB, 222.60 MB, 232.57 MB, 238.45 MB
- BytesReceived: 239.38 MB (251012894)
- ConvertRowBatchTime: 84.169ms
- DeserializeRowBatchTimer: 586.345ms
- FirstBatchArrivalWaitTime: 2s706ms
- PeakMemoryUsage: 0
- RowsReturned: 4.51M (4511103)
- RowsReturnedRate: 723.28 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:2b (host=cdh12.net.cuberonlabs.com:22000):(Total: 13s698ms, non-child: 5s004ms, % non-child: 36.53%)
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 43.20 MB, 108.37 MB, 169.29 MB, 210.76 MB, 256.93 MB, 290.29 MB, 322.29 MB, 330.20 MB, 330.24 MB, 330.80 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.20 MB, 310.03 MB, 309.94 MB, 186.36 MB, 83.06 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 331.11 MB (347191915)
- PerHostPeakMemUsage: 1.12 GB (1201773720)
- RowsProduced: 2.55M (2551617)
- TotalNetworkReceiveTime: 5s884ms
- TotalNetworkSendTime: 4s480ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 18 (18)
- TotalThreadsTotalWallClockTime: 13s659ms
- TotalThreadsSysTime: 196.000ms
- TotalThreadsUserTime: 3s204ms
- TotalThreadsVoluntaryContextSwitches: 5.45K (5449)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s911ms
- ExecTreeExecTime: 84.686ms
- OpenTime: 7s748ms
- ExecTreeOpenTime: 7s625ms
- PrepareTime: 38.915ms
- ExecTreePrepareTime: 636.341us
DataStreamSender (dst_id=28):(Total: 827.509ms, non-child: 827.509ms, % non-child: 100.00%)
- BytesSent: 122.23 MB (128169834)
- NetworkThroughput(*): 562.91 MB/sec
- OverallThroughput: 147.71 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 2.55M (2551617)
- SerializeBatchTime: 609.767ms
- TransmitDataRPCTime: 217.142ms
- UncompressedRowBatchSize: 201.45 MB (211239434)
CodeGen:(Total: 156.778ms, non-child: 156.778ms, % non-child: 100.00%)
- CodegenTime: 2.896ms
- CompileTime: 32.303ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 43 (43)
- NumInstructions: 836 (836)
- OptimizationTime: 88.773ms
- PeakMemoryUsage: 418.00 KB (428032)
- PrepareTime: 34.787ms
AGGREGATION_NODE (id=25):(Total: 7s710ms, non-child: 1s722ms, % non-child: 22.34%)
ExecOption: Codegen Enabled
- BuildTime: 1s630ms
- GetNewBlockTime: 381.838us
- GetResultsTime: 72.126ms
- HTResizeTime: 186.183ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 330.17 MB (346203548)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.55M (2551617)
- RowsReturnedRate: 330.94 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 960.000ns
EXCHANGE_NODE (id=24):(Total: 5s988ms, non-child: 203.740ms, % non-child: 3.40%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 5.59 MB, 24.76 MB, 63.91 MB, 109.20 MB, 151.07 MB, 188.95 MB, 213.06 MB, 227.68 MB, 236.29 MB
- BytesReceived: 239.66 MB (251297912)
- ConvertRowBatchTime: 93.150ms
- DeserializeRowBatchTimer: 622.513ms
- FirstBatchArrivalWaitTime: 2s707ms
- PeakMemoryUsage: 0
- RowsReturned: 4.52M (4517374)
- RowsReturnedRate: 754.39 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:28 (host=cdh3.net.cuberonlabs.com:22000):(Total: 13s689ms, non-child: 5s008ms, % non-child: 36.59%)
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 43.49 MB, 108.75 MB, 170.29 MB, 212.33 MB, 254.28 MB, 294.20 MB, 322.16 MB, 330.20 MB, 330.20 MB, 330.61 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 310.12 MB, 289.47 MB, 186.42 MB, 83.11 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 331.11 MB (347191915)
- PerHostPeakMemUsage: 2.16 GB (2318232477)
- RowsProduced: 2.55M (2548818)
- TotalNetworkReceiveTime: 6s243ms
- TotalNetworkSendTime: 4s534ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 26 (26)
- TotalThreadsTotalWallClockTime: 13s654ms
- TotalThreadsSysTime: 252.000ms
- TotalThreadsUserTime: 2s712ms
- TotalThreadsVoluntaryContextSwitches: 6.35K (6352)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s904ms
- ExecTreeExecTime: 79.721ms
- OpenTime: 7s750ms
- ExecTreeOpenTime: 7s606ms
- PrepareTime: 35.183ms
- ExecTreePrepareTime: 1.562ms
DataStreamSender (dst_id=28):(Total: 820.942ms, non-child: 820.942ms, % non-child: 100.00%)
- BytesSent: 122.16 MB (128098416)
- NetworkThroughput(*): 601.79 MB/sec
- OverallThroughput: 148.81 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 2.55M (2548818)
- SerializeBatchTime: 617.366ms
- TransmitDataRPCTime: 203.002ms
- UncompressedRowBatchSize: 201.28 MB (211056917)
CodeGen:(Total: 173.606ms, non-child: 173.606ms, % non-child: 100.00%)
- CodegenTime: 3.085ms
- CompileTime: 30.896ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 43 (43)
- NumInstructions: 836 (836)
- OptimizationTime: 111.172ms
- PeakMemoryUsage: 418.00 KB (428032)
- PrepareTime: 30.833ms
AGGREGATION_NODE (id=25):(Total: 7s686ms, non-child: 1s360ms, % non-child: 17.71%)
ExecOption: Codegen Enabled
- BuildTime: 1s274ms
- GetNewBlockTime: 1.363ms
- GetResultsTime: 67.094ms
- HTResizeTime: 138.914ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 330.17 MB (346203781)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.55M (2548818)
- RowsReturnedRate: 331.60 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.472us
EXCHANGE_NODE (id=24):(Total: 6s325ms, non-child: 157.532ms, % non-child: 2.49%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 5.93 MB, 26.27 MB, 66.03 MB, 111.32 MB, 152.85 MB, 190.32 MB, 213.58 MB, 227.78 MB, 236.13 MB
- BytesReceived: 239.16 MB (250775482)
- ConvertRowBatchTime: 73.218ms
- DeserializeRowBatchTimer: 469.698ms
- FirstBatchArrivalWaitTime: 2s691ms
- PeakMemoryUsage: 0
- RowsReturned: 4.51M (4508285)
- RowsReturnedRate: 712.71 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:23 (host=cdh4.net.cuberonlabs.com:22000):(Total: 13s688ms, non-child: 4s858ms, % non-child: 35.49%)
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 33.27 MB, 99.83 MB, 161.02 MB, 206.33 MB, 248.37 MB, 282.33 MB, 322.24 MB, 330.16 MB, 330.20 MB, 330.16 MB, 310.28 MB, 310.28 MB, 310.28 MB, 310.28 MB, 310.28 MB, 310.28 MB, 310.28 MB, 309.88 MB, 309.84 MB, 206.84 MB, 103.88 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 331.11 MB (347191915)
- PerHostPeakMemUsage: 2.13 GB (2284202661)
- RowsProduced: 2.55M (2546375)
- TotalNetworkReceiveTime: 5s962ms
- TotalNetworkSendTime: 4s478ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 15 (15)
- TotalThreadsTotalWallClockTime: 13s653ms
- TotalThreadsSysTime: 248.000ms
- TotalThreadsUserTime: 3s064ms
- TotalThreadsVoluntaryContextSwitches: 5.53K (5534)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s903ms
- ExecTreeExecTime: 85.221ms
- OpenTime: 7s750ms
- ExecTreeOpenTime: 7s633ms
- PrepareTime: 35.051ms
- ExecTreePrepareTime: 803.072us
DataStreamSender (dst_id=28):(Total: 964.585ms, non-child: 964.585ms, % non-child: 100.00%)
- BytesSent: 122.03 MB (127953851)
- NetworkThroughput(*): 381.71 MB/sec
- OverallThroughput: 126.51 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 2.55M (2546375)
- SerializeBatchTime: 644.323ms
- TransmitDataRPCTime: 319.681ms
- UncompressedRowBatchSize: 201.09 MB (210856957)
CodeGen:(Total: 147.457ms, non-child: 147.457ms, % non-child: 100.00%)
- CodegenTime: 2.560ms
- CompileTime: 30.305ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 43 (43)
- NumInstructions: 836 (836)
- OptimizationTime: 85.336ms
- PeakMemoryUsage: 418.00 KB (428032)
- PrepareTime: 31.114ms
AGGREGATION_NODE (id=25):(Total: 7s718ms, non-child: 1s649ms, % non-child: 21.38%)
ExecOption: Codegen Enabled
- BuildTime: 1s557ms
- GetNewBlockTime: 1.342ms
- GetResultsTime: 74.234ms
- HTResizeTime: 178.671ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 330.17 MB (346203099)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.55M (2546375)
- RowsReturnedRate: 329.91 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.028us
EXCHANGE_NODE (id=24):(Total: 6s068ms, non-child: 231.788ms, % non-child: 3.82%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 4.45 MB, 20.83 MB, 57.67 MB, 102.90 MB, 145.39 MB, 183.95 MB, 209.84 MB, 225.56 MB, 234.43 MB, 238.69 MB
- BytesReceived: 238.84 MB (250441784)
- ConvertRowBatchTime: 93.699ms
- DeserializeRowBatchTimer: 638.986ms
- FirstBatchArrivalWaitTime: 2s721ms
- PeakMemoryUsage: 0
- RowsReturned: 4.50M (4500412)
- RowsReturnedRate: 741.59 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:2c (host=cdh14.net.cuberonlabs.com:22000):(Total: 13s676ms, non-child: 5s015ms, % non-child: 36.67%)
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 43.45 MB, 116.66 MB, 170.20 MB, 212.24 MB, 254.24 MB, 294.29 MB, 322.24 MB, 330.16 MB, 330.16 MB, 330.62 MB, 310.15 MB, 310.15 MB, 310.15 MB, 310.15 MB, 310.15 MB, 310.15 MB, 310.15 MB, 310.12 MB, 289.42 MB, 186.21 MB, 83.06 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 331.11 MB (347191915)
- PerHostPeakMemUsage: 1.44 GB (1548652528)
- RowsProduced: 2.55M (2548397)
- TotalNetworkReceiveTime: 6s064ms
- TotalNetworkSendTime: 4s531ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 17 (17)
- TotalThreadsTotalWallClockTime: 13s641ms
- TotalThreadsSysTime: 176.000ms
- TotalThreadsUserTime: 2s972ms
- TotalThreadsVoluntaryContextSwitches: 6.02K (6019)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s888ms
- ExecTreeExecTime: 77.863ms
- OpenTime: 7s752ms
- ExecTreeOpenTime: 7s636ms
- PrepareTime: 35.307ms
- ExecTreePrepareTime: 1.046ms
DataStreamSender (dst_id=28):(Total: 799.627ms, non-child: 799.627ms, % non-child: 100.00%)
- BytesSent: 122.17 MB (128108692)
- NetworkThroughput(*): 661.76 MB/sec
- OverallThroughput: 152.79 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 2.55M (2548397)
- SerializeBatchTime: 614.414ms
- TransmitDataRPCTime: 184.620ms
- UncompressedRowBatchSize: 201.27 MB (211042173)
CodeGen:(Total: 147.248ms, non-child: 147.248ms, % non-child: 100.00%)
- CodegenTime: 2.375ms
- CompileTime: 31.789ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 43 (43)
- NumInstructions: 836 (836)
- OptimizationTime: 83.486ms
- PeakMemoryUsage: 418.00 KB (428032)
- PrepareTime: 31.240ms
AGGREGATION_NODE (id=25):(Total: 7s714ms, non-child: 1s539ms, % non-child: 19.96%)
ExecOption: Codegen Enabled
- BuildTime: 1s453ms
- GetNewBlockTime: 683.634us
- GetResultsTime: 69.148ms
- HTResizeTime: 169.028ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 330.17 MB (346203860)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.55M (2548397)
- RowsReturnedRate: 330.36 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 992.000ns
EXCHANGE_NODE (id=24):(Total: 6s174ms, non-child: 211.191ms, % non-child: 3.42%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 6.12 MB, 27.08 MB, 66.89 MB, 112.17 MB, 153.70 MB, 191.14 MB, 214.22 MB, 228.29 MB, 236.59 MB
- BytesReceived: 239.55 MB (251181428)
- ConvertRowBatchTime: 98.747ms
- DeserializeRowBatchTimer: 630.323ms
- FirstBatchArrivalWaitTime: 2s716ms
- PeakMemoryUsage: 0
- RowsReturned: 4.52M (4515321)
- RowsReturnedRate: 731.30 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:2a (host=cdh2.net.cuberonlabs.com:22000):(Total: 13s629ms, non-child: 4s987ms, % non-child: 36.59%)
MemoryUsage(500.000ms): 2.77 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 22.83 MB, 64.12 MB, 154.24 MB, 201.74 MB, 238.24 MB, 266.25 MB, 306.20 MB, 330.16 MB, 330.16 MB, 330.16 MB, 310.21 MB, 310.21 MB, 310.21 MB, 310.21 MB, 310.21 MB, 310.21 MB, 310.21 MB, 310.21 MB, 309.94 MB, 248.15 MB, 124.45 MB, 21.32 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 331.11 MB (347191915)
- PerHostPeakMemUsage: 1.74 GB (1866918022)
- RowsProduced: 2.55M (2550057)
- TotalNetworkReceiveTime: 6s143ms
- TotalNetworkSendTime: 4s534ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 22 (22)
- TotalThreadsTotalWallClockTime: 13s595ms
- TotalThreadsSysTime: 268.000ms
- TotalThreadsUserTime: 2s748ms
- TotalThreadsVoluntaryContextSwitches: 6.19K (6193)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s843ms
- ExecTreeExecTime: 75.667ms
- OpenTime: 7s752ms
- ExecTreeOpenTime: 7s634ms
- PrepareTime: 33.912ms
- ExecTreePrepareTime: 772.228us
DataStreamSender (dst_id=28):(Total: 784.991ms, non-child: 784.991ms, % non-child: 100.00%)
- BytesSent: 122.20 MB (128140946)
- NetworkThroughput(*): 634.40 MB/sec
- OverallThroughput: 155.68 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 2.55M (2550057)
- SerializeBatchTime: 591.776ms
- TransmitDataRPCTime: 192.631ms
- UncompressedRowBatchSize: 201.35 MB (211126503)
CodeGen:(Total: 147.341ms, non-child: 147.341ms, % non-child: 100.00%)
- CodegenTime: 2.418ms
- CompileTime: 32.270ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 43 (43)
- NumInstructions: 836 (836)
- OptimizationTime: 84.397ms
- PeakMemoryUsage: 418.00 KB (428032)
- PrepareTime: 29.966ms
AGGREGATION_NODE (id=25):(Total: 7s709ms, non-child: 1s467ms, % non-child: 19.03%)
ExecOption: Codegen Enabled
- BuildTime: 1s384ms
- GetNewBlockTime: 1.004ms
- GetResultsTime: 66.117ms
- HTResizeTime: 155.483ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 330.17 MB (346203484)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.55M (2550057)
- RowsReturnedRate: 330.75 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.048us
EXCHANGE_NODE (id=24):(Total: 6s242ms, non-child: 195.485ms, % non-child: 3.13%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 2.26 MB, 13.12 MB, 46.17 MB, 89.86 MB, 134.43 MB, 174.08 MB, 205.04 MB, 222.91 MB, 232.80 MB, 238.60 MB
- BytesReceived: 239.54 MB (251177476)
- ConvertRowBatchTime: 87.435ms
- DeserializeRowBatchTimer: 587.089ms
- FirstBatchArrivalWaitTime: 2s718ms
- PeakMemoryUsage: 0
- RowsReturned: 4.52M (4515451)
- RowsReturnedRate: 723.36 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:31 (host=cdh11.net.cuberonlabs.com:22000):(Total: 13s623ms, non-child: 5s005ms, % non-child: 36.74%)
MemoryUsage(500.000ms): 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 2.36 MB, 12.61 MB, 53.08 MB, 144.74 MB, 184.20 MB, 222.24 MB, 258.24 MB, 298.33 MB, 330.16 MB, 330.20 MB, 330.20 MB, 310.25 MB, 310.25 MB, 310.25 MB, 310.25 MB, 310.25 MB, 310.25 MB, 310.25 MB, 310.25 MB, 310.25 MB, 269.02 MB, 145.13 MB, 42.02 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 331.11 MB (347191915)
- PerHostPeakMemUsage: 1.48 GB (1591793359)
- RowsProduced: 2.55M (2548785)
- TotalNetworkReceiveTime: 5s966ms
- TotalNetworkSendTime: 4s532ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 23 (23)
- TotalThreadsTotalWallClockTime: 13s586ms
- TotalThreadsSysTime: 224.000ms
- TotalThreadsUserTime: 2s964ms
- TotalThreadsVoluntaryContextSwitches: 5.90K (5901)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s833ms
- ExecTreeExecTime: 76.720ms
- OpenTime: 7s752ms
- ExecTreeOpenTime: 7s631ms
- PrepareTime: 37.250ms
- ExecTreePrepareTime: 630.577us
DataStreamSender (dst_id=28):(Total: 756.435ms, non-child: 756.435ms, % non-child: 100.00%)
- BytesSent: 122.16 MB (128093434)
- NetworkThroughput(*): 599.80 MB/sec
- OverallThroughput: 161.49 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 2.55M (2548785)
- SerializeBatchTime: 552.184ms
- TransmitDataRPCTime: 203.665ms
- UncompressedRowBatchSize: 201.29 MB (211065211)
CodeGen:(Total: 153.998ms, non-child: 153.998ms, % non-child: 100.00%)
- CodegenTime: 2.615ms
- CompileTime: 32.813ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 43 (43)
- NumInstructions: 836 (836)
- OptimizationTime: 87.322ms
- PeakMemoryUsage: 418.00 KB (428032)
- PrepareTime: 33.057ms
AGGREGATION_NODE (id=25):(Total: 7s707ms, non-child: 1s635ms, % non-child: 21.22%)
ExecOption: Codegen Enabled
- BuildTime: 1s551ms
- GetNewBlockTime: 466.567us
- GetResultsTime: 64.356ms
- HTResizeTime: 176.922ms
- HashBuckets: 4.19M (4194304)
- LargestPartitionPercent: 3 (3)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 330.17 MB (346203485)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.55M (2548785)
- RowsReturnedRate: 330.69 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 931.000ns
EXCHANGE_NODE (id=24):(Total: 6s071ms, non-child: 204.685ms, % non-child: 3.37%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.03 MB, 8.97 MB, 36.29 MB, 77.87 MB, 123.29 MB, 163.55 MB, 198.35 MB, 218.28 MB, 230.25 MB, 237.43 MB
- BytesReceived: 239.04 MB (250650384)
- ConvertRowBatchTime: 95.177ms
- DeserializeRowBatchTimer: 613.898ms
- FirstBatchArrivalWaitTime: 2s711ms
- PeakMemoryUsage: 0
- RowsReturned: 4.51M (4505321)
- RowsReturnedRate: 742.01 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Averaged Fragment F00:(Total: 6s196ms, non-child: 1s035ms, % non-child: 16.71%)
split sizes: min: 1.81 GB, max: 3.59 GB, avg: 2.76 GB, stddev: 468.16 MB
completion times: min:4s756ms max:7s784ms mean: 6s197ms stddev:841.626ms
execution rates: min:372.54 MB/sec max:516.93 MB/sec mean:454.68 MB/sec stddev:37.63 MB/sec
num instances: 17
- AverageThreadTokens: 5.10
- BloomFilterBytes: 0
- PeakMemoryUsage: 568.45 MB (596067042)
- PerHostPeakMemUsage: 1.70 GB (1824024877)
- RowsProduced: 4.51M (4509900)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 7.478ms
- TotalStorageWaitTime: 85.969ms
- TotalThreadsInvoluntaryContextSwitches: 33 (33)
- TotalThreadsTotalWallClockTime: 31s528ms
- TotalThreadsSysTime: 570.823ms
- TotalThreadsUserTime: 6s735ms
- TotalThreadsVoluntaryContextSwitches: 12.32K (12324)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s998ms
- ExecTreeExecTime: 3s583ms
- OpenTime: 159.762ms
- ExecTreeOpenTime: 41.715us
- PrepareTime: 37.798ms
- ExecTreePrepareTime: 1.252ms
DataStreamSender (dst_id=24):(Total: 1s387ms, non-child: 1s387ms, % non-child: 100.00%)
- BytesSent: 239.28 MB (250900204)
- NetworkThroughput(*): 627.94 MB/sec
- OverallThroughput: 174.07 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 4.51M (4509900)
- SerializeBatchTime: 976.652ms
- TransmitDataRPCTime: 410.108ms
- UncompressedRowBatchSize: 376.11 MB (394378759)
CodeGen:(Total: 191.156ms, non-child: 191.156ms, % non-child: 100.00%)
- CodegenTime: 3.877ms
- CompileTime: 43.500ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 73 (73)
- NumInstructions: 1.41K (1412)
- OptimizationTime: 114.890ms
- PeakMemoryUsage: 706.00 KB (722944)
- PrepareTime: 31.994ms
AGGREGATION_NODE (id=3):(Total: 3s582ms, non-child: 2s677ms, % non-child: 74.72%)
- GetNewBlockTime: 1.217ms
- GetResultsTime: 112.945ms
- HTResizeTime: 199.209ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 539.35 MB (565545308)
- PinTime: 0.000ns
- ReductionFactorEstimate: 36.19
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.51M (4509900)
- RowsReturnedRate: 1.26 M/sec
- StreamingTime: 2s538ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=2):(Total: 905.576ms, non-child: 905.576ms, % non-child: 100.00%)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.29
- BytesRead: 353.91 MB (371101408)
- BytesReadDataNodeCache: 344.78 MB (361531001)
- BytesReadLocal: 353.91 MB (371101408)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 353.91 MB (371101408)
- DecompressionTime: 801.406ms
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 29 (29)
- NumScannerThreadsStarted: 8 (8)
- PeakMemoryUsage: 37.74 MB (39577983)
- PerReadThreadRawHdfsThroughput: 33.32 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 36.395ms
- RowBatchQueuePutWaitTime: 19s573ms
- RowsRead: 11.56M (11559184)
- RowsReturned: 11.56M (11559184)
- RowsReturnedRate: 12.76 M/sec
- ScanRangesComplete: 29 (29)
- ScannerThreadsInvoluntaryContextSwitches: 24 (24)
- ScannerThreadsTotalWallClockTime: 25s369ms
- MaterializeTupleTime(*): 625.976ms
- ScannerThreadsSysTime: 213.411ms
- ScannerThreadsUserTime: 1s802ms
- ScannerThreadsVoluntaryContextSwitches: 11.97K (11975)
- TotalRawHdfsReadTime(*): 10.426ms
- TotalReadThroughput: 95.89 MB/sec
Filter 0 (16.00 MB):
- Rows processed: 0 (0)
- Rows rejected: 0 (0)
- Rows total: 11.56M (11559184)
Fragment F00:
Instance 514ee9ab39cdc507:17 (host=cdh3.net.cuberonlabs.com:22000):(Total: 7s782ms, non-child: 1s509ms, % non-child: 19.39%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.39 GB
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 185.10 MB, 205.64 MB, 361.19 MB, 387.00 MB, 556.44 MB, 554.78 MB, 637.42 MB, 609.11 MB, 527.98 MB, 406.24 MB, 325.19 MB, 203.47 MB, 122.34 MB
ThreadUsage(500.000ms): 1, 9, 9, 9, 9, 9, 10, 10, 8, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 5.33
- BloomFilterBytes: 0
- PeakMemoryUsage: 677.73 MB (710655691)
- PerHostPeakMemUsage: 2.16 GB (2318232477)
- RowsProduced: 5.23M (5232220)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 7.611ms
- TotalStorageWaitTime: 96.800ms
- TotalThreadsInvoluntaryContextSwitches: 55 (55)
- TotalThreadsTotalWallClockTime: 38s799ms
- TotalThreadsSysTime: 640.000ms
- TotalThreadsUserTime: 8s708ms
- TotalThreadsVoluntaryContextSwitches: 15.31K (15310)
Fragment Instance Lifecycle Timings:
- ExecTime: 7s548ms
- ExecTreeExecTime: 4s462ms
- OpenTime: 188.245ms
- ExecTreeOpenTime: 39.792us
- PrepareTime: 46.019ms
- ExecTreePrepareTime: 726.544us
DataStreamSender (dst_id=24):(Total: 1s584ms, non-child: 1s584ms, % non-child: 100.00%)
- BytesSent: 276.41 MB (289837842)
- NetworkThroughput(*): 721.32 MB/sec
- OverallThroughput: 174.50 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 5.23M (5232220)
- SerializeBatchTime: 1s199ms
- TransmitDataRPCTime: 383.201ms
- UncompressedRowBatchSize: 434.83 MB (455951011)
CodeGen:(Total: 228.039ms, non-child: 228.039ms, % non-child: 100.00%)
- CodegenTime: 5.182ms
- CompileTime: 42.385ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 73 (73)
- NumInstructions: 1.41K (1412)
- OptimizationTime: 143.630ms
- PeakMemoryUsage: 706.00 KB (722944)
- PrepareTime: 41.065ms
AGGREGATION_NODE (id=3):(Total: 4s461ms, non-child: 3s556ms, % non-child: 79.73%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 628.464us
- GetResultsTime: 123.660ms
- HTResizeTime: 202.827ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 652.16 MB (683836526)
- PinTime: 0.000ns
- ReductionFactorEstimate: 37.17
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 5.23M (5232220)
- RowsReturnedRate: 1.17 M/sec
- StreamingTime: 3s397ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=2):(Total: 904.408ms, non-child: 904.408ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.39 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35
Runtime filters: Only following filters arrived: , waited 783ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:70
BytesRead(500.000ms): 0, 0, 105.88 MB, 143.20 MB, 206.87 MB, 301.16 MB, 327.83 MB, 418.77 MB, 432.24 MB
- FooterProcessingTime: (Avg: 9.817ms ; Min: 3.249ms ; Max: 50.757ms ; Number of samples: 35)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.22
- BytesRead: 432.24 MB (453237686)
- BytesReadDataNodeCache: 421.44 MB (441912627)
- BytesReadLocal: 432.24 MB (453237686)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 432.24 MB (453237686)
- DecompressionTime: 905.674ms
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 35 (35)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 37.00 MB (38794707)
- PerReadThreadRawHdfsThroughput: 35.15 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 44.939ms
- RowBatchQueuePutWaitTime: 25s713ms
- RowsRead: 14.44M (14439291)
- RowsReturned: 14.44M (14439291)
- RowsReturnedRate: 15.97 M/sec
- ScanRangesComplete: 35 (35)
- ScannerThreadsInvoluntaryContextSwitches: 39 (39)
- ScannerThreadsTotalWallClockTime: 31s063ms
- MaterializeTupleTime(*): 787.470ms
- ScannerThreadsSysTime: 272.000ms
- ScannerThreadsUserTime: 2s184ms
- ScannerThreadsVoluntaryContextSwitches: 14.83K (14834)
- TotalRawHdfsReadTime(*): 12.007ms
- TotalReadThroughput: 96.05 MB/sec
Filter 0 (16.00 MB):
- Rows processed: 0 (0)
- Rows rejected: 0 (0)
- Rows total: 14.44M (14439291)
Instance 514ee9ab39cdc507:1d (host=cdh5.net.cuberonlabs.com:22000):(Total: 7s481ms, non-child: 1s348ms, % non-child: 18.03%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.36 GB
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 187.92 MB, 236.01 MB, 364.84 MB, 429.07 MB, 556.03 MB, 582.15 MB, 649.84 MB, 568.54 MB, 446.85 MB, 365.75 MB, 244.15 MB, 162.92 MB, 41.15 MB
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 10, 8, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 5.07
- BloomFilterBytes: 0
- PeakMemoryUsage: 678.53 MB (711488676)
- PerHostPeakMemUsage: 2.15 GB (2303708143)
- RowsProduced: 5.38M (5379618)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 6.941ms
- TotalStorageWaitTime: 110.134ms
- TotalThreadsInvoluntaryContextSwitches: 34 (34)
- TotalThreadsTotalWallClockTime: 37s031ms
- TotalThreadsSysTime: 636.000ms
- TotalThreadsUserTime: 8s480ms
- TotalThreadsVoluntaryContextSwitches: 14.92K (14916)
Fragment Instance Lifecycle Timings:
- ExecTime: 7s266ms
- ExecTreeExecTime: 4s121ms
- OpenTime: 170.007ms
- ExecTreeOpenTime: 48.024us
- PrepareTime: 45.521ms
- ExecTreePrepareTime: 824.132us
DataStreamSender (dst_id=24):(Total: 1s803ms, non-child: 1s803ms, % non-child: 100.00%)
- BytesSent: 286.92 MB (300861929)
- NetworkThroughput(*): 409.25 MB/sec
- OverallThroughput: 159.05 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 5.38M (5379618)
- SerializeBatchTime: 1s102ms
- TransmitDataRPCTime: 701.102ms
- UncompressedRowBatchSize: 452.23 MB (474193247)
CodeGen:(Total: 208.299ms, non-child: 208.299ms, % non-child: 100.00%)
- CodegenTime: 5.007ms
- CompileTime: 43.576ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 73 (73)
- NumInstructions: 1.41K (1412)
- OptimizationTime: 124.926ms
- PeakMemoryUsage: 706.00 KB (722944)
- PrepareTime: 38.988ms
AGGREGATION_NODE (id=3):(Total: 4s120ms, non-child: 3s220ms, % non-child: 78.16%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 2.800ms
- GetResultsTime: 141.112ms
- HTResizeTime: 212.125ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 652.25 MB (683936972)
- PinTime: 0.000ns
- ReductionFactorEstimate: 35.71
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 5.38M (5379618)
- RowsReturnedRate: 1.31 M/sec
- StreamingTime: 3s046ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=2):(Total: 899.939ms, non-child: 899.939ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.36 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35
Runtime filters: Only following filters arrived: , waited 803ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:70
BytesRead(500.000ms): 0, 0, 120.80 MB, 133.77 MB, 239.03 MB, 279.37 MB, 353.73 MB, 433.86 MB
- FooterProcessingTime: (Avg: 11.888ms ; Min: 3.692ms ; Max: 46.672ms ; Number of samples: 35)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.62
- BytesRead: 433.86 MB (454933101)
- BytesReadDataNodeCache: 423.06 MB (443611786)
- BytesReadLocal: 433.86 MB (454933101)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 433.86 MB (454933101)
- DecompressionTime: 1s070ms
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 35 (35)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 37.83 MB (39666615)
- PerReadThreadRawHdfsThroughput: 30.97 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 32.210ms
- RowBatchQueuePutWaitTime: 23s876ms
- RowsRead: 13.95M (13952334)
- RowsReturned: 13.95M (13952334)
- RowsReturnedRate: 15.50 M/sec
- ScanRangesComplete: 35 (35)
- ScannerThreadsInvoluntaryContextSwitches: 27 (27)
- ScannerThreadsTotalWallClockTime: 29s595ms
- MaterializeTupleTime(*): 786.412ms
- ScannerThreadsSysTime: 244.000ms
- ScannerThreadsUserTime: 2s304ms
- ScannerThreadsVoluntaryContextSwitches: 14.49K (14486)
- TotalRawHdfsReadTime(*): 13.679ms
- TotalReadThroughput: 108.46 MB/sec
Filter 0 (16.00 MB):
- Rows processed: 0 (0)
- Rows rejected: 0 (0)
- Rows total: 13.95M (13952334)
Instance 514ee9ab39cdc507:12 (host=cdh4.net.cuberonlabs.com:22000):(Total: 7s332ms, non-child: 1s091ms, % non-child: 14.89%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:40/3.59 GB
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 187.74 MB, 203.76 MB, 363.92 MB, 434.28 MB, 555.31 MB, 555.22 MB, 650.02 MB, 568.66 MB, 447.02 MB, 365.87 MB, 244.04 MB, 130.51 MB, 41.41 MB
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 10, 10, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 5.20
- BloomFilterBytes: 0
- PeakMemoryUsage: 683.26 MB (716447973)
- PerHostPeakMemUsage: 2.13 GB (2284202661)
- RowsProduced: 5.60M (5603026)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 8.432ms
- TotalStorageWaitTime: 87.968ms
- TotalThreadsInvoluntaryContextSwitches: 54 (54)
- TotalThreadsTotalWallClockTime: 37s767ms
- TotalThreadsSysTime: 812.000ms
- TotalThreadsUserTime: 8s256ms
- TotalThreadsVoluntaryContextSwitches: 15.81K (15810)
Fragment Instance Lifecycle Timings:
- ExecTime: 7s140ms
- ExecTreeExecTime: 4s169ms
- OpenTime: 155.948ms
- ExecTreeOpenTime: 39.344us
- PrepareTime: 35.411ms
- ExecTreePrepareTime: 729.932us
DataStreamSender (dst_id=24):(Total: 1s887ms, non-child: 1s887ms, % non-child: 100.00%)
- BytesSent: 295.29 MB (309636992)
- NetworkThroughput(*): 455.14 MB/sec
- OverallThroughput: 156.44 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 5.60M (5603026)
- SerializeBatchTime: 1s237ms
- TransmitDataRPCTime: 648.795ms
- UncompressedRowBatchSize: 465.80 MB (488430203)
CodeGen:(Total: 185.775ms, non-child: 185.775ms, % non-child: 100.00%)
- CodegenTime: 3.773ms
- CompileTime: 39.931ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 73 (73)
- NumInstructions: 1.41K (1412)
- OptimizationTime: 114.679ms
- PeakMemoryUsage: 706.00 KB (722944)
- PrepareTime: 30.369ms
AGGREGATION_NODE (id=3):(Total: 4s167ms, non-child: 3s235ms, % non-child: 77.64%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 771.256us
- GetResultsTime: 116.769ms
- HTResizeTime: 200.741ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 652.14 MB (683816441)
- PinTime: 0.000ns
- ReductionFactorEstimate: 36.18
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 5.60M (5603026)
- RowsReturnedRate: 1.34 M/sec
- StreamingTime: 3s090ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=2):(Total: 931.911ms, non-child: 931.911ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:40/3.59 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 40 out of 40
Runtime filters: Only following filters arrived: , waited 823ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:80
BytesRead(500.000ms): 0, 0, 115.80 MB, 129.28 MB, 223.92 MB, 294.83 MB, 371.07 MB, 459.98 MB
- FooterProcessingTime: (Avg: 8.958ms ; Min: 3.176ms ; Max: 37.350ms ; Number of samples: 40)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.88
- BytesRead: 459.98 MB (482322831)
- BytesReadDataNodeCache: 447.64 MB (469384703)
- BytesReadLocal: 459.98 MB (482322831)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 459.98 MB (482322831)
- DecompressionTime: 1s027ms
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 40 (40)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 37.40 MB (39217051)
- PerReadThreadRawHdfsThroughput: 31.02 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 33.716ms
- RowBatchQueuePutWaitTime: 24s654ms
- RowsRead: 15.04M (15041855)
- RowsReturned: 15.04M (15041855)
- RowsReturnedRate: 16.14 M/sec
- ScanRangesComplete: 40 (40)
- ScannerThreadsInvoluntaryContextSwitches: 43 (43)
- ScannerThreadsTotalWallClockTime: 30s470ms
- MaterializeTupleTime(*): 800.643ms
- ScannerThreadsSysTime: 368.000ms
- ScannerThreadsUserTime: 2s276ms
- ScannerThreadsVoluntaryContextSwitches: 15.48K (15484)
- TotalRawHdfsReadTime(*): 14.478ms
- TotalReadThroughput: 114.99 MB/sec
Filter 0 (16.00 MB):
- Rows processed: 0 (0)
- Rows rejected: 0 (0)
- Rows total: 15.04M (15041855)
Instance 514ee9ab39cdc507:18 (host=cdh17.net.cuberonlabs.com:22000):(Total: 6s912ms, non-child: 1s320ms, % non-child: 19.11%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.58 GB
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 184.75 MB, 203.93 MB, 362.53 MB, 363.95 MB, 416.18 MB, 552.78 MB, 521.61 MB, 423.96 MB, 326.34 MB, 228.66 MB, 131.08 MB, 33.26 MB
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 10, 9, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 5.43
- BloomFilterBytes: 0
- PeakMemoryUsage: 556.40 MB (583425568)
- PerHostPeakMemUsage: 1.75 GB (1879028559)
- RowsProduced: 4.28M (4284546)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 6.722ms
- TotalStorageWaitTime: 90.974ms
- TotalThreadsInvoluntaryContextSwitches: 18 (18)
- TotalThreadsTotalWallClockTime: 36s029ms
- TotalThreadsSysTime: 632.000ms
- TotalThreadsUserTime: 7s348ms
- TotalThreadsVoluntaryContextSwitches: 11.59K (11589)
Fragment Instance Lifecycle Timings:
- ExecTime: 6s722ms
- ExecTreeExecTime: 4s076ms
- OpenTime: 152.679ms
- ExecTreeOpenTime: 41.716us
- PrepareTime: 37.195ms
- ExecTreePrepareTime: 737.372us
DataStreamSender (dst_id=24):(Total: 1s331ms, non-child: 1s331ms, % non-child: 100.00%)
- BytesSent: 227.94 MB (239015276)
- NetworkThroughput(*): 634.21 MB/sec
- OverallThroughput: 171.24 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 4.28M (4284546)
- SerializeBatchTime: 970.989ms
- TransmitDataRPCTime: 359.410ms
- UncompressedRowBatchSize: 357.34 MB (374701393)
CodeGen:(Total: 184.445ms, non-child: 184.445ms, % non-child: 100.00%)
- CodegenTime: 3.764ms
- CompileTime: 41.873ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 73 (73)
- NumInstructions: 1.41K (1412)
- OptimizationTime: 109.361ms
- PeakMemoryUsage: 706.00 KB (722944)
- PrepareTime: 32.444ms
AGGREGATION_NODE (id=3):(Total: 4s075ms, non-child: 3s171ms, % non-child: 77.81%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 621.577us
- GetResultsTime: 120.216ms
- HTResizeTime: 255.295ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 524.22 MB (549683385)
- PinTime: 0.000ns
- ReductionFactorEstimate: 36.57
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.28M (4284546)
- RowsReturnedRate: 1.05 M/sec
- StreamingTime: 3s021ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=2):(Total: 904.408ms, non-child: 904.408ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.58 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 26 out of 26
Runtime filters: Only following filters arrived: , waited 823ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:52
BytesRead(500.000ms): 0, 0, 115.34 MB, 115.34 MB, 182.54 MB, 240.63 MB, 264.31 MB, 330.99 MB
- FooterProcessingTime: (Avg: 11.043ms ; Min: 2.644ms ; Max: 43.484ms ; Number of samples: 26)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.75
- BytesRead: 330.99 MB (347066972)
- BytesReadDataNodeCache: 322.96 MB (338652199)
- BytesReadLocal: 330.99 MB (347066972)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 330.99 MB (347066972)
- DecompressionTime: 806.682ms
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 26 (26)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 38.65 MB (40523701)
- PerReadThreadRawHdfsThroughput: 31.86 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 31.816ms
- RowBatchQueuePutWaitTime: 23s987ms
- RowsRead: 10.92M (10919165)
- RowsReturned: 10.92M (10919165)
- RowsReturnedRate: 12.07 M/sec
- ScanRangesComplete: 26 (26)
- ScannerThreadsInvoluntaryContextSwitches: 10 (10)
- ScannerThreadsTotalWallClockTime: 29s154ms
- MaterializeTupleTime(*): 633.210ms
- ScannerThreadsSysTime: 172.000ms
- ScannerThreadsUserTime: 1s796ms
- ScannerThreadsVoluntaryContextSwitches: 11.25K (11251)
- TotalRawHdfsReadTime(*): 10.144ms
- TotalReadThroughput: 82.75 MB/sec
Filter 0 (16.00 MB):
- Rows processed: 0 (0)
- Rows rejected: 0 (0)
- Rows total: 10.92M (10919165)
Instance 514ee9ab39cdc507:13 (host=cdh16.net.cuberonlabs.com:22000):(Total: 6s641ms, non-child: 1s388ms, % non-child: 20.90%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.64 GB
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 203.78 MB, 235.70 MB, 363.60 MB, 431.65 MB, 549.81 MB, 521.90 MB, 423.98 MB, 326.26 MB, 228.64 MB, 130.84 MB, 33.31 MB
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 8, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 5.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 556.44 MB (583473332)
- PerHostPeakMemUsage: 1.64 GB (1763578733)
- RowsProduced: 4.39M (4385303)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 5.815ms
- TotalStorageWaitTime: 54.375ms
- TotalThreadsInvoluntaryContextSwitches: 21 (21)
- TotalThreadsTotalWallClockTime: 33s508ms
- TotalThreadsSysTime: 560.000ms
- TotalThreadsUserTime: 7s056ms
- TotalThreadsVoluntaryContextSwitches: 11.75K (11748)
Fragment Instance Lifecycle Timings:
- ExecTime: 6s459ms
- ExecTreeExecTime: 3s773ms
- OpenTime: 147.268ms
- ExecTreeOpenTime: 36.610us
- PrepareTime: 35.118ms
- ExecTreePrepareTime: 661.166us
DataStreamSender (dst_id=24):(Total: 1s304ms, non-child: 1s304ms, % non-child: 100.00%)
- BytesSent: 232.76 MB (244062142)
- NetworkThroughput(*): 763.54 MB/sec
- OverallThroughput: 178.42 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 4.39M (4385303)
- SerializeBatchTime: 998.939ms
- TransmitDataRPCTime: 304.837ms
- UncompressedRowBatchSize: 365.86 MB (383632260)
CodeGen:(Total: 176.880ms, non-child: 176.880ms, % non-child: 100.00%)
- CodegenTime: 3.706ms
- CompileTime: 39.327ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 73 (73)
- NumInstructions: 1.41K (1412)
- OptimizationTime: 106.684ms
- PeakMemoryUsage: 706.00 KB (722944)
- PrepareTime: 30.110ms
AGGREGATION_NODE (id=3):(Total: 3s772ms, non-child: 2s864ms, % non-child: 75.94%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 705.934us
- GetResultsTime: 123.473ms
- HTResizeTime: 229.786ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 524.24 MB (549702601)
- PinTime: 0.000ns
- ReductionFactorEstimate: 36.38
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.39M (4385303)
- RowsReturnedRate: 1.16 M/sec
- StreamingTime: 2s713ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=2):(Total: 907.537ms, non-child: 907.537ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.64 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28
Runtime filters: Only following filters arrived: , waited 823ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:56
BytesRead(500.000ms): 0, 0, 120.24 MB, 146.94 MB, 243.90 MB, 271.58 MB, 338.43 MB
- FooterProcessingTime: (Avg: 11.259ms ; Min: 3.230ms ; Max: 37.617ms ; Number of samples: 28)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.43
- BytesRead: 338.43 MB (354874263)
- BytesReadDataNodeCache: 329.80 MB (345817326)
- BytesReadLocal: 338.43 MB (354874263)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 338.43 MB (354874263)
- DecompressionTime: 754.485ms
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 28 (28)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 37.77 MB (39608233)
- PerReadThreadRawHdfsThroughput: 29.37 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 35.989ms
- RowBatchQueuePutWaitTime: 21s863ms
- RowsRead: 11.05M (11051815)
- RowsReturned: 11.05M (11051815)
- RowsReturnedRate: 12.18 M/sec
- ScanRangesComplete: 28 (28)
- ScannerThreadsInvoluntaryContextSwitches: 13 (13)
- ScannerThreadsTotalWallClockTime: 26s901ms
- MaterializeTupleTime(*): 612.518ms
- ScannerThreadsSysTime: 180.000ms
- ScannerThreadsUserTime: 1s704ms
- ScannerThreadsVoluntaryContextSwitches: 11.43K (11433)
- TotalRawHdfsReadTime(*): 11.253ms
- TotalReadThroughput: 96.70 MB/sec
Filter 0 (16.00 MB):
- Rows processed: 0 (0)
- Rows rejected: 0 (0)
- Rows total: 11.05M (11051815)
Instance 514ee9ab39cdc507:19 (host=cdh2.net.cuberonlabs.com:22000):(Total: 6s637ms, non-child: 1s188ms, % non-child: 17.91%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/3.00 GB
MemoryUsage(500.000ms): 2.05 MB, 1.37 MB, 43.92 MB, 204.13 MB, 362.23 MB, 363.31 MB, 556.16 MB, 552.23 MB, 489.10 MB, 391.40 MB, 293.79 MB, 196.07 MB, 130.91 MB, 33.23 MB
ThreadUsage(500.000ms): 1, 9, 10, 10, 10, 10, 10, 9, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 5.36
- BloomFilterBytes: 0
- PeakMemoryUsage: 558.37 MB (585496347)
- PerHostPeakMemUsage: 1.74 GB (1866918022)
- RowsProduced: 4.86M (4858229)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 7.465ms
- TotalStorageWaitTime: 62.051ms
- TotalThreadsInvoluntaryContextSwitches: 27 (27)
- TotalThreadsTotalWallClockTime: 34s474ms
- TotalThreadsSysTime: 676.000ms
- TotalThreadsUserTime: 7s340ms
- TotalThreadsVoluntaryContextSwitches: 13.47K (13468)
Fragment Instance Lifecycle Timings:
- ExecTime: 6s422ms
- ExecTreeExecTime: 3s744ms
- OpenTime: 179.831ms
- ExecTreeOpenTime: 48.556us
- PrepareTime: 34.408ms
- ExecTreePrepareTime: 741.516us
DataStreamSender (dst_id=24):(Total: 1s497ms, non-child: 1s497ms, % non-child: 100.00%)
- BytesSent: 257.13 MB (269623144)
- NetworkThroughput(*): 746.80 MB/sec
- OverallThroughput: 171.71 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 4.86M (4858229)
- SerializeBatchTime: 1s152ms
- TransmitDataRPCTime: 344.313ms
- UncompressedRowBatchSize: 404.42 MB (424064953)
CodeGen:(Total: 208.138ms, non-child: 208.138ms, % non-child: 100.00%)
- CodegenTime: 4.173ms
- CompileTime: 48.434ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 73 (73)
- NumInstructions: 1.41K (1412)
- OptimizationTime: 129.193ms
- PeakMemoryUsage: 706.00 KB (722944)
- PrepareTime: 29.801ms
AGGREGATION_NODE (id=3):(Total: 3s742ms, non-child: 2s846ms, % non-child: 76.06%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 1.022ms
- GetResultsTime: 122.613ms
- HTResizeTime: 193.419ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 524.27 MB (549733277)
- PinTime: 0.000ns
- ReductionFactorEstimate: 36.05
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.86M (4858229)
- RowsReturnedRate: 1.30 M/sec
- StreamingTime: 2s697ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=2):(Total: 896.106ms, non-child: 896.106ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/3.00 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32
Runtime filters: Only following filters arrived: , waited 803ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:64
BytesRead(500.000ms): 0, 0, 116.42 MB, 116.42 MB, 227.61 MB, 244.34 MB, 341.06 MB, 384.71 MB
- FooterProcessingTime: (Avg: 12.375ms ; Min: 2.931ms ; Max: 63.332ms ; Number of samples: 32)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 8.71
- BytesRead: 384.71 MB (403402232)
- BytesReadDataNodeCache: 374.84 MB (393048946)
- BytesReadLocal: 384.71 MB (403402232)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 384.71 MB (403402232)
- DecompressionTime: 882.708ms
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 32 (32)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 38.08 MB (39929878)
- PerReadThreadRawHdfsThroughput: 33.26 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 33.163ms
- RowBatchQueuePutWaitTime: 21s372ms
- RowsRead: 12.59M (12593336)
- RowsReturned: 12.59M (12593336)
- RowsReturnedRate: 14.05 M/sec
- ScanRangesComplete: 32 (32)
- ScannerThreadsInvoluntaryContextSwitches: 17 (17)
- ScannerThreadsTotalWallClockTime: 27s871ms
- MaterializeTupleTime(*): 697.891ms
- ScannerThreadsSysTime: 252.000ms
- ScannerThreadsUserTime: 2s008ms
- ScannerThreadsVoluntaryContextSwitches: 13.05K (13055)
- TotalRawHdfsReadTime(*): 11.295ms
- TotalReadThroughput: 96.18 MB/sec
Filter 0 (16.00 MB):
- Rows processed: 0 (0)
- Rows rejected: 0 (0)
- Rows total: 12.59M (12593336)
Instance 514ee9ab39cdc507:1c (host=cdh1.net.cuberonlabs.com:22000):(Total: 6s423ms, non-child: 1s139ms, % non-child: 17.74%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/2.99 GB
MemoryUsage(500.000ms): 2.05 MB, 1.37 MB, 27.57 MB, 197.10 MB, 356.18 MB, 357.15 MB, 550.12 MB, 546.52 MB, 489.12 MB, 391.49 MB, 293.74 MB, 196.14 MB, 98.34 MB
ThreadUsage(500.000ms): 1, 1, 8, 8, 8, 8, 8, 7, 1, 1, 1, 1, 1
- AverageThreadTokens: 4.15
- BloomFilterBytes: 0
- PeakMemoryUsage: 551.79 MB (578591555)
- PerHostPeakMemUsage: 1.81 GB (1939587581)
- RowsProduced: 4.79M (4794858)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 7.618ms
- TotalStorageWaitTime: 108.653ms
- TotalThreadsInvoluntaryContextSwitches: 45 (45)
- TotalThreadsTotalWallClockTime: 27s386ms
- TotalThreadsSysTime: 596.000ms
- TotalThreadsUserTime: 7s192ms
- TotalThreadsVoluntaryContextSwitches: 13.34K (13343)
Fragment Instance Lifecycle Timings:
- ExecTime: 6s245ms
- ExecTreeExecTime: 3s737ms
- OpenTime: 141.013ms
- ExecTreeOpenTime: 40.668us
- PrepareTime: 36.668ms
- ExecTreePrepareTime: 8.919ms
DataStreamSender (dst_id=24):(Total: 1s375ms, non-child: 1s375ms, % non-child: 100.00%)
- BytesSent: 253.69 MB (266013619)
- NetworkThroughput(*): 745.44 MB/sec
- OverallThroughput: 184.44 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 4.79M (4794858)
- SerializeBatchTime: 1s034ms
- TransmitDataRPCTime: 340.324ms
- UncompressedRowBatchSize: 398.88 MB (418257477)
CodeGen:(Total: 164.113ms, non-child: 164.113ms, % non-child: 100.00%)
- CodegenTime: 2.546ms
- CompileTime: 40.027ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 73 (73)
- NumInstructions: 1.41K (1412)
- OptimizationTime: 99.960ms
- PeakMemoryUsage: 706.00 KB (722944)
- PrepareTime: 23.653ms
AGGREGATION_NODE (id=3):(Total: 3s744ms, non-child: 2s801ms, % non-child: 74.81%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 2.725ms
- GetResultsTime: 111.908ms
- HTResizeTime: 197.261ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 524.24 MB (549701310)
- PinTime: 0.000ns
- ReductionFactorEstimate: 36.49
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.79M (4794858)
- RowsReturnedRate: 1.28 M/sec
- StreamingTime: 2s665ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=2):(Total: 943.004ms, non-child: 943.004ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/2.99 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35
Runtime filters: Only following filters arrived: , waited 829ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:70
BytesRead(500.000ms): 0, 0, 55.90 MB, 108.45 MB, 187.11 MB, 265.74 MB, 344.61 MB, 383.67 MB
- FooterProcessingTime: (Avg: 12.341ms ; Min: 3.729ms ; Max: 76.218ms ; Number of samples: 35)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 5.86
- BytesRead: 383.67 MB (402308363)
- BytesReadDataNodeCache: 372.88 MB (390990094)
- BytesReadLocal: 383.67 MB (402308363)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 383.67 MB (402308363)
- DecompressionTime: 894.256ms
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 35 (35)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 31.03 MB (32542382)
- PerReadThreadRawHdfsThroughput: 32.72 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 40.794ms
- RowBatchQueuePutWaitTime: 15s986ms
- RowsRead: 12.55M (12550697)
- RowsReturned: 12.55M (12550697)
- RowsReturnedRate: 13.31 M/sec
- ScanRangesComplete: 35 (35)
- ScannerThreadsInvoluntaryContextSwitches: 30 (30)
- ScannerThreadsTotalWallClockTime: 20s999ms
- MaterializeTupleTime(*): 681.589ms
- ScannerThreadsSysTime: 280.000ms
- ScannerThreadsUserTime: 2s016ms
- ScannerThreadsVoluntaryContextSwitches: 12.99K (12992)
- TotalRawHdfsReadTime(*): 11.450ms
- TotalReadThroughput: 95.92 MB/sec
Filter 0 (16.00 MB):
- Rows processed: 0 (0)
- Rows rejected: 0 (0)
- Rows total: 12.55M (12550697)
Instance 514ee9ab39cdc507:15 (host=cdh6.net.cuberonlabs.com:22000):(Total: 6s113ms, non-child: 1s045ms, % non-child: 17.10%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/2.89 GB
MemoryUsage(500.000ms): 2.05 MB, 1.37 MB, 42.41 MB, 203.34 MB, 363.65 MB, 362.92 MB, 555.62 MB, 528.86 MB, 424.01 MB, 326.38 MB, 228.63 MB, 130.91 MB, 33.18 MB
ThreadUsage(500.000ms): 1, 1, 10, 10, 10, 10, 10, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 4.46
- BloomFilterBytes: 0
- PeakMemoryUsage: 557.58 MB (584668810)
- PerHostPeakMemUsage: 1.67 GB (1794839264)
- RowsProduced: 4.66M (4663530)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 6.315ms
- TotalStorageWaitTime: 86.677ms
- TotalThreadsInvoluntaryContextSwitches: 22 (22)
- TotalThreadsTotalWallClockTime: 31s145ms
- TotalThreadsSysTime: 492.000ms
- TotalThreadsUserTime: 6s848ms
- TotalThreadsVoluntaryContextSwitches: 12.71K (12707)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s897ms
- ExecTreeExecTime: 3s518ms
- OpenTime: 177.526ms
- ExecTreeOpenTime: 49.884us
- PrepareTime: 38.315ms
- ExecTreePrepareTime: 684.628us
DataStreamSender (dst_id=24):(Total: 1s340ms, non-child: 1s340ms, % non-child: 100.00%)
- BytesSent: 247.32 MB (259328986)
- NetworkThroughput(*): 751.79 MB/sec
- OverallThroughput: 184.56 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 4.66M (4663530)
- SerializeBatchTime: 1s010ms
- TransmitDataRPCTime: 328.969ms
- UncompressedRowBatchSize: 388.66 MB (407541293)
CodeGen:(Total: 210.314ms, non-child: 210.314ms, % non-child: 100.00%)
- CodegenTime: 4.103ms
- CompileTime: 62.392ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 73 (73)
- NumInstructions: 1.41K (1412)
- OptimizationTime: 113.813ms
- PeakMemoryUsage: 706.00 KB (722944)
- PrepareTime: 33.309ms
AGGREGATION_NODE (id=3):(Total: 3s517ms, non-child: 2s627ms, % non-child: 74.70%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 572.760us
- GetResultsTime: 112.696ms
- HTResizeTime: 180.793ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 524.31 MB (549773890)
- PinTime: 0.000ns
- ReductionFactorEstimate: 36.60
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.66M (4663530)
- RowsReturnedRate: 1.33 M/sec
- StreamingTime: 2s492ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=2):(Total: 890.074ms, non-child: 890.074ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/2.89 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32
Runtime filters: Only following filters arrived: , waited 803ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:64
BytesRead(500.000ms): 0, 0, 113.42 MB, 126.70 MB, 218.61 MB, 281.90 MB, 348.45 MB, 371.87 MB
- FooterProcessingTime: (Avg: 12.084ms ; Min: 3.180ms ; Max: 46.430ms ; Number of samples: 32)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.43
- BytesRead: 371.87 MB (389930944)
- BytesReadDataNodeCache: 362.00 MB (379580217)
- BytesReadLocal: 371.87 MB (389930944)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 371.87 MB (389930944)
- DecompressionTime: 841.196ms
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 32 (32)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 37.49 MB (39313688)
- PerReadThreadRawHdfsThroughput: 37.69 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 37.240ms
- RowBatchQueuePutWaitTime: 19s572ms
- RowsRead: 12.15M (12150960)
- RowsReturned: 12.15M (12150960)
- RowsReturnedRate: 13.65 M/sec
- ScanRangesComplete: 32 (32)
- ScannerThreadsInvoluntaryContextSwitches: 16 (16)
- ScannerThreadsTotalWallClockTime: 25s069ms
- MaterializeTupleTime(*): 668.817ms
- ScannerThreadsSysTime: 180.000ms
- ScannerThreadsUserTime: 1s932ms
- ScannerThreadsVoluntaryContextSwitches: 12.43K (12427)
- TotalRawHdfsReadTime(*): 9.634ms
- TotalReadThroughput: 92.97 MB/sec
Filter 0 (16.00 MB):
- Rows processed: 0 (0)
- Rows rejected: 0 (0)
- Rows total: 12.15M (12150960)
Instance 514ee9ab39cdc507:22 (host=cdh10.net.cuberonlabs.com:22000):(Total: 6s081ms, non-child: 809.232ms, % non-child: 13.31%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.75 GB
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 206.67 MB, 365.55 MB, 365.67 MB, 555.79 MB, 548.63 MB, 456.63 MB, 358.80 MB, 261.27 MB, 163.58 MB, 33.25 MB
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 7, 1, 1, 1, 1, 1
- AverageThreadTokens: 5.25
- BloomFilterBytes: 0
- PeakMemoryUsage: 560.96 MB (588212896)
- PerHostPeakMemUsage: 1.66 GB (1784016472)
- RowsProduced: 4.57M (4572828)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 9.421ms
- TotalStorageWaitTime: 114.773ms
- TotalThreadsInvoluntaryContextSwitches: 49 (49)
- TotalThreadsTotalWallClockTime: 30s502ms
- TotalThreadsSysTime: 636.000ms
- TotalThreadsUserTime: 6s464ms
- TotalThreadsVoluntaryContextSwitches: 12.15K (12151)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s891ms
- ExecTreeExecTime: 3s497ms
- OpenTime: 152.020ms
- ExecTreeOpenTime: 36.090us
- PrepareTime: 37.710ms
- ExecTreePrepareTime: 748.248us
DataStreamSender (dst_id=24):(Total: 1s592ms, non-child: 1s592ms, % non-child: 100.00%)
- BytesSent: 243.06 MB (254868683)
- NetworkThroughput(*): 407.26 MB/sec
- OverallThroughput: 152.64 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 4.57M (4572828)
- SerializeBatchTime: 994.709ms
- TransmitDataRPCTime: 596.816ms
- UncompressedRowBatchSize: 382.38 MB (400955551)
CodeGen:(Total: 183.657ms, non-child: 183.657ms, % non-child: 100.00%)
- CodegenTime: 3.898ms
- CompileTime: 39.873ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 73 (73)
- NumInstructions: 1.41K (1412)
- OptimizationTime: 110.956ms
- PeakMemoryUsage: 706.00 KB (722944)
- PrepareTime: 32.049ms
AGGREGATION_NODE (id=3):(Total: 3s496ms, non-child: 2s578ms, % non-child: 73.74%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 1.014ms
- GetResultsTime: 113.486ms
- HTResizeTime: 188.242ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 524.23 MB (549692743)
- PinTime: 0.000ns
- ReductionFactorEstimate: 35.11
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.57M (4572828)
- RowsReturnedRate: 1.31 M/sec
- StreamingTime: 2s440ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=2):(Total: 918.030ms, non-child: 918.030ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.75 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30
Runtime filters: Only following filters arrived: , waited 824ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0%
File Formats: PARQUET/SNAPPY:60
BytesRead(500.000ms): 0, 0, 117.15 MB, 143.75 MB, 250.76 MB, 327.35 MB, 354.06 MB
- FooterProcessingTime: (Avg: 13.739ms ; Min: 3.041ms ; Max: 49.831ms ; Number of samples: 30)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.29
- BytesRead: 354.06 MB (371259437)
- BytesReadDataNodeCache: 344.81 MB (361554938)
- BytesReadLocal: 354.06 MB (371259437)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 354.06 MB (371259437)
- DecompressionTime: 752.010ms
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 30 (30)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 40.59 MB (42565388)
- PerReadThreadRawHdfsThroughput: 34.33 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 41.898ms
- RowBatchQueuePutWaitTime: 19s102ms
- RowsRead: 11.46M (11459388)
- RowsReturned: 11.46M (11459388)
- RowsReturnedRate: 12.48 M/sec
- ScanRangesComplete: 30 (30)
- ScannerThreadsInvoluntaryContextSwitches: 42 (42)
- ScannerThreadsTotalWallClockTime: 24s458ms
- MaterializeTupleTime(*): 586.825ms
- ScannerThreadsSysTime: 204.000ms
- ScannerThreadsUserTime: 1s736ms
- ScannerThreadsVoluntaryContextSwitches: 11.83K (11829)
- TotalRawHdfsReadTime(*): 10.072ms
- TotalReadThroughput: 101.16 MB/sec
Filter 0 (16.00 MB):
- Rows processed: 0 (0)
- Rows rejected: 0 (0)
- Rows total: 11.46M (11459388)
Instance 514ee9ab39cdc507:21 (host=cdh9.net.cuberonlabs.com:22000):(Total: 5s977ms, non-child: 940.172ms, % non-child: 15.73%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/3.02 GB
MemoryUsage(500.000ms): 2.05 MB, 1.37 MB, 40.54 MB, 204.31 MB, 364.41 MB, 379.48 MB, 556.04 MB, 536.75 MB, 424.00 MB, 326.52 MB, 196.08 MB, 98.47 MB
ThreadUsage(500.000ms): 1, 9, 10, 10, 10, 10, 10, 4, 1, 1, 1, 1
- AverageThreadTokens: 5.67
- BloomFilterBytes: 0
- PeakMemoryUsage: 557.72 MB (584806842)
- PerHostPeakMemUsage: 1.69 GB (1813107104)
- RowsProduced: 4.85M (4853569)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 8.834ms
- TotalStorageWaitTime: 43.479ms
- TotalThreadsInvoluntaryContextSwitches: 28 (28)
- TotalThreadsTotalWallClockTime: 32s301ms
- TotalThreadsSysTime: 524.000ms
- TotalThreadsUserTime: 6s584ms
- TotalThreadsVoluntaryContextSwitches: 13.43K (13425)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s783ms
- ExecTreeExecTime: 3s566ms
- OpenTime: 155.432ms
- ExecTreeOpenTime: 37.702us
- PrepareTime: 38.316ms
- ExecTreePrepareTime: 808.971us
DataStreamSender (dst_id=24):(Total: 1s283ms, non-child: 1s283ms, % non-child: 100.00%)
- BytesSent: 257.44 MB (269940699)
- NetworkThroughput(*): 746.43 MB/sec
- OverallThroughput: 200.52 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 4.85M (4853569)
- SerializeBatchTime: 938.230ms
- TransmitDataRPCTime: 344.888ms
- UncompressedRowBatchSize: 404.92 MB (424589956)
CodeGen:(Total: 187.863ms, non-child: 187.863ms, % non-child: 100.00%)
- CodegenTime: 3.949ms
- CompileTime: 40.763ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 73 (73)
- NumInstructions: 1.41K (1412)
- OptimizationTime: 113.479ms
- PeakMemoryUsage: 706.00 KB (722944)
- PrepareTime: 32.838ms
AGGREGATION_NODE (id=3):(Total: 3s565ms, non-child: 2s663ms, % non-child: 74.70%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 676.644us
- GetResultsTime: 99.482ms
- HTResizeTime: 182.971ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 524.26 MB (549723860)
- PinTime: 0.000ns
- ReductionFactorEstimate: 35.69
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.85M (4853569)
- RowsReturnedRate: 1.36 M/sec
- StreamingTime: 2s540ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=2):(Total: 901.930ms, non-child: 901.930ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/3.02 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31
Runtime filters: Only following filters arrived: , waited 823ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:62
BytesRead(500.000ms): 0, 0, 103.98 MB, 117.11 MB, 217.76 MB, 270.98 MB, 347.78 MB, 387.40 MB
- FooterProcessingTime: (Avg: 12.984ms ; Min: 2.639ms ; Max: 60.996ms ; Number of samples: 31)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 8.00
- BytesRead: 387.40 MB (406219320)
- BytesReadDataNodeCache: 377.84 MB (396191917)
- BytesReadLocal: 387.40 MB (406219320)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 387.40 MB (406219320)
- DecompressionTime: 811.635ms
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 31 (31)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 37.91 MB (39750521)
- PerReadThreadRawHdfsThroughput: 36.06 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 26.780ms
- RowBatchQueuePutWaitTime: 20s161ms
- RowsRead: 12.71M (12711965)
- RowsReturned: 12.71M (12711965)
- RowsReturnedRate: 14.09 M/sec
- ScanRangesComplete: 31 (31)
- ScannerThreadsInvoluntaryContextSwitches: 23 (23)
- ScannerThreadsTotalWallClockTime: 26s362ms
- MaterializeTupleTime(*): 638.552ms
- ScannerThreadsSysTime: 204.000ms
- ScannerThreadsUserTime: 1s824ms
- ScannerThreadsVoluntaryContextSwitches: 13.10K (13103)
- TotalRawHdfsReadTime(*): 10.491ms
- TotalReadThroughput: 96.85 MB/sec
Filter 0 (16.00 MB):
- Rows processed: 0 (0)
- Rows rejected: 0 (0)
- Rows total: 12.71M (12711965)
Instance 514ee9ab39cdc507:1f (host=cdh8.net.cuberonlabs.com:22000):(Total: 5s970ms, non-child: 747.470ms, % non-child: 12.52%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.70 GB
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 204.50 MB, 235.14 MB, 363.40 MB, 555.63 MB, 539.86 MB, 456.60 MB, 358.77 MB, 228.68 MB, 130.98 MB, 33.27 MB
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 5, 1, 1, 1, 1, 1
- AverageThreadTokens: 5.08
- BloomFilterBytes: 0
- PeakMemoryUsage: 558.00 MB (585104887)
- PerHostPeakMemUsage: 1.63 GB (1748411303)
- RowsProduced: 4.35M (4348675)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 7.694ms
- TotalStorageWaitTime: 106.236ms
- TotalThreadsInvoluntaryContextSwitches: 39 (39)
- TotalThreadsTotalWallClockTime: 31s216ms
- TotalThreadsSysTime: 540.000ms
- TotalThreadsUserTime: 6s672ms
- TotalThreadsVoluntaryContextSwitches: 12.23K (12233)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s749ms
- ExecTreeExecTime: 3s441ms
- OpenTime: 188.687ms
- ExecTreeOpenTime: 63.645us
- PrepareTime: 32.516ms
- ExecTreePrepareTime: 714.738us
DataStreamSender (dst_id=24):(Total: 1s567ms, non-child: 1s567ms, % non-child: 100.00%)
- BytesSent: 229.65 MB (240800981)
- NetworkThroughput(*): 387.49 MB/sec
- OverallThroughput: 146.50 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 4.35M (4348675)
- SerializeBatchTime: 974.138ms
- TransmitDataRPCTime: 592.655ms
- UncompressedRowBatchSize: 361.15 MB (378692981)
CodeGen:(Total: 215.842ms, non-child: 215.842ms, % non-child: 100.00%)
- CodegenTime: 3.273ms
- CompileTime: 62.743ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 73 (73)
- NumInstructions: 1.41K (1412)
- OptimizationTime: 124.760ms
- PeakMemoryUsage: 706.00 KB (722944)
- PrepareTime: 27.712ms
AGGREGATION_NODE (id=3):(Total: 3s440ms, non-child: 2s563ms, % non-child: 74.52%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 570.935us
- GetResultsTime: 113.082ms
- HTResizeTime: 193.469ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 524.29 MB (549761556)
- PinTime: 0.000ns
- ReductionFactorEstimate: 36.29
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.35M (4348675)
- RowsReturnedRate: 1.26 M/sec
- StreamingTime: 2s425ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=2):(Total: 876.413ms, non-child: 876.413ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.70 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28
Runtime filters: Only following filters arrived: , waited 783ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:56
BytesRead(500.000ms): 0, 0, 116.17 MB, 156.70 MB, 249.29 MB, 316.03 MB, 345.44 MB
- FooterProcessingTime: (Avg: 11.868ms ; Min: 2.985ms ; Max: 42.725ms ; Number of samples: 28)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.00
- BytesRead: 345.44 MB (362217941)
- BytesReadDataNodeCache: 336.80 MB (353164502)
- BytesReadLocal: 345.44 MB (362217941)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 345.44 MB (362217941)
- DecompressionTime: 871.125ms
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 28 (28)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 37.49 MB (39315743)
- PerReadThreadRawHdfsThroughput: 37.64 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 35.226ms
- RowBatchQueuePutWaitTime: 19s017ms
- RowsRead: 11.39M (11388046)
- RowsReturned: 11.39M (11388046)
- RowsReturnedRate: 12.99 M/sec
- ScanRangesComplete: 28 (28)
- ScannerThreadsInvoluntaryContextSwitches: 27 (27)
- ScannerThreadsTotalWallClockTime: 25s278ms
- MaterializeTupleTime(*): 664.422ms
- ScannerThreadsSysTime: 164.000ms
- ScannerThreadsUserTime: 1s948ms
- ScannerThreadsVoluntaryContextSwitches: 11.89K (11887)
- TotalRawHdfsReadTime(*): 8.961ms
- TotalReadThroughput: 98.70 MB/sec
Filter 0 (16.00 MB):
- Rows processed: 0 (0)
- Rows rejected: 0 (0)
- Rows total: 11.39M (11388046)
Instance 514ee9ab39cdc507:14 (host=cdh13.net.cuberonlabs.com:22000):(Total: 5s871ms, non-child: 925.565ms, % non-child: 15.76%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/2.80 GB
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 187.75 MB, 204.16 MB, 366.19 MB, 451.24 MB, 552.89 MB, 489.09 MB, 359.04 MB, 261.19 MB, 131.08 MB, 33.01 MB
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 10, 9, 1, 1, 1, 1, 1
- AverageThreadTokens: 5.42
- BloomFilterBytes: 0
- PeakMemoryUsage: 558.06 MB (585168101)
- PerHostPeakMemUsage: 1.66 GB (1782381748)
- RowsProduced: 4.64M (4636970)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 6.695ms
- TotalStorageWaitTime: 76.330ms
- TotalThreadsInvoluntaryContextSwitches: 23 (23)
- TotalThreadsTotalWallClockTime: 31s119ms
- TotalThreadsSysTime: 556.000ms
- TotalThreadsUserTime: 6s372ms
- TotalThreadsVoluntaryContextSwitches: 12.48K (12476)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s683ms
- ExecTreeExecTime: 3s499ms
- OpenTime: 148.839ms
- ExecTreeOpenTime: 37.582us
- PrepareTime: 39.032ms
- ExecTreePrepareTime: 821.258us
DataStreamSender (dst_id=24):(Total: 1s265ms, non-child: 1s265ms, % non-child: 100.00%)
- BytesSent: 247.01 MB (259008146)
- NetworkThroughput(*): 711.06 MB/sec
- OverallThroughput: 195.26 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 4.64M (4636970)
- SerializeBatchTime: 916.918ms
- TransmitDataRPCTime: 347.381ms
- UncompressedRowBatchSize: 388.37 MB (407230356)
CodeGen:(Total: 181.765ms, non-child: 181.765ms, % non-child: 100.00%)
- CodegenTime: 4.076ms
- CompileTime: 39.025ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 73 (73)
- NumInstructions: 1.41K (1412)
- OptimizationTime: 108.669ms
- PeakMemoryUsage: 706.00 KB (722944)
- PrepareTime: 32.936ms
AGGREGATION_NODE (id=3):(Total: 3s498ms, non-child: 2s590ms, % non-child: 74.03%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 673.506us
- GetResultsTime: 99.458ms
- HTResizeTime: 189.067ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 524.27 MB (549740424)
- PinTime: 0.000ns
- ReductionFactorEstimate: 35.23
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.64M (4636970)
- RowsReturnedRate: 1.33 M/sec
- StreamingTime: 2s469ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=2):(Total: 908.553ms, non-child: 908.553ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/2.80 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31
Runtime filters: Only following filters arrived: , waited 824ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:62
BytesRead(500.000ms): 0, 0, 108.93 MB, 136.37 MB, 232.35 MB, 276.62 MB, 360.67 MB
- FooterProcessingTime: (Avg: 11.181ms ; Min: 2.436ms ; Max: 54.744ms ; Number of samples: 31)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.57
- BytesRead: 360.67 MB (378194120)
- BytesReadDataNodeCache: 351.12 MB (368172058)
- BytesReadLocal: 360.67 MB (378194120)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 360.67 MB (378194120)
- DecompressionTime: 768.648ms
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 31 (31)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 37.89 MB (39732003)
- PerReadThreadRawHdfsThroughput: 35.28 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 36.856ms
- RowBatchQueuePutWaitTime: 19s809ms
- RowsRead: 11.68M (11677391)
- RowsReturned: 11.68M (11677391)
- RowsReturnedRate: 12.85 M/sec
- ScanRangesComplete: 31 (31)
- ScannerThreadsInvoluntaryContextSwitches: 17 (17)
- ScannerThreadsTotalWallClockTime: 25s287ms
- MaterializeTupleTime(*): 611.905ms
- ScannerThreadsSysTime: 220.000ms
- ScannerThreadsUserTime: 1s744ms
- ScannerThreadsVoluntaryContextSwitches: 12.12K (12119)
- TotalRawHdfsReadTime(*): 9.982ms
- TotalReadThroughput: 103.05 MB/sec
Filter 0 (16.00 MB):
- Rows processed: 0 (0)
- Rows rejected: 0 (0)
- Rows total: 11.68M (11677391)
Instance 514ee9ab39cdc507:16 (host=cdh15.net.cuberonlabs.com:22000):(Total: 5s712ms, non-child: 986.595ms, % non-child: 17.27%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.66 GB
MemoryUsage(500.000ms): 1.35 MB, 1.37 MB, 5.69 MB, 203.96 MB, 363.77 MB, 384.01 MB, 553.28 MB, 489.37 MB, 391.35 MB, 261.30 MB, 163.50 MB, 65.76 MB
ThreadUsage(500.000ms): 1, 1, 10, 10, 10, 10, 9, 1, 1, 1, 1, 1
- AverageThreadTokens: 4.67
- BloomFilterBytes: 0
- PeakMemoryUsage: 556.90 MB (583948431)
- PerHostPeakMemUsage: 1.57 GB (1688553772)
- RowsProduced: 4.41M (4413574)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 8.596ms
- TotalStorageWaitTime: 98.115ms
- TotalThreadsInvoluntaryContextSwitches: 44 (44)
- TotalThreadsTotalWallClockTime: 29s418ms
- TotalThreadsSysTime: 512.000ms
- TotalThreadsUserTime: 5s996ms
- TotalThreadsVoluntaryContextSwitches: 11.74K (11745)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s519ms
- ExecTreeExecTime: 3s269ms
- OpenTime: 154.690ms
- ExecTreeOpenTime: 40.398us
- PrepareTime: 38.780ms
- ExecTreePrepareTime: 774.259us
DataStreamSender (dst_id=24):(Total: 1s270ms, non-child: 1s270ms, % non-child: 100.00%)
- BytesSent: 235.15 MB (246567845)
- NetworkThroughput(*): 733.27 MB/sec
- OverallThroughput: 185.09 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 4.41M (4413574)
- SerializeBatchTime: 948.988ms
- TransmitDataRPCTime: 320.678ms
- UncompressedRowBatchSize: 369.48 MB (387425805)
CodeGen:(Total: 187.460ms, non-child: 187.460ms, % non-child: 100.00%)
- CodegenTime: 3.872ms
- CompileTime: 40.036ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 73 (73)
- NumInstructions: 1.41K (1412)
- OptimizationTime: 113.434ms
- PeakMemoryUsage: 706.00 KB (722944)
- PrepareTime: 33.220ms
AGGREGATION_NODE (id=3):(Total: 3s268ms, non-child: 2s371ms, % non-child: 72.58%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 361.612us
- GetResultsTime: 110.995ms
- HTResizeTime: 182.928ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 524.25 MB (549718437)
- PinTime: 0.000ns
- ReductionFactorEstimate: 36.23
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.41M (4413574)
- RowsReturnedRate: 1.35 M/sec
- StreamingTime: 2s238ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=2):(Total: 896.261ms, non-child: 896.261ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.66 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30
Runtime filters: Only following filters arrived: , waited 823ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:60
BytesRead(500.000ms): 0, 0, 14.33 MB, 131.48 MB, 214.59 MB, 264.25 MB, 342.47 MB
- FooterProcessingTime: (Avg: 13.111ms ; Min: 3.051ms ; Max: 56.753ms ; Number of samples: 30)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.33
- BytesRead: 342.47 MB (359108875)
- BytesReadDataNodeCache: 333.22 MB (349403564)
- BytesReadLocal: 342.47 MB (359108875)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 342.47 MB (359108875)
- DecompressionTime: 663.903ms
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 30 (30)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 37.79 MB (39629261)
- PerReadThreadRawHdfsThroughput: 30.01 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 31.903ms
- RowBatchQueuePutWaitTime: 17s783ms
- RowsRead: 11.11M (11113210)
- RowsReturned: 11.11M (11113210)
- RowsReturnedRate: 12.40 M/sec
- ScanRangesComplete: 30 (30)
- ScannerThreadsInvoluntaryContextSwitches: 35 (35)
- ScannerThreadsTotalWallClockTime: 23s744ms
- MaterializeTupleTime(*): 513.564ms
- ScannerThreadsSysTime: 176.000ms
- ScannerThreadsUserTime: 1s520ms
- ScannerThreadsVoluntaryContextSwitches: 11.45K (11453)
- TotalRawHdfsReadTime(*): 11.144ms
- TotalReadThroughput: 97.85 MB/sec
Filter 0 (16.00 MB):
- Rows processed: 0 (0)
- Rows rejected: 0 (0)
- Rows total: 11.11M (11113210)
Instance 514ee9ab39cdc507:1e (host=cdh7.net.cuberonlabs.com:22000):(Total: 5s584ms, non-child: 644.896ms, % non-child: 11.55%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:27/2.46 GB
MemoryUsage(500.000ms): 2.05 MB, 1.37 MB, 44.47 MB, 203.43 MB, 361.81 MB, 364.15 MB, 549.85 MB, 489.04 MB, 391.34 MB, 260.98 MB, 131.00 MB
ThreadUsage(500.000ms): 1, 9, 10, 10, 10, 10, 8, 1, 1, 1, 1
- AverageThreadTokens: 5.64
- BloomFilterBytes: 0
- PeakMemoryUsage: 552.40 MB (579233628)
- PerHostPeakMemUsage: 1.58 GB (1699637471)
- RowsProduced: 4.15M (4150227)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 10.184ms
- TotalStorageWaitTime: 118.617ms
- TotalThreadsInvoluntaryContextSwitches: 39 (39)
- TotalThreadsTotalWallClockTime: 29s742ms
- TotalThreadsSysTime: 544.000ms
- TotalThreadsUserTime: 6s072ms
- TotalThreadsVoluntaryContextSwitches: 11.25K (11249)
Fragment Instance Lifecycle Timings:
- ExecTime: 5s384ms
- ExecTreeExecTime: 3s366ms
- OpenTime: 159.715ms
- ExecTreeOpenTime: 47.736us
- PrepareTime: 40.238ms
- ExecTreePrepareTime: 1.240ms
DataStreamSender (dst_id=24):(Total: 1s380ms, non-child: 1s380ms, % non-child: 100.00%)
- BytesSent: 219.89 MB (230573220)
- NetworkThroughput(*): 409.41 MB/sec
- OverallThroughput: 159.31 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 4.15M (4150227)
- SerializeBatchTime: 842.415ms
- TransmitDataRPCTime: 537.099ms
- UncompressedRowBatchSize: 345.00 MB (361760812)
CodeGen:(Total: 192.721ms, non-child: 192.721ms, % non-child: 100.00%)
- CodegenTime: 4.023ms
- CompileTime: 41.669ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 73 (73)
- NumInstructions: 1.41K (1412)
- OptimizationTime: 116.686ms
- PeakMemoryUsage: 706.00 KB (722944)
- PrepareTime: 33.572ms
AGGREGATION_NODE (id=3):(Total: 3s366ms, non-child: 2s460ms, % non-child: 73.10%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 3.018ms
- GetResultsTime: 100.660ms
- HTResizeTime: 195.254ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 524.13 MB (549590100)
- PinTime: 0.000ns
- ReductionFactorEstimate: 36.61
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 4.15M (4150227)
- RowsReturnedRate: 1.23 M/sec
- StreamingTime: 2s333ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=2):(Total: 905.629ms, non-child: 905.629ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:27/2.46 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 27 out of 27
Runtime filters: Only following filters arrived: , waited 803ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:54
BytesRead(500.000ms): 0, 0, 112.62 MB, 112.62 MB, 181.51 MB, 248.29 MB, 314.97 MB
- FooterProcessingTime: (Avg: 15.053ms ; Min: 3.059ms ; Max: 48.490ms ; Number of samples: 27)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 8.50
- BytesRead: 314.97 MB (330266381)
- BytesReadDataNodeCache: 306.65 MB (321540951)
- BytesReadLocal: 314.97 MB (330266381)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 314.97 MB (330266381)
- DecompressionTime: 797.524ms
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 27 (27)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 37.81 MB (39642068)
- PerReadThreadRawHdfsThroughput: 38.92 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 49.250ms
- RowBatchQueuePutWaitTime: 18s019ms
- RowsRead: 10.29M (10293228)
- RowsReturned: 10.29M (10293228)
- RowsReturnedRate: 11.37 M/sec
- ScanRangesComplete: 27 (27)
- ScannerThreadsInvoluntaryContextSwitches: 27 (27)
- ScannerThreadsTotalWallClockTime: 24s198ms
- MaterializeTupleTime(*): 593.475ms
- ScannerThreadsSysTime: 208.000ms
- ScannerThreadsUserTime: 1s748ms
- ScannerThreadsVoluntaryContextSwitches: 10.89K (10886)
- TotalRawHdfsReadTime(*): 7.902ms
- TotalReadThroughput: 89.99 MB/sec
Filter 0 (16.00 MB):
- Rows processed: 0 (0)
- Rows rejected: 0 (0)
- Rows total: 10.29M (10293228)
Instance 514ee9ab39cdc507:20 (host=cdh11.net.cuberonlabs.com:22000):(Total: 5s080ms, non-child: 783.754ms, % non-child: 15.43%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:21/2.18 GB
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 206.13 MB, 364.76 MB, 365.69 MB, 538.60 MB, 456.55 MB, 326.29 MB, 195.95 MB, 33.36 MB
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 4, 1, 1, 1, 1
- AverageThreadTokens: 4.90
- BloomFilterBytes: 0
- PeakMemoryUsage: 546.99 MB (573565060)
- PerHostPeakMemUsage: 1.48 GB (1591793359)
- RowsProduced: 3.77M (3768829)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 6.201ms
- TotalStorageWaitTime: 77.370ms
- TotalThreadsInvoluntaryContextSwitches: 16 (16)
- TotalThreadsTotalWallClockTime: 26s415ms
- TotalThreadsSysTime: 428.000ms
- TotalThreadsUserTime: 5s276ms
- TotalThreadsVoluntaryContextSwitches: 9.71K (9715)
Fragment Instance Lifecycle Timings:
- ExecTime: 4s899ms
- ExecTreeExecTime: 3s055ms
- OpenTime: 146.565ms
- ExecTreeOpenTime: 33.053us
- PrepareTime: 34.498ms
- ExecTreePrepareTime: 784.355us
DataStreamSender (dst_id=24):(Total: 1s066ms, non-child: 1s066ms, % non-child: 100.00%)
- BytesSent: 201.54 MB (211335214)
- NetworkThroughput(*): 702.02 MB/sec
- OverallThroughput: 189.04 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 3.77M (3768829)
- SerializeBatchTime: 778.486ms
- TransmitDataRPCTime: 287.093ms
- UncompressedRowBatchSize: 315.92 MB (331270904)
CodeGen:(Total: 175.646ms, non-child: 175.646ms, % non-child: 100.00%)
- CodegenTime: 3.503ms
- CompileTime: 39.177ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 73 (73)
- NumInstructions: 1.41K (1412)
- OptimizationTime: 106.188ms
- PeakMemoryUsage: 706.00 KB (722944)
- PrepareTime: 29.551ms
AGGREGATION_NODE (id=3):(Total: 3s054ms, non-child: 2s150ms, % non-child: 70.39%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 862.689us
- GetResultsTime: 101.697ms
- HTResizeTime: 203.959ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 524.23 MB (549690076)
- PinTime: 0.000ns
- ReductionFactorEstimate: 35.27
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 3.77M (3768829)
- RowsReturnedRate: 1.23 M/sec
- StreamingTime: 2s025ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=2):(Total: 904.465ms, non-child: 904.465ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:21/2.18 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 21 out of 21
Runtime filters: Only following filters arrived: , waited 824ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0%
File Formats: PARQUET/SNAPPY:42
BytesRead(500.000ms): 0, 0, 121.14 MB, 201.53 MB, 240.47 MB, 280.98 MB
- FooterProcessingTime: (Avg: 14.390ms ; Min: 3.177ms ; Max: 49.657ms ; Number of samples: 21)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.50
- BytesRead: 280.98 MB (294628359)
- BytesReadDataNodeCache: 274.50 MB (287832965)
- BytesReadLocal: 280.98 MB (294628359)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 280.98 MB (294628359)
- DecompressionTime: 623.473ms
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 21 (21)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 40.00 MB (41940953)
- PerReadThreadRawHdfsThroughput: 34.37 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 39.985ms
- RowBatchQueuePutWaitTime: 15s263ms
- RowsRead: 8.99M (8989956)
- RowsReturned: 8.99M (8989956)
- RowsReturnedRate: 9.94 M/sec
- ScanRangesComplete: 21 (21)
- ScannerThreadsInvoluntaryContextSwitches: 12 (12)
- ScannerThreadsTotalWallClockTime: 21s369ms
- MaterializeTupleTime(*): 474.319ms
- ScannerThreadsSysTime: 132.000ms
- ScannerThreadsUserTime: 1s400ms
- ScannerThreadsVoluntaryContextSwitches: 9.35K (9350)
- TotalRawHdfsReadTime(*): 7.984ms
- TotalReadThroughput: 93.66 MB/sec
Filter 0 (16.00 MB):
- Rows processed: 0 (0)
- Rows rejected: 0 (0)
- Rows total: 8.99M (8989956)
Instance 514ee9ab39cdc507:1a (host=cdh12.net.cuberonlabs.com:22000):(Total: 4s984ms, non-child: 964.882ms, % non-child: 19.36%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:20/1.81 GB
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 189.46 MB, 207.86 MB, 364.91 MB, 395.96 MB, 319.98 MB, 221.84 MB, 148.16 MB, 49.93 MB
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 3, 1, 1, 1, 1
- AverageThreadTokens: 4.80
- BloomFilterBytes: 0
- PeakMemoryUsage: 411.53 MB (431523752)
- PerHostPeakMemUsage: 1.12 GB (1201773720)
- RowsProduced: 3.19M (3190684)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 6.693ms
- TotalStorageWaitTime: 63.199ms
- TotalThreadsInvoluntaryContextSwitches: 24 (24)
- TotalThreadsTotalWallClockTime: 24s305ms
- TotalThreadsSysTime: 452.000ms
- TotalThreadsUserTime: 5s004ms
- TotalThreadsVoluntaryContextSwitches: 8.38K (8377)
Fragment Instance Lifecycle Timings:
- ExecTime: 4s788ms
- ExecTreeExecTime: 2s788ms
- OpenTime: 157.083ms
- ExecTreeOpenTime: 36.913us
- PrepareTime: 38.783ms
- ExecTreePrepareTime: 727.872us
DataStreamSender (dst_id=24):(Total: 1s041ms, non-child: 1s041ms, % non-child: 100.00%)
- BytesSent: 169.57 MB (177809606)
- NetworkThroughput(*): 583.62 MB/sec
- OverallThroughput: 162.75 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 3.19M (3190684)
- SerializeBatchTime: 750.814ms
- TransmitDataRPCTime: 290.551ms
- UncompressedRowBatchSize: 265.21 MB (278094165)
CodeGen:(Total: 189.793ms, non-child: 189.793ms, % non-child: 100.00%)
- CodegenTime: 3.885ms
- CompileTime: 40.538ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 73 (73)
- NumInstructions: 1.41K (1412)
- OptimizationTime: 115.174ms
- PeakMemoryUsage: 706.00 KB (722944)
- PrepareTime: 33.274ms
AGGREGATION_NODE (id=3):(Total: 2s788ms, non-child: 1s896ms, % non-child: 68.03%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 1.600ms
- GetResultsTime: 107.466ms
- HTResizeTime: 200.247ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 397.14 MB (416431198)
- PinTime: 0.000ns
- ReductionFactorEstimate: 37.14
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 3.19M (3190684)
- RowsReturnedRate: 1.14 M/sec
- StreamingTime: 1s761ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=2):(Total: 891.434ms, non-child: 891.434ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:20/1.81 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 20 out of 20
Runtime filters: Only following filters arrived: , waited 823ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0%
File Formats: PARQUET/SNAPPY:40
BytesRead(500.000ms): 0, 0, 106.77 MB, 133.53 MB, 232.35 MB, 232.35 MB
- FooterProcessingTime: (Avg: 16.666ms ; Min: 3.441ms ; Max: 56.684ms ; Number of samples: 20)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.33
- BytesRead: 232.35 MB (243633322)
- BytesReadDataNodeCache: 226.18 MB (237164635)
- BytesReadLocal: 232.35 MB (243633322)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 232.35 MB (243633322)
- DecompressionTime: 560.666ms
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 20 (20)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 39.91 MB (41851230)
- PerReadThreadRawHdfsThroughput: 26.51 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 31.226ms
- RowBatchQueuePutWaitTime: 12s978ms
- RowsRead: 7.62M (7619211)
- RowsReturned: 7.62M (7619211)
- RowsReturnedRate: 8.55 M/sec
- ScanRangesComplete: 20 (20)
- ScannerThreadsInvoluntaryContextSwitches: 18 (18)
- ScannerThreadsTotalWallClockTime: 19s359ms
- MaterializeTupleTime(*): 438.491ms
- ScannerThreadsSysTime: 188.000ms
- ScannerThreadsUserTime: 1s208ms
- ScannerThreadsVoluntaryContextSwitches: 8.04K (8035)
- TotalRawHdfsReadTime(*): 8.557ms
- TotalReadThroughput: 77.45 MB/sec
Filter 0 (16.00 MB):
- Rows processed: 0 (0)
- Rows rejected: 0 (0)
- Rows total: 7.62M (7619211)
Instance 514ee9ab39cdc507:1b (host=cdh14.net.cuberonlabs.com:22000):(Total: 4s754ms, non-child: 763.589ms, % non-child: 16.06%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:22/2.04 GB
MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 188.06 MB, 235.20 MB, 363.93 MB, 537.24 MB, 424.25 MB, 261.27 MB, 131.09 MB
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 4, 1, 1, 1
- AverageThreadTokens: 5.33
- BloomFilterBytes: 0
- PeakMemoryUsage: 541.05 MB (567328174)
- PerHostPeakMemUsage: 1.44 GB (1548652528)
- RowsProduced: 3.53M (3531621)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 5.887ms
- TotalStorageWaitTime: 65.721ms
- TotalThreadsInvoluntaryContextSwitches: 25 (25)
- TotalThreadsTotalWallClockTime: 24s820ms
- TotalThreadsSysTime: 468.000ms
- TotalThreadsUserTime: 4s840ms
- TotalThreadsVoluntaryContextSwitches: 9.25K (9249)
Fragment Instance Lifecycle Timings:
- ExecTime: 4s579ms
- ExecTreeExecTime: 2s826ms
- OpenTime: 140.412ms
- ExecTreeOpenTime: 31.442us
- PrepareTime: 34.047ms
- ExecTreePrepareTime: 654.852us
DataStreamSender (dst_id=24):(Total: 996.014ms, non-child: 996.014ms, % non-child: 100.00%)
- BytesSent: 186.94 MB (196019152)
- NetworkThroughput(*): 767.00 MB/sec
- OverallThroughput: 187.69 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 3.53M (3531621)
- SerializeBatchTime: 751.637ms
- TransmitDataRPCTime: 243.726ms
- UncompressedRowBatchSize: 293.39 MB (307646551)
CodeGen:(Total: 168.902ms, non-child: 168.902ms, % non-child: 100.00%)
- CodegenTime: 3.185ms
- CompileTime: 37.722ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 73 (73)
- NumInstructions: 1.41K (1412)
- OptimizationTime: 101.535ms
- PeakMemoryUsage: 706.00 KB (722944)
- PrepareTime: 28.999ms
AGGREGATION_NODE (id=3):(Total: 2s825ms, non-child: 1s911ms, % non-child: 67.63%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 2.061ms
- GetResultsTime: 101.299ms
- HTResizeTime: 178.163ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 524.27 MB (549737445)
- PinTime: 0.000ns
- ReductionFactorEstimate: 36.56
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 3.53M (3531621)
- RowsReturnedRate: 1.25 M/sec
- StreamingTime: 1s790ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=2):(Total: 914.697ms, non-child: 914.697ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:22/2.04 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 22 out of 22
Runtime filters: Only following filters arrived: , waited 844ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:44
BytesRead(500.000ms): 0, 0, 98.77 MB, 150.53 MB, 262.37 MB, 262.37 MB
- FooterProcessingTime: (Avg: 17.329ms ; Min: 3.535ms ; Max: 61.890ms ; Number of samples: 22)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.50
- BytesRead: 262.37 MB (275119793)
- BytesReadDataNodeCache: 255.59 MB (268003604)
- BytesReadLocal: 262.37 MB (275119793)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 262.37 MB (275119793)
- DecompressionTime: 591.515ms
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 22 (22)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 37.00 MB (38802289)
- PerReadThreadRawHdfsThroughput: 31.19 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 35.725ms
- RowBatchQueuePutWaitTime: 13s591ms
- RowsRead: 8.55M (8554292)
- RowsReturned: 8.55M (8554292)
- RowsReturnedRate: 9.35 M/sec
- ScanRangesComplete: 22 (22)
- ScannerThreadsInvoluntaryContextSwitches: 19 (19)
- ScannerThreadsTotalWallClockTime: 20s100ms
- MaterializeTupleTime(*): 451.485ms
- ScannerThreadsSysTime: 184.000ms
- ScannerThreadsUserTime: 1s292ms
- ScannerThreadsVoluntaryContextSwitches: 8.96K (8964)
- TotalRawHdfsReadTime(*): 8.214ms
- TotalReadThroughput: 87.46 MB/sec
Filter 0 (16.00 MB):
- Rows processed: 0 (0)
- Rows rejected: 0 (0)
- Rows total: 8.55M (8554292)
Averaged Fragment F07:(Total: 2s966ms, non-child: 27.803ms, % non-child: 0.94%)
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:2s952ms max:2s985ms mean: 2s968ms stddev:8.135ms
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 17
- AverageThreadTokens: 1.08
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 39.41 MB (41320558)
- PerHostPeakMemUsage: 1.37 GB (1470385006)
- RowsProduced: 30.48K (30477)
- TotalNetworkReceiveTime: 2s291ms
- TotalNetworkSendTime: 7.033ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 11 (11)
- TotalThreadsTotalWallClockTime: 3s184ms
- TotalThreadsSysTime: 97.176ms
- TotalThreadsUserTime: 824.705ms
- TotalThreadsVoluntaryContextSwitches: 4.76K (4763)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s886ms
- ExecTreeExecTime: 1s844ms
- OpenTime: 1s036ms
- ExecTreeOpenTime: 578.883ms
- PrepareTime: 43.735ms
- ExecTreePrepareTime: 902.610us
DataStreamSender (dst_id=33):(Total: 23.849ms, non-child: 23.849ms, % non-child: 100.00%)
- BytesSent: 1.64 MB (1714946)
- NetworkThroughput(*): 350.81 MB/sec
- OverallThroughput: 70.89 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 30.48K (30477)
- SerializeBatchTime: 17.697ms
- TransmitDataRPCTime: 6.039ms
- UncompressedRowBatchSize: 2.50 MB (2624015)
CodeGen:(Total: 490.489ms, non-child: 490.489ms, % non-child: 100.00%)
- CodegenTime: 2.622ms
- CompileTime: 159.638ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 92 (92)
- NumInstructions: 3.46K (3457)
- OptimizationTime: 296.559ms
- PeakMemoryUsage: 1.69 MB (1769984)
- PrepareTime: 33.520ms
AGGREGATION_NODE (id=8):(Total: 2s424ms, non-child: 94.774ms, % non-child: 3.91%)
- GetNewBlockTime: 273.734us
- GetResultsTime: 7.431ms
- HTResizeTime: 1.224ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.95 MB (13574479)
- PinTime: 0.000ns
- ReductionFactorEstimate: 493.19
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 30.48K (30477)
- RowsReturnedRate: 12.57 K/sec
- StreamingTime: 84.499ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=7):(Total: 2s329ms, non-child: 215.970ms, % non-child: 9.27%)
- BuildRows: 30.48K (30477)
- BuildTime: 40.337ms
- PeakMemoryUsage: 10.18 MB (10672922)
- ProbeRows: 2.22M (2221711)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 209.383ms
- RowsReturned: 80.29K (80293)
- RowsReturnedRate: 34.47 K/sec
Hash Join Builder (join_node_id=7):
- BuildRowsPartitionTime: 12.663ms
- BuildRowsPartitioned: 30.48K (30477)
- GetNewBlockTime: 118.710us
- HashBuckets: 65.54K (65536)
- HashCollisions: 16 (16)
- HashTablesBuildTime: 2.243ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.04 MB (10524800)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=32):(Total: 220.756ms, non-child: 220.756ms, % non-child: 100.00%)
- BytesReceived: 1.38 MB (1450005)
- ConvertRowBatchTime: 621.766us
- DeserializeRowBatchTimer: 3.458ms
- FirstBatchArrivalWaitTime: 204.616ms
- PeakMemoryUsage: 0
- RowsReturned: 30.48K (30477)
- RowsReturnedRate: 143.18 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=31):(Total: 2s113ms, non-child: 2s113ms, % non-child: 100.00%)
- BytesReceived: 102.14 MB (107102132)
- ConvertRowBatchTime: 37.430ms
- DeserializeRowBatchTimer: 327.855ms
- FirstBatchArrivalWaitTime: 573.711ms
- PeakMemoryUsage: 0
- RowsReturned: 2.22M (2221711)
- RowsReturnedRate: 1.05 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Fragment F07:
Instance 514ee9ab39cdc507:6f (host=cdh12.net.cuberonlabs.com:22000):(Total: 2s983ms, non-child: 35.194ms, % non-child: 1.18%)
MemoryUsage(500.000ms): 3.11 MB, 27.43 MB, 29.10 MB, 37.21 MB, 38.50 MB, 38.49 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 39.42 MB (41331426)
- PerHostPeakMemUsage: 1.12 GB (1201773720)
- RowsProduced: 30.45K (30454)
- TotalNetworkReceiveTime: 2s312ms
- TotalNetworkSendTime: 10.475ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 5 (5)
- TotalThreadsTotalWallClockTime: 3s255ms
- TotalThreadsSysTime: 132.000ms
- TotalThreadsUserTime: 844.000ms
- TotalThreadsVoluntaryContextSwitches: 4.07K (4074)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s903ms
- ExecTreeExecTime: 1s849ms
- OpenTime: 1s040ms
- ExecTreeOpenTime: 625.245ms
- PrepareTime: 39.425ms
- ExecTreePrepareTime: 1.035ms
DataStreamSender (dst_id=33):(Total: 28.108ms, non-child: 28.108ms, % non-child: 100.00%)
- BytesSent: 1.63 MB (1713708)
- NetworkThroughput(*): 211.21 MB/sec
- OverallThroughput: 58.14 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 30.45K (30454)
- SerializeBatchTime: 20.282ms
- TransmitDataRPCTime: 7.737ms
- UncompressedRowBatchSize: 2.50 MB (2621294)
CodeGen:(Total: 444.784ms, non-child: 444.784ms, % non-child: 100.00%)
- CodegenTime: 2.481ms
- CompileTime: 142.221ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 92 (92)
- NumInstructions: 3.46K (3457)
- OptimizationTime: 272.036ms
- PeakMemoryUsage: 1.69 MB (1769984)
- PrepareTime: 29.836ms
AGGREGATION_NODE (id=8):(Total: 2s475ms, non-child: 120.072ms, % non-child: 4.85%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 285.988us
- GetResultsTime: 8.745ms
- HTResizeTime: 1.492ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.91 MB (13536008)
- PinTime: 0.000ns
- ReductionFactorEstimate: 507.78
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 30.45K (30454)
- RowsReturnedRate: 12.30 K/sec
- StreamingTime: 106.358ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=7):(Total: 2s355ms, non-child: 249.557ms, % non-child: 10.59%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 30.45K (30454)
- BuildTime: 52.401ms
- PeakMemoryUsage: 10.18 MB (10672623)
- ProbeRows: 2.22M (2219305)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 242.245ms
- RowsReturned: 80.25K (80255)
- RowsReturnedRate: 34.07 K/sec
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 2 of 2 Runtime Filters Published
- BuildRowsPartitionTime: 17.487ms
- BuildRowsPartitioned: 30.45K (30454)
- GetNewBlockTime: 187.828us
- HashBuckets: 65.54K (65536)
- HashCollisions: 13 (13)
- HashTablesBuildTime: 2.395ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.04 MB (10524800)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=32):(Total: 258.931ms, non-child: 965.917us, % non-child: 0.37%)
BytesReceived(500.000ms): 0, 1.38 MB, 1.38 MB, 1.38 MB, 1.38 MB, 1.38 MB
- BytesReceived: 1.38 MB (1448552)
- ConvertRowBatchTime: 674.361us
- DeserializeRowBatchTimer: 3.699ms
- FirstBatchArrivalWaitTime: 250.269ms
- PeakMemoryUsage: 0
- RowsReturned: 30.45K (30454)
- RowsReturnedRate: 117.61 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=31):(Total: 2s106ms, non-child: 188.042ms, % non-child: 8.93%)
BytesReceived(500.000ms): 0, 0, 17.71 MB, 54.33 MB, 88.40 MB, 101.64 MB
- BytesReceived: 102.00 MB (106953299)
- ConvertRowBatchTime: 45.184ms
- DeserializeRowBatchTimer: 396.517ms
- FirstBatchArrivalWaitTime: 621.685ms
- PeakMemoryUsage: 0
- RowsReturned: 2.22M (2219305)
- RowsReturnedRate: 1.05 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:73 (host=cdh7.net.cuberonlabs.com:22000):(Total: 2s980ms, non-child: 31.169ms, % non-child: 1.05%)
MemoryUsage(500.000ms): 3.11 MB, 1.43 MB, 28.89 MB, 37.43 MB, 37.79 MB, 39.04 MB
ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.17
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 39.65 MB (41572331)
- PerHostPeakMemUsage: 1.27 GB (1366441402)
- RowsProduced: 30.51K (30512)
- TotalNetworkReceiveTime: 2s208ms
- TotalNetworkSendTime: 11.683ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 24 (24)
- TotalThreadsTotalWallClockTime: 3s167ms
- TotalThreadsSysTime: 108.000ms
- TotalThreadsUserTime: 872.000ms
- TotalThreadsVoluntaryContextSwitches: 4.35K (4346)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s900ms
- ExecTreeExecTime: 1s849ms
- OpenTime: 1s034ms
- ExecTreeOpenTime: 550.687ms
- PrepareTime: 45.386ms
- ExecTreePrepareTime: 1.063ms
DataStreamSender (dst_id=33):(Total: 31.614ms, non-child: 31.614ms, % non-child: 100.00%)
- BytesSent: 1.64 MB (1716874)
- NetworkThroughput(*): 139.74 MB/sec
- OverallThroughput: 51.79 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 30.51K (30512)
- SerializeBatchTime: 19.776ms
- TransmitDataRPCTime: 11.717ms
- UncompressedRowBatchSize: 2.51 MB (2627053)
CodeGen:(Total: 517.098ms, non-child: 517.098ms, % non-child: 100.00%)
- CodegenTime: 2.649ms
- CompileTime: 172.820ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 92 (92)
- NumInstructions: 3.46K (3457)
- OptimizationTime: 309.349ms
- PeakMemoryUsage: 1.69 MB (1769984)
- PrepareTime: 34.149ms
AGGREGATION_NODE (id=8):(Total: 2s400ms, non-child: 109.245ms, % non-child: 4.55%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 546.682us
- GetResultsTime: 7.792ms
- HTResizeTime: 1.221ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.97 MB (13598820)
- PinTime: 0.000ns
- ReductionFactorEstimate: 488.31
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 30.51K (30512)
- RowsReturnedRate: 12.71 K/sec
- StreamingTime: 98.650ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=7):(Total: 2s291ms, non-child: 235.613ms, % non-child: 10.28%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 30.51K (30512)
- BuildTime: 30.334ms
- PeakMemoryUsage: 10.18 MB (10671130)
- ProbeRows: 2.22M (2222535)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 228.284ms
- RowsReturned: 80.08K (80085)
- RowsReturnedRate: 34.95 K/sec
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 2 of 2 Runtime Filters Published
- BuildRowsPartitionTime: 10.137ms
- BuildRowsPartitioned: 30.51K (30512)
- GetNewBlockTime: 206.168us
- HashBuckets: 65.54K (65536)
- HashCollisions: 13 (13)
- HashTablesBuildTime: 1.901ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.04 MB (10524800)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=32):(Total: 202.204ms, non-child: 1.351ms, % non-child: 0.67%)
BytesReceived(500.000ms): 0, 0, 1.38 MB, 1.38 MB, 1.38 MB, 1.38 MB
- BytesReceived: 1.38 MB (1451153)
- ConvertRowBatchTime: 599.862us
- DeserializeRowBatchTimer: 4.201ms
- FirstBatchArrivalWaitTime: 176.581ms
- PeakMemoryUsage: 0
- RowsReturned: 30.51K (30512)
- RowsReturnedRate: 150.90 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=31):(Total: 2s055ms, non-child: 176.233ms, % non-child: 8.57%)
BytesReceived(500.000ms): 0, 0, 908.46 KB, 40.15 MB, 76.13 MB, 100.01 MB
- BytesReceived: 102.17 MB (107131219)
- ConvertRowBatchTime: 43.212ms
- DeserializeRowBatchTimer: 363.159ms
- FirstBatchArrivalWaitTime: 545.607ms
- PeakMemoryUsage: 0
- RowsReturned: 2.22M (2222535)
- RowsReturnedRate: 1.08 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:77 (host=cdh10.net.cuberonlabs.com:22000):(Total: 2s978ms, non-child: 26.323ms, % non-child: 0.88%)
MemoryUsage(500.000ms): 1.42 MB, 27.43 MB, 29.05 MB, 37.71 MB, 38.18 MB, 25.31 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 39.41 MB (41321127)
- PerHostPeakMemUsage: 1.50 GB (1609929093)
- RowsProduced: 30.21K (30212)
- TotalNetworkReceiveTime: 2s264ms
- TotalNetworkSendTime: 10.286ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 37 (37)
- TotalThreadsTotalWallClockTime: 3s153ms
- TotalThreadsSysTime: 84.000ms
- TotalThreadsUserTime: 824.000ms
- TotalThreadsVoluntaryContextSwitches: 4.82K (4815)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s899ms
- ExecTreeExecTime: 1s851ms
- OpenTime: 1s025ms
- ExecTreeOpenTime: 544.048ms
- PrepareTime: 53.815ms
- ExecTreePrepareTime: 685.104us
DataStreamSender (dst_id=33):(Total: 31.816ms, non-child: 31.816ms, % non-child: 100.00%)
- BytesSent: 1.62 MB (1700254)
- NetworkThroughput(*): 111.70 MB/sec
- OverallThroughput: 50.96 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 30.21K (30212)
- SerializeBatchTime: 17.177ms
- TransmitDataRPCTime: 14.516ms
- UncompressedRowBatchSize: 2.48 MB (2601300)
CodeGen:(Total: 523.822ms, non-child: 523.822ms, % non-child: 100.00%)
- CodegenTime: 2.630ms
- CompileTime: 168.023ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 92 (92)
- NumInstructions: 3.46K (3457)
- OptimizationTime: 311.675ms
- PeakMemoryUsage: 1.69 MB (1769984)
- PrepareTime: 43.329ms
AGGREGATION_NODE (id=8):(Total: 2s396ms, non-child: 88.317ms, % non-child: 3.69%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 263.153us
- GetResultsTime: 6.886ms
- HTResizeTime: 1.262ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.91 MB (13535346)
- PinTime: 0.000ns
- ReductionFactorEstimate: 489.00
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 30.21K (30212)
- RowsReturnedRate: 12.61 K/sec
- StreamingTime: 77.301ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=7):(Total: 2s308ms, non-child: 196.657ms, % non-child: 8.52%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 30.21K (30212)
- BuildTime: 36.148ms
- PeakMemoryUsage: 10.18 MB (10673640)
- ProbeRows: 2.22M (2220659)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 189.982ms
- RowsReturned: 79.68K (79683)
- RowsReturnedRate: 34.52 K/sec
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 2 of 2 Runtime Filters Published
- BuildRowsPartitionTime: 12.053ms
- BuildRowsPartitioned: 30.21K (30212)
- GetNewBlockTime: 143.058us
- HashBuckets: 65.54K (65536)
- HashCollisions: 16 (16)
- HashTablesBuildTime: 1.729ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.04 MB (10524800)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=32):(Total: 192.874ms, non-child: 955.647us, % non-child: 0.50%)
BytesReceived(500.000ms): 0, 1.37 MB, 1.37 MB, 1.37 MB, 1.37 MB
- BytesReceived: 1.37 MB (1436465)
- ConvertRowBatchTime: 444.991us
- DeserializeRowBatchTimer: 3.103ms
- FirstBatchArrivalWaitTime: 171.504ms
- PeakMemoryUsage: 0
- RowsReturned: 30.21K (30212)
- RowsReturnedRate: 156.64 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=31):(Total: 2s111ms, non-child: 116.822ms, % non-child: 5.53%)
BytesReceived(500.000ms): 0, 0, 27.04 MB, 63.31 MB, 94.31 MB
- BytesReceived: 102.09 MB (107047423)
- ConvertRowBatchTime: 34.099ms
- DeserializeRowBatchTimer: 295.502ms
- FirstBatchArrivalWaitTime: 540.398ms
- PeakMemoryUsage: 0
- RowsReturned: 2.22M (2220659)
- RowsReturnedRate: 1.05 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:76 (host=cdh9.net.cuberonlabs.com:22000):(Total: 2s972ms, non-child: 28.817ms, % non-child: 0.97%)
MemoryUsage(500.000ms): 3.11 MB, 1.43 MB, 27.74 MB, 31.87 MB, 38.06 MB, 38.92 MB
ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.17
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 39.38 MB (41295369)
- PerHostPeakMemUsage: 1.49 GB (1603367675)
- RowsProduced: 30.39K (30392)
- TotalNetworkReceiveTime: 2s349ms
- TotalNetworkSendTime: 5.488ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 2 (2)
- TotalThreadsTotalWallClockTime: 3s220ms
- TotalThreadsSysTime: 96.000ms
- TotalThreadsUserTime: 804.000ms
- TotalThreadsVoluntaryContextSwitches: 4.93K (4934)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s891ms
- ExecTreeExecTime: 1s851ms
- OpenTime: 1s038ms
- ExecTreeOpenTime: 601.403ms
- PrepareTime: 42.514ms
- ExecTreePrepareTime: 787.627us
DataStreamSender (dst_id=33):(Total: 21.350ms, non-child: 21.350ms, % non-child: 100.00%)
- BytesSent: 1.63 MB (1709536)
- NetworkThroughput(*): 522.57 MB/sec
- OverallThroughput: 76.36 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 30.39K (30392)
- SerializeBatchTime: 18.125ms
- TransmitDataRPCTime: 3.119ms
- UncompressedRowBatchSize: 2.50 MB (2616790)
CodeGen:(Total: 468.706ms, non-child: 468.706ms, % non-child: 100.00%)
- CodegenTime: 3.113ms
- CompileTime: 151.534ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 92 (92)
- NumInstructions: 3.46K (3457)
- OptimizationTime: 284.076ms
- PeakMemoryUsage: 1.69 MB (1769984)
- PrepareTime: 32.377ms
AGGREGATION_NODE (id=8):(Total: 2s453ms, non-child: 93.398ms, % non-child: 3.81%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 250.447us
- GetResultsTime: 9.443ms
- HTResizeTime: 1.020ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.98 MB (13610763)
- PinTime: 0.000ns
- ReductionFactorEstimate: 488.12
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 30.39K (30392)
- RowsReturnedRate: 12.39 K/sec
- StreamingTime: 81.369ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=7):(Total: 2s359ms, non-child: 216.624ms, % non-child: 9.18%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 30.39K (30392)
- BuildTime: 41.656ms
- PeakMemoryUsage: 10.18 MB (10674414)
- ProbeRows: 2.23M (2225196)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 210.449ms
- RowsReturned: 80.12K (80119)
- RowsReturnedRate: 33.95 K/sec
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 2 of 2 Runtime Filters Published
- BuildRowsPartitionTime: 14.366ms
- BuildRowsPartitioned: 30.39K (30392)
- GetNewBlockTime: 88.421us
- HashBuckets: 65.54K (65536)
- HashCollisions: 18 (18)
- HashTablesBuildTime: 2.910ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.04 MB (10524800)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=32):(Total: 249.359ms, non-child: 1.150ms, % non-child: 0.46%)
BytesReceived(500.000ms): 0, 0, 1.38 MB, 1.38 MB, 1.38 MB, 1.38 MB
- BytesReceived: 1.38 MB (1445621)
- ConvertRowBatchTime: 692.829us
- DeserializeRowBatchTimer: 2.496ms
- FirstBatchArrivalWaitTime: 226.921ms
- PeakMemoryUsage: 0
- RowsReturned: 30.39K (30392)
- RowsReturnedRate: 121.88 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=31):(Total: 2s143ms, non-child: 104.342ms, % non-child: 4.87%)
BytesReceived(500.000ms): 0, 0, 176.58 KB, 38.96 MB, 75.01 MB, 99.86 MB
- BytesReceived: 102.31 MB (107277079)
- ConvertRowBatchTime: 37.084ms
- DeserializeRowBatchTimer: 299.331ms
- FirstBatchArrivalWaitTime: 594.240ms
- PeakMemoryUsage: 0
- RowsReturned: 2.23M (2225196)
- RowsReturnedRate: 1.04 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:74 (host=cdh8.net.cuberonlabs.com:22000):(Total: 2s970ms, non-child: 24.550ms, % non-child: 0.83%)
MemoryUsage(500.000ms): 1.42 MB, 27.43 MB, 29.94 MB, 37.59 MB, 38.24 MB, 24.55 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 39.38 MB (41290613)
- PerHostPeakMemUsage: 1.35 GB (1451309932)
- RowsProduced: 30.64K (30637)
- TotalNetworkReceiveTime: 2s192ms
- TotalNetworkSendTime: 8.395ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 13 (13)
- TotalThreadsTotalWallClockTime: 3s124ms
- TotalThreadsSysTime: 104.000ms
- TotalThreadsUserTime: 852.000ms
- TotalThreadsVoluntaryContextSwitches: 4.60K (4603)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s888ms
- ExecTreeExecTime: 1s845ms
- OpenTime: 1s039ms
- ExecTreeOpenTime: 513.413ms
- PrepareTime: 41.741ms
- ExecTreePrepareTime: 688.639us
DataStreamSender (dst_id=33):(Total: 28.046ms, non-child: 28.046ms, % non-child: 100.00%)
- BytesSent: 1.64 MB (1723410)
- NetworkThroughput(*): 138.69 MB/sec
- OverallThroughput: 58.60 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 30.64K (30637)
- SerializeBatchTime: 16.069ms
- TransmitDataRPCTime: 11.850ms
- UncompressedRowBatchSize: 2.51 MB (2636627)
CodeGen:(Total: 557.655ms, non-child: 557.655ms, % non-child: 100.00%)
- CodegenTime: 2.547ms
- CompileTime: 153.366ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 92 (92)
- NumInstructions: 3.46K (3457)
- OptimizationTime: 371.642ms
- PeakMemoryUsage: 1.69 MB (1769984)
- PrepareTime: 31.909ms
AGGREGATION_NODE (id=8):(Total: 2s359ms, non-child: 92.248ms, % non-child: 3.91%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 174.054us
- GetResultsTime: 6.990ms
- HTResizeTime: 1.303ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.97 MB (13598349)
- PinTime: 0.000ns
- ReductionFactorEstimate: 507.14
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 30.64K (30637)
- RowsReturnedRate: 12.98 K/sec
- StreamingTime: 82.869ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=7):(Total: 2s267ms, non-child: 192.684ms, % non-child: 8.50%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 30.64K (30637)
- BuildTime: 38.681ms
- PeakMemoryUsage: 10.18 MB (10672226)
- ProbeRows: 2.23M (2225622)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 186.720ms
- RowsReturned: 80.62K (80623)
- RowsReturnedRate: 35.55 K/sec
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 2 of 2 Runtime Filters Published
- BuildRowsPartitionTime: 12.490ms
- BuildRowsPartitioned: 30.64K (30637)
- GetNewBlockTime: 70.096us
- HashBuckets: 65.54K (65536)
- HashCollisions: 20 (20)
- HashTablesBuildTime: 2.048ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.04 MB (10524800)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=32):(Total: 157.359ms, non-child: 1.099ms, % non-child: 0.70%)
BytesReceived(500.000ms): 0, 1.39 MB, 1.39 MB, 1.39 MB, 1.39 MB
- BytesReceived: 1.39 MB (1458127)
- ConvertRowBatchTime: 575.615us
- DeserializeRowBatchTimer: 4.810ms
- FirstBatchArrivalWaitTime: 138.110ms
- PeakMemoryUsage: 0
- RowsReturned: 30.64K (30637)
- RowsReturnedRate: 194.69 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=31):(Total: 2s075ms, non-child: 135.277ms, % non-child: 6.52%)
BytesReceived(500.000ms): 0, 0, 27.40 MB, 63.85 MB, 94.78 MB
- BytesReceived: 102.32 MB (107294559)
- ConvertRowBatchTime: 33.954ms
- DeserializeRowBatchTimer: 310.307ms
- FirstBatchArrivalWaitTime: 508.402ms
- PeakMemoryUsage: 0
- RowsReturned: 2.23M (2225622)
- RowsReturnedRate: 1.07 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:6d (host=cdh17.net.cuberonlabs.com:22000):(Total: 2s969ms, non-child: 28.372ms, % non-child: 0.96%)
MemoryUsage(500.000ms): 3.11 MB, 26.43 MB, 33.52 MB, 37.00 MB, 38.37 MB, 38.56 MB
ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.17
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 39.36 MB (41268705)
- PerHostPeakMemUsage: 1.10 GB (1185118898)
- RowsProduced: 30.45K (30451)
- TotalNetworkReceiveTime: 2s150ms
- TotalNetworkSendTime: 6.269ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 8 (8)
- TotalThreadsTotalWallClockTime: 3s127ms
- TotalThreadsSysTime: 124.000ms
- TotalThreadsUserTime: 876.000ms
- TotalThreadsVoluntaryContextSwitches: 4.79K (4785)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s887ms
- ExecTreeExecTime: 1s844ms
- OpenTime: 1s039ms
- ExecTreeOpenTime: 520.566ms
- PrepareTime: 43.000ms
- ExecTreePrepareTime: 706.144us
DataStreamSender (dst_id=33):(Total: 24.116ms, non-child: 24.116ms, % non-child: 100.00%)
- BytesSent: 1.63 MB (1713879)
- NetworkThroughput(*): 337.80 MB/sec
- OverallThroughput: 67.77 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 30.45K (30451)
- SerializeBatchTime: 19.180ms
- TransmitDataRPCTime: 4.838ms
- UncompressedRowBatchSize: 2.50 MB (2620432)
CodeGen:(Total: 551.112ms, non-child: 551.112ms, % non-child: 100.00%)
- CodegenTime: 2.572ms
- CompileTime: 211.324ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 92 (92)
- NumInstructions: 3.46K (3457)
- OptimizationTime: 305.390ms
- PeakMemoryUsage: 1.69 MB (1769984)
- PrepareTime: 33.610ms
AGGREGATION_NODE (id=8):(Total: 2s366ms, non-child: 107.798ms, % non-child: 4.56%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 169.376us
- GetResultsTime: 9.531ms
- HTResizeTime: 1.915ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.97 MB (13599077)
- PinTime: 0.000ns
- ReductionFactorEstimate: 489.61
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 30.45K (30451)
- RowsReturnedRate: 12.87 K/sec
- StreamingTime: 95.631ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=7):(Total: 2s258ms, non-child: 232.915ms, % non-child: 10.31%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 30.45K (30451)
- BuildTime: 38.008ms
- PeakMemoryUsage: 10.18 MB (10672398)
- ProbeRows: 2.23M (2225981)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 226.765ms
- RowsReturned: 80.37K (80366)
- RowsReturnedRate: 35.59 K/sec
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 2 of 2 Runtime Filters Published
- BuildRowsPartitionTime: 11.231ms
- BuildRowsPartitioned: 30.45K (30451)
- GetNewBlockTime: 107.106us
- HashBuckets: 65.54K (65536)
- HashCollisions: 12 (12)
- HashTablesBuildTime: 2.191ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.04 MB (10524800)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=32):(Total: 162.381ms, non-child: 1.204ms, % non-child: 0.74%)
BytesReceived(500.000ms): 0, 1.38 MB, 1.38 MB, 1.38 MB, 1.38 MB, 1.38 MB
- BytesReceived: 1.38 MB (1449110)
- ConvertRowBatchTime: 623.585us
- DeserializeRowBatchTimer: 2.817ms
- FirstBatchArrivalWaitTime: 144.460ms
- PeakMemoryUsage: 0
- RowsReturned: 30.45K (30451)
- RowsReturnedRate: 187.53 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=31):(Total: 2s025ms, non-child: 112.257ms, % non-child: 5.54%)
BytesReceived(500.000ms): 0, 0, 13.73 MB, 51.05 MB, 86.28 MB, 101.82 MB
- BytesReceived: 102.36 MB (107334395)
- ConvertRowBatchTime: 32.228ms
- DeserializeRowBatchTimer: 331.236ms
- FirstBatchArrivalWaitTime: 512.864ms
- PeakMemoryUsage: 0
- RowsReturned: 2.23M (2225981)
- RowsReturnedRate: 1.10 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:69 (host=cdh13.net.cuberonlabs.com:22000):(Total: 2s967ms, non-child: 31.036ms, % non-child: 1.05%)
MemoryUsage(500.000ms): 1.42 MB, 27.43 MB, 29.37 MB, 37.95 MB, 38.75 MB, 38.63 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 39.37 MB (41279187)
- PerHostPeakMemUsage: 1.50 GB (1613813494)
- RowsProduced: 30.80K (30796)
- TotalNetworkReceiveTime: 2s303ms
- TotalNetworkSendTime: 7.548ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 3s204ms
- TotalThreadsSysTime: 76.000ms
- TotalThreadsUserTime: 852.000ms
- TotalThreadsVoluntaryContextSwitches: 4.86K (4860)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s887ms
- ExecTreeExecTime: 1s843ms
- OpenTime: 1s037ms
- ExecTreeOpenTime: 600.651ms
- PrepareTime: 43.277ms
- ExecTreePrepareTime: 1.108ms
DataStreamSender (dst_id=33):(Total: 23.022ms, non-child: 23.022ms, % non-child: 100.00%)
- BytesSent: 1.65 MB (1732465)
- NetworkThroughput(*): 449.35 MB/sec
- OverallThroughput: 71.77 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 30.80K (30796)
- SerializeBatchTime: 19.248ms
- TransmitDataRPCTime: 3.676ms
- UncompressedRowBatchSize: 2.53 MB (2651835)
CodeGen:(Total: 468.832ms, non-child: 468.832ms, % non-child: 100.00%)
- CodegenTime: 2.786ms
- CompileTime: 151.129ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 92 (92)
- NumInstructions: 3.46K (3457)
- OptimizationTime: 283.926ms
- PeakMemoryUsage: 1.69 MB (1769984)
- PrepareTime: 33.035ms
AGGREGATION_NODE (id=8):(Total: 2s445ms, non-child: 94.538ms, % non-child: 3.87%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 288.966us
- GetResultsTime: 8.473ms
- HTResizeTime: 1.222ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.87 MB (13492702)
- PinTime: 0.000ns
- ReductionFactorEstimate: 459.35
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 30.80K (30796)
- RowsReturnedRate: 12.60 K/sec
- StreamingTime: 83.268ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=7):(Total: 2s350ms, non-child: 244.000ms, % non-child: 10.38%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 30.80K (30796)
- BuildTime: 40.088ms
- PeakMemoryUsage: 10.18 MB (10672710)
- ProbeRows: 2.22M (2221369)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 238.332ms
- RowsReturned: 81.12K (81118)
- RowsReturnedRate: 34.51 K/sec
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 2 of 2 Runtime Filters Published
- BuildRowsPartitionTime: 11.161ms
- BuildRowsPartitioned: 30.80K (30796)
- GetNewBlockTime: 75.297us
- HashBuckets: 65.54K (65536)
- HashCollisions: 14 (14)
- HashTablesBuildTime: 2.371ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.04 MB (10524800)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=32):(Total: 239.861ms, non-child: 1.338ms, % non-child: 0.56%)
BytesReceived(500.000ms): 0, 1.40 MB, 1.40 MB, 1.40 MB, 1.40 MB, 1.40 MB
- BytesReceived: 1.40 MB (1464999)
- ConvertRowBatchTime: 681.921us
- DeserializeRowBatchTimer: 3.775ms
- FirstBatchArrivalWaitTime: 227.543ms
- PeakMemoryUsage: 0
- RowsReturned: 30.80K (30796)
- RowsReturnedRate: 128.39 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=31):(Total: 2s106ms, non-child: 113.355ms, % non-child: 5.38%)
BytesReceived(500.000ms): 0, 0, 20.26 MB, 56.73 MB, 90.06 MB, 101.90 MB
- BytesReceived: 102.13 MB (107087612)
- ConvertRowBatchTime: 37.613ms
- DeserializeRowBatchTimer: 328.882ms
- FirstBatchArrivalWaitTime: 596.439ms
- PeakMemoryUsage: 0
- RowsReturned: 2.22M (2221369)
- RowsReturnedRate: 1.05 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:75 (host=cdh11.net.cuberonlabs.com:22000):(Total: 2s967ms, non-child: 26.435ms, % non-child: 0.89%)
MemoryUsage(500.000ms): 1.42 MB, 27.43 MB, 30.27 MB, 38.27 MB, 38.50 MB, 16.20 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 39.48 MB (41393865)
- PerHostPeakMemUsage: 1.39 GB (1494361848)
- RowsProduced: 30.28K (30279)
- TotalNetworkReceiveTime: 2s338ms
- TotalNetworkSendTime: 5.763ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 8 (8)
- TotalThreadsTotalWallClockTime: 3s208ms
- TotalThreadsSysTime: 92.000ms
- TotalThreadsUserTime: 820.000ms
- TotalThreadsVoluntaryContextSwitches: 4.80K (4798)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s886ms
- ExecTreeExecTime: 1s846ms
- OpenTime: 1s047ms
- ExecTreeOpenTime: 593.390ms
- PrepareTime: 33.968ms
- ExecTreePrepareTime: 644.360us
DataStreamSender (dst_id=33):(Total: 21.835ms, non-child: 21.835ms, % non-child: 100.00%)
- BytesSent: 1.63 MB (1703990)
- NetworkThroughput(*): 455.69 MB/sec
- OverallThroughput: 74.42 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 30.28K (30279)
- SerializeBatchTime: 18.152ms
- TransmitDataRPCTime: 3.566ms
- UncompressedRowBatchSize: 2.49 MB (2607517)
CodeGen:(Total: 478.869ms, non-child: 478.869ms, % non-child: 100.00%)
- CodegenTime: 1.905ms
- CompileTime: 159.109ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 92 (92)
- NumInstructions: 3.46K (3457)
- OptimizationTime: 293.394ms
- PeakMemoryUsage: 1.69 MB (1769984)
- PrepareTime: 25.577ms
AGGREGATION_NODE (id=8):(Total: 2s440ms, non-child: 92.371ms, % non-child: 3.78%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 138.138us
- GetResultsTime: 6.939ms
- HTResizeTime: 1.259ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.97 MB (13596213)
- PinTime: 0.000ns
- ReductionFactorEstimate: 493.14
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 30.28K (30279)
- RowsReturnedRate: 12.41 K/sec
- StreamingTime: 83.104ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=7):(Total: 2s348ms, non-child: 204.501ms, % non-child: 8.71%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 30.28K (30279)
- BuildTime: 35.435ms
- PeakMemoryUsage: 10.18 MB (10676080)
- ProbeRows: 2.23M (2225047)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 197.410ms
- RowsReturned: 79.26K (79259)
- RowsReturnedRate: 33.75 K/sec
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 2 of 2 Runtime Filters Published
- BuildRowsPartitionTime: 13.984ms
- BuildRowsPartitioned: 30.28K (30279)
- GetNewBlockTime: 118.992us
- HashBuckets: 65.54K (65536)
- HashCollisions: 24 (24)
- HashTablesBuildTime: 2.030ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.04 MB (10524800)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=32):(Total: 239.193ms, non-child: 1.216ms, % non-child: 0.51%)
BytesReceived(500.000ms): 0, 1.37 MB, 1.37 MB, 1.37 MB, 1.37 MB
- BytesReceived: 1.37 MB (1440841)
- ConvertRowBatchTime: 645.092us
- DeserializeRowBatchTimer: 3.021ms
- FirstBatchArrivalWaitTime: 217.382ms
- PeakMemoryUsage: 0
- RowsReturned: 30.28K (30279)
- RowsReturnedRate: 126.59 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=31):(Total: 2s143ms, non-child: 124.041ms, % non-child: 5.79%)
BytesReceived(500.000ms): 0, 0, 29.91 MB, 66.31 MB, 96.22 MB
- BytesReceived: 102.30 MB (107266213)
- ConvertRowBatchTime: 38.443ms
- DeserializeRowBatchTimer: 328.696ms
- FirstBatchArrivalWaitTime: 588.857ms
- PeakMemoryUsage: 0
- RowsReturned: 2.23M (2225047)
- RowsReturnedRate: 1.04 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:70 (host=cdh14.net.cuberonlabs.com:22000):(Total: 2s966ms, non-child: 26.525ms, % non-child: 0.89%)
MemoryUsage(500.000ms): 1.42 MB, 27.43 MB, 30.15 MB, 38.39 MB, 38.27 MB, 37.41 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 39.44 MB (41351762)
- PerHostPeakMemUsage: 1.44 GB (1548652528)
- RowsProduced: 30.57K (30571)
- TotalNetworkReceiveTime: 2s322ms
- TotalNetworkSendTime: 6.246ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 3 (3)
- TotalThreadsTotalWallClockTime: 3s232ms
- TotalThreadsSysTime: 76.000ms
- TotalThreadsUserTime: 868.000ms
- TotalThreadsVoluntaryContextSwitches: 4.71K (4714)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s885ms
- ExecTreeExecTime: 1s844ms
- OpenTime: 1s040ms
- ExecTreeOpenTime: 624.689ms
- PrepareTime: 40.764ms
- ExecTreePrepareTime: 1.039ms
DataStreamSender (dst_id=33):(Total: 22.622ms, non-child: 22.622ms, % non-child: 100.00%)
- BytesSent: 1.64 MB (1719638)
- NetworkThroughput(*): 601.04 MB/sec
- OverallThroughput: 72.49 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 30.57K (30571)
- SerializeBatchTime: 19.813ms
- TransmitDataRPCTime: 2.728ms
- UncompressedRowBatchSize: 2.51 MB (2632749)
CodeGen:(Total: 447.717ms, non-child: 447.717ms, % non-child: 100.00%)
- CodegenTime: 2.153ms
- CompileTime: 148.842ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 92 (92)
- NumInstructions: 3.46K (3457)
- OptimizationTime: 266.189ms
- PeakMemoryUsage: 1.69 MB (1769984)
- PrepareTime: 32.108ms
AGGREGATION_NODE (id=8):(Total: 2s469ms, non-child: 99.156ms, % non-child: 4.01%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 262.981us
- GetResultsTime: 7.513ms
- HTResizeTime: 1.636ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 13.02 MB (13656513)
- PinTime: 0.000ns
- ReductionFactorEstimate: 511.99
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 30.57K (30571)
- RowsReturnedRate: 12.38 K/sec
- StreamingTime: 88.955ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=7):(Total: 2s370ms, non-child: 258.952ms, % non-child: 10.92%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 30.57K (30571)
- BuildTime: 42.167ms
- PeakMemoryUsage: 10.18 MB (10671383)
- ProbeRows: 2.22M (2220280)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 251.935ms
- RowsReturned: 80.55K (80553)
- RowsReturnedRate: 33.98 K/sec
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 2 of 2 Runtime Filters Published
- BuildRowsPartitionTime: 12.815ms
- BuildRowsPartitioned: 30.57K (30571)
- GetNewBlockTime: 82.045us
- HashBuckets: 65.54K (65536)
- HashCollisions: 13 (13)
- HashTablesBuildTime: 2.461ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.04 MB (10524800)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=32):(Total: 264.290ms, non-child: 1.165ms, % non-child: 0.44%)
BytesReceived(500.000ms): 0, 1.39 MB, 1.39 MB, 1.39 MB, 1.39 MB, 1.39 MB
- BytesReceived: 1.39 MB (1454086)
- ConvertRowBatchTime: 725.357us
- DeserializeRowBatchTimer: 4.203ms
- FirstBatchArrivalWaitTime: 248.061ms
- PeakMemoryUsage: 0
- RowsReturned: 30.57K (30571)
- RowsReturnedRate: 115.67 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=31):(Total: 2s111ms, non-child: 124.841ms, % non-child: 5.91%)
BytesReceived(500.000ms): 0, 0, 20.44 MB, 56.81 MB, 90.12 MB, 101.83 MB
- BytesReceived: 102.06 MB (107018615)
- ConvertRowBatchTime: 46.927ms
- DeserializeRowBatchTimer: 326.084ms
- FirstBatchArrivalWaitTime: 620.271ms
- PeakMemoryUsage: 0
- RowsReturned: 2.22M (2220280)
- RowsReturnedRate: 1.05 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:67 (host=cdh4.net.cuberonlabs.com:22000):(Total: 2s963ms, non-child: 25.685ms, % non-child: 0.87%)
MemoryUsage(500.000ms): 3.11 MB, 26.47 MB, 30.94 MB, 37.83 MB, 38.21 MB, 38.91 MB
ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.17
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 39.42 MB (41337976)
- PerHostPeakMemUsage: 1.49 GB (1602749019)
- RowsProduced: 30.78K (30778)
- TotalNetworkReceiveTime: 2s341ms
- TotalNetworkSendTime: 7.259ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 11 (11)
- TotalThreadsTotalWallClockTime: 3s187ms
- TotalThreadsSysTime: 76.000ms
- TotalThreadsUserTime: 800.000ms
- TotalThreadsVoluntaryContextSwitches: 4.80K (4799)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s879ms
- ExecTreeExecTime: 1s838ms
- OpenTime: 1s040ms
- ExecTreeOpenTime: 595.022ms
- PrepareTime: 43.281ms
- ExecTreePrepareTime: 714.344us
DataStreamSender (dst_id=33):(Total: 25.842ms, non-child: 25.842ms, % non-child: 100.00%)
- BytesSent: 1.65 MB (1731946)
- NetworkThroughput(*): 197.87 MB/sec
- OverallThroughput: 63.92 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 30.78K (30778)
- SerializeBatchTime: 17.399ms
- TransmitDataRPCTime: 8.347ms
- UncompressedRowBatchSize: 2.53 MB (2650681)
CodeGen:(Total: 477.159ms, non-child: 477.159ms, % non-child: 100.00%)
- CodegenTime: 2.647ms
- CompileTime: 159.322ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 92 (92)
- NumInstructions: 3.46K (3457)
- OptimizationTime: 284.510ms
- PeakMemoryUsage: 1.69 MB (1769984)
- PrepareTime: 32.556ms
AGGREGATION_NODE (id=8):(Total: 2s434ms, non-child: 90.068ms, % non-child: 3.70%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 212.640us
- GetResultsTime: 7.495ms
- HTResizeTime: 1.558ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.88 MB (13505543)
- PinTime: 0.000ns
- ReductionFactorEstimate: 490.67
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 30.78K (30778)
- RowsReturnedRate: 12.64 K/sec
- StreamingTime: 79.222ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=7):(Total: 2s344ms, non-child: 192.547ms, % non-child: 8.21%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 30.78K (30778)
- BuildTime: 38.062ms
- PeakMemoryUsage: 10.18 MB (10673175)
- ProbeRows: 2.22M (2219647)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 186.195ms
- RowsReturned: 81.56K (81563)
- RowsReturnedRate: 34.79 K/sec
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 2 of 2 Runtime Filters Published
- BuildRowsPartitionTime: 12.390ms
- BuildRowsPartitioned: 30.78K (30778)
- GetNewBlockTime: 200.164us
- HashBuckets: 65.54K (65536)
- HashCollisions: 45 (45)
- HashTablesBuildTime: 1.549ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.04 MB (10524800)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=32):(Total: 229.010ms, non-child: 960.696us, % non-child: 0.42%)
BytesReceived(500.000ms): 0, 1.37 MB, 1.40 MB, 1.40 MB, 1.40 MB, 1.40 MB
- BytesReceived: 1.40 MB (1463644)
- ConvertRowBatchTime: 518.780us
- DeserializeRowBatchTimer: 3.145ms
- FirstBatchArrivalWaitTime: 218.817ms
- PeakMemoryUsage: 0
- RowsReturned: 30.78K (30778)
- RowsReturnedRate: 134.40 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=31):(Total: 2s151ms, non-child: 118.786ms, % non-child: 5.52%)
BytesReceived(500.000ms): 0, 0, 12.11 MB, 49.70 MB, 85.10 MB, 101.46 MB
- BytesReceived: 102.05 MB (107007510)
- ConvertRowBatchTime: 33.212ms
- DeserializeRowBatchTimer: 299.723ms
- FirstBatchArrivalWaitTime: 588.043ms
- PeakMemoryUsage: 0
- RowsReturned: 2.22M (2219647)
- RowsReturnedRate: 1.03 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:68 (host=cdh16.net.cuberonlabs.com:22000):(Total: 2s962ms, non-child: 29.233ms, % non-child: 0.99%)
MemoryUsage(500.000ms): 1.42 MB, 27.43 MB, 29.22 MB, 38.48 MB, 37.54 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 39.30 MB (41210205)
- PerHostPeakMemUsage: 1.37 GB (1468229737)
- RowsProduced: 30.73K (30728)
- TotalNetworkReceiveTime: 2s296ms
- TotalNetworkSendTime: 5.362ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 2 (2)
- TotalThreadsTotalWallClockTime: 3s171ms
- TotalThreadsSysTime: 96.000ms
- TotalThreadsUserTime: 804.000ms
- TotalThreadsVoluntaryContextSwitches: 5.13K (5133)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s882ms
- ExecTreeExecTime: 1s840ms
- OpenTime: 1s034ms
- ExecTreeOpenTime: 576.755ms
- PrepareTime: 45.688ms
- ExecTreePrepareTime: 650.886us
DataStreamSender (dst_id=33):(Total: 24.062ms, non-child: 24.062ms, % non-child: 100.00%)
- BytesSent: 1.65 MB (1728736)
- NetworkThroughput(*): 401.91 MB/sec
- OverallThroughput: 68.52 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 30.73K (30728)
- SerializeBatchTime: 19.824ms
- TransmitDataRPCTime: 4.102ms
- UncompressedRowBatchSize: 2.52 MB (2646891)
CodeGen:(Total: 491.743ms, non-child: 491.743ms, % non-child: 100.00%)
- CodegenTime: 3.279ms
- CompileTime: 152.368ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 92 (92)
- NumInstructions: 3.46K (3457)
- OptimizationTime: 304.226ms
- PeakMemoryUsage: 1.69 MB (1769984)
- PrepareTime: 34.270ms
AGGREGATION_NODE (id=8):(Total: 2s417ms, non-child: 85.892ms, % non-child: 3.55%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 176.999us
- GetResultsTime: 7.108ms
- HTResizeTime: 1.014ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.91 MB (13536259)
- PinTime: 0.000ns
- ReductionFactorEstimate: 490.08
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 30.73K (30728)
- RowsReturnedRate: 12.71 K/sec
- StreamingTime: 76.589ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=7):(Total: 2s331ms, non-child: 210.033ms, % non-child: 9.01%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 30.73K (30728)
- BuildTime: 35.012ms
- PeakMemoryUsage: 10.18 MB (10672664)
- ProbeRows: 2.22M (2224064)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 204.098ms
- RowsReturned: 80.74K (80744)
- RowsReturnedRate: 34.62 K/sec
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 2 of 2 Runtime Filters Published
- BuildRowsPartitionTime: 12.838ms
- BuildRowsPartitioned: 30.73K (30728)
- GetNewBlockTime: 108.596us
- HashBuckets: 65.54K (65536)
- HashCollisions: 18 (18)
- HashTablesBuildTime: 2.002ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.04 MB (10524800)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=32):(Total: 219.252ms, non-child: 1.200ms, % non-child: 0.55%)
BytesReceived(500.000ms): 0, 1.39 MB, 1.39 MB, 1.39 MB, 1.39 MB
- BytesReceived: 1.39 MB (1461037)
- ConvertRowBatchTime: 562.423us
- DeserializeRowBatchTimer: 3.331ms
- FirstBatchArrivalWaitTime: 205.187ms
- PeakMemoryUsage: 0
- RowsReturned: 30.73K (30728)
- RowsReturnedRate: 140.15 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=31):(Total: 2s121ms, non-child: 132.512ms, % non-child: 6.24%)
BytesReceived(500.000ms): 0, 0, 30.10 MB, 66.50 MB, 96.24 MB
- BytesReceived: 102.29 MB (107263071)
- ConvertRowBatchTime: 39.055ms
- DeserializeRowBatchTimer: 379.623ms
- FirstBatchArrivalWaitTime: 573.321ms
- PeakMemoryUsage: 0
- RowsReturned: 2.22M (2224064)
- RowsReturnedRate: 1.05 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:6a (host=cdh6.net.cuberonlabs.com:22000):(Total: 2s962ms, non-child: 26.576ms, % non-child: 0.90%)
MemoryUsage(500.000ms): 3.11 MB, 1.43 MB, 27.88 MB, 32.50 MB, 37.62 MB, 37.59 MB
ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.17
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 39.36 MB (41269315)
- PerHostPeakMemUsage: 1.35 GB (1448427474)
- RowsProduced: 30.23K (30234)
- TotalNetworkReceiveTime: 2s300ms
- TotalNetworkSendTime: 5.084ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 3 (3)
- TotalThreadsTotalWallClockTime: 3s175ms
- TotalThreadsSysTime: 76.000ms
- TotalThreadsUserTime: 832.000ms
- TotalThreadsVoluntaryContextSwitches: 5.12K (5122)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s880ms
- ExecTreeExecTime: 1s840ms
- OpenTime: 1s040ms
- ExecTreeOpenTime: 577.813ms
- PrepareTime: 41.348ms
- ExecTreePrepareTime: 673.480us
DataStreamSender (dst_id=33):(Total: 23.295ms, non-child: 23.295ms, % non-child: 100.00%)
- BytesSent: 1.62 MB (1701503)
- NetworkThroughput(*): 389.73 MB/sec
- OverallThroughput: 69.66 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 30.23K (30234)
- SerializeBatchTime: 19.035ms
- TransmitDataRPCTime: 4.163ms
- UncompressedRowBatchSize: 2.48 MB (2602622)
CodeGen:(Total: 493.775ms, non-child: 493.775ms, % non-child: 100.00%)
- CodegenTime: 2.602ms
- CompileTime: 160.950ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 92 (92)
- NumInstructions: 3.46K (3457)
- OptimizationTime: 300.344ms
- PeakMemoryUsage: 1.69 MB (1769984)
- PrepareTime: 31.748ms
AGGREGATION_NODE (id=8):(Total: 2s418ms, non-child: 85.457ms, % non-child: 3.53%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 161.272us
- GetResultsTime: 7.590ms
- HTResizeTime: 1.077ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.89 MB (13520180)
- PinTime: 0.000ns
- ReductionFactorEstimate: 498.75
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 30.23K (30234)
- RowsReturnedRate: 12.50 K/sec
- StreamingTime: 75.522ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=7):(Total: 2s333ms, non-child: 200.578ms, % non-child: 8.60%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 30.23K (30234)
- BuildTime: 45.042ms
- PeakMemoryUsage: 10.18 MB (10673957)
- ProbeRows: 2.22M (2220537)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 194.207ms
- RowsReturned: 79.54K (79543)
- RowsReturnedRate: 34.09 K/sec
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 2 of 2 Runtime Filters Published
- BuildRowsPartitionTime: 14.704ms
- BuildRowsPartitioned: 30.23K (30234)
- GetNewBlockTime: 125.072us
- HashBuckets: 65.54K (65536)
- HashCollisions: 16 (16)
- HashTablesBuildTime: 2.238ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.04 MB (10524800)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=32):(Total: 209.504ms, non-child: 1.225ms, % non-child: 0.58%)
BytesReceived(500.000ms): 0, 0, 1.37 MB, 1.37 MB, 1.37 MB, 1.37 MB
- BytesReceived: 1.37 MB (1439488)
- ConvertRowBatchTime: 802.692us
- DeserializeRowBatchTimer: 3.396ms
- FirstBatchArrivalWaitTime: 203.207ms
- PeakMemoryUsage: 0
- RowsReturned: 30.23K (30234)
- RowsReturnedRate: 144.31 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=31):(Total: 2s132ms, non-child: 111.456ms, % non-child: 5.23%)
BytesReceived(500.000ms): 0, 0, 263.07 KB, 39.08 MB, 75.08 MB, 99.67 MB
- BytesReceived: 102.06 MB (107018518)
- ConvertRowBatchTime: 35.509ms
- DeserializeRowBatchTimer: 298.880ms
- FirstBatchArrivalWaitTime: 571.666ms
- PeakMemoryUsage: 0
- RowsReturned: 2.22M (2220537)
- RowsReturnedRate: 1.04 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:72 (host=cdh5.net.cuberonlabs.com:22000):(Total: 2s961ms, non-child: 21.219ms, % non-child: 0.72%)
MemoryUsage(500.000ms): 1.42 MB, 27.43 MB, 30.64 MB, 37.36 MB, 37.89 MB, 39.07 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 39.29 MB (41199970)
- PerHostPeakMemUsage: 1.38 GB (1486351700)
- RowsProduced: 30.67K (30669)
- TotalNetworkReceiveTime: 2s401ms
- TotalNetworkSendTime: 6.290ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 4 (4)
- TotalThreadsTotalWallClockTime: 3s231ms
- TotalThreadsSysTime: 80.000ms
- TotalThreadsUserTime: 772.000ms
- TotalThreadsVoluntaryContextSwitches: 4.62K (4622)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s881ms
- ExecTreeExecTime: 1s845ms
- OpenTime: 1s044ms
- ExecTreeOpenTime: 619.463ms
- PrepareTime: 35.379ms
- ExecTreePrepareTime: 1.140ms
DataStreamSender (dst_id=33):(Total: 24.745ms, non-child: 24.745ms, % non-child: 100.00%)
- BytesSent: 1.65 MB (1726368)
- NetworkThroughput(*): 213.34 MB/sec
- OverallThroughput: 66.53 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 30.67K (30669)
- SerializeBatchTime: 16.908ms
- TransmitDataRPCTime: 7.717ms
- UncompressedRowBatchSize: 2.52 MB (2640672)
CodeGen:(Total: 450.205ms, non-child: 450.205ms, % non-child: 100.00%)
- CodegenTime: 2.385ms
- CompileTime: 143.887ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 92 (92)
- NumInstructions: 3.46K (3457)
- OptimizationTime: 279.431ms
- PeakMemoryUsage: 1.69 MB (1769984)
- PrepareTime: 26.140ms
AGGREGATION_NODE (id=8):(Total: 2s465ms, non-child: 89.681ms, % non-child: 3.64%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 312.176us
- GetResultsTime: 5.238ms
- HTResizeTime: 1.068ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.90 MB (13531716)
- PinTime: 0.000ns
- ReductionFactorEstimate: 483.42
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 30.67K (30669)
- RowsReturnedRate: 12.44 K/sec
- StreamingTime: 81.483ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=7):(Total: 2s375ms, non-child: 199.962ms, % non-child: 8.42%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 30.67K (30669)
- BuildTime: 40.018ms
- PeakMemoryUsage: 10.18 MB (10672621)
- ProbeRows: 2.22M (2219481)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 193.834ms
- RowsReturned: 81.36K (81361)
- RowsReturnedRate: 34.24 K/sec
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 2 of 2 Runtime Filters Published
- BuildRowsPartitionTime: 10.275ms
- BuildRowsPartitioned: 30.67K (30669)
- GetNewBlockTime: 77.728us
- HashBuckets: 65.54K (65536)
- HashCollisions: 12 (12)
- HashTablesBuildTime: 2.470ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.04 MB (10524800)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=32):(Total: 265.106ms, non-child: 825.668us, % non-child: 0.31%)
BytesReceived(500.000ms): 0, 1.39 MB, 1.39 MB, 1.39 MB, 1.39 MB, 1.39 MB
- BytesReceived: 1.39 MB (1458600)
- ConvertRowBatchTime: 451.196us
- DeserializeRowBatchTimer: 3.472ms
- FirstBatchArrivalWaitTime: 246.182ms
- PeakMemoryUsage: 0
- RowsReturned: 30.67K (30669)
- RowsReturnedRate: 115.69 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=31):(Total: 2s176ms, non-child: 143.985ms, % non-child: 6.62%)
BytesReceived(500.000ms): 0, 0, 20.68 MB, 57.06 MB, 90.21 MB, 101.82 MB
- BytesReceived: 102.03 MB (106982246)
- ConvertRowBatchTime: 34.052ms
- DeserializeRowBatchTimer: 323.994ms
- FirstBatchArrivalWaitTime: 612.240ms
- PeakMemoryUsage: 0
- RowsReturned: 2.22M (2219481)
- RowsReturnedRate: 1.02 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:71 (host=cdh1.net.cuberonlabs.com:22000):(Total: 2s959ms, non-child: 31.269ms, % non-child: 1.06%)
MemoryUsage(500.000ms): 3.11 MB, 1.43 MB, 27.55 MB, 30.48 MB, 37.92 MB, 37.32 MB
ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.17
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 39.33 MB (41242714)
- PerHostPeakMemUsage: 1.40 GB (1507241412)
- RowsProduced: 30.12K (30123)
- TotalNetworkReceiveTime: 2s339ms
- TotalNetworkSendTime: 5.772ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 20 (20)
- TotalThreadsTotalWallClockTime: 3s221ms
- TotalThreadsSysTime: 136.000ms
- TotalThreadsUserTime: 780.000ms
- TotalThreadsVoluntaryContextSwitches: 4.47K (4472)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s887ms
- ExecTreeExecTime: 1s846ms
- OpenTime: 1s029ms
- ExecTreeOpenTime: 607.156ms
- PrepareTime: 43.043ms
- ExecTreePrepareTime: 1.943ms
DataStreamSender (dst_id=33):(Total: 21.149ms, non-child: 21.149ms, % non-child: 100.00%)
- BytesSent: 1.62 MB (1695130)
- NetworkThroughput(*): 433.73 MB/sec
- OverallThroughput: 76.44 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 30.12K (30123)
- SerializeBatchTime: 17.230ms
- TransmitDataRPCTime: 3.727ms
- UncompressedRowBatchSize: 2.47 MB (2594256)
CodeGen:(Total: 452.157ms, non-child: 452.157ms, % non-child: 100.00%)
- CodegenTime: 2.275ms
- CompileTime: 148.868ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 92 (92)
- NumInstructions: 3.46K (3457)
- OptimizationTime: 272.042ms
- PeakMemoryUsage: 1.69 MB (1769984)
- PrepareTime: 30.642ms
AGGREGATION_NODE (id=8):(Total: 2s455ms, non-child: 101.497ms, % non-child: 4.13%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 558.644us
- GetResultsTime: 7.154ms
- HTResizeTime: 1.087ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.89 MB (13520159)
- PinTime: 0.000ns
- ReductionFactorEstimate: 504.70
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 30.12K (30123)
- RowsReturnedRate: 12.27 K/sec
- StreamingTime: 91.138ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=7):(Total: 2s353ms, non-child: 219.633ms, % non-child: 9.33%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 30.12K (30123)
- BuildTime: 51.814ms
- PeakMemoryUsage: 10.18 MB (10672128)
- ProbeRows: 2.22M (2221252)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 211.638ms
- RowsReturned: 79.65K (79652)
- RowsReturnedRate: 33.84 K/sec
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 2 of 2 Runtime Filters Published
- BuildRowsPartitionTime: 11.817ms
- BuildRowsPartitioned: 30.12K (30123)
- GetNewBlockTime: 86.860us
- HashBuckets: 65.54K (65536)
- HashCollisions: 16 (16)
- HashTablesBuildTime: 3.181ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.04 MB (10524800)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=32):(Total: 252.492ms, non-child: 1.225ms, % non-child: 0.49%)
BytesReceived(500.000ms): 0, 0, 1.37 MB, 1.37 MB, 1.37 MB, 1.37 MB
- BytesReceived: 1.37 MB (1434860)
- ConvertRowBatchTime: 604.280us
- DeserializeRowBatchTimer: 3.710ms
- FirstBatchArrivalWaitTime: 232.887ms
- PeakMemoryUsage: 0
- RowsReturned: 30.12K (30123)
- RowsReturnedRate: 119.30 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=31):(Total: 2s134ms, non-child: 178.529ms, % non-child: 8.36%)
BytesReceived(500.000ms): 0, 0, 60.25 KB, 38.19 MB, 74.20 MB, 99.48 MB
- BytesReceived: 102.11 MB (107069877)
- ConvertRowBatchTime: 40.329ms
- DeserializeRowBatchTimer: 382.210ms
- FirstBatchArrivalWaitTime: 602.101ms
- PeakMemoryUsage: 0
- RowsReturned: 2.22M (2221252)
- RowsReturnedRate: 1.04 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:6e (host=cdh2.net.cuberonlabs.com:22000):(Total: 2s959ms, non-child: 26.910ms, % non-child: 0.91%)
MemoryUsage(500.000ms): 3.11 MB, 1.43 MB, 28.00 MB, 33.48 MB, 38.84 MB, 38.97 MB
ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.17
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 39.50 MB (41423370)
- PerHostPeakMemUsage: 1.47 GB (1583684231)
- RowsProduced: 30.54K (30540)
- TotalNetworkReceiveTime: 2s302ms
- TotalNetworkSendTime: 5.654ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 8 (8)
- TotalThreadsTotalWallClockTime: 3s175ms
- TotalThreadsSysTime: 84.000ms
- TotalThreadsUserTime: 832.000ms
- TotalThreadsVoluntaryContextSwitches: 4.85K (4851)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s878ms
- ExecTreeExecTime: 1s843ms
- OpenTime: 1s022ms
- ExecTreeOpenTime: 589.804ms
- PrepareTime: 57.642ms
- ExecTreePrepareTime: 1.071ms
DataStreamSender (dst_id=33):(Total: 19.375ms, non-child: 19.375ms, % non-child: 100.00%)
- BytesSent: 1.64 MB (1718575)
- NetworkThroughput(*): 455.06 MB/sec
- OverallThroughput: 84.59 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 30.54K (30540)
- SerializeBatchTime: 15.654ms
- TransmitDataRPCTime: 3.601ms
- UncompressedRowBatchSize: 2.51 MB (2628031)
CodeGen:(Total: 478.922ms, non-child: 478.922ms, % non-child: 100.00%)
- CodegenTime: 2.551ms
- CompileTime: 149.466ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 92 (92)
- NumInstructions: 3.46K (3457)
- OptimizationTime: 282.306ms
- PeakMemoryUsage: 1.69 MB (1769984)
- PrepareTime: 46.130ms
AGGREGATION_NODE (id=8):(Total: 2s434ms, non-child: 89.908ms, % non-child: 3.69%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 312.580us
- GetResultsTime: 6.344ms
- HTResizeTime: 738.432us
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 13.03 MB (13659792)
- PinTime: 0.000ns
- ReductionFactorEstimate: 487.08
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 30.54K (30540)
- RowsReturnedRate: 12.55 K/sec
- StreamingTime: 80.861ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=7):(Total: 2s344ms, non-child: 227.869ms, % non-child: 9.72%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 30.54K (30540)
- BuildTime: 42.823ms
- PeakMemoryUsage: 10.18 MB (10672068)
- ProbeRows: 2.22M (2219807)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 220.549ms
- RowsReturned: 80.22K (80222)
- RowsReturnedRate: 34.22 K/sec
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 2 of 2 Runtime Filters Published
- BuildRowsPartitionTime: 12.691ms
- BuildRowsPartitioned: 30.54K (30540)
- GetNewBlockTime: 92.824us
- HashBuckets: 65.54K (65536)
- HashCollisions: 8 (8)
- HashTablesBuildTime: 2.498ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.04 MB (10524800)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=32):(Total: 230.588ms, non-child: 1.130ms, % non-child: 0.49%)
BytesReceived(500.000ms): 0, 0, 1.39 MB, 1.39 MB, 1.39 MB, 1.39 MB
- BytesReceived: 1.39 MB (1452862)
- ConvertRowBatchTime: 670.228us
- DeserializeRowBatchTimer: 3.204ms
- FirstBatchArrivalWaitTime: 214.747ms
- PeakMemoryUsage: 0
- RowsReturned: 30.54K (30540)
- RowsReturnedRate: 132.44 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=31):(Total: 2s116ms, non-child: 124.672ms, % non-child: 5.89%)
BytesReceived(500.000ms): 0, 0, 346.25 KB, 39.24 MB, 75.27 MB, 99.74 MB
- BytesReceived: 102.04 MB (106991620)
- ConvertRowBatchTime: 38.227ms
- DeserializeRowBatchTimer: 322.299ms
- FirstBatchArrivalWaitTime: 585.133ms
- PeakMemoryUsage: 0
- RowsReturned: 2.22M (2219807)
- RowsReturnedRate: 1.05 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:6c (host=cdh3.net.cuberonlabs.com:22000):(Total: 2s958ms, non-child: 29.606ms, % non-child: 1.00%)
MemoryUsage(500.000ms): 3.11 MB, 27.43 MB, 28.96 MB, 38.68 MB, 37.94 MB, 37.29 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 39.45 MB (41366491)
- PerHostPeakMemUsage: 1.13 GB (1217735172)
- RowsProduced: 30.25K (30249)
- TotalNetworkReceiveTime: 2s141ms
- TotalNetworkSendTime: 6.661ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 35 (35)
- TotalThreadsTotalWallClockTime: 3s078ms
- TotalThreadsSysTime: 116.000ms
- TotalThreadsUserTime: 848.000ms
- TotalThreadsVoluntaryContextSwitches: 4.96K (4962)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s877ms
- ExecTreeExecTime: 1s840ms
- OpenTime: 1s027ms
- ExecTreeOpenTime: 497.059ms
- PrepareTime: 53.154ms
- ExecTreePrepareTime: 790.708us
DataStreamSender (dst_id=33):(Total: 19.641ms, non-child: 19.641ms, % non-child: 100.00%)
- BytesSent: 1.62 MB (1701777)
- NetworkThroughput(*): 411.07 MB/sec
- OverallThroughput: 82.63 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 30.25K (30249)
- SerializeBatchTime: 15.602ms
- TransmitDataRPCTime: 3.948ms
- UncompressedRowBatchSize: 2.48 MB (2604464)
CodeGen:(Total: 571.051ms, non-child: 571.051ms, % non-child: 100.00%)
- CodegenTime: 3.455ms
- CompileTime: 184.820ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 92 (92)
- NumInstructions: 3.46K (3457)
- OptimizationTime: 343.731ms
- PeakMemoryUsage: 1.69 MB (1769984)
- PrepareTime: 41.462ms
AGGREGATION_NODE (id=8):(Total: 2s338ms, non-child: 91.729ms, % non-child: 3.92%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 320.416us
- GetResultsTime: 6.217ms
- HTResizeTime: 1.231ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 13.04 MB (13668340)
- PinTime: 0.000ns
- ReductionFactorEstimate: 506.56
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 30.25K (30249)
- RowsReturnedRate: 12.94 K/sec
- StreamingTime: 83.122ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=7):(Total: 2s246ms, non-child: 200.914ms, % non-child: 8.94%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 30.25K (30249)
- BuildTime: 37.890ms
- PeakMemoryUsage: 10.18 MB (10673888)
- ProbeRows: 2.22M (2220811)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 194.662ms
- RowsReturned: 79.45K (79450)
- RowsReturnedRate: 35.37 K/sec
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 2 of 2 Runtime Filters Published
- BuildRowsPartitionTime: 12.113ms
- BuildRowsPartitioned: 30.25K (30249)
- GetNewBlockTime: 105.204us
- HashBuckets: 65.54K (65536)
- HashCollisions: 11 (11)
- HashTablesBuildTime: 1.693ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.04 MB (10524800)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=32):(Total: 135.325ms, non-child: 998.716us, % non-child: 0.74%)
BytesReceived(500.000ms): 0, 1.37 MB, 1.37 MB, 1.37 MB, 1.37 MB, 1.37 MB
- BytesReceived: 1.37 MB (1440047)
- ConvertRowBatchTime: 589.964us
- DeserializeRowBatchTimer: 2.894ms
- FirstBatchArrivalWaitTime: 123.571ms
- PeakMemoryUsage: 0
- RowsReturned: 30.25K (30249)
- RowsReturnedRate: 223.53 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=31):(Total: 2s045ms, non-child: 112.855ms, % non-child: 5.52%)
BytesReceived(500.000ms): 0, 0, 19.74 MB, 56.26 MB, 89.68 MB, 101.85 MB
- BytesReceived: 102.13 MB (107087588)
- ConvertRowBatchTime: 33.463ms
- DeserializeRowBatchTimer: 301.876ms
- FirstBatchArrivalWaitTime: 489.737ms
- PeakMemoryUsage: 0
- RowsReturned: 2.22M (2220811)
- RowsReturnedRate: 1.09 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:6b (host=cdh15.net.cuberonlabs.com:22000):(Total: 2s950ms, non-child: 23.728ms, % non-child: 0.80%)
MemoryUsage(500.000ms): 1.41 MB, 1.43 MB, 27.43 MB, 29.40 MB, 39.10 MB, 38.29 MB
ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1
- AverageThreadTokens: 1.17
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 39.38 MB (41295070)
- PerHostPeakMemUsage: 1.50 GB (1607357771)
- RowsProduced: 30.50K (30498)
- TotalNetworkReceiveTime: 2s385ms
- TotalNetworkSendTime: 5.336ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 18 (18)
- TotalThreadsTotalWallClockTime: 3s195ms
- TotalThreadsSysTime: 96.000ms
- TotalThreadsUserTime: 740.000ms
- TotalThreadsVoluntaryContextSwitches: 5.08K (5083)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s872ms
- ExecTreeExecTime: 1s842ms
- OpenTime: 1s038ms
- ExecTreeOpenTime: 603.850ms
- PrepareTime: 40.077ms
- ExecTreePrepareTime: 601.566us
DataStreamSender (dst_id=33):(Total: 14.797ms, non-child: 14.797ms, % non-child: 100.00%)
- BytesSent: 1.64 MB (1716295)
- NetworkThroughput(*): 493.28 MB/sec
- OverallThroughput: 110.61 MB/sec
- PeakMemoryUsage: 1.06 MB (1111936)
- RowsReturned: 30.50K (30498)
- SerializeBatchTime: 11.371ms
- TransmitDataRPCTime: 3.318ms
- UncompressedRowBatchSize: 2.50 MB (2625057)
CodeGen:(Total: 464.711ms, non-child: 464.711ms, % non-child: 100.00%)
- CodegenTime: 2.552ms
- CompileTime: 155.795ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 92 (92)
- NumInstructions: 3.46K (3457)
- OptimizationTime: 277.241ms
- PeakMemoryUsage: 1.69 MB (1769984)
- PrepareTime: 30.960ms
AGGREGATION_NODE (id=8):(Total: 2s447ms, non-child: 79.791ms, % non-child: 3.26%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 218.966us
- GetResultsTime: 6.875ms
- HTResizeTime: 707.507us
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.97 MB (13600374)
- PinTime: 0.000ns
- ReductionFactorEstimate: 488.47
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 30.50K (30498)
- RowsReturnedRate: 12.46 K/sec
- StreamingTime: 71.035ms
- UnpinTime: 0.000ns
HASH_JOIN_NODE (id=7):(Total: 2s367ms, non-child: 188.452ms, % non-child: 7.96%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
- BuildRows: 30.50K (30498)
- BuildTime: 40.158ms
- PeakMemoryUsage: 10.18 MB (10672572)
- ProbeRows: 2.22M (2217505)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 182.216ms
- RowsReturned: 80.39K (80393)
- RowsReturnedRate: 33.96 K/sec
Hash Join Builder (join_node_id=7):
ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
Runtime filters: 2 of 2 Runtime Filters Published
- BuildRowsPartitionTime: 12.724ms
- BuildRowsPartitioned: 30.50K (30498)
- GetNewBlockTime: 142.620us
- HashBuckets: 65.54K (65536)
- HashCollisions: 15 (15)
- HashTablesBuildTime: 2.470ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.04 MB (10524800)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=32):(Total: 245.122ms, non-child: 1.064ms, % non-child: 0.43%)
BytesReceived(500.000ms): 0, 0, 1.38 MB, 1.38 MB, 1.38 MB, 1.38 MB
- BytesReceived: 1.38 MB (1450598)
- ConvertRowBatchTime: 706.861us
- DeserializeRowBatchTimer: 3.502ms
- FirstBatchArrivalWaitTime: 233.046ms
- PeakMemoryUsage: 0
- RowsReturned: 30.50K (30498)
- RowsReturnedRate: 124.42 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=31):(Total: 2s179ms, non-child: 99.566ms, % non-child: 4.57%)
BytesReceived(500.000ms): 0, 0, 0, 34.70 MB, 70.85 MB, 98.04 MB
- BytesReceived: 101.95 MB (106905413)
- ConvertRowBatchTime: 33.724ms
- DeserializeRowBatchTimer: 285.213ms
- FirstBatchArrivalWaitTime: 602.084ms
- PeakMemoryUsage: 0
- RowsReturned: 2.22M (2217505)
- RowsReturnedRate: 1.02 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Averaged Fragment F04:(Total: 2s469ms, non-child: 570.679ms, % non-child: 23.11%)
split sizes: min: 1.81 GB, max: 3.59 GB, avg: 2.76 GB, stddev: 468.16 MB
completion times: min:2s122ms max:2s905ms mean: 2s470ms stddev:207.758ms
execution rates: min:823.68 MB/sec max:1.31 GB/sec mean:1.11 GB/sec stddev:128.25 MB/sec
num instances: 17
- AverageThreadTokens: 7.28
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 102.75 MB (107743019)
- PerHostPeakMemUsage: 1.15 GB (1237569248)
- RowsProduced: 2.22M (2221711)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 13.111ms
- TotalStorageWaitTime: 149.829ms
- TotalThreadsInvoluntaryContextSwitches: 48 (48)
- TotalThreadsTotalWallClockTime: 17s657ms
- TotalThreadsSysTime: 400.705ms
- TotalThreadsUserTime: 4s453ms
- TotalThreadsVoluntaryContextSwitches: 3.92K (3917)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s357ms
- ExecTreeExecTime: 981.603ms
- OpenTime: 76.627ms
- ExecTreeOpenTime: 41.849us
- PrepareTime: 34.850ms
- ExecTreePrepareTime: 311.152us
DataStreamSender (dst_id=31):(Total: 810.450ms, non-child: 810.450ms, % non-child: 100.00%)
- BytesSent: 102.14 MB (107102132)
- NetworkThroughput(*): 478.15 MB/sec
- OverallThroughput: 127.55 MB/sec
- PeakMemoryUsage: 1.04 MB (1089588)
- RowsReturned: 2.22M (2221711)
- SerializeBatchTime: 572.875ms
- TransmitDataRPCTime: 237.037ms
- UncompressedRowBatchSize: 176.28 MB (184839048)
CodeGen:(Total: 107.276ms, non-child: 107.276ms, % non-child: 100.00%)
- CodegenTime: 1.415ms
- CompileTime: 14.007ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 32 (32)
- NumInstructions: 547 (547)
- OptimizationTime: 61.493ms
- PeakMemoryUsage: 273.50 KB (280064)
- PrepareTime: 31.060ms
HDFS_SCAN_NODE (id=4):(Total: 980.913ms, non-child: 980.913ms, % non-child: 100.00%)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.93
- BytesRead: 372.01 MB (390076376)
- BytesReadDataNodeCache: 362.88 MB (380505970)
- BytesReadLocal: 372.01 MB (390076376)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 372.01 MB (390076376)
- DecompressionTime: 751.176ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 29 (29)
- NumScannerThreadsStarted: 8 (8)
- PeakMemoryUsage: 85.62 MB (89779341)
- PerReadThreadRawHdfsThroughput: 36.59 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 50.199ms
- RowBatchQueuePutWaitTime: 7s433ms
- RowsRead: 11.56M (11559184)
- RowsReturned: 2.22M (2221711)
- RowsReturnedRate: 2.26 M/sec
- ScanRangesComplete: 29 (29)
- ScannerThreadsInvoluntaryContextSwitches: 44 (44)
- ScannerThreadsTotalWallClockTime: 15s223ms
- MaterializeTupleTime(*): 2s257ms
- ScannerThreadsSysTime: 271.058ms
- ScannerThreadsUserTime: 3s148ms
- ScannerThreadsVoluntaryContextSwitches: 3.34K (3338)
- TotalRawHdfsReadTime(*): 10.060ms
- TotalReadThroughput: 143.27 MB/sec
Filter 1 (8.00 MB):
- Rows processed: 10.33M (10331985)
- Rows rejected: 3.57M (3571189)
- Rows total: 11.56M (11559184)
Filter 2 (8.00 MB):
- Rows processed: 7.68M (7681788)
- Rows rejected: 5.77M (5766283)
- Rows total: 7.99M (7987995)
Fragment F04:
Instance 514ee9ab39cdc507:3f (host=cdh5.net.cuberonlabs.com:22000):(Total: 2s903ms, non-child: 673.619ms, % non-child: 23.20%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.36 GB
Filter 2 arrival: 1s242ms
Filter 1 arrival: 1s366ms
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 67.30 MB, 92.09 MB, 87.50 MB, 64.83 MB
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 3
- AverageThreadTokens: 7.33
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 106.99 MB (112184150)
- PerHostPeakMemUsage: 1.38 GB (1486351700)
- RowsProduced: 2.49M (2493270)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 12.025ms
- TotalStorageWaitTime: 172.829ms
- TotalThreadsInvoluntaryContextSwitches: 57 (57)
- TotalThreadsTotalWallClockTime: 21s297ms
- TotalThreadsSysTime: 544.000ms
- TotalThreadsUserTime: 5s532ms
- TotalThreadsVoluntaryContextSwitches: 4.49K (4486)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s795ms
- ExecTreeExecTime: 1s000ms
- OpenTime: 76.703ms
- ExecTreeOpenTime: 39.400us
- PrepareTime: 31.608ms
- ExecTreePrepareTime: 292.184us
DataStreamSender (dst_id=31):(Total: 1s126ms, non-child: 1s126ms, % non-child: 100.00%)
- BytesSent: 115.32 MB (120920318)
- NetworkThroughput(*): 267.07 MB/sec
- OverallThroughput: 102.40 MB/sec
- PeakMemoryUsage: 1.05 MB (1098744)
- RowsReturned: 2.49M (2493270)
- SerializeBatchTime: 693.750ms
- TransmitDataRPCTime: 431.789ms
- UncompressedRowBatchSize: 197.97 MB (207585567)
CodeGen:(Total: 104.630ms, non-child: 104.630ms, % non-child: 100.00%)
- CodegenTime: 1.377ms
- CompileTime: 14.073ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 32 (32)
- NumInstructions: 547 (547)
- OptimizationTime: 61.651ms
- PeakMemoryUsage: 273.50 KB (280064)
- PrepareTime: 28.200ms
HDFS_SCAN_NODE (id=4):(Total: 999.468ms, non-child: 999.468ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.36 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35
Runtime filters: Only following filters arrived: , waited 923ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:105
BytesRead(500.000ms): 0, 0, 122.16 MB, 245.06 MB, 350.17 MB, 456.00 MB
- FooterProcessingTime: (Avg: 13.338ms ; Min: 3.070ms ; Max: 45.345ms ; Number of samples: 35)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.33
- BytesRead: 456.00 MB (478151119)
- BytesReadDataNodeCache: 445.20 MB (466829804)
- BytesReadLocal: 456.00 MB (478151119)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 456.00 MB (478151119)
- DecompressionTime: 995.540ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 35 (35)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 89.76 MB (94118577)
- PerReadThreadRawHdfsThroughput: 34.20 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 58.846ms
- RowBatchQueuePutWaitTime: 10s321ms
- RowsRead: 13.95M (13952334)
- RowsReturned: 2.49M (2493270)
- RowsReturnedRate: 2.49 M/sec
- ScanRangesComplete: 35 (35)
- ScannerThreadsInvoluntaryContextSwitches: 52 (52)
- ScannerThreadsTotalWallClockTime: 18s425ms
- MaterializeTupleTime(*): 2s858ms
- ScannerThreadsSysTime: 328.000ms
- ScannerThreadsUserTime: 3s920ms
- ScannerThreadsVoluntaryContextSwitches: 3.81K (3815)
- TotalRawHdfsReadTime(*): 13.021ms
- TotalReadThroughput: 152.00 MB/sec
Filter 1 (8.00 MB):
- Rows processed: 12.72M (12723942)
- Rows rejected: 4.52M (4520695)
- Rows total: 13.95M (13952334)
Filter 2 (8.00 MB):
- Rows processed: 9.14M (9139799)
- Rows rejected: 6.94M (6938369)
- Rows total: 9.43M (9431639)
Instance 514ee9ab39cdc507:34 (host=cdh4.net.cuberonlabs.com:22000):(Total: 2s738ms, non-child: 660.950ms, % non-child: 24.14%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:40/3.59 GB
Filter 2 arrival: 1s183ms
Filter 1 arrival: 1s281ms
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 58.08 MB, 92.44 MB, 80.95 MB, 16.16 MB
ThreadUsage(500.000ms): 1, 10, 10, 10, 10, 1
- AverageThreadTokens: 7.00
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 105.45 MB (110570590)
- PerHostPeakMemUsage: 1.24 GB (1328686555)
- RowsProduced: 2.73M (2733568)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 14.978ms
- TotalStorageWaitTime: 195.240ms
- TotalThreadsInvoluntaryContextSwitches: 77 (77)
- TotalThreadsTotalWallClockTime: 19s937ms
- TotalThreadsSysTime: 600.000ms
- TotalThreadsUserTime: 5s608ms
- TotalThreadsVoluntaryContextSwitches: 4.87K (4870)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s635ms
- ExecTreeExecTime: 1s004ms
- OpenTime: 65.287ms
- ExecTreeOpenTime: 37.616us
- PrepareTime: 37.783ms
- ExecTreePrepareTime: 364.452us
DataStreamSender (dst_id=31):(Total: 975.151ms, non-child: 975.151ms, % non-child: 100.00%)
- BytesSent: 125.06 MB (131139844)
- NetworkThroughput(*): 386.32 MB/sec
- OverallThroughput: 128.25 MB/sec
- PeakMemoryUsage: 1.05 MB (1098744)
- RowsReturned: 2.73M (2733568)
- SerializeBatchTime: 650.868ms
- TransmitDataRPCTime: 323.729ms
- UncompressedRowBatchSize: 215.94 MB (226428167)
CodeGen:(Total: 99.175ms, non-child: 99.175ms, % non-child: 100.00%)
- CodegenTime: 1.222ms
- CompileTime: 12.312ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 32 (32)
- NumInstructions: 547 (547)
- OptimizationTime: 52.073ms
- PeakMemoryUsage: 273.50 KB (280064)
- PrepareTime: 34.226ms
HDFS_SCAN_NODE (id=4):(Total: 1s003ms, non-child: 1s003ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:40/3.59 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 40 out of 40
Runtime filters: Only following filters arrived: , waited 923ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:120
BytesRead(500.000ms): 0, 0, 113.98 MB, 237.68 MB, 411.45 MB
- FooterProcessingTime: (Avg: 11.433ms ; Min: 3.372ms ; Max: 53.866ms ; Number of samples: 40)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.20
- BytesRead: 483.40 MB (506880472)
- BytesReadDataNodeCache: 471.06 MB (493942344)
- BytesReadLocal: 483.40 MB (506880472)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 483.40 MB (506880472)
- DecompressionTime: 976.650ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 40 (40)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 88.16 MB (92440462)
- PerReadThreadRawHdfsThroughput: 31.94 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 64.414ms
- RowBatchQueuePutWaitTime: 8s872ms
- RowsRead: 15.04M (15041855)
- RowsReturned: 2.73M (2733568)
- RowsReturnedRate: 2.72 M/sec
- ScanRangesComplete: 40 (40)
- ScannerThreadsInvoluntaryContextSwitches: 76 (76)
- ScannerThreadsTotalWallClockTime: 17s237ms
- MaterializeTupleTime(*): 2s986ms
- ScannerThreadsSysTime: 416.000ms
- ScannerThreadsUserTime: 4s120ms
- ScannerThreadsVoluntaryContextSwitches: 4.16K (4161)
- TotalRawHdfsReadTime(*): 14.777ms
- TotalReadThroughput: 164.58 MB/sec
Filter 1 (8.00 MB):
- Rows processed: 14.01M (14011449)
- Rows rejected: 4.79M (4790698)
- Rows total: 15.04M (15041855)
Filter 2 (8.00 MB):
- Rows processed: 10.00M (10000277)
- Rows rejected: 7.52M (7517589)
- Rows total: 10.25M (10251157)
Instance 514ee9ab39cdc507:39 (host=cdh3.net.cuberonlabs.com:22000):(Total: 2s696ms, non-child: 745.042ms, % non-child: 27.63%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.39 GB
Filter 2 arrival: 1s175ms
Filter 1 arrival: 1s315ms
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 65.53 MB, 86.82 MB, 66.64 MB
ThreadUsage(500.000ms): 1, 9, 9, 9, 9
- AverageThreadTokens: 7.40
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 97.91 MB (102667266)
- PerHostPeakMemUsage: 1.12 GB (1198374937)
- RowsProduced: 2.71M (2705054)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 12.786ms
- TotalStorageWaitTime: 128.156ms
- TotalThreadsInvoluntaryContextSwitches: 31 (31)
- TotalThreadsTotalWallClockTime: 18s007ms
- TotalThreadsSysTime: 460.000ms
- TotalThreadsUserTime: 5s600ms
- TotalThreadsVoluntaryContextSwitches: 4.84K (4845)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s600ms
- ExecTreeExecTime: 997.055ms
- OpenTime: 67.374ms
- ExecTreeOpenTime: 41.188us
- PrepareTime: 28.266ms
- ExecTreePrepareTime: 278.856us
DataStreamSender (dst_id=31):(Total: 864.096ms, non-child: 864.096ms, % non-child: 100.00%)
- BytesSent: 123.28 MB (129265987)
- NetworkThroughput(*): 572.24 MB/sec
- OverallThroughput: 142.67 MB/sec
- PeakMemoryUsage: 1.02 MB (1065976)
- RowsReturned: 2.71M (2705054)
- SerializeBatchTime: 648.095ms
- TransmitDataRPCTime: 215.428ms
- UncompressedRowBatchSize: 213.51 MB (223877808)
CodeGen:(Total: 91.471ms, non-child: 91.471ms, % non-child: 100.00%)
- CodegenTime: 1.364ms
- CompileTime: 12.915ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 32 (32)
- NumInstructions: 547 (547)
- OptimizationTime: 53.367ms
- PeakMemoryUsage: 273.50 KB (280064)
- PrepareTime: 24.604ms
HDFS_SCAN_NODE (id=4):(Total: 995.884ms, non-child: 995.884ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.39 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35
Runtime filters: Only following filters arrived: , waited 927ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:105
BytesRead(500.000ms): 0, 0, 114.71 MB, 239.81 MB, 427.43 MB
- FooterProcessingTime: (Avg: 15.402ms ; Min: 3.359ms ; Max: 73.829ms ; Number of samples: 35)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.40
- BytesRead: 454.94 MB (477042646)
- BytesReadDataNodeCache: 444.14 MB (465717587)
- BytesReadLocal: 454.94 MB (477042646)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 454.94 MB (477042646)
- DecompressionTime: 902.956ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 35 (35)
- NumScannerThreadsStarted: 8 (8)
- PeakMemoryUsage: 80.90 MB (84832626)
- PerReadThreadRawHdfsThroughput: 34.96 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 53.969ms
- RowBatchQueuePutWaitTime: 7s497ms
- RowsRead: 14.44M (14439291)
- RowsReturned: 2.71M (2705054)
- RowsReturnedRate: 2.72 M/sec
- ScanRangesComplete: 35 (35)
- ScannerThreadsInvoluntaryContextSwitches: 29 (29)
- ScannerThreadsTotalWallClockTime: 15s339ms
- MaterializeTupleTime(*): 2s939ms
- ScannerThreadsSysTime: 316.000ms
- ScannerThreadsUserTime: 4s088ms
- ScannerThreadsVoluntaryContextSwitches: 4.14K (4143)
- TotalRawHdfsReadTime(*): 12.708ms
- TotalReadThroughput: 170.97 MB/sec
Filter 1 (8.00 MB):
- Rows processed: 13.18M (13184146)
- Rows rejected: 4.56M (4555952)
- Rows total: 14.44M (14439291)
Filter 2 (8.00 MB):
- Rows processed: 9.65M (9645771)
- Rows rejected: 7.18M (7178285)
- Rows total: 9.88M (9883339)
Instance 514ee9ab39cdc507:3e (host=cdh1.net.cuberonlabs.com:22000):(Total: 2s635ms, non-child: 599.141ms, % non-child: 22.73%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/2.99 GB
Filter 2 arrival: 1s185ms
Filter 1 arrival: 1s341ms
MemoryUsage(500.000ms): 334.49 KB, 62.31 KB, 2.27 MB, 77.31 MB, 68.63 MB, 55.44 MB
ThreadUsage(500.000ms): 1, 1, 8, 8, 8, 3
- AverageThreadTokens: 4.83
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 88.78 MB (93096546)
- PerHostPeakMemUsage: 1.19 GB (1275970066)
- RowsProduced: 2.34M (2336860)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 22.958ms
- TotalStorageWaitTime: 180.549ms
- TotalThreadsInvoluntaryContextSwitches: 30 (30)
- TotalThreadsTotalWallClockTime: 15s608ms
- TotalThreadsSysTime: 480.000ms
- TotalThreadsUserTime: 5s004ms
- TotalThreadsVoluntaryContextSwitches: 4.11K (4111)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s548ms
- ExecTreeExecTime: 1s025ms
- OpenTime: 61.212ms
- ExecTreeOpenTime: 37.100us
- PrepareTime: 25.463ms
- ExecTreePrepareTime: 372.712us
DataStreamSender (dst_id=31):(Total: 930.079ms, non-child: 930.079ms, % non-child: 100.00%)
- BytesSent: 106.67 MB (111848715)
- NetworkThroughput(*): 379.47 MB/sec
- OverallThroughput: 114.69 MB/sec
- PeakMemoryUsage: 1.05 MB (1098744)
- RowsReturned: 2.34M (2336860)
- SerializeBatchTime: 648.376ms
- TransmitDataRPCTime: 281.098ms
- UncompressedRowBatchSize: 184.59 MB (193553406)
CodeGen:(Total: 81.664ms, non-child: 81.664ms, % non-child: 100.00%)
- CodegenTime: 798.924us
- CompileTime: 10.997ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 32 (32)
- NumInstructions: 547 (547)
- OptimizationTime: 49.495ms
- PeakMemoryUsage: 273.50 KB (280064)
- PrepareTime: 20.720ms
HDFS_SCAN_NODE (id=4):(Total: 1s024ms, non-child: 1s024ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/2.99 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35
Runtime filters: Only following filters arrived: , waited 944ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:105
BytesRead(500.000ms): 0, 0, 700.00 KB, 116.79 MB, 292.41 MB, 403.52 MB
- FooterProcessingTime: (Avg: 13.986ms ; Min: 3.512ms ; Max: 72.248ms ; Number of samples: 35)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 4.60
- BytesRead: 403.52 MB (423122517)
- BytesReadDataNodeCache: 392.73 MB (411804248)
- BytesReadLocal: 403.52 MB (423122517)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 403.52 MB (423122517)
- DecompressionTime: 797.218ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 35 (35)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 71.69 MB (75171250)
- PerReadThreadRawHdfsThroughput: 32.08 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 65.796ms
- RowBatchQueuePutWaitTime: 5s681ms
- RowsRead: 12.55M (12550697)
- RowsReturned: 2.34M (2336860)
- RowsReturnedRate: 2.28 M/sec
- ScanRangesComplete: 35 (35)
- ScannerThreadsInvoluntaryContextSwitches: 26 (26)
- ScannerThreadsTotalWallClockTime: 12s998ms
- MaterializeTupleTime(*): 2s639ms
- ScannerThreadsSysTime: 352.000ms
- ScannerThreadsUserTime: 3s588ms
- ScannerThreadsVoluntaryContextSwitches: 3.50K (3496)
- TotalRawHdfsReadTime(*): 12.283ms
- TotalReadThroughput: 134.51 MB/sec
Filter 1 (8.00 MB):
- Rows processed: 11.57M (11574639)
- Rows rejected: 3.85M (3852025)
- Rows total: 12.55M (12550697)
Filter 2 (8.00 MB):
- Rows processed: 8.55M (8550192)
- Rows rejected: 6.36M (6361812)
- Rows total: 8.70M (8698672)
Instance 514ee9ab39cdc507:3b (host=cdh2.net.cuberonlabs.com:22000):(Total: 2s590ms, non-child: 661.203ms, % non-child: 25.52%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/3.00 GB
Filter 2 arrival: 1s182ms
Filter 1 arrival: 1s324ms
MemoryUsage(500.000ms): 334.49 KB, 62.31 KB, 14.01 MB, 92.36 MB, 94.59 MB, 16.14 MB
ThreadUsage(500.000ms): 1, 9, 10, 10, 10, 1
- AverageThreadTokens: 6.83
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 97.16 MB (101881340)
- PerHostPeakMemUsage: 1.14 GB (1223487800)
- RowsProduced: 2.38M (2378568)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 12.402ms
- TotalStorageWaitTime: 106.668ms
- TotalThreadsInvoluntaryContextSwitches: 27 (27)
- TotalThreadsTotalWallClockTime: 19s525ms
- TotalThreadsSysTime: 428.000ms
- TotalThreadsUserTime: 5s036ms
- TotalThreadsVoluntaryContextSwitches: 3.96K (3958)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s482ms
- ExecTreeExecTime: 985.345ms
- OpenTime: 76.289ms
- ExecTreeOpenTime: 45.912us
- PrepareTime: 31.672ms
- ExecTreePrepareTime: 317.280us
DataStreamSender (dst_id=31):(Total: 840.495ms, non-child: 840.495ms, % non-child: 100.00%)
- BytesSent: 108.53 MB (113802732)
- NetworkThroughput(*): 571.65 MB/sec
- OverallThroughput: 129.13 MB/sec
- PeakMemoryUsage: 1.05 MB (1098744)
- RowsReturned: 2.38M (2378568)
- SerializeBatchTime: 650.033ms
- TransmitDataRPCTime: 189.855ms
- UncompressedRowBatchSize: 187.72 MB (196835081)
CodeGen:(Total: 104.229ms, non-child: 104.229ms, % non-child: 100.00%)
- CodegenTime: 1.312ms
- CompileTime: 13.926ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 32 (32)
- NumInstructions: 547 (547)
- OptimizationTime: 61.307ms
- PeakMemoryUsage: 273.50 KB (280064)
- PrepareTime: 28.328ms
HDFS_SCAN_NODE (id=4):(Total: 984.515ms, non-child: 984.515ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/3.00 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32
Runtime filters: Only following filters arrived: , waited 924ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:96
BytesRead(500.000ms): 0, 0, 33.05 MB, 169.27 MB, 330.32 MB
- FooterProcessingTime: (Avg: 14.657ms ; Min: 3.089ms ; Max: 56.792ms ; Number of samples: 32)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 8.75
- BytesRead: 404.37 MB (424008438)
- BytesReadDataNodeCache: 394.49 MB (413655152)
- BytesReadLocal: 404.37 MB (424008438)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 404.37 MB (424008438)
- DecompressionTime: 836.483ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 32 (32)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 80.35 MB (84247929)
- PerReadThreadRawHdfsThroughput: 37.03 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 46.572ms
- RowBatchQueuePutWaitTime: 8s336ms
- RowsRead: 12.59M (12593336)
- RowsReturned: 2.38M (2378568)
- RowsReturnedRate: 2.42 M/sec
- ScanRangesComplete: 32 (32)
- ScannerThreadsInvoluntaryContextSwitches: 22 (22)
- ScannerThreadsTotalWallClockTime: 16s966ms
- MaterializeTupleTime(*): 2s560ms
- ScannerThreadsSysTime: 276.000ms
- ScannerThreadsUserTime: 3s624ms
- ScannerThreadsVoluntaryContextSwitches: 3.45K (3454)
- TotalRawHdfsReadTime(*): 10.665ms
- TotalReadThroughput: 132.13 MB/sec
Filter 1 (8.00 MB):
- Rows processed: 11.43M (11431091)
- Rows rejected: 3.83M (3834795)
- Rows total: 12.59M (12593336)
Filter 2 (8.00 MB):
- Rows processed: 8.54M (8542477)
- Rows rejected: 6.38M (6379973)
- Rows total: 8.76M (8758541)
Instance 514ee9ab39cdc507:41 (host=cdh8.net.cuberonlabs.com:22000):(Total: 2s576ms, non-child: 539.434ms, % non-child: 20.94%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.70 GB
Filter 2 arrival: 1s245ms
Filter 1 arrival: 1s367ms
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 100.93 MB, 89.16 MB, 77.99 MB
ThreadUsage(500.000ms): 1, 10, 10, 10, 6
- AverageThreadTokens: 7.40
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 101.00 MB (105905193)
- PerHostPeakMemUsage: 1.13 GB (1208346900)
- RowsProduced: 2.30M (2301609)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 14.827ms
- TotalStorageWaitTime: 139.351ms
- TotalThreadsInvoluntaryContextSwitches: 62 (62)
- TotalThreadsTotalWallClockTime: 19s229ms
- TotalThreadsSysTime: 420.000ms
- TotalThreadsUserTime: 4s332ms
- TotalThreadsVoluntaryContextSwitches: 4.11K (4111)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s455ms
- ExecTreeExecTime: 971.590ms
- OpenTime: 73.343ms
- ExecTreeOpenTime: 39.575us
- PrepareTime: 47.299ms
- ExecTreePrepareTime: 250.871us
DataStreamSender (dst_id=31):(Total: 950.453ms, non-child: 950.453ms, % non-child: 100.00%)
- BytesSent: 106.50 MB (111676941)
- NetworkThroughput(*): 305.35 MB/sec
- OverallThroughput: 112.06 MB/sec
- PeakMemoryUsage: 1.05 MB (1098744)
- RowsReturned: 2.30M (2301609)
- SerializeBatchTime: 601.062ms
- TransmitDataRPCTime: 348.787ms
- UncompressedRowBatchSize: 183.77 MB (192693719)
CodeGen:(Total: 115.543ms, non-child: 115.543ms, % non-child: 100.00%)
- CodegenTime: 2.066ms
- CompileTime: 12.723ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 32 (32)
- NumInstructions: 547 (547)
- OptimizationTime: 58.947ms
- PeakMemoryUsage: 273.50 KB (280064)
- PrepareTime: 42.838ms
HDFS_SCAN_NODE (id=4):(Total: 970.767ms, non-child: 970.767ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.70 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28
Runtime filters: Only following filters arrived: , waited 904ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:84
BytesRead(500.000ms): 0, 0, 120.62 MB, 256.39 MB, 362.83 MB
- FooterProcessingTime: (Avg: 14.339ms ; Min: 2.651ms ; Max: 62.240ms ; Number of samples: 28)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.40
- BytesRead: 362.83 MB (380457173)
- BytesReadDataNodeCache: 354.20 MB (371403734)
- BytesReadLocal: 362.83 MB (380457173)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 362.83 MB (380457173)
- DecompressionTime: 743.662ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 28 (28)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 83.96 MB (88037483)
- PerReadThreadRawHdfsThroughput: 43.55 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 51.098ms
- RowBatchQueuePutWaitTime: 8s762ms
- RowsRead: 11.39M (11388046)
- RowsReturned: 2.30M (2301609)
- RowsReturnedRate: 2.37 M/sec
- ScanRangesComplete: 28 (28)
- ScannerThreadsInvoluntaryContextSwitches: 60 (60)
- ScannerThreadsTotalWallClockTime: 16s700ms
- MaterializeTupleTime(*): 2s155ms
- ScannerThreadsSysTime: 260.000ms
- ScannerThreadsUserTime: 2s964ms
- ScannerThreadsVoluntaryContextSwitches: 3.57K (3571)
- TotalRawHdfsReadTime(*): 8.135ms
- TotalReadThroughput: 145.13 MB/sec
Filter 1 (8.00 MB):
- Rows processed: 10.05M (10048669)
- Rows rejected: 3.37M (3369959)
- Rows total: 11.39M (11388046)
Filter 2 (8.00 MB):
- Rows processed: 7.62M (7620775)
- Rows rejected: 5.72M (5716478)
- Rows total: 8.02M (8018087)
Instance 514ee9ab39cdc507:44 (host=cdh10.net.cuberonlabs.com:22000):(Total: 2s563ms, non-child: 573.246ms, % non-child: 22.37%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.75 GB
Filter 2 arrival: 1s278ms
Filter 1 arrival: 1s374ms
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 88.19 MB, 101.34 MB, 83.21 MB
ThreadUsage(500.000ms): 1, 10, 10, 10, 6
- AverageThreadTokens: 7.40
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 116.08 MB (121720253)
- PerHostPeakMemUsage: 1.16 GB (1241765271)
- RowsProduced: 2.20M (2203358)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 9.068ms
- TotalStorageWaitTime: 169.240ms
- TotalThreadsInvoluntaryContextSwitches: 190 (190)
- TotalThreadsTotalWallClockTime: 18s113ms
- TotalThreadsSysTime: 392.000ms
- TotalThreadsUserTime: 4s064ms
- TotalThreadsVoluntaryContextSwitches: 3.79K (3792)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s418ms
- ExecTreeExecTime: 948.116ms
- OpenTime: 98.963ms
- ExecTreeOpenTime: 50.128us
- PrepareTime: 45.929ms
- ExecTreePrepareTime: 466.204us
DataStreamSender (dst_id=31):(Total: 902.101ms, non-child: 902.101ms, % non-child: 100.00%)
- BytesSent: 102.11 MB (107067375)
- NetworkThroughput(*): 343.58 MB/sec
- OverallThroughput: 113.19 MB/sec
- PeakMemoryUsage: 1.05 MB (1098744)
- RowsReturned: 2.20M (2203358)
- SerializeBatchTime: 604.279ms
- TransmitDataRPCTime: 297.189ms
- UncompressedRowBatchSize: 175.81 MB (184350185)
CodeGen:(Total: 139.881ms, non-child: 139.881ms, % non-child: 100.00%)
- CodegenTime: 1.506ms
- CompileTime: 19.035ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 32 (32)
- NumInstructions: 547 (547)
- OptimizationTime: 78.561ms
- PeakMemoryUsage: 273.50 KB (280064)
- PrepareTime: 41.494ms
HDFS_SCAN_NODE (id=4):(Total: 947.794ms, non-child: 947.794ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.75 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30
Runtime filters: Only following filters arrived: , waited 884ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0%
File Formats: PARQUET/SNAPPY:90
BytesRead(500.000ms): 0, 0, 119.98 MB, 257.58 MB, 371.89 MB
- FooterProcessingTime: (Avg: 18.296ms ; Min: 2.880ms ; Max: 66.746ms ; Number of samples: 30)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.40
- BytesRead: 371.89 MB (389958203)
- BytesReadDataNodeCache: 362.64 MB (380253704)
- BytesReadLocal: 371.89 MB (389958203)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 371.89 MB (389958203)
- DecompressionTime: 664.765ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 30 (30)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 98.90 MB (103703766)
- PerReadThreadRawHdfsThroughput: 39.18 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 52.598ms
- RowBatchQueuePutWaitTime: 8s600ms
- RowsRead: 11.46M (11459388)
- RowsReturned: 2.20M (2203358)
- RowsReturnedRate: 2.32 M/sec
- ScanRangesComplete: 30 (30)
- ScannerThreadsInvoluntaryContextSwitches: 180 (180)
- ScannerThreadsTotalWallClockTime: 15s596ms
- MaterializeTupleTime(*): 1s912ms
- ScannerThreadsSysTime: 288.000ms
- ScannerThreadsUserTime: 2s616ms
- ScannerThreadsVoluntaryContextSwitches: 3.40K (3404)
- TotalRawHdfsReadTime(*): 9.268ms
- TotalReadThroughput: 148.76 MB/sec
Filter 1 (8.00 MB):
- Rows processed: 10.50M (10498359)
- Rows rejected: 3.69M (3691719)
- Rows total: 11.46M (11459388)
Filter 2 (8.00 MB):
- Rows processed: 7.34M (7339929)
- Rows rejected: 5.56M (5564311)
- Rows total: 7.77M (7767669)
Instance 514ee9ab39cdc507:3a (host=cdh17.net.cuberonlabs.com:22000):(Total: 2s520ms, non-child: 675.537ms, % non-child: 26.80%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.58 GB
Filter 2 arrival: 1s204ms
Filter 1 arrival: 1s325ms
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 55.97 MB, 81.09 MB, 87.67 MB
ThreadUsage(500.000ms): 1, 10, 10, 10, 9
- AverageThreadTokens: 8.00
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 101.20 MB (106116696)
- PerHostPeakMemUsage: 1.10 GB (1185118898)
- RowsProduced: 2.16M (2157672)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 17.831ms
- TotalStorageWaitTime: 147.238ms
- TotalThreadsInvoluntaryContextSwitches: 23 (23)
- TotalThreadsTotalWallClockTime: 18s001ms
- TotalThreadsSysTime: 368.000ms
- TotalThreadsUserTime: 4s600ms
- TotalThreadsVoluntaryContextSwitches: 3.73K (3732)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s412ms
- ExecTreeExecTime: 985.673ms
- OpenTime: 73.631ms
- ExecTreeOpenTime: 41.521us
- PrepareTime: 34.120ms
- ExecTreePrepareTime: 282.506us
DataStreamSender (dst_id=31):(Total: 756.253ms, non-child: 756.253ms, % non-child: 100.00%)
- BytesSent: 99.23 MB (104052737)
- NetworkThroughput(*): 551.79 MB/sec
- OverallThroughput: 131.22 MB/sec
- PeakMemoryUsage: 1.05 MB (1098744)
- RowsReturned: 2.16M (2157672)
- SerializeBatchTime: 575.913ms
- TransmitDataRPCTime: 179.836ms
- UncompressedRowBatchSize: 170.77 MB (179060553)
CodeGen:(Total: 103.940ms, non-child: 103.940ms, % non-child: 100.00%)
- CodegenTime: 1.283ms
- CompileTime: 13.787ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 32 (32)
- NumInstructions: 547 (547)
- OptimizationTime: 58.572ms
- PeakMemoryUsage: 273.50 KB (280064)
- PrepareTime: 30.910ms
HDFS_SCAN_NODE (id=4):(Total: 985.052ms, non-child: 985.052ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.58 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 26 out of 26
Runtime filters: Only following filters arrived: , waited 924ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:78
BytesRead(500.000ms): 0, 0, 126.10 MB, 233.31 MB, 348.22 MB
- FooterProcessingTime: (Avg: 14.258ms ; Min: 2.829ms ; Max: 49.622ms ; Number of samples: 26)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.00
- BytesRead: 348.22 MB (365131885)
- BytesReadDataNodeCache: 340.19 MB (356717112)
- BytesReadLocal: 348.22 MB (365131885)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 348.22 MB (365131885)
- DecompressionTime: 775.288ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 26 (26)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 84.18 MB (88274267)
- PerReadThreadRawHdfsThroughput: 33.84 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 49.556ms
- RowBatchQueuePutWaitTime: 8s323ms
- RowsRead: 10.92M (10919165)
- RowsReturned: 2.16M (2157672)
- RowsReturnedRate: 2.19 M/sec
- ScanRangesComplete: 26 (26)
- ScannerThreadsInvoluntaryContextSwitches: 20 (20)
- ScannerThreadsTotalWallClockTime: 15s514ms
- MaterializeTupleTime(*): 2s268ms
- ScannerThreadsSysTime: 240.000ms
- ScannerThreadsUserTime: 3s240ms
- ScannerThreadsVoluntaryContextSwitches: 3.12K (3122)
- TotalRawHdfsReadTime(*): 10.049ms
- TotalReadThroughput: 139.29 MB/sec
Filter 1 (8.00 MB):
- Rows processed: 9.79M (9790286)
- Rows rejected: 3.33M (3328545)
- Rows total: 10.92M (10919165)
Filter 2 (8.00 MB):
- Rows processed: 7.30M (7298780)
- Rows rejected: 5.43M (5432948)
- Rows total: 7.59M (7590620)
Instance 514ee9ab39cdc507:37 (host=cdh6.net.cuberonlabs.com:22000):(Total: 2s459ms, non-child: 613.694ms, % non-child: 24.95%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/2.89 GB
Filter 2 arrival: 1s176ms
Filter 1 arrival: 1s319ms
MemoryUsage(500.000ms): 334.49 KB, 62.31 KB, 8.47 MB, 88.34 MB, 83.63 MB
ThreadUsage(500.000ms): 1, 1, 10, 10, 10
- AverageThreadTokens: 6.40
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 101.08 MB (105986718)
- PerHostPeakMemUsage: 1.12 GB (1202239123)
- RowsProduced: 2.27M (2274652)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 15.768ms
- TotalStorageWaitTime: 176.283ms
- TotalThreadsInvoluntaryContextSwitches: 28 (28)
- TotalThreadsTotalWallClockTime: 17s490ms
- TotalThreadsSysTime: 432.000ms
- TotalThreadsUserTime: 4s652ms
- TotalThreadsVoluntaryContextSwitches: 3.88K (3884)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s359ms
- ExecTreeExecTime: 1s002ms
- OpenTime: 71.529ms
- ExecTreeOpenTime: 35.336us
- PrepareTime: 28.933ms
- ExecTreePrepareTime: 303.304us
DataStreamSender (dst_id=31):(Total: 748.363ms, non-child: 748.363ms, % non-child: 100.00%)
- BytesSent: 103.58 MB (108608715)
- NetworkThroughput(*): 605.18 MB/sec
- OverallThroughput: 138.41 MB/sec
- PeakMemoryUsage: 1.05 MB (1098744)
- RowsReturned: 2.27M (2274652)
- SerializeBatchTime: 576.658ms
- TransmitDataRPCTime: 171.152ms
- UncompressedRowBatchSize: 179.30 MB (188014357)
CodeGen:(Total: 96.251ms, non-child: 96.251ms, % non-child: 100.00%)
- CodegenTime: 1.292ms
- CompileTime: 13.202ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 32 (32)
- NumInstructions: 547 (547)
- OptimizationTime: 57.519ms
- PeakMemoryUsage: 273.50 KB (280064)
- PrepareTime: 24.934ms
HDFS_SCAN_NODE (id=4):(Total: 1s001ms, non-child: 1s001ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/2.89 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32
Runtime filters: Only following filters arrived: , waited 923ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:96
BytesRead(500.000ms): 0, 0, 53.20 MB, 185.52 MB, 355.23 MB
- FooterProcessingTime: (Avg: 14.196ms ; Min: 2.877ms ; Max: 61.234ms ; Number of samples: 32)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.75
- BytesRead: 390.94 MB (409928073)
- BytesReadDataNodeCache: 381.07 MB (399577346)
- BytesReadLocal: 390.94 MB (409928073)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 390.94 MB (409928073)
- DecompressionTime: 782.762ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 32 (32)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 83.72 MB (87787375)
- PerReadThreadRawHdfsThroughput: 44.41 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 66.226ms
- RowBatchQueuePutWaitTime: 7s510ms
- RowsRead: 12.15M (12150960)
- RowsReturned: 2.27M (2274652)
- RowsReturnedRate: 2.27 M/sec
- ScanRangesComplete: 32 (32)
- ScannerThreadsInvoluntaryContextSwitches: 21 (21)
- ScannerThreadsTotalWallClockTime: 15s059ms
- MaterializeTupleTime(*): 2s407ms
- ScannerThreadsSysTime: 300.000ms
- ScannerThreadsUserTime: 3s364ms
- ScannerThreadsVoluntaryContextSwitches: 3.21K (3214)
- TotalRawHdfsReadTime(*): 8.595ms
- TotalReadThroughput: 142.09 MB/sec
Filter 1 (8.00 MB):
- Rows processed: 10.92M (10922816)
- Rows rejected: 3.81M (3808558)
- Rows total: 12.15M (12150960)
Filter 2 (8.00 MB):
- Rows processed: 8.12M (8119170)
- Rows rejected: 6.07M (6067750)
- Rows total: 8.34M (8342402)
Instance 514ee9ab39cdc507:40 (host=cdh7.net.cuberonlabs.com:22000):(Total: 2s447ms, non-child: 503.545ms, % non-child: 20.57%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:27/2.46 GB
Filter 2 arrival: 1s232ms
Filter 1 arrival: 1s378ms
MemoryUsage(500.000ms): 334.49 KB, 62.31 KB, 7.66 MB, 90.08 MB, 82.52 MB
ThreadUsage(500.000ms): 1, 9, 10, 10, 10
- AverageThreadTokens: 8.00
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 104.44 MB (109515662)
- PerHostPeakMemUsage: 1.11 GB (1196289976)
- RowsProduced: 2.07M (2065360)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 18.971ms
- TotalStorageWaitTime: 335.720ms
- TotalThreadsInvoluntaryContextSwitches: 115 (115)
- TotalThreadsTotalWallClockTime: 17s797ms
- TotalThreadsSysTime: 416.000ms
- TotalThreadsUserTime: 4s308ms
- TotalThreadsVoluntaryContextSwitches: 4.09K (4091)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s331ms
- ExecTreeExecTime: 995.729ms
- OpenTime: 80.687ms
- ExecTreeOpenTime: 42.046us
- PrepareTime: 35.068ms
- ExecTreePrepareTime: 292.340us
DataStreamSender (dst_id=31):(Total: 837.499ms, non-child: 837.499ms, % non-child: 100.00%)
- BytesSent: 94.83 MB (99432439)
- NetworkThroughput(*): 286.50 MB/sec
- OverallThroughput: 113.23 MB/sec
- PeakMemoryUsage: 1.05 MB (1098744)
- RowsReturned: 2.07M (2065360)
- SerializeBatchTime: 506.040ms
- TransmitDataRPCTime: 330.984ms
- UncompressedRowBatchSize: 164.14 MB (172117913)
CodeGen:(Total: 111.516ms, non-child: 111.516ms, % non-child: 100.00%)
- CodegenTime: 1.531ms
- CompileTime: 14.397ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 32 (32)
- NumInstructions: 547 (547)
- OptimizationTime: 65.014ms
- PeakMemoryUsage: 273.50 KB (280064)
- PrepareTime: 31.325ms
HDFS_SCAN_NODE (id=4):(Total: 995.100ms, non-child: 995.100ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:27/2.46 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 27 out of 27
Runtime filters: Only following filters arrived: , waited 924ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:81
BytesRead(500.000ms): 0, 0, 76.60 MB, 145.04 MB, 303.30 MB
- FooterProcessingTime: (Avg: 19.756ms ; Min: 3.067ms ; Max: 105.169ms ; Number of samples: 27)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 8.75
- BytesRead: 331.18 MB (347264442)
- BytesReadDataNodeCache: 322.86 MB (338539012)
- BytesReadLocal: 331.18 MB (347264442)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 331.18 MB (347264442)
- DecompressionTime: 768.852ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 27 (27)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 87.33 MB (91574953)
- PerReadThreadRawHdfsThroughput: 40.30 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 57.167ms
- RowBatchQueuePutWaitTime: 6s517ms
- RowsRead: 10.29M (10293228)
- RowsReturned: 2.07M (2065360)
- RowsReturnedRate: 2.08 M/sec
- ScanRangesComplete: 27 (27)
- ScannerThreadsInvoluntaryContextSwitches: 105 (105)
- ScannerThreadsTotalWallClockTime: 15s384ms
- MaterializeTupleTime(*): 2s269ms
- ScannerThreadsSysTime: 280.000ms
- ScannerThreadsUserTime: 3s064ms
- ScannerThreadsVoluntaryContextSwitches: 3.27K (3271)
- TotalRawHdfsReadTime(*): 8.024ms
- TotalReadThroughput: 121.32 MB/sec
Filter 1 (8.00 MB):
- Rows processed: 8.91M (8909474)
- Rows rejected: 2.93M (2928028)
- Rows total: 10.29M (10293228)
Filter 2 (8.00 MB):
- Rows processed: 7.04M (7041616)
- Rows rejected: 5.30M (5299840)
- Rows total: 7.37M (7365200)
Instance 514ee9ab39cdc507:43 (host=cdh9.net.cuberonlabs.com:22000):(Total: 2s438ms, non-child: 565.029ms, % non-child: 23.17%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/3.02 GB
Filter 2 arrival: 1s253ms
Filter 1 arrival: 1s370ms
MemoryUsage(500.000ms): 334.49 KB, 62.31 KB, 8.42 MB, 85.30 MB, 80.66 MB
ThreadUsage(500.000ms): 1, 9, 10, 10, 10
- AverageThreadTokens: 8.00
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 97.75 MB (102496077)
- PerHostPeakMemUsage: 1.14 GB (1228248750)
- RowsProduced: 2.54M (2540173)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 18.063ms
- TotalStorageWaitTime: 87.061ms
- TotalThreadsInvoluntaryContextSwitches: 12 (12)
- TotalThreadsTotalWallClockTime: 18s373ms
- TotalThreadsSysTime: 324.000ms
- TotalThreadsUserTime: 4s756ms
- TotalThreadsVoluntaryContextSwitches: 4.33K (4332)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s326ms
- ExecTreeExecTime: 973.536ms
- OpenTime: 78.648ms
- ExecTreeOpenTime: 42.455us
- PrepareTime: 33.332ms
- ExecTreePrepareTime: 334.133us
DataStreamSender (dst_id=31):(Total: 792.071ms, non-child: 792.071ms, % non-child: 100.00%)
- BytesSent: 117.66 MB (123373300)
- NetworkThroughput(*): 618.18 MB/sec
- OverallThroughput: 148.54 MB/sec
- PeakMemoryUsage: 1.02 MB (1065976)
- RowsReturned: 2.54M (2540173)
- SerializeBatchTime: 601.158ms
- TransmitDataRPCTime: 190.330ms
- UncompressedRowBatchSize: 202.52 MB (212361693)
CodeGen:(Total: 107.974ms, non-child: 107.974ms, % non-child: 100.00%)
- CodegenTime: 1.436ms
- CompileTime: 14.389ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 32 (32)
- NumInstructions: 547 (547)
- OptimizationTime: 63.154ms
- PeakMemoryUsage: 273.50 KB (280064)
- PrepareTime: 29.725ms
HDFS_SCAN_NODE (id=4):(Total: 973.028ms, non-child: 973.028ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/3.02 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31
Runtime filters: Only following filters arrived: , waited 923ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:93
BytesRead(500.000ms): 0, 0, 28.85 MB, 168.43 MB, 393.09 MB
- FooterProcessingTime: (Avg: 13.276ms ; Min: 2.899ms ; Max: 47.455ms ; Number of samples: 31)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 8.75
- BytesRead: 407.14 MB (426915606)
- BytesReadDataNodeCache: 397.58 MB (416888203)
- BytesReadLocal: 407.14 MB (426915606)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 407.14 MB (426915606)
- DecompressionTime: 755.764ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 31 (31)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 80.89 MB (84818613)
- PerReadThreadRawHdfsThroughput: 38.55 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 37.815ms
- RowBatchQueuePutWaitTime: 7s682ms
- RowsRead: 12.71M (12711965)
- RowsReturned: 2.54M (2540173)
- RowsReturnedRate: 2.61 M/sec
- ScanRangesComplete: 31 (31)
- ScannerThreadsInvoluntaryContextSwitches: 11 (11)
- ScannerThreadsTotalWallClockTime: 15s968ms
- MaterializeTupleTime(*): 2s413ms
- ScannerThreadsSysTime: 236.000ms
- ScannerThreadsUserTime: 3s428ms
- ScannerThreadsVoluntaryContextSwitches: 3.62K (3618)
- TotalRawHdfsReadTime(*): 10.313ms
- TotalReadThroughput: 157.24 MB/sec
Filter 1 (8.00 MB):
- Rows processed: 11.32M (11317517)
- Rows rejected: 3.75M (3745695)
- Rows total: 12.71M (12711965)
Filter 2 (8.00 MB):
- Rows processed: 8.55M (8549502)
- Rows rejected: 6.43M (6426097)
- Rows total: 8.97M (8966270)
Instance 514ee9ab39cdc507:35 (host=cdh16.net.cuberonlabs.com:22000):(Total: 2s315ms, non-child: 483.680ms, % non-child: 20.89%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.64 GB
Filter 2 arrival: 1s228ms
Filter 1 arrival: 1s322ms
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 91.80 MB, 84.44 MB
ThreadUsage(500.000ms): 1, 10, 10, 10
- AverageThreadTokens: 7.75
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 98.24 MB (103010051)
- PerHostPeakMemUsage: 1.12 GB (1206706067)
- RowsProduced: 2.15M (2149394)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 16.808ms
- TotalStorageWaitTime: 181.040ms
- TotalThreadsInvoluntaryContextSwitches: 10 (10)
- TotalThreadsTotalWallClockTime: 15s897ms
- TotalThreadsSysTime: 304.000ms
- TotalThreadsUserTime: 4s096ms
- TotalThreadsVoluntaryContextSwitches: 3.49K (3487)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s205ms
- ExecTreeExecTime: 967.844ms
- OpenTime: 76.892ms
- ExecTreeOpenTime: 40.505us
- PrepareTime: 32.959ms
- ExecTreePrepareTime: 237.637us
DataStreamSender (dst_id=31):(Total: 758.788ms, non-child: 758.788ms, % non-child: 100.00%)
- BytesSent: 99.38 MB (104202598)
- NetworkThroughput(*): 514.76 MB/sec
- OverallThroughput: 130.97 MB/sec
- PeakMemoryUsage: 1.05 MB (1098744)
- RowsReturned: 2.15M (2149394)
- SerializeBatchTime: 565.191ms
- TransmitDataRPCTime: 193.050ms
- UncompressedRowBatchSize: 170.94 MB (179239272)
CodeGen:(Total: 106.191ms, non-child: 106.191ms, % non-child: 100.00%)
- CodegenTime: 1.428ms
- CompileTime: 13.981ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 32 (32)
- NumInstructions: 547 (547)
- OptimizationTime: 61.855ms
- PeakMemoryUsage: 273.50 KB (280064)
- PrepareTime: 29.616ms
HDFS_SCAN_NODE (id=4):(Total: 967.112ms, non-child: 967.112ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.64 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28
Runtime filters: Only following filters arrived: , waited 923ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:84
BytesRead(500.000ms): 0, 0, 125.80 MB, 299.26 MB
- FooterProcessingTime: (Avg: 13.192ms ; Min: 2.890ms ; Max: 54.360ms ; Number of samples: 28)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.75
- BytesRead: 355.65 MB (372923733)
- BytesReadDataNodeCache: 347.01 MB (363866796)
- BytesReadLocal: 355.65 MB (372923733)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 355.65 MB (372923733)
- DecompressionTime: 698.464ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 28 (28)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 81.01 MB (84943509)
- PerReadThreadRawHdfsThroughput: 31.82 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 33.702ms
- RowBatchQueuePutWaitTime: 6s752ms
- RowsRead: 11.05M (11051815)
- RowsReturned: 2.15M (2149394)
- RowsReturnedRate: 2.22 M/sec
- ScanRangesComplete: 28 (28)
- ScannerThreadsInvoluntaryContextSwitches: 9 (9)
- ScannerThreadsTotalWallClockTime: 13s614ms
- MaterializeTupleTime(*): 1s970ms
- ScannerThreadsSysTime: 224.000ms
- ScannerThreadsUserTime: 2s872ms
- ScannerThreadsVoluntaryContextSwitches: 3.06K (3065)
- TotalRawHdfsReadTime(*): 10.914ms
- TotalReadThroughput: 149.63 MB/sec
Filter 1 (8.00 MB):
- Rows processed: 9.84M (9841992)
- Rows rejected: 3.38M (3382474)
- Rows total: 11.05M (11051815)
Filter 2 (8.00 MB):
- Rows processed: 7.32M (7316765)
- Rows rejected: 5.52M (5519947)
- Rows total: 7.67M (7669341)
Instance 514ee9ab39cdc507:36 (host=cdh13.net.cuberonlabs.com:22000):(Total: 2s287ms, non-child: 545.263ms, % non-child: 23.83%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/2.80 GB
Filter 2 arrival: 1s183ms
Filter 1 arrival: 1s313ms
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 83.95 MB, 91.20 MB
ThreadUsage(500.000ms): 1, 10, 10, 10
- AverageThreadTokens: 7.75
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 107.30 MB (112511598)
- PerHostPeakMemUsage: 1.13 GB (1212995919)
- RowsProduced: 2.12M (2116190)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 6.925ms
- TotalStorageWaitTime: 125.046ms
- TotalThreadsInvoluntaryContextSwitches: 29 (29)
- TotalThreadsTotalWallClockTime: 15s871ms
- TotalThreadsSysTime: 356.000ms
- TotalThreadsUserTime: 4s248ms
- TotalThreadsVoluntaryContextSwitches: 3.90K (3904)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s176ms
- ExecTreeExecTime: 975.677ms
- OpenTime: 77.271ms
- ExecTreeOpenTime: 43.291us
- PrepareTime: 34.427ms
- ExecTreePrepareTime: 414.211us
DataStreamSender (dst_id=31):(Total: 659.919ms, non-child: 659.919ms, % non-child: 100.00%)
- BytesSent: 97.56 MB (102301510)
- NetworkThroughput(*): 648.29 MB/sec
- OverallThroughput: 147.84 MB/sec
- PeakMemoryUsage: 1.05 MB (1098744)
- RowsReturned: 2.12M (2116190)
- SerializeBatchTime: 508.960ms
- TransmitDataRPCTime: 150.492ms
- UncompressedRowBatchSize: 168.16 MB (176327357)
CodeGen:(Total: 107.355ms, non-child: 107.355ms, % non-child: 100.00%)
- CodegenTime: 1.338ms
- CompileTime: 13.950ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 32 (32)
- NumInstructions: 547 (547)
- OptimizationTime: 62.183ms
- PeakMemoryUsage: 273.50 KB (280064)
- PrepareTime: 30.468ms
HDFS_SCAN_NODE (id=4):(Total: 975.257ms, non-child: 975.257ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/2.80 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31
Runtime filters: Only following filters arrived: , waited 924ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:93
BytesRead(500.000ms): 0, 0, 114.22 MB, 298.80 MB
- FooterProcessingTime: (Avg: 12.148ms ; Min: 2.607ms ; Max: 47.645ms ; Number of samples: 31)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.75
- BytesRead: 379.46 MB (397894562)
- BytesReadDataNodeCache: 369.90 MB (387872500)
- BytesReadLocal: 379.46 MB (397894562)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 379.46 MB (397894562)
- DecompressionTime: 713.376ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 31 (31)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 89.99 MB (94365110)
- PerReadThreadRawHdfsThroughput: 38.90 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 40.998ms
- RowBatchQueuePutWaitTime: 6s263ms
- RowsRead: 11.68M (11677391)
- RowsReturned: 2.12M (2116190)
- RowsReturnedRate: 2.17 M/sec
- ScanRangesComplete: 31 (31)
- ScannerThreadsInvoluntaryContextSwitches: 24 (24)
- ScannerThreadsTotalWallClockTime: 13s618ms
- MaterializeTupleTime(*): 2s207ms
- ScannerThreadsSysTime: 224.000ms
- ScannerThreadsUserTime: 3s108ms
- ScannerThreadsVoluntaryContextSwitches: 3.35K (3347)
- TotalRawHdfsReadTime(*): 9.525ms
- TotalReadThroughput: 149.40 MB/sec
Filter 1 (8.00 MB):
- Rows processed: 10.44M (10444627)
- Rows rejected: 3.95M (3945787)
- Rows total: 11.68M (11677391)
Filter 2 (8.00 MB):
- Rows processed: 7.47M (7474580)
- Rows rejected: 5.62M (5615414)
- Rows total: 7.73M (7731604)
Instance 514ee9ab39cdc507:3c (host=cdh12.net.cuberonlabs.com:22000):(Total: 2s253ms, non-child: 427.952ms, % non-child: 18.99%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:20/1.81 GB
Filter 2 arrival: 1s255ms
Filter 1 arrival: 1s392ms
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 57.48 MB, 83.97 MB
ThreadUsage(500.000ms): 1, 10, 10, 10
- AverageThreadTokens: 7.75
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 107.91 MB (113150469)
- PerHostPeakMemUsage: 1.12 GB (1201773720)
- RowsProduced: 1.69M (1692231)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 7.149ms
- TotalStorageWaitTime: 96.740ms
- TotalThreadsInvoluntaryContextSwitches: 14 (14)
- TotalThreadsTotalWallClockTime: 16s813ms
- TotalThreadsSysTime: 324.000ms
- TotalThreadsUserTime: 3s288ms
- TotalThreadsVoluntaryContextSwitches: 3.33K (3330)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s134ms
- ExecTreeExecTime: 957.231ms
- OpenTime: 81.364ms
- ExecTreeOpenTime: 43.704us
- PrepareTime: 38.305ms
- ExecTreePrepareTime: 238.994us
DataStreamSender (dst_id=31):(Total: 753.685ms, non-child: 753.685ms, % non-child: 100.00%)
- BytesSent: 78.55 MB (82369455)
- NetworkThroughput(*): 264.31 MB/sec
- OverallThroughput: 104.23 MB/sec
- PeakMemoryUsage: 984.99 KB (1008632)
- RowsReturned: 1.69M (1692231)
- SerializeBatchTime: 456.039ms
- TransmitDataRPCTime: 297.203ms
- UncompressedRowBatchSize: 135.17 MB (141731854)
CodeGen:(Total: 115.657ms, non-child: 115.657ms, % non-child: 100.00%)
- CodegenTime: 1.642ms
- CompileTime: 14.611ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 32 (32)
- NumInstructions: 547 (547)
- OptimizationTime: 65.450ms
- PeakMemoryUsage: 273.50 KB (280064)
- PrepareTime: 34.738ms
HDFS_SCAN_NODE (id=4):(Total: 956.581ms, non-child: 956.581ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:20/1.81 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 20 out of 20
Runtime filters: Only following filters arrived: , waited 904ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0%
File Formats: PARQUET/SNAPPY:60
BytesRead(500.000ms): 0, 0, 125.52 MB, 213.01 MB
- FooterProcessingTime: (Avg: 25.096ms ; Min: 3.239ms ; Max: 63.428ms ; Number of samples: 20)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.75
- BytesRead: 244.33 MB (256195759)
- BytesReadDataNodeCache: 238.16 MB (249727072)
- BytesReadLocal: 244.33 MB (256195759)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 244.33 MB (256195759)
- DecompressionTime: 571.883ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 20 (20)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 90.61 MB (95013829)
- PerReadThreadRawHdfsThroughput: 32.63 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 40.796ms
- RowBatchQueuePutWaitTime: 6s726ms
- RowsRead: 7.62M (7619211)
- RowsReturned: 1.69M (1692231)
- RowsReturnedRate: 1.77 M/sec
- ScanRangesComplete: 20 (20)
- ScannerThreadsInvoluntaryContextSwitches: 12 (12)
- ScannerThreadsTotalWallClockTime: 14s597ms
- MaterializeTupleTime(*): 1s597ms
- ScannerThreadsSysTime: 184.000ms
- ScannerThreadsUserTime: 2s200ms
- ScannerThreadsVoluntaryContextSwitches: 2.71K (2706)
- TotalRawHdfsReadTime(*): 7.312ms
- TotalReadThroughput: 106.50 MB/sec
Filter 1 (8.00 MB):
- Rows processed: 6.18M (6175108)
- Rows rejected: 2.08M (2077633)
- Rows total: 7.62M (7619211)
Filter 2 (8.00 MB):
- Rows processed: 5.15M (5149386)
- Rows rejected: 3.85M (3849347)
- Rows total: 5.54M (5541578)
Instance 514ee9ab39cdc507:42 (host=cdh11.net.cuberonlabs.com:22000):(Total: 2s219ms, non-child: 479.643ms, % non-child: 21.61%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:21/2.18 GB
Filter 2 arrival: 1s253ms
Filter 1 arrival: 1s368ms
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 106.55 MB, 105.27 MB
ThreadUsage(500.000ms): 1, 10, 10, 10
- AverageThreadTokens: 7.75
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 109.01 MB (114300249)
- PerHostPeakMemUsage: 1.13 GB (1213483033)
- RowsProduced: 1.82M (1815269)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 5.498ms
- TotalStorageWaitTime: 97.344ms
- TotalThreadsInvoluntaryContextSwitches: 20 (20)
- TotalThreadsTotalWallClockTime: 16s478ms
- TotalThreadsSysTime: 312.000ms
- TotalThreadsUserTime: 3s552ms
- TotalThreadsVoluntaryContextSwitches: 3.10K (3099)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s103ms
- ExecTreeExecTime: 982.167ms
- OpenTime: 80.595ms
- ExecTreeOpenTime: 47.578us
- PrepareTime: 35.571ms
- ExecTreePrepareTime: 305.007us
DataStreamSender (dst_id=31):(Total: 646.700ms, non-child: 646.700ms, % non-child: 100.00%)
- BytesSent: 84.17 MB (88259837)
- NetworkThroughput(*): 573.90 MB/sec
- OverallThroughput: 130.15 MB/sec
- PeakMemoryUsage: 1.05 MB (1098744)
- RowsReturned: 1.82M (1815269)
- SerializeBatchTime: 499.527ms
- TransmitDataRPCTime: 146.665ms
- UncompressedRowBatchSize: 144.71 MB (151735864)
CodeGen:(Total: 111.697ms, non-child: 111.697ms, % non-child: 100.00%)
- CodegenTime: 1.485ms
- CompileTime: 14.747ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 32 (32)
- NumInstructions: 547 (547)
- OptimizationTime: 64.638ms
- PeakMemoryUsage: 273.50 KB (280064)
- PrepareTime: 31.552ms
HDFS_SCAN_NODE (id=4):(Total: 981.880ms, non-child: 981.880ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:21/2.18 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 21 out of 21
Runtime filters: Only following filters arrived: , waited 923ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0%
File Formats: PARQUET/SNAPPY:63
BytesRead(500.000ms): 0, 0, 126.17 MB, 295.08 MB
- FooterProcessingTime: (Avg: 15.731ms ; Min: 2.930ms ; Max: 43.360ms ; Number of samples: 21)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.75
- BytesRead: 295.08 MB (309412485)
- BytesReadDataNodeCache: 288.60 MB (302617091)
- BytesReadLocal: 295.08 MB (309412485)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 295.08 MB (309412485)
- DecompressionTime: 619.220ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 21 (21)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 92.00 MB (96468568)
- PerReadThreadRawHdfsThroughput: 42.25 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 46.960ms
- RowBatchQueuePutWaitTime: 6s478ms
- RowsRead: 8.99M (8989956)
- RowsReturned: 1.82M (1815269)
- RowsReturnedRate: 1.85 M/sec
- ScanRangesComplete: 21 (21)
- ScannerThreadsInvoluntaryContextSwitches: 20 (20)
- ScannerThreadsTotalWallClockTime: 14s294ms
- MaterializeTupleTime(*): 1s718ms
- ScannerThreadsSysTime: 228.000ms
- ScannerThreadsUserTime: 2s432ms
- ScannerThreadsVoluntaryContextSwitches: 2.69K (2685)
- TotalRawHdfsReadTime(*): 6.820ms
- TotalReadThroughput: 147.54 MB/sec
Filter 1 (8.00 MB):
- Rows processed: 7.71M (7705493)
- Rows rejected: 2.78M (2781853)
- Rows total: 8.99M (8989956)
Filter 2 (8.00 MB):
- Rows processed: 5.85M (5854823)
- Rows rejected: 4.39M (4392834)
- Rows total: 6.21M (6208103)
Instance 514ee9ab39cdc507:38 (host=cdh15.net.cuberonlabs.com:22000):(Total: 2s209ms, non-child: 486.983ms, % non-child: 22.04%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.66 GB
Filter 2 arrival: 1s176ms
Filter 1 arrival: 1s311ms
MemoryUsage(500.000ms): 52.99 KB, 62.31 KB, 86.31 KB, 77.44 MB, 84.29 MB
ThreadUsage(500.000ms): 1, 1, 10, 10, 10
- AverageThreadTokens: 6.40
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 104.37 MB (109435945)
- PerHostPeakMemUsage: 1.12 GB (1205171847)
- RowsProduced: 2.05M (2047960)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 6.485ms
- TotalStorageWaitTime: 101.473ms
- TotalThreadsInvoluntaryContextSwitches: 75 (75)
- TotalThreadsTotalWallClockTime: 16s040ms
- TotalThreadsSysTime: 356.000ms
- TotalThreadsUserTime: 3s932ms
- TotalThreadsVoluntaryContextSwitches: 3.36K (3364)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s092ms
- ExecTreeExecTime: 955.363ms
- OpenTime: 81.031ms
- ExecTreeOpenTime: 42.805us
- PrepareTime: 36.086ms
- ExecTreePrepareTime: 290.026us
DataStreamSender (dst_id=31):(Total: 654.227ms, non-child: 654.227ms, % non-child: 100.00%)
- BytesSent: 92.99 MB (97511479)
- NetworkThroughput(*): 591.91 MB/sec
- OverallThroughput: 142.14 MB/sec
- PeakMemoryUsage: 1.05 MB (1098744)
- RowsReturned: 2.05M (2047960)
- SerializeBatchTime: 496.665ms
- TransmitDataRPCTime: 157.109ms
- UncompressedRowBatchSize: 161.35 MB (169190904)
CodeGen:(Total: 113.108ms, non-child: 113.108ms, % non-child: 100.00%)
- CodegenTime: 1.548ms
- CompileTime: 14.605ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 32 (32)
- NumInstructions: 547 (547)
- OptimizationTime: 65.430ms
- PeakMemoryUsage: 273.50 KB (280064)
- PrepareTime: 32.294ms
HDFS_SCAN_NODE (id=4):(Total: 954.854ms, non-child: 954.854ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.66 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30
Runtime filters: Only following filters arrived: , waited 904ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:90
BytesRead(500.000ms): 0, 0, 300.00 KB, 167.42 MB, 359.86 MB
- FooterProcessingTime: (Avg: 17.012ms ; Min: 2.770ms ; Max: 65.700ms ; Number of samples: 30)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.75
- BytesRead: 359.86 MB (377336639)
- BytesReadDataNodeCache: 350.60 MB (367631328)
- BytesReadLocal: 359.86 MB (377336639)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 359.86 MB (377336639)
- DecompressionTime: 668.942ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 30 (30)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 87.23 MB (91468692)
- PerReadThreadRawHdfsThroughput: 34.17 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 41.277ms
- RowBatchQueuePutWaitTime: 6s170ms
- RowsRead: 11.11M (11113210)
- RowsReturned: 2.05M (2047960)
- RowsReturnedRate: 2.14 M/sec
- ScanRangesComplete: 30 (30)
- ScannerThreadsInvoluntaryContextSwitches: 74 (74)
- ScannerThreadsTotalWallClockTime: 13s867ms
- MaterializeTupleTime(*): 1s985ms
- ScannerThreadsSysTime: 268.000ms
- ScannerThreadsUserTime: 2s804ms
- ScannerThreadsVoluntaryContextSwitches: 2.98K (2977)
- TotalRawHdfsReadTime(*): 10.284ms
- TotalReadThroughput: 143.94 MB/sec
Filter 1 (8.00 MB):
- Rows processed: 9.73M (9727261)
- Rows rejected: 3.53M (3526130)
- Rows total: 11.11M (11113210)
Filter 2 (8.00 MB):
- Rows processed: 7.34M (7342879)
- Rows rejected: 5.54M (5539120)
- Rows total: 7.59M (7587080)
Instance 514ee9ab39cdc507:3d (host=cdh14.net.cuberonlabs.com:22000):(Total: 2s121ms, non-child: 467.589ms, % non-child: 22.04%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:22/2.04 GB
Filter 2 arrival: 1s238ms
Filter 1 arrival: 1s344ms
MemoryUsage(500.000ms): 62.31 KB, 62.31 KB, 68.30 MB, 87.90 MB
ThreadUsage(500.000ms): 1, 10, 10, 10
- AverageThreadTokens: 7.75
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 102.12 MB (107082528)
- PerHostPeakMemUsage: 1.14 GB (1223666665)
- RowsProduced: 1.76M (1757910)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 10.350ms
- TotalStorageWaitTime: 107.113ms
- TotalThreadsInvoluntaryContextSwitches: 16 (16)
- TotalThreadsTotalWallClockTime: 15s695ms
- TotalThreadsSysTime: 296.000ms
- TotalThreadsUserTime: 3s108ms
- TotalThreadsVoluntaryContextSwitches: 3.20K (3201)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s003ms
- ExecTreeExecTime: 959.223ms
- OpenTime: 81.844ms
- ExecTreeOpenTime: 41.285us
- PrepareTime: 35.627ms
- ExecTreePrepareTime: 248.867us
DataStreamSender (dst_id=31):(Total: 581.607ms, non-child: 581.607ms, % non-child: 100.00%)
- BytesSent: 80.97 MB (84902275)
- NetworkThroughput(*): 648.12 MB/sec
- OverallThroughput: 139.22 MB/sec
- PeakMemoryUsage: 1.05 MB (1098744)
- RowsReturned: 1.76M (1757910)
- SerializeBatchTime: 456.265ms
- TransmitDataRPCTime: 124.929ms
- UncompressedRowBatchSize: 140.34 MB (147160131)
CodeGen:(Total: 113.415ms, non-child: 113.415ms, % non-child: 100.00%)
- CodegenTime: 1.430ms
- CompileTime: 14.472ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 32 (32)
- NumInstructions: 547 (547)
- OptimizationTime: 66.163ms
- PeakMemoryUsage: 273.50 KB (280064)
- PrepareTime: 32.043ms
HDFS_SCAN_NODE (id=4):(Total: 958.695ms, non-child: 958.695ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:22/2.04 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 22 out of 22
Runtime filters: Only following filters arrived: , waited 904ms
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:66
BytesRead(500.000ms): 0, 0, 118.26 MB, 261.11 MB
- FooterProcessingTime: (Avg: 23.177ms ; Min: 3.315ms ; Max: 72.449ms ; Number of samples: 22)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 6.75
- BytesRead: 275.30 MB (288674646)
- BytesReadDataNodeCache: 268.52 MB (281558457)
- BytesReadLocal: 275.30 MB (288674646)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 275.30 MB (288674646)
- DecompressionTime: 498.171ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 22 (22)
- NumScannerThreadsStarted: 9 (9)
- PeakMemoryUsage: 84.86 MB (88981795)
- PerReadThreadRawHdfsThroughput: 32.25 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 45.589ms
- RowBatchQueuePutWaitTime: 5s877ms
- RowsRead: 8.55M (8554292)
- RowsReturned: 1.76M (1757910)
- RowsReturnedRate: 1.83 M/sec
- ScanRangesComplete: 22 (22)
- ScannerThreadsInvoluntaryContextSwitches: 11 (11)
- ScannerThreadsTotalWallClockTime: 13s609ms
- MaterializeTupleTime(*): 1s483ms
- ScannerThreadsSysTime: 188.000ms
- ScannerThreadsUserTime: 2s100ms
- ScannerThreadsVoluntaryContextSwitches: 2.71K (2708)
- TotalRawHdfsReadTime(*): 8.336ms
- TotalReadThroughput: 130.56 MB/sec
Filter 1 (8.00 MB):
- Rows processed: 7.34M (7336885)
- Rows rejected: 2.57M (2569676)
- Rows total: 8.55M (8554292)
Filter 2 (8.00 MB):
- Rows processed: 5.60M (5603688)
- Rows rejected: 4.23M (4226706)
- Rows total: 5.98M (5984616)
Averaged Fragment F06:(Total: 727.199ms, non-child: 19.705ms, % non-child: 2.71%)
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:716.217ms max:742.308ms mean: 728.009ms stddev:6.591ms
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 17
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.34 MB (11893844)
- PerHostPeakMemUsage: 382.09 MB (400655012)
- RowsProduced: 30.48K (30477)
- TotalNetworkReceiveTime: 537.789ms
- TotalNetworkSendTime: 5.871ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 691.075ms
- TotalThreadsSysTime: 7.529ms
- TotalThreadsUserTime: 142.352ms
- TotalThreadsVoluntaryContextSwitches: 240 (240)
Fragment Instance Lifecycle Timings:
- ExecTime: 33.739ms
- ExecTreeExecTime: 2.863ms
- OpenTime: 657.355ms
- ExecTreeOpenTime: 560.817ms
- PrepareTime: 36.046ms
- ExecTreePrepareTime: 860.193us
DataStreamSender (dst_id=32):(Total: 15.475ms, non-child: 15.475ms, % non-child: 100.00%)
- BytesSent: 1.38 MB (1450005)
- NetworkThroughput(*): 447.41 MB/sec
- OverallThroughput: 94.67 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 30.48K (30477)
- SerializeBatchTime: 11.347ms
- TransmitDataRPCTime: 4.056ms
- UncompressedRowBatchSize: 1.89 MB (1981262)
CodeGen:(Total: 127.505ms, non-child: 127.505ms, % non-child: 100.00%)
- CodegenTime: 2.753ms
- CompileTime: 23.380ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 45 (45)
- NumInstructions: 786 (786)
- OptimizationTime: 71.980ms
- PeakMemoryUsage: 393.00 KB (402432)
- PrepareTime: 31.422ms
AGGREGATION_NODE (id=30):(Total: 564.512ms, non-child: 24.420ms, % non-child: 4.33%)
- BuildTime: 20.275ms
- GetNewBlockTime: 717.739us
- GetResultsTime: 1.689ms
- HTResizeTime: 2.015ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 11.12 MB (11656121)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 30.48K (30477)
- RowsReturnedRate: 54.03 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.044us
EXCHANGE_NODE (id=29):(Total: 540.092ms, non-child: 540.092ms, % non-child: 100.00%)
- BytesReceived: 5.29 MB (5546297)
- ConvertRowBatchTime: 2.035ms
- DeserializeRowBatchTimer: 11.917ms
- FirstBatchArrivalWaitTime: 277.742ms
- PeakMemoryUsage: 0
- RowsReturned: 116.80K (116799)
- RowsReturnedRate: 216.45 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Fragment F06:
Instance 514ee9ab39cdc507:61 (host=cdh5.net.cuberonlabs.com:22000):(Total: 740.880ms, non-child: 21.907ms, % non-child: 2.96%)
MemoryUsage(500.000ms): 2.37 MB
ThreadUsage(500.000ms): 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.42 MB (11973390)
- PerHostPeakMemUsage: 385.83 MB (404575445)
- RowsProduced: 30.56K (30557)
- TotalNetworkReceiveTime: 573.723ms
- TotalNetworkSendTime: 8.306ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 712.159ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 132.000ms
- TotalThreadsVoluntaryContextSwitches: 249 (249)
Fragment Instance Lifecycle Timings:
- ExecTime: 46.126ms
- ExecTreeExecTime: 5.413ms
- OpenTime: 666.059ms
- ExecTreeOpenTime: 593.983ms
- PrepareTime: 28.574ms
- ExecTreePrepareTime: 630.572us
DataStreamSender (dst_id=32):(Total: 22.329ms, non-child: 22.329ms, % non-child: 100.00%)
- BytesSent: 1.39 MB (1454306)
- NetworkThroughput(*): 156.60 MB/sec
- OverallThroughput: 62.11 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 30.56K (30557)
- SerializeBatchTime: 13.419ms
- TransmitDataRPCTime: 8.856ms
- UncompressedRowBatchSize: 1.89 MB (1986409)
CodeGen:(Total: 96.662ms, non-child: 96.662ms, % non-child: 100.00%)
- CodegenTime: 1.807ms
- CompileTime: 20.362ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 45 (45)
- NumInstructions: 786 (786)
- OptimizationTime: 50.923ms
- PeakMemoryUsage: 393.00 KB (402432)
- PrepareTime: 24.914ms
AGGREGATION_NODE (id=30):(Total: 599.981ms, non-child: 24.261ms, % non-child: 4.04%)
ExecOption: Codegen Enabled
- BuildTime: 17.862ms
- GetNewBlockTime: 399.076us
- GetResultsTime: 2.143ms
- HTResizeTime: 2.015ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 11.11 MB (11652262)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 30.56K (30557)
- RowsReturnedRate: 50.93 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 952.000ns
EXCHANGE_NODE (id=29):(Total: 575.720ms, non-child: 3.521ms, % non-child: 0.61%)
BytesReceived(500.000ms): 0
- BytesReceived: 5.31 MB (5563652)
- ConvertRowBatchTime: 1.756ms
- DeserializeRowBatchTimer: 11.362ms
- FirstBatchArrivalWaitTime: 310.021ms
- PeakMemoryUsage: 0
- RowsReturned: 117.15K (117151)
- RowsReturnedRate: 203.49 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:5e (host=cdh12.net.cuberonlabs.com:22000):(Total: 735.579ms, non-child: 18.749ms, % non-child: 2.55%)
MemoryUsage(500.000ms): 2.37 MB
ThreadUsage(500.000ms): 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.33 MB (11883000)
- PerHostPeakMemUsage: 346.18 MB (362992000)
- RowsProduced: 30.27K (30272)
- TotalNetworkReceiveTime: 550.317ms
- TotalNetworkSendTime: 7.459ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 705.335ms
- TotalThreadsSysTime: 16.000ms
- TotalThreadsUserTime: 136.000ms
- TotalThreadsVoluntaryContextSwitches: 207 (207)
Fragment Instance Lifecycle Timings:
- ExecTime: 41.720ms
- ExecTreeExecTime: 3.112ms
- OpenTime: 663.624ms
- ExecTreeOpenTime: 574.741ms
- PrepareTime: 30.183ms
- ExecTreePrepareTime: 581.516us
DataStreamSender (dst_id=32):(Total: 23.410ms, non-child: 23.410ms, % non-child: 100.00%)
- BytesSent: 1.37 MB (1439979)
- NetworkThroughput(*): 140.87 MB/sec
- OverallThroughput: 58.66 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 30.27K (30272)
- SerializeBatchTime: 13.625ms
- TransmitDataRPCTime: 9.748ms
- UncompressedRowBatchSize: 1.88 MB (1967884)
CodeGen:(Total: 115.012ms, non-child: 115.012ms, % non-child: 100.00%)
- CodegenTime: 2.405ms
- CompileTime: 22.554ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 45 (45)
- NumInstructions: 786 (786)
- OptimizationTime: 65.353ms
- PeakMemoryUsage: 393.00 KB (402432)
- PrepareTime: 26.486ms
AGGREGATION_NODE (id=30):(Total: 578.408ms, non-child: 25.602ms, % non-child: 4.43%)
ExecOption: Codegen Enabled
- BuildTime: 21.378ms
- GetNewBlockTime: 180.539us
- GetResultsTime: 1.860ms
- HTResizeTime: 1.166ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 11.11 MB (11652262)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 30.27K (30272)
- RowsReturnedRate: 52.34 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 779.000ns
EXCHANGE_NODE (id=29):(Total: 552.806ms, non-child: 3.654ms, % non-child: 0.66%)
BytesReceived(500.000ms): 0
- BytesReceived: 5.24 MB (5493171)
- ConvertRowBatchTime: 2.248ms
- DeserializeRowBatchTimer: 11.854ms
- FirstBatchArrivalWaitTime: 290.898ms
- PeakMemoryUsage: 0
- RowsReturned: 115.69K (115687)
- RowsReturnedRate: 209.27 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:66 (host=cdh10.net.cuberonlabs.com:22000):(Total: 733.353ms, non-child: 21.920ms, % non-child: 2.99%)
MemoryUsage(500.000ms): 2.67 MB
ThreadUsage(500.000ms): 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.33 MB (11883000)
- PerHostPeakMemUsage: 376.66 MB (394960185)
- RowsProduced: 30.40K (30397)
- TotalNetworkReceiveTime: 534.018ms
- TotalNetworkSendTime: 5.066ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 690.408ms
- TotalThreadsSysTime: 8.000ms
- TotalThreadsUserTime: 144.000ms
- TotalThreadsVoluntaryContextSwitches: 225 (225)
Fragment Instance Lifecycle Timings:
- ExecTime: 35.409ms
- ExecTreeExecTime: 2.975ms
- OpenTime: 655.025ms
- ExecTreeOpenTime: 560.216ms
- PrepareTime: 42.859ms
- ExecTreePrepareTime: 672.310us
DataStreamSender (dst_id=32):(Total: 14.997ms, non-child: 14.997ms, % non-child: 100.00%)
- BytesSent: 1.38 MB (1446283)
- NetworkThroughput(*): 562.02 MB/sec
- OverallThroughput: 91.97 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 30.40K (30397)
- SerializeBatchTime: 12.495ms
- TransmitDataRPCTime: 2.454ms
- UncompressedRowBatchSize: 1.88 MB (1976009)
CodeGen:(Total: 132.600ms, non-child: 132.600ms, % non-child: 100.00%)
- CodegenTime: 2.763ms
- CompileTime: 23.670ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 45 (45)
- NumInstructions: 786 (786)
- OptimizationTime: 70.020ms
- PeakMemoryUsage: 393.00 KB (402432)
- PrepareTime: 38.216ms
AGGREGATION_NODE (id=30):(Total: 563.834ms, non-child: 27.262ms, % non-child: 4.84%)
ExecOption: Codegen Enabled
- BuildTime: 23.143ms
- GetNewBlockTime: 804.336us
- GetResultsTime: 2.048ms
- HTResizeTime: 2.116ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 11.12 MB (11661290)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 30.40K (30397)
- RowsReturnedRate: 53.91 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 982.000ns
EXCHANGE_NODE (id=29):(Total: 536.571ms, non-child: 3.999ms, % non-child: 0.75%)
BytesReceived(500.000ms): 60.82 KB
- BytesReceived: 5.29 MB (5548510)
- ConvertRowBatchTime: 2.284ms
- DeserializeRowBatchTimer: 11.564ms
- FirstBatchArrivalWaitTime: 270.302ms
- PeakMemoryUsage: 0
- RowsReturned: 116.80K (116802)
- RowsReturnedRate: 217.68 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:59 (host=cdh6.net.cuberonlabs.com:22000):(Total: 733.089ms, non-child: 24.553ms, % non-child: 3.35%)
MemoryUsage(500.000ms): 2.75 MB, 11.21 MB
ThreadUsage(500.000ms): 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.33 MB (11883000)
- PerHostPeakMemUsage: 396.78 MB (416054636)
- RowsProduced: 30.35K (30348)
- TotalNetworkReceiveTime: 521.711ms
- TotalNetworkSendTime: 5.614ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 2 (2)
- TotalThreadsTotalWallClockTime: 694.449ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 168.000ms
- TotalThreadsVoluntaryContextSwitches: 231 (231)
Fragment Instance Lifecycle Timings:
- ExecTime: 42.596ms
- ExecTreeExecTime: 3.671ms
- OpenTime: 651.884ms
- ExecTreeOpenTime: 545.014ms
- PrepareTime: 38.562ms
- ExecTreePrepareTime: 1.325ms
DataStreamSender (dst_id=32):(Total: 18.817ms, non-child: 18.817ms, % non-child: 100.00%)
- BytesSent: 1.38 MB (1442960)
- NetworkThroughput(*): 616.79 MB/sec
- OverallThroughput: 73.13 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 30.35K (30348)
- SerializeBatchTime: 16.520ms
- TransmitDataRPCTime: 2.231ms
- UncompressedRowBatchSize: 1.88 MB (1972824)
CodeGen:(Total: 139.743ms, non-child: 139.743ms, % non-child: 100.00%)
- CodegenTime: 2.783ms
- CompileTime: 21.892ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 45 (45)
- NumInstructions: 786 (786)
- OptimizationTime: 83.903ms
- PeakMemoryUsage: 393.00 KB (402432)
- PrepareTime: 33.208ms
AGGREGATION_NODE (id=30):(Total: 549.974ms, non-child: 25.851ms, % non-child: 4.70%)
ExecOption: Codegen Enabled
- BuildTime: 20.436ms
- GetNewBlockTime: 855.092us
- GetResultsTime: 2.452ms
- HTResizeTime: 1.728ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 11.12 MB (11659695)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 30.35K (30348)
- RowsReturnedRate: 55.18 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.472us
EXCHANGE_NODE (id=29):(Total: 524.122ms, non-child: 4.284ms, % non-child: 0.82%)
BytesReceived(500.000ms): 0, 2.36 MB
- BytesReceived: 5.33 MB (5590454)
- ConvertRowBatchTime: 2.132ms
- DeserializeRowBatchTimer: 14.147ms
- FirstBatchArrivalWaitTime: 264.766ms
- PeakMemoryUsage: 0
- RowsReturned: 117.80K (117796)
- RowsReturnedRate: 224.75 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:63 (host=cdh8.net.cuberonlabs.com:22000):(Total: 732.429ms, non-child: 18.134ms, % non-child: 2.48%)
MemoryUsage(500.000ms): 2.70 MB
ThreadUsage(500.000ms): 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.33 MB (11883000)
- PerHostPeakMemUsage: 378.86 MB (397268194)
- RowsProduced: 30.22K (30219)
- TotalNetworkReceiveTime: 545.965ms
- TotalNetworkSendTime: 6.385ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 695.798ms
- TotalThreadsSysTime: 12.000ms
- TotalThreadsUserTime: 132.000ms
- TotalThreadsVoluntaryContextSwitches: 246 (246)
Fragment Instance Lifecycle Timings:
- ExecTime: 37.056ms
- ExecTreeExecTime: 3.054ms
- OpenTime: 658.766ms
- ExecTreeOpenTime: 564.887ms
- PrepareTime: 36.541ms
- ExecTreePrepareTime: 700.650us
DataStreamSender (dst_id=32):(Total: 20.425ms, non-child: 20.425ms, % non-child: 100.00%)
- BytesSent: 1.37 MB (1438860)
- NetworkThroughput(*): 184.61 MB/sec
- OverallThroughput: 67.18 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 30.22K (30219)
- SerializeBatchTime: 12.931ms
- TransmitDataRPCTime: 7.432ms
- UncompressedRowBatchSize: 1.87 MB (1964439)
CodeGen:(Total: 125.256ms, non-child: 125.256ms, % non-child: 100.00%)
- CodegenTime: 2.963ms
- CompileTime: 20.723ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 45 (45)
- NumInstructions: 786 (786)
- OptimizationTime: 71.875ms
- PeakMemoryUsage: 393.00 KB (402432)
- PrepareTime: 31.916ms
AGGREGATION_NODE (id=30):(Total: 568.613ms, non-child: 20.858ms, % non-child: 3.67%)
ExecOption: Codegen Enabled
- BuildTime: 16.713ms
- GetNewBlockTime: 260.356us
- GetResultsTime: 1.905ms
- HTResizeTime: 2.637ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 11.11 MB (11648166)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 30.22K (30219)
- RowsReturnedRate: 53.15 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 980.000ns
EXCHANGE_NODE (id=29):(Total: 547.755ms, non-child: 2.764ms, % non-child: 0.50%)
BytesReceived(500.000ms): 121.55 KB
- BytesReceived: 5.24 MB (5498866)
- ConvertRowBatchTime: 1.563ms
- DeserializeRowBatchTimer: 10.663ms
- FirstBatchArrivalWaitTime: 277.785ms
- PeakMemoryUsage: 0
- RowsReturned: 115.75K (115751)
- RowsReturnedRate: 211.32 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:62 (host=cdh7.net.cuberonlabs.com:22000):(Total: 731.886ms, non-child: 18.504ms, % non-child: 2.53%)
MemoryUsage(500.000ms): 2.75 MB, 11.17 MB
ThreadUsage(500.000ms): 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.33 MB (11883000)
- PerHostPeakMemUsage: 380.97 MB (399479666)
- RowsProduced: 30.49K (30492)
- TotalNetworkReceiveTime: 535.496ms
- TotalNetworkSendTime: 6.455ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 694.155ms
- TotalThreadsSysTime: 12.000ms
- TotalThreadsUserTime: 144.000ms
- TotalThreadsVoluntaryContextSwitches: 222 (222)
Fragment Instance Lifecycle Timings:
- ExecTime: 36.727ms
- ExecTreeExecTime: 3.074ms
- OpenTime: 657.457ms
- ExecTreeOpenTime: 557.534ms
- PrepareTime: 37.626ms
- ExecTreePrepareTime: 1.163ms
DataStreamSender (dst_id=32):(Total: 19.373ms, non-child: 19.373ms, % non-child: 100.00%)
- BytesSent: 1.38 MB (1450016)
- NetworkThroughput(*): 225.30 MB/sec
- OverallThroughput: 71.38 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 30.49K (30492)
- SerializeBatchTime: 13.181ms
- TransmitDataRPCTime: 6.137ms
- UncompressedRowBatchSize: 1.89 MB (1982184)
CodeGen:(Total: 132.264ms, non-child: 132.264ms, % non-child: 100.00%)
- CodegenTime: 3.106ms
- CompileTime: 24.679ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 45 (45)
- NumInstructions: 786 (786)
- OptimizationTime: 74.005ms
- PeakMemoryUsage: 393.00 KB (402432)
- PrepareTime: 32.730ms
AGGREGATION_NODE (id=30):(Total: 561.743ms, non-child: 23.699ms, % non-child: 4.22%)
ExecOption: Codegen Enabled
- BuildTime: 19.017ms
- GetNewBlockTime: 417.869us
- GetResultsTime: 1.869ms
- HTResizeTime: 1.519ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 11.12 MB (11660305)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 30.49K (30492)
- RowsReturnedRate: 54.28 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 784.000ns
EXCHANGE_NODE (id=29):(Total: 538.044ms, non-child: 3.785ms, % non-child: 0.70%)
BytesReceived(500.000ms): 0, 2.46 MB
- BytesReceived: 5.29 MB (5546249)
- ConvertRowBatchTime: 2.197ms
- DeserializeRowBatchTimer: 13.389ms
- FirstBatchArrivalWaitTime: 271.242ms
- PeakMemoryUsage: 0
- RowsReturned: 116.84K (116836)
- RowsReturnedRate: 217.15 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:5d (host=cdh2.net.cuberonlabs.com:22000):(Total: 728.911ms, non-child: 21.508ms, % non-child: 2.95%)
MemoryUsage(500.000ms): 2.75 MB, 11.17 MB
ThreadUsage(500.000ms): 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.33 MB (11883000)
- PerHostPeakMemUsage: 377.94 MB (396297272)
- RowsProduced: 30.51K (30514)
- TotalNetworkReceiveTime: 521.696ms
- TotalNetworkSendTime: 5.655ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 688.141ms
- TotalThreadsSysTime: 16.000ms
- TotalThreadsUserTime: 148.000ms
- TotalThreadsVoluntaryContextSwitches: 238 (238)
Fragment Instance Lifecycle Timings:
- ExecTime: 35.319ms
- ExecTreeExecTime: 2.952ms
- OpenTime: 652.848ms
- ExecTreeOpenTime: 546.676ms
- PrepareTime: 40.671ms
- ExecTreePrepareTime: 588.252us
DataStreamSender (dst_id=32):(Total: 15.118ms, non-child: 15.118ms, % non-child: 100.00%)
- BytesSent: 1.38 MB (1451601)
- NetworkThroughput(*): 566.58 MB/sec
- OverallThroughput: 91.56 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 30.51K (30514)
- SerializeBatchTime: 12.622ms
- TransmitDataRPCTime: 2.443ms
- UncompressedRowBatchSize: 1.89 MB (1983614)
CodeGen:(Total: 142.095ms, non-child: 142.095ms, % non-child: 100.00%)
- CodegenTime: 3.186ms
- CompileTime: 26.207ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 45 (45)
- NumInstructions: 786 (786)
- OptimizationTime: 78.742ms
- PeakMemoryUsage: 393.00 KB (402432)
- PrepareTime: 36.339ms
AGGREGATION_NODE (id=30):(Total: 550.187ms, non-child: 25.815ms, % non-child: 4.69%)
ExecOption: Codegen Enabled
- BuildTime: 21.851ms
- GetNewBlockTime: 245.280us
- GetResultsTime: 1.889ms
- HTResizeTime: 2.335ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 11.12 MB (11656532)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 30.51K (30514)
- RowsReturnedRate: 55.46 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 944.000ns
EXCHANGE_NODE (id=29):(Total: 524.372ms, non-child: 3.708ms, % non-child: 0.71%)
BytesReceived(500.000ms): 0, 2.37 MB
- BytesReceived: 5.28 MB (5533953)
- ConvertRowBatchTime: 2.397ms
- DeserializeRowBatchTimer: 12.008ms
- FirstBatchArrivalWaitTime: 262.716ms
- PeakMemoryUsage: 0
- RowsReturned: 116.61K (116611)
- RowsReturnedRate: 222.38 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:57 (host=cdh16.net.cuberonlabs.com:22000):(Total: 725.959ms, non-child: 21.829ms, % non-child: 3.01%)
MemoryUsage(500.000ms): 3.11 MB
ThreadUsage(500.000ms): 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.33 MB (11883000)
- PerHostPeakMemUsage: 380.14 MB (398604618)
- RowsProduced: 30.48K (30484)
- TotalNetworkReceiveTime: 523.774ms
- TotalNetworkSendTime: 5.574ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 687.069ms
- TotalThreadsSysTime: 4.000ms
- TotalThreadsUserTime: 152.000ms
- TotalThreadsVoluntaryContextSwitches: 272 (272)
Fragment Instance Lifecycle Timings:
- ExecTime: 35.765ms
- ExecTreeExecTime: 3.157ms
- OpenTime: 651.320ms
- ExecTreeOpenTime: 552.082ms
- PrepareTime: 38.838ms
- ExecTreePrepareTime: 665.533us
DataStreamSender (dst_id=32):(Total: 15.062ms, non-child: 15.062ms, % non-child: 100.00%)
- BytesSent: 1.38 MB (1450251)
- NetworkThroughput(*): 587.53 MB/sec
- OverallThroughput: 91.82 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 30.48K (30484)
- SerializeBatchTime: 12.656ms
- TransmitDataRPCTime: 2.354ms
- UncompressedRowBatchSize: 1.89 MB (1981664)
CodeGen:(Total: 133.191ms, non-child: 133.191ms, % non-child: 100.00%)
- CodegenTime: 3.060ms
- CompileTime: 24.383ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 45 (45)
- NumInstructions: 786 (786)
- OptimizationTime: 73.715ms
- PeakMemoryUsage: 393.00 KB (402432)
- PrepareTime: 34.297ms
AGGREGATION_NODE (id=30):(Total: 555.875ms, non-child: 29.346ms, % non-child: 5.28%)
ExecOption: Codegen Enabled
- BuildTime: 25.121ms
- GetNewBlockTime: 1.674ms
- GetResultsTime: 1.959ms
- HTResizeTime: 2.917ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 11.12 MB (11656340)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 30.48K (30484)
- RowsReturnedRate: 54.84 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 916.000ns
EXCHANGE_NODE (id=29):(Total: 526.528ms, non-child: 4.386ms, % non-child: 0.83%)
BytesReceived(500.000ms): 574.36 KB
- BytesReceived: 5.32 MB (5580303)
- ConvertRowBatchTime: 2.440ms
- DeserializeRowBatchTimer: 14.767ms
- FirstBatchArrivalWaitTime: 274.108ms
- PeakMemoryUsage: 0
- RowsReturned: 117.50K (117503)
- RowsReturnedRate: 223.16 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:64 (host=cdh11.net.cuberonlabs.com:22000):(Total: 725.097ms, non-child: 19.021ms, % non-child: 2.62%)
MemoryUsage(500.000ms): 3.08 MB
ThreadUsage(500.000ms): 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.34 MB (11888240)
- PerHostPeakMemUsage: 386.83 MB (405618375)
- RowsProduced: 30.52K (30523)
- TotalNetworkReceiveTime: 526.857ms
- TotalNetworkSendTime: 5.394ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 689.101ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 160.000ms
- TotalThreadsVoluntaryContextSwitches: 246 (246)
Fragment Instance Lifecycle Timings:
- ExecTime: 28.546ms
- ExecTreeExecTime: 2.192ms
- OpenTime: 660.567ms
- ExecTreeOpenTime: 545.819ms
- PrepareTime: 35.935ms
- ExecTreePrepareTime: 686.058us
DataStreamSender (dst_id=32):(Total: 12.032ms, non-child: 12.032ms, % non-child: 100.00%)
- BytesSent: 1.39 MB (1453207)
- NetworkThroughput(*): 621.27 MB/sec
- OverallThroughput: 115.18 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 30.52K (30523)
- SerializeBatchTime: 9.762ms
- TransmitDataRPCTime: 2.230ms
- UncompressedRowBatchSize: 1.89 MB (1984199)
CodeGen:(Total: 145.367ms, non-child: 145.367ms, % non-child: 100.00%)
- CodegenTime: 2.755ms
- CompileTime: 26.740ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 45 (45)
- NumInstructions: 786 (786)
- OptimizationTime: 86.128ms
- PeakMemoryUsage: 393.00 KB (402432)
- PrepareTime: 31.748ms
AGGREGATION_NODE (id=30):(Total: 548.675ms, non-child: 19.902ms, % non-child: 3.63%)
ExecOption: Codegen Enabled
- BuildTime: 16.646ms
- GetNewBlockTime: 213.139us
- GetResultsTime: 1.325ms
- HTResizeTime: 1.867ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 11.11 MB (11651033)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 30.52K (30523)
- RowsReturnedRate: 55.63 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 988.000ns
EXCHANGE_NODE (id=29):(Total: 528.773ms, non-child: 2.940ms, % non-child: 0.56%)
BytesReceived(500.000ms): 515.06 KB
- BytesReceived: 5.26 MB (5518124)
- ConvertRowBatchTime: 1.697ms
- DeserializeRowBatchTimer: 11.318ms
- FirstBatchArrivalWaitTime: 259.450ms
- PeakMemoryUsage: 0
- RowsReturned: 116.29K (116289)
- RowsReturnedRate: 219.92 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:5f (host=cdh14.net.cuberonlabs.com:22000):(Total: 724.920ms, non-child: 19.075ms, % non-child: 2.63%)
MemoryUsage(500.000ms): 2.37 MB
ThreadUsage(500.000ms): 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.36 MB (11916050)
- PerHostPeakMemUsage: 375.41 MB (393643300)
- RowsProduced: 30.54K (30536)
- TotalNetworkReceiveTime: 545.385ms
- TotalNetworkSendTime: 5.378ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 691.383ms
- TotalThreadsSysTime: 8.000ms
- TotalThreadsUserTime: 140.000ms
- TotalThreadsVoluntaryContextSwitches: 214 (214)
Fragment Instance Lifecycle Timings:
- ExecTime: 30.802ms
- ExecTreeExecTime: 2.393ms
- OpenTime: 660.596ms
- ExecTreeOpenTime: 568.013ms
- PrepareTime: 33.432ms
- ExecTreePrepareTime: 1.042ms
DataStreamSender (dst_id=32):(Total: 13.221ms, non-child: 13.221ms, % non-child: 100.00%)
- BytesSent: 1.39 MB (1453492)
- NetworkThroughput(*): 524.83 MB/sec
- OverallThroughput: 104.84 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 30.54K (30536)
- SerializeBatchTime: 10.542ms
- TransmitDataRPCTime: 2.641ms
- UncompressedRowBatchSize: 1.89 MB (1985044)
CodeGen:(Total: 121.194ms, non-child: 121.194ms, % non-child: 100.00%)
- CodegenTime: 2.863ms
- CompileTime: 23.378ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 45 (45)
- NumInstructions: 786 (786)
- OptimizationTime: 68.080ms
- PeakMemoryUsage: 393.00 KB (402432)
- PrepareTime: 29.019ms
AGGREGATION_NODE (id=30):(Total: 571.428ms, non-child: 23.534ms, % non-child: 4.12%)
ExecOption: Codegen Enabled
- BuildTime: 19.686ms
- GetNewBlockTime: 407.172us
- GetResultsTime: 1.523ms
- HTResizeTime: 1.660ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 11.11 MB (11652262)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 30.54K (30536)
- RowsReturnedRate: 53.44 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 818.000ns
EXCHANGE_NODE (id=29):(Total: 547.893ms, non-child: 3.553ms, % non-child: 0.65%)
BytesReceived(500.000ms): 0
- BytesReceived: 5.26 MB (5518343)
- ConvertRowBatchTime: 2.203ms
- DeserializeRowBatchTimer: 12.523ms
- FirstBatchArrivalWaitTime: 283.078ms
- PeakMemoryUsage: 0
- RowsReturned: 116.21K (116211)
- RowsReturnedRate: 212.10 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:58 (host=cdh13.net.cuberonlabs.com:22000):(Total: 724.803ms, non-child: 20.570ms, % non-child: 2.84%)
MemoryUsage(500.000ms): 2.37 MB
ThreadUsage(500.000ms): 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.38 MB (11928195)
- PerHostPeakMemUsage: 391.21 MB (410213646)
- RowsProduced: 30.47K (30466)
- TotalNetworkReceiveTime: 528.505ms
- TotalNetworkSendTime: 5.239ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 688.171ms
- TotalThreadsSysTime: 8.000ms
- TotalThreadsUserTime: 152.000ms
- TotalThreadsVoluntaryContextSwitches: 211 (211)
Fragment Instance Lifecycle Timings:
- ExecTime: 33.864ms
- ExecTreeExecTime: 2.908ms
- OpenTime: 654.321ms
- ExecTreeOpenTime: 557.110ms
- PrepareTime: 36.584ms
- ExecTreePrepareTime: 1.095ms
DataStreamSender (dst_id=32):(Total: 14.658ms, non-child: 14.658ms, % non-child: 100.00%)
- BytesSent: 1.38 MB (1450793)
- NetworkThroughput(*): 565.94 MB/sec
- OverallThroughput: 94.39 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 30.47K (30466)
- SerializeBatchTime: 12.144ms
- TransmitDataRPCTime: 2.444ms
- UncompressedRowBatchSize: 1.89 MB (1980494)
CodeGen:(Total: 128.487ms, non-child: 128.487ms, % non-child: 100.00%)
- CodegenTime: 2.716ms
- CompileTime: 23.457ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 45 (45)
- NumInstructions: 786 (786)
- OptimizationTime: 72.686ms
- PeakMemoryUsage: 393.00 KB (402432)
- PrepareTime: 31.597ms
AGGREGATION_NODE (id=30):(Total: 561.087ms, non-child: 29.222ms, % non-child: 5.21%)
ExecOption: Codegen Enabled
- BuildTime: 24.793ms
- GetNewBlockTime: 746.580us
- GetResultsTime: 1.821ms
- HTResizeTime: 1.550ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 11.13 MB (11668113)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 30.47K (30466)
- RowsReturnedRate: 54.30 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.052us
EXCHANGE_NODE (id=29):(Total: 531.864ms, non-child: 4.587ms, % non-child: 0.86%)
BytesReceived(500.000ms): 0
- BytesReceived: 5.30 MB (5557088)
- ConvertRowBatchTime: 3.020ms
- DeserializeRowBatchTimer: 11.158ms
- FirstBatchArrivalWaitTime: 277.735ms
- PeakMemoryUsage: 0
- RowsReturned: 117.01K (117013)
- RowsReturnedRate: 220.00 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:65 (host=cdh9.net.cuberonlabs.com:22000):(Total: 724.708ms, non-child: 17.726ms, % non-child: 2.45%)
MemoryUsage(500.000ms): 2.75 MB, 11.17 MB
ThreadUsage(500.000ms): 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.33 MB (11883000)
- PerHostPeakMemUsage: 380.31 MB (398787248)
- RowsProduced: 30.64K (30639)
- TotalNetworkReceiveTime: 542.496ms
- TotalNetworkSendTime: 4.734ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 687.350ms
- TotalThreadsSysTime: 12.000ms
- TotalThreadsUserTime: 132.000ms
- TotalThreadsVoluntaryContextSwitches: 237 (237)
Fragment Instance Lifecycle Timings:
- ExecTime: 27.569ms
- ExecTreeExecTime: 2.398ms
- OpenTime: 659.801ms
- ExecTreeOpenTime: 558.897ms
- PrepareTime: 37.265ms
- ExecTreePrepareTime: 700.818us
DataStreamSender (dst_id=32):(Total: 11.372ms, non-child: 11.372ms, % non-child: 100.00%)
- BytesSent: 1.39 MB (1456566)
- NetworkThroughput(*): 641.18 MB/sec
- OverallThroughput: 122.14 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 30.64K (30639)
- SerializeBatchTime: 9.156ms
- TransmitDataRPCTime: 2.166ms
- UncompressedRowBatchSize: 1.90 MB (1991739)
CodeGen:(Total: 133.637ms, non-child: 133.637ms, % non-child: 100.00%)
- CodegenTime: 2.999ms
- CompileTime: 24.910ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 45 (45)
- NumInstructions: 786 (786)
- OptimizationTime: 74.809ms
- PeakMemoryUsage: 393.00 KB (402432)
- PrepareTime: 33.117ms
AGGREGATION_NODE (id=30):(Total: 561.972ms, non-child: 17.775ms, % non-child: 3.16%)
ExecOption: Codegen Enabled
- BuildTime: 14.309ms
- GetNewBlockTime: 320.624us
- GetResultsTime: 1.374ms
- HTResizeTime: 1.615ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 11.12 MB (11656358)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 30.64K (30639)
- RowsReturnedRate: 54.52 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 840.000ns
EXCHANGE_NODE (id=29):(Total: 544.197ms, non-child: 2.383ms, % non-child: 0.44%)
BytesReceived(500.000ms): 0, 2.34 MB
- BytesReceived: 5.33 MB (5591481)
- ConvertRowBatchTime: 1.486ms
- DeserializeRowBatchTimer: 8.921ms
- FirstBatchArrivalWaitTime: 270.726ms
- PeakMemoryUsage: 0
- RowsReturned: 117.76K (117764)
- RowsReturnedRate: 216.40 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:60 (host=cdh1.net.cuberonlabs.com:22000):(Total: 724.087ms, non-child: 20.549ms, % non-child: 2.84%)
MemoryUsage(500.000ms): 2.75 MB, 11.21 MB
ThreadUsage(500.000ms): 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.33 MB (11883000)
- PerHostPeakMemUsage: 456.03 MB (478183185)
- RowsProduced: 30.18K (30176)
- TotalNetworkReceiveTime: 547.046ms
- TotalNetworkSendTime: 5.850ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 687.074ms
- TotalThreadsSysTime: 8.000ms
- TotalThreadsUserTime: 128.000ms
- TotalThreadsVoluntaryContextSwitches: 242 (242)
Fragment Instance Lifecycle Timings:
- ExecTime: 29.269ms
- ExecTreeExecTime: 2.408ms
- OpenTime: 657.838ms
- ExecTreeOpenTime: 570.610ms
- PrepareTime: 36.935ms
- ExecTreePrepareTime: 1.640ms
DataStreamSender (dst_id=32):(Total: 12.787ms, non-child: 12.787ms, % non-child: 100.00%)
- BytesSent: 1.37 MB (1436088)
- NetworkThroughput(*): 485.42 MB/sec
- OverallThroughput: 107.10 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 30.18K (30176)
- SerializeBatchTime: 9.572ms
- TransmitDataRPCTime: 2.821ms
- UncompressedRowBatchSize: 1.87 MB (1961644)
CodeGen:(Total: 116.126ms, non-child: 116.126ms, % non-child: 100.00%)
- CodegenTime: 2.326ms
- CompileTime: 21.732ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 45 (45)
- NumInstructions: 786 (786)
- OptimizationTime: 64.575ms
- PeakMemoryUsage: 393.00 KB (402432)
- PrepareTime: 29.157ms
AGGREGATION_NODE (id=30):(Total: 574.624ms, non-child: 25.142ms, % non-child: 4.38%)
ExecOption: Codegen Enabled
- BuildTime: 20.664ms
- GetNewBlockTime: 1.200ms
- GetResultsTime: 1.404ms
- HTResizeTime: 1.776ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 11.12 MB (11660610)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 30.18K (30176)
- RowsReturnedRate: 52.51 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.824us
EXCHANGE_NODE (id=29):(Total: 549.481ms, non-child: 3.964ms, % non-child: 0.72%)
BytesReceived(500.000ms): 0, 2.26 MB
- BytesReceived: 5.24 MB (5489958)
- ConvertRowBatchTime: 2.144ms
- DeserializeRowBatchTimer: 12.837ms
- FirstBatchArrivalWaitTime: 287.503ms
- PeakMemoryUsage: 0
- RowsReturned: 115.50K (115500)
- RowsReturnedRate: 210.20 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:5a (host=cdh15.net.cuberonlabs.com:22000):(Total: 722.799ms, non-child: 19.923ms, % non-child: 2.76%)
MemoryUsage(500.000ms): 2.36 MB, 7.21 MB
ThreadUsage(500.000ms): 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.33 MB (11883000)
- PerHostPeakMemUsage: 375.05 MB (393265454)
- RowsProduced: 30.58K (30583)
- TotalNetworkReceiveTime: 538.903ms
- TotalNetworkSendTime: 5.365ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 688.712ms
- TotalThreadsSysTime: 16.000ms
- TotalThreadsUserTime: 132.000ms
- TotalThreadsVoluntaryContextSwitches: 237 (237)
Fragment Instance Lifecycle Timings:
- ExecTime: 31.810ms
- ExecTreeExecTime: 2.594ms
- OpenTime: 656.911ms
- ExecTreeOpenTime: 561.100ms
- PrepareTime: 34.027ms
- ExecTreePrepareTime: 639.079us
DataStreamSender (dst_id=32):(Total: 13.195ms, non-child: 13.195ms, % non-child: 100.00%)
- BytesSent: 1.39 MB (1454496)
- NetworkThroughput(*): 637.34 MB/sec
- OverallThroughput: 105.12 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 30.58K (30583)
- SerializeBatchTime: 10.954ms
- TransmitDataRPCTime: 2.176ms
- UncompressedRowBatchSize: 1.90 MB (1988099)
CodeGen:(Total: 125.375ms, non-child: 125.375ms, % non-child: 100.00%)
- CodegenTime: 2.771ms
- CompileTime: 23.703ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 45 (45)
- NumInstructions: 786 (786)
- OptimizationTime: 71.027ms
- PeakMemoryUsage: 393.00 KB (402432)
- PrepareTime: 29.874ms
AGGREGATION_NODE (id=30):(Total: 564.305ms, non-child: 23.136ms, % non-child: 4.10%)
ExecOption: Codegen Enabled
- BuildTime: 19.512ms
- GetNewBlockTime: 196.570us
- GetResultsTime: 1.634ms
- HTResizeTime: 2.222ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 11.11 MB (11654022)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 30.58K (30583)
- RowsReturnedRate: 54.20 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 970.000ns
EXCHANGE_NODE (id=29):(Total: 541.169ms, non-child: 3.240ms, % non-child: 0.60%)
BytesReceived(500.000ms): 0, 1.52 MB
- BytesReceived: 5.30 MB (5560302)
- ConvertRowBatchTime: 2.011ms
- DeserializeRowBatchTimer: 10.884ms
- FirstBatchArrivalWaitTime: 280.536ms
- PeakMemoryUsage: 0
- RowsReturned: 117.01K (117010)
- RowsReturnedRate: 216.22 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:5c (host=cdh17.net.cuberonlabs.com:22000):(Total: 722.364ms, non-child: 17.786ms, % non-child: 2.46%)
MemoryUsage(500.000ms): 2.37 MB
ThreadUsage(500.000ms): 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.34 MB (11888240)
- PerHostPeakMemUsage: 361.40 MB (378952889)
- RowsProduced: 30.64K (30641)
- TotalNetworkReceiveTime: 530.585ms
- TotalNetworkSendTime: 6.299ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 686.933ms
- TotalThreadsSysTime: 4.000ms
- TotalThreadsUserTime: 148.000ms
- TotalThreadsVoluntaryContextSwitches: 263 (263)
Fragment Instance Lifecycle Timings:
- ExecTime: 30.836ms
- ExecTreeExecTime: 2.406ms
- OpenTime: 656.110ms
- ExecTreeOpenTime: 558.683ms
- PrepareTime: 35.372ms
- ExecTreePrepareTime: 707.990us
DataStreamSender (dst_id=32):(Total: 14.680ms, non-child: 14.680ms, % non-child: 100.00%)
- BytesSent: 1.39 MB (1457838)
- NetworkThroughput(*): 232.29 MB/sec
- OverallThroughput: 94.70 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 30.64K (30641)
- SerializeBatchTime: 8.651ms
- TransmitDataRPCTime: 5.985ms
- UncompressedRowBatchSize: 1.90 MB (1991869)
CodeGen:(Total: 128.119ms, non-child: 128.119ms, % non-child: 100.00%)
- CodegenTime: 2.935ms
- CompileTime: 24.062ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 45 (45)
- NumInstructions: 786 (786)
- OptimizationTime: 72.130ms
- PeakMemoryUsage: 393.00 KB (402432)
- PrepareTime: 31.150ms
AGGREGATION_NODE (id=30):(Total: 561.777ms, non-child: 29.285ms, % non-child: 5.21%)
ExecOption: Codegen Enabled
- BuildTime: 25.687ms
- GetNewBlockTime: 1.256ms
- GetResultsTime: 1.467ms
- HTResizeTime: 3.565ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 11.11 MB (11652314)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 30.64K (30641)
- RowsReturnedRate: 54.54 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.326us
EXCHANGE_NODE (id=29):(Total: 532.491ms, non-child: 3.230ms, % non-child: 0.61%)
BytesReceived(500.000ms): 0
- BytesReceived: 5.33 MB (5583955)
- ConvertRowBatchTime: 1.701ms
- DeserializeRowBatchTimer: 12.326ms
- FirstBatchArrivalWaitTime: 278.456ms
- PeakMemoryUsage: 0
- RowsReturned: 117.62K (117620)
- RowsReturnedRate: 220.89 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:5b (host=cdh3.net.cuberonlabs.com:22000):(Total: 716.077ms, non-child: 16.661ms, % non-child: 2.33%)
MemoryUsage(500.000ms): 2.37 MB
ThreadUsage(500.000ms): 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.33 MB (11883000)
- PerHostPeakMemUsage: 357.28 MB (374633487)
- RowsProduced: 30.64K (30643)
- TotalNetworkReceiveTime: 568.436ms
- TotalNetworkSendTime: 5.276ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 690.071ms
- TotalThreadsSysTime: 4.000ms
- TotalThreadsUserTime: 112.000ms
- TotalThreadsVoluntaryContextSwitches: 315 (315)
Fragment Instance Lifecycle Timings:
- ExecTime: 25.166ms
- ExecTreeExecTime: 2.085ms
- OpenTime: 664.919ms
- ExecTreeOpenTime: 591.124ms
- PrepareTime: 25.948ms
- ExecTreePrepareTime: 1.016ms
DataStreamSender (dst_id=32):(Total: 10.158ms, non-child: 10.158ms, % non-child: 100.00%)
- BytesSent: 1.39 MB (1456738)
- NetworkThroughput(*): 527.52 MB/sec
- OverallThroughput: 136.76 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 30.64K (30643)
- SerializeBatchTime: 7.471ms
- TransmitDataRPCTime: 2.633ms
- UncompressedRowBatchSize: 1.90 MB (1991999)
CodeGen:(Total: 95.051ms, non-child: 95.051ms, % non-child: 100.00%)
- CodegenTime: 1.806ms
- CompileTime: 20.976ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 45 (45)
- NumInstructions: 786 (786)
- OptimizationTime: 51.707ms
- PeakMemoryUsage: 393.00 KB (402432)
- PrepareTime: 21.909ms
AGGREGATION_NODE (id=30):(Total: 594.206ms, non-child: 23.880ms, % non-child: 4.02%)
ExecOption: Codegen Enabled
- BuildTime: 20.328ms
- GetNewBlockTime: 2.530ms
- GetResultsTime: 1.033ms
- HTResizeTime: 1.976ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 11.12 MB (11660244)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 30.64K (30643)
- RowsReturnedRate: 51.57 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 808.000ns
EXCHANGE_NODE (id=29):(Total: 570.325ms, non-child: 2.994ms, % non-child: 0.52%)
BytesReceived(500.000ms): 0
- BytesReceived: 5.33 MB (5584117)
- ConvertRowBatchTime: 1.639ms
- DeserializeRowBatchTimer: 11.935ms
- FirstBatchArrivalWaitTime: 312.251ms
- PeakMemoryUsage: 0
- RowsReturned: 117.58K (117579)
- RowsReturnedRate: 206.16 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 514ee9ab39cdc507:56 (host=cdh4.net.cuberonlabs.com:22000):(Total: 715.447ms, non-child: 16.568ms, % non-child: 2.32%)
MemoryUsage(500.000ms): 2.37 MB
ThreadUsage(500.000ms): 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 11.34 MB (11888240)
- PerHostPeakMemUsage: 388.72 MB (407605616)
- RowsProduced: 30.63K (30633)
- TotalNetworkReceiveTime: 507.508ms
- TotalNetworkSendTime: 5.755ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 5 (5)
- TotalThreadsTotalWallClockTime: 671.965ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 160.000ms
- TotalThreadsVoluntaryContextSwitches: 236 (236)
Fragment Instance Lifecycle Timings:
- ExecTime: 24.985ms
- ExecTreeExecTime: 1.880ms
- OpenTime: 646.995ms
- ExecTreeOpenTime: 527.392ms
- PrepareTime: 43.430ms
- ExecTreePrepareTime: 767.252us
DataStreamSender (dst_id=32):(Total: 11.448ms, non-child: 11.448ms, % non-child: 100.00%)
- BytesSent: 1.39 MB (1456616)
- NetworkThroughput(*): 329.95 MB/sec
- OverallThroughput: 121.34 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 30.63K (30633)
- SerializeBatchTime: 7.200ms
- TransmitDataRPCTime: 4.210ms
- UncompressedRowBatchSize: 1.90 MB (1991349)
CodeGen:(Total: 157.409ms, non-child: 157.409ms, % non-child: 100.00%)
- CodegenTime: 3.554ms
- CompileTime: 24.034ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 45 (45)
- NumInstructions: 786 (786)
- OptimizationTime: 93.983ms
- PeakMemoryUsage: 393.00 KB (402432)
- PrepareTime: 38.491ms
AGGREGATION_NODE (id=30):(Total: 530.020ms, non-child: 20.571ms, % non-child: 3.88%)
ExecOption: Codegen Enabled
- BuildTime: 17.521ms
- GetNewBlockTime: 493.172us
- GetResultsTime: 1.004ms
- HTResizeTime: 1.585ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 11.11 MB (11652262)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 30.63K (30633)
- RowsReturnedRate: 57.80 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.328us
EXCHANGE_NODE (id=29):(Total: 509.448ms, non-child: 3.239ms, % non-child: 0.64%)
BytesReceived(500.000ms): 0
- BytesReceived: 5.27 MB (5528536)
- ConvertRowBatchTime: 1.669ms
- DeserializeRowBatchTimer: 10.939ms
- FirstBatchArrivalWaitTime: 250.042ms
- PeakMemoryUsage: 0
- RowsReturned: 116.47K (116468)
- RowsReturnedRate: 228.62 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Averaged Fragment F05:(Total: 586.880ms, non-child: 31.115ms, % non-child: 5.30%)
split sizes: min: 1.81 GB, max: 3.59 GB, avg: 2.76 GB, stddev: 468.16 MB
completion times: min:445.050ms max:688.967ms mean: 588.336ms stddev:78.409ms
execution rates: min:3.93 GB/sec max:5.62 GB/sec mean:4.69 GB/sec stddev:513.44 MB/sec
num instances: 17
- AverageThreadTokens: 5.29
- BloomFilterBytes: 0
- PeakMemoryUsage: 77.55 MB (81315222)
- PerHostPeakMemUsage: 373.39 MB (391526364)
- RowsProduced: 116.80K (116799)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 5.272ms
- TotalStorageWaitTime: 132.746ms
- TotalThreadsInvoluntaryContextSwitches: 24 (24)
- TotalThreadsTotalWallClockTime: 2s925ms
- TotalThreadsSysTime: 411.764ms
- TotalThreadsUserTime: 1s730ms
- TotalThreadsVoluntaryContextSwitches: 2.88K (2880)
Fragment Instance Lifecycle Timings:
- ExecTime: 447.336ms
- ExecTreeExecTime: 381.921ms
- OpenTime: 104.239ms
- ExecTreeOpenTime: 44.204us
- PrepareTime: 35.262ms
- ExecTreePrepareTime: 776.279us
DataStreamSender (dst_id=29):(Total: 39.370ms, non-child: 39.370ms, % non-child: 100.00%)
- BytesSent: 5.29 MB (5546297)
- NetworkThroughput(*): 624.97 MB/sec
- OverallThroughput: 139.13 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 116.80K (116799)
- SerializeBatchTime: 29.105ms
- TransmitDataRPCTime: 10.194ms
- UncompressedRowBatchSize: 7.24 MB (7592710)
CodeGen:(Total: 133.708ms, non-child: 133.708ms, % non-child: 100.00%)
- CodegenTime: 3.332ms
- CompileTime: 26.844ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.04K (1041)
- OptimizationTime: 76.142ms
- PeakMemoryUsage: 520.50 KB (532992)
- PrepareTime: 29.995ms
AGGREGATION_NODE (id=6):(Total: 382.685ms, non-child: 223.177ms, % non-child: 58.32%)
- GetNewBlockTime: 194.600us
- GetResultsTime: 4.361ms
- HTResizeTime: 7.586ms
- HashBuckets: 262.14K (262144)
- LargestPartitionPercent: 3 (3)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 21.01 MB (22028317)
- PinTime: 0.000ns
- ReductionFactorEstimate: 95.93
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 116.80K (116799)
- RowsReturnedRate: 309.60 K/sec
- StreamingTime: 215.699ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=5):(Total: 159.508ms, non-child: 159.508ms, % non-child: 100.00%)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 4.47
- BytesRead: 372.01 MB (390076376)
- BytesReadDataNodeCache: 362.88 MB (380505970)
- BytesReadLocal: 372.01 MB (390076376)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 372.01 MB (390076376)
- DecompressionTime: 725.154ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 29 (29)
- NumScannerThreadsStarted: 6 (6)
- PeakMemoryUsage: 60.36 MB (63295486)
- PerReadThreadRawHdfsThroughput: 35.40 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 153.412ms
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 11.56M (11559184)
- RowsReturned: 213.53K (213525)
- RowsReturnedRate: 1.40 M/sec
- ScanRangesComplete: 29 (29)
- ScannerThreadsInvoluntaryContextSwitches: 21 (21)
- ScannerThreadsTotalWallClockTime: 2s373ms
- MaterializeTupleTime(*): 663.547ms
- ScannerThreadsSysTime: 290.588ms
- ScannerThreadsUserTime: 1s468ms
- ScannerThreadsVoluntaryContextSwitches: 2.50K (2497)
- TotalRawHdfsReadTime(*): 10.362ms
- TotalReadThroughput: 299.08 MB/sec
Fragment F05:
Instance 514ee9ab39cdc507:50 (host=cdh5.net.cuberonlabs.com:22000):(Total: 687.604ms, non-child: 34.153ms, % non-child: 4.97%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.36 GB
MemoryUsage(500.000ms): 54.97 MB
ThreadUsage(500.000ms): 8
- AverageThreadTokens: 8.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 78.50 MB (82310017)
- PerHostPeakMemUsage: 385.83 MB (404575445)
- RowsProduced: 132.98K (132979)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 7.037ms
- TotalStorageWaitTime: 147.665ms
- TotalThreadsInvoluntaryContextSwitches: 11 (11)
- TotalThreadsTotalWallClockTime: 3s343ms
- TotalThreadsSysTime: 456.000ms
- TotalThreadsUserTime: 1s944ms
- TotalThreadsVoluntaryContextSwitches: 3.66K (3657)
Fragment Instance Lifecycle Timings:
- ExecTime: 541.865ms
- ExecTreeExecTime: 440.373ms
- OpenTime: 109.894ms
- ExecTreeOpenTime: 41.136us
- PrepareTime: 35.814ms
- ExecTreePrepareTime: 682.136us
DataStreamSender (dst_id=29):(Total: 72.317ms, non-child: 72.317ms, % non-child: 100.00%)
- BytesSent: 6.02 MB (6314568)
- NetworkThroughput(*): 227.55 MB/sec
- OverallThroughput: 83.27 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 132.98K (132979)
- SerializeBatchTime: 45.800ms
- TransmitDataRPCTime: 26.464ms
- UncompressedRowBatchSize: 8.24 MB (8644483)
CodeGen:(Total: 140.116ms, non-child: 140.116ms, % non-child: 100.00%)
- CodegenTime: 3.559ms
- CompileTime: 27.724ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.04K (1041)
- OptimizationTime: 80.800ms
- PeakMemoryUsage: 520.50 KB (532992)
- PrepareTime: 30.795ms
AGGREGATION_NODE (id=6):(Total: 441.016ms, non-child: 269.191ms, % non-child: 61.04%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 126.556us
- GetResultsTime: 6.514ms
- HTResizeTime: 8.240ms
- HashBuckets: 262.14K (262144)
- LargestPartitionPercent: 3 (3)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 21.12 MB (22150881)
- PinTime: 0.000ns
- ReductionFactorEstimate: 94.90
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 132.98K (132979)
- RowsReturnedRate: 301.53 K/sec
- StreamingTime: 259.087ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=5):(Total: 171.824ms, non-child: 171.824ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.36 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:105
BytesRead(500.000ms): 213.46 MB
- FooterProcessingTime: (Avg: 11.181ms ; Min: 3.027ms ; Max: 40.808ms ; Number of samples: 35)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.00
- BytesRead: 456.00 MB (478151119)
- BytesReadDataNodeCache: 445.20 MB (466829804)
- BytesReadLocal: 456.00 MB (478151119)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 456.00 MB (478151119)
- DecompressionTime: 839.814ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 35 (35)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 61.28 MB (64258403)
- PerReadThreadRawHdfsThroughput: 41.57 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 168.273ms
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 13.95M (13952334)
- RowsReturned: 252.70K (252699)
- RowsReturnedRate: 1.47 M/sec
- ScanRangesComplete: 35 (35)
- ScannerThreadsInvoluntaryContextSwitches: 11 (11)
- ScannerThreadsTotalWallClockTime: 2s691ms
- MaterializeTupleTime(*): 725.278ms
- ScannerThreadsSysTime: 304.000ms
- ScannerThreadsUserTime: 1s632ms
- ScannerThreadsVoluntaryContextSwitches: 3.32K (3323)
- TotalRawHdfsReadTime(*): 10.712ms
- TotalReadThroughput: 426.91 MB/sec
Instance 514ee9ab39cdc507:45 (host=cdh4.net.cuberonlabs.com:22000):(Total: 661.247ms, non-child: 31.385ms, % non-child: 4.75%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:40/3.59 GB
MemoryUsage(500.000ms): 49.60 MB
ThreadUsage(500.000ms): 8
- AverageThreadTokens: 8.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 77.28 MB (81036607)
- PerHostPeakMemUsage: 388.72 MB (407605616)
- RowsProduced: 141.25K (141246)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 5.610ms
- TotalStorageWaitTime: 177.993ms
- TotalThreadsInvoluntaryContextSwitches: 29 (29)
- TotalThreadsTotalWallClockTime: 3s632ms
- TotalThreadsSysTime: 544.000ms
- TotalThreadsUserTime: 2s136ms
- TotalThreadsVoluntaryContextSwitches: 3.25K (3249)
Fragment Instance Lifecycle Timings:
- ExecTime: 527.406ms
- ExecTreeExecTime: 458.044ms
- OpenTime: 95.539ms
- ExecTreeOpenTime: 40.960us
- PrepareTime: 38.263ms
- ExecTreePrepareTime: 989.420us
DataStreamSender (dst_id=29):(Total: 42.865ms, non-child: 42.865ms, % non-child: 100.00%)
- BytesSent: 6.40 MB (6708961)
- NetworkThroughput(*): 559.19 MB/sec
- OverallThroughput: 149.26 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 141.25K (141246)
- SerializeBatchTime: 31.349ms
- TransmitDataRPCTime: 11.441ms
- UncompressedRowBatchSize: 8.76 MB (9181874)
CodeGen:(Total: 127.990ms, non-child: 127.990ms, % non-child: 100.00%)
- CodegenTime: 2.601ms
- CompileTime: 24.009ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.04K (1041)
- OptimizationTime: 70.392ms
- PeakMemoryUsage: 520.50 KB (532992)
- PrepareTime: 33.012ms
AGGREGATION_NODE (id=6):(Total: 459.005ms, non-child: 266.717ms, % non-child: 58.11%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 243.252us
- GetResultsTime: 4.172ms
- HTResizeTime: 7.295ms
- HashBuckets: 262.14K (262144)
- LargestPartitionPercent: 3 (3)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 21.12 MB (22142733)
- PinTime: 0.000ns
- ReductionFactorEstimate: 94.30
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 141.25K (141246)
- RowsReturnedRate: 307.72 K/sec
- StreamingTime: 259.330ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=5):(Total: 192.288ms, non-child: 192.288ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:40/3.59 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 40 out of 40
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:120
BytesRead(500.000ms): 82.77 MB
- FooterProcessingTime: (Avg: 9.690ms ; Min: 2.778ms ; Max: 38.629ms ; Number of samples: 40)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.00
- BytesRead: 483.40 MB (506880472)
- BytesReadDataNodeCache: 471.06 MB (493942344)
- BytesReadLocal: 483.40 MB (506880472)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 483.40 MB (506880472)
- DecompressionTime: 891.624ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 40 (40)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 59.39 MB (62270139)
- PerReadThreadRawHdfsThroughput: 38.33 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 187.115ms
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 15.04M (15041855)
- RowsReturned: 277.35K (277345)
- RowsReturnedRate: 1.44 M/sec
- ScanRangesComplete: 40 (40)
- ScannerThreadsInvoluntaryContextSwitches: 25 (25)
- ScannerThreadsTotalWallClockTime: 3s009ms
- MaterializeTupleTime(*): 849.276ms
- ScannerThreadsSysTime: 396.000ms
- ScannerThreadsUserTime: 1s864ms
- ScannerThreadsVoluntaryContextSwitches: 2.71K (2710)
- TotalRawHdfsReadTime(*): 12.314ms
- TotalReadThroughput: 165.53 MB/sec
Instance 514ee9ab39cdc507:4a (host=cdh3.net.cuberonlabs.com:22000):(Total: 660.221ms, non-child: 35.841ms, % non-child: 5.43%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.39 GB
MemoryUsage(500.000ms): 54.43 MB
ThreadUsage(500.000ms): 8
- AverageThreadTokens: 8.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 84.45 MB (88551574)
- PerHostPeakMemUsage: 357.28 MB (374633487)
- RowsProduced: 141.71K (141710)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 5.858ms
- TotalStorageWaitTime: 138.966ms
- TotalThreadsInvoluntaryContextSwitches: 108 (108)
- TotalThreadsTotalWallClockTime: 3s465ms
- TotalThreadsSysTime: 500.000ms
- TotalThreadsUserTime: 2s116ms
- TotalThreadsVoluntaryContextSwitches: 3.84K (3836)
Fragment Instance Lifecycle Timings:
- ExecTime: 507.450ms
- ExecTreeExecTime: 437.331ms
- OpenTime: 123.153ms
- ExecTreeOpenTime: 40.432us
- PrepareTime: 29.572ms
- ExecTreePrepareTime: 735.848us
DataStreamSender (dst_id=29):(Total: 39.239ms, non-child: 39.239ms, % non-child: 100.00%)
- BytesSent: 6.42 MB (6731770)
- NetworkThroughput(*): 727.37 MB/sec
- OverallThroughput: 163.61 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 141.71K (141710)
- SerializeBatchTime: 30.358ms
- TransmitDataRPCTime: 8.826ms
- UncompressedRowBatchSize: 8.79 MB (9212034)
CodeGen:(Total: 147.088ms, non-child: 147.088ms, % non-child: 100.00%)
- CodegenTime: 3.001ms
- CompileTime: 31.999ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.04K (1041)
- OptimizationTime: 89.550ms
- PeakMemoryUsage: 520.50 KB (532992)
- PrepareTime: 24.838ms
AGGREGATION_NODE (id=6):(Total: 438.052ms, non-child: 279.724ms, % non-child: 63.86%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 129.259us
- GetResultsTime: 3.910ms
- HTResizeTime: 7.898ms
- HashBuckets: 262.14K (262144)
- LargestPartitionPercent: 3 (3)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 21.13 MB (22152905)
- PinTime: 0.000ns
- ReductionFactorEstimate: 97.39
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 141.71K (141710)
- RowsReturnedRate: 323.50 K/sec
- StreamingTime: 272.196ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=5):(Total: 158.327ms, non-child: 158.327ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/3.39 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:105
BytesRead(500.000ms): 178.97 MB
- FooterProcessingTime: (Avg: 10.346ms ; Min: 2.755ms ; Max: 31.854ms ; Number of samples: 35)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.00
- BytesRead: 454.94 MB (477042646)
- BytesReadDataNodeCache: 444.14 MB (465717587)
- BytesReadLocal: 454.94 MB (477042646)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 454.94 MB (477042646)
- DecompressionTime: 877.653ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 35 (35)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 65.39 MB (68567960)
- PerReadThreadRawHdfsThroughput: 34.27 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 154.473ms
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 14.44M (14439291)
- RowsReturned: 272.20K (272203)
- RowsReturnedRate: 1.72 M/sec
- ScanRangesComplete: 35 (35)
- ScannerThreadsInvoluntaryContextSwitches: 99 (99)
- ScannerThreadsTotalWallClockTime: 2s835ms
- MaterializeTupleTime(*): 823.963ms
- ScannerThreadsSysTime: 348.000ms
- ScannerThreadsUserTime: 1s812ms
- ScannerThreadsVoluntaryContextSwitches: 3.33K (3332)
- TotalRawHdfsReadTime(*): 12.965ms
- TotalReadThroughput: 357.95 MB/sec
Instance 514ee9ab39cdc507:46 (host=cdh16.net.cuberonlabs.com:22000):(Total: 657.968ms, non-child: 38.804ms, % non-child: 5.90%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.64 GB
MemoryUsage(500.000ms): 49.01 MB
ThreadUsage(500.000ms): 8
- AverageThreadTokens: 8.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 77.80 MB (81581582)
- PerHostPeakMemUsage: 366.62 MB (384426439)
- RowsProduced: 112.39K (112393)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 4.051ms
- TotalStorageWaitTime: 130.369ms
- TotalThreadsInvoluntaryContextSwitches: 7 (7)
- TotalThreadsTotalWallClockTime: 3s252ms
- TotalThreadsSysTime: 516.000ms
- TotalThreadsUserTime: 1s900ms
- TotalThreadsVoluntaryContextSwitches: 2.80K (2803)
Fragment Instance Lifecycle Timings:
- ExecTime: 512.585ms
- ExecTreeExecTime: 434.420ms
- OpenTime: 107.614ms
- ExecTreeOpenTime: 37.742us
- PrepareTime: 37.672ms
- ExecTreePrepareTime: 808.157us
DataStreamSender (dst_id=29):(Total: 44.664ms, non-child: 44.664ms, % non-child: 100.00%)
- BytesSent: 5.09 MB (5336638)
- NetworkThroughput(*): 590.69 MB/sec
- OverallThroughput: 113.95 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 112.39K (112393)
- SerializeBatchTime: 35.993ms
- TransmitDataRPCTime: 8.616ms
- UncompressedRowBatchSize: 6.97 MB (7306289)
CodeGen:(Total: 139.296ms, non-child: 139.296ms, % non-child: 100.00%)
- CodegenTime: 3.578ms
- CompileTime: 27.548ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.04K (1041)
- OptimizationTime: 78.864ms
- PeakMemoryUsage: 520.50 KB (532992)
- PrepareTime: 32.113ms
AGGREGATION_NODE (id=6):(Total: 435.203ms, non-child: 236.026ms, % non-child: 54.23%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 190.487us
- GetResultsTime: 5.736ms
- HTResizeTime: 8.575ms
- HashBuckets: 262.14K (262144)
- LargestPartitionPercent: 3 (3)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 21.10 MB (22120903)
- PinTime: 0.000ns
- ReductionFactorEstimate: 95.89
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 112.39K (112393)
- RowsReturnedRate: 258.25 K/sec
- StreamingTime: 227.286ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=5):(Total: 199.177ms, non-child: 199.177ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.64 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:84
BytesRead(500.000ms): 314.21 MB
- FooterProcessingTime: (Avg: 11.264ms ; Min: 3.319ms ; Max: 45.412ms ; Number of samples: 28)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.00
- BytesRead: 355.65 MB (372923733)
- BytesReadDataNodeCache: 347.01 MB (363866796)
- BytesReadLocal: 355.65 MB (372923733)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 355.65 MB (372923733)
- DecompressionTime: 807.599ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 28 (28)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 59.58 MB (62474573)
- PerReadThreadRawHdfsThroughput: 32.98 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 196.385ms
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 11.05M (11051815)
- RowsReturned: 204.57K (204566)
- RowsReturnedRate: 1.03 M/sec
- ScanRangesComplete: 28 (28)
- ScannerThreadsInvoluntaryContextSwitches: 7 (7)
- ScannerThreadsTotalWallClockTime: 2s632ms
- MaterializeTupleTime(*): 779.791ms
- ScannerThreadsSysTime: 400.000ms
- ScannerThreadsUserTime: 1s600ms
- ScannerThreadsVoluntaryContextSwitches: 2.51K (2508)
- TotalRawHdfsReadTime(*): 10.532ms
- TotalReadThroughput: 628.41 MB/sec
Instance 514ee9ab39cdc507:4b (host=cdh17.net.cuberonlabs.com:22000):(Total: 655.398ms, non-child: 29.401ms, % non-child: 4.49%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.58 GB
MemoryUsage(500.000ms): 57.25 MB
ThreadUsage(500.000ms): 8
- AverageThreadTokens: 8.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 80.12 MB (84009455)
- PerHostPeakMemUsage: 361.40 MB (378952889)
- RowsProduced: 120.43K (120434)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 5.335ms
- TotalStorageWaitTime: 107.031ms
- TotalThreadsInvoluntaryContextSwitches: 88 (88)
- TotalThreadsTotalWallClockTime: 3s303ms
- TotalThreadsSysTime: 596.000ms
- TotalThreadsUserTime: 2s032ms
- TotalThreadsVoluntaryContextSwitches: 2.27K (2275)
Fragment Instance Lifecycle Timings:
- ExecTime: 508.773ms
- ExecTreeExecTime: 435.748ms
- OpenTime: 109.170ms
- ExecTreeOpenTime: 43.822us
- PrepareTime: 37.417ms
- ExecTreePrepareTime: 818.414us
DataStreamSender (dst_id=29):(Total: 48.755ms, non-child: 48.755ms, % non-child: 100.00%)
- BytesSent: 5.45 MB (5715393)
- NetworkThroughput(*): 299.97 MB/sec
- OverallThroughput: 111.80 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 120.43K (120434)
- SerializeBatchTime: 30.533ms
- TransmitDataRPCTime: 18.170ms
- UncompressedRowBatchSize: 7.47 MB (7828962)
CodeGen:(Total: 140.684ms, non-child: 140.684ms, % non-child: 100.00%)
- CodegenTime: 3.670ms
- CompileTime: 28.925ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.04K (1041)
- OptimizationTime: 78.911ms
- PeakMemoryUsage: 520.50 KB (532992)
- PrepareTime: 32.098ms
AGGREGATION_NODE (id=6):(Total: 436.557ms, non-child: 314.593ms, % non-child: 72.06%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 187.740us
- GetResultsTime: 4.395ms
- HTResizeTime: 12.206ms
- HashBuckets: 262.14K (262144)
- LargestPartitionPercent: 3 (3)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 21.11 MB (22137429)
- PinTime: 0.000ns
- ReductionFactorEstimate: 96.78
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 120.43K (120434)
- RowsReturnedRate: 275.87 K/sec
- StreamingTime: 306.643ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=5):(Total: 121.963ms, non-child: 121.963ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.58 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 26 out of 26
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:78
BytesRead(500.000ms): 105.29 MB
- FooterProcessingTime: (Avg: 11.716ms ; Min: 3.793ms ; Max: 41.744ms ; Number of samples: 26)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.00
- BytesRead: 348.22 MB (365131885)
- BytesReadDataNodeCache: 340.19 MB (356717112)
- BytesReadLocal: 348.22 MB (365131885)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 348.22 MB (365131885)
- DecompressionTime: 840.908ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 26 (26)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 62.05 MB (65063625)
- PerReadThreadRawHdfsThroughput: 28.28 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 118.812ms
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 10.92M (10919165)
- RowsReturned: 216.19K (216191)
- RowsReturnedRate: 1.77 M/sec
- ScanRangesComplete: 26 (26)
- ScannerThreadsInvoluntaryContextSwitches: 79 (79)
- ScannerThreadsTotalWallClockTime: 2s685ms
- MaterializeTupleTime(*): 870.115ms
- ScannerThreadsSysTime: 448.000ms
- ScannerThreadsUserTime: 1s692ms
- ScannerThreadsVoluntaryContextSwitches: 1.93K (1928)
- TotalRawHdfsReadTime(*): 12.023ms
- TotalReadThroughput: 210.58 MB/sec
Instance 514ee9ab39cdc507:48 (host=cdh6.net.cuberonlabs.com:22000):(Total: 653.523ms, non-child: 32.066ms, % non-child: 4.91%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/2.89 GB
MemoryUsage(500.000ms): 1.88 MB, 23.21 MB
ThreadUsage(500.000ms): 1, 2
- AverageThreadTokens: 1.50
- BloomFilterBytes: 0
- PeakMemoryUsage: 71.25 MB (74706123)
- PerHostPeakMemUsage: 396.78 MB (416054636)
- RowsProduced: 123.36K (123356)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 4.166ms
- TotalStorageWaitTime: 154.366ms
- TotalThreadsInvoluntaryContextSwitches: 17 (17)
- TotalThreadsTotalWallClockTime: 3s212ms
- TotalThreadsSysTime: 364.000ms
- TotalThreadsUserTime: 1s768ms
- TotalThreadsVoluntaryContextSwitches: 3.09K (3087)
Fragment Instance Lifecycle Timings:
- ExecTime: 514.814ms
- ExecTreeExecTime: 444.423ms
- OpenTime: 104.093ms
- ExecTreeOpenTime: 82.860us
- PrepareTime: 34.563ms
- ExecTreePrepareTime: 802.400us
DataStreamSender (dst_id=29):(Total: 43.077ms, non-child: 43.077ms, % non-child: 100.00%)
- BytesSent: 5.58 MB (5855826)
- NetworkThroughput(*): 593.20 MB/sec
- OverallThroughput: 129.64 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 123.36K (123356)
- SerializeBatchTime: 33.598ms
- TransmitDataRPCTime: 9.414ms
- UncompressedRowBatchSize: 7.65 MB (8018940)
CodeGen:(Total: 133.143ms, non-child: 133.143ms, % non-child: 100.00%)
- CodegenTime: 3.411ms
- CompileTime: 27.694ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.04K (1041)
- OptimizationTime: 75.192ms
- PeakMemoryUsage: 520.50 KB (532992)
- PrepareTime: 29.504ms
AGGREGATION_NODE (id=6):(Total: 445.236ms, non-child: 217.385ms, % non-child: 48.82%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 273.844us
- GetResultsTime: 5.039ms
- HTResizeTime: 6.122ms
- HashBuckets: 262.14K (262144)
- LargestPartitionPercent: 3 (3)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 21.14 MB (22165714)
- PinTime: 0.000ns
- ReductionFactorEstimate: 92.62
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 123.36K (123356)
- RowsReturnedRate: 277.06 K/sec
- StreamingTime: 209.665ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=5):(Total: 227.850ms, non-child: 227.850ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/2.89 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:96
BytesRead(500.000ms): 0, 390.94 MB
- FooterProcessingTime: (Avg: 9.728ms ; Min: 3.129ms ; Max: 27.061ms ; Number of samples: 32)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 1.00
- BytesRead: 390.94 MB (409928073)
- BytesReadDataNodeCache: 381.07 MB (399577346)
- BytesReadLocal: 390.94 MB (409928073)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 390.94 MB (409928073)
- DecompressionTime: 716.149ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 32 (32)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 54.24 MB (56877713)
- PerReadThreadRawHdfsThroughput: 40.59 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 181.382ms
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 12.15M (12150960)
- RowsReturned: 226.91K (226915)
- RowsReturnedRate: 995.89 K/sec
- ScanRangesComplete: 32 (32)
- ScannerThreadsInvoluntaryContextSwitches: 15 (15)
- ScannerThreadsTotalWallClockTime: 2s593ms
- MaterializeTupleTime(*): 645.871ms
- ScannerThreadsSysTime: 256.000ms
- ScannerThreadsUserTime: 1s492ms
- ScannerThreadsVoluntaryContextSwitches: 2.67K (2670)
- TotalRawHdfsReadTime(*): 9.406ms
- TotalReadThroughput: 390.94 MB/sec
Instance 514ee9ab39cdc507:4f (host=cdh1.net.cuberonlabs.com:22000):(Total: 646.511ms, non-child: 30.992ms, % non-child: 4.79%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/2.99 GB
MemoryUsage(500.000ms): 1.88 MB, 53.26 MB
ThreadUsage(500.000ms): 1, 6
- AverageThreadTokens: 3.50
- BloomFilterBytes: 0
- PeakMemoryUsage: 67.81 MB (71105797)
- PerHostPeakMemUsage: 456.03 MB (478183185)
- RowsProduced: 125.59K (125593)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 4.787ms
- TotalStorageWaitTime: 174.654ms
- TotalThreadsInvoluntaryContextSwitches: 12 (12)
- TotalThreadsTotalWallClockTime: 3s210ms
- TotalThreadsSysTime: 356.000ms
- TotalThreadsUserTime: 1s884ms
- TotalThreadsVoluntaryContextSwitches: 2.56K (2558)
Fragment Instance Lifecycle Timings:
- ExecTime: 521.745ms
- ExecTreeExecTime: 458.849ms
- OpenTime: 91.609ms
- ExecTreeOpenTime: 38.944us
- PrepareTime: 33.134ms
- ExecTreePrepareTime: 646.472us
DataStreamSender (dst_id=29):(Total: 37.268ms, non-child: 37.268ms, % non-child: 100.00%)
- BytesSent: 5.69 MB (5963404)
- NetworkThroughput(*): 678.90 MB/sec
- OverallThroughput: 152.60 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 125.59K (125593)
- SerializeBatchTime: 28.785ms
- TransmitDataRPCTime: 8.376ms
- UncompressedRowBatchSize: 7.79 MB (8164357)
CodeGen:(Total: 118.770ms, non-child: 118.770ms, % non-child: 100.00%)
- CodegenTime: 3.437ms
- CompileTime: 23.685ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.04K (1041)
- OptimizationTime: 66.302ms
- PeakMemoryUsage: 520.50 KB (532992)
- PrepareTime: 28.101ms
AGGREGATION_NODE (id=6):(Total: 459.478ms, non-child: 221.947ms, % non-child: 48.30%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 527.576us
- GetResultsTime: 4.388ms
- HTResizeTime: 6.007ms
- HashBuckets: 262.14K (262144)
- LargestPartitionPercent: 3 (3)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 21.13 MB (22158339)
- PinTime: 0.000ns
- ReductionFactorEstimate: 95.82
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 125.59K (125593)
- RowsReturnedRate: 273.34 K/sec
- StreamingTime: 214.786ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=5):(Total: 237.531ms, non-child: 237.531ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:35/2.99 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:105
BytesRead(500.000ms): 0, 403.52 MB
- FooterProcessingTime: (Avg: 9.537ms ; Min: 3.384ms ; Max: 30.438ms ; Number of samples: 35)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 5.00
- BytesRead: 403.52 MB (423122517)
- BytesReadDataNodeCache: 392.73 MB (411804248)
- BytesReadLocal: 403.52 MB (423122517)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 403.52 MB (423122517)
- DecompressionTime: 743.317ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 35 (35)
- NumScannerThreadsStarted: 6 (6)
- PeakMemoryUsage: 51.80 MB (54321003)
- PerReadThreadRawHdfsThroughput: 27.96 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 234.240ms
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 12.55M (12550697)
- RowsReturned: 231.64K (231641)
- RowsReturnedRate: 975.20 K/sec
- ScanRangesComplete: 35 (35)
- ScannerThreadsInvoluntaryContextSwitches: 6 (6)
- ScannerThreadsTotalWallClockTime: 2s596ms
- MaterializeTupleTime(*): 675.027ms
- ScannerThreadsSysTime: 240.000ms
- ScannerThreadsUserTime: 1s632ms
- ScannerThreadsVoluntaryContextSwitches: 2.11K (2108)
- TotalRawHdfsReadTime(*): 14.091ms
- TotalReadThroughput: 403.52 MB/sec
Instance 514ee9ab39cdc507:55 (host=cdh10.net.cuberonlabs.com:22000):(Total: 645.472ms, non-child: 35.451ms, % non-child: 5.49%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.75 GB
MemoryUsage(500.000ms): 63.91 MB
ThreadUsage(500.000ms): 8
- AverageThreadTokens: 8.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 89.85 MB (94211855)
- PerHostPeakMemUsage: 367.15 MB (384989011)
- RowsProduced: 112.36K (112359)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 5.451ms
- TotalStorageWaitTime: 170.218ms
- TotalThreadsInvoluntaryContextSwitches: 84 (84)
- TotalThreadsTotalWallClockTime: 3s288ms
- TotalThreadsSysTime: 392.000ms
- TotalThreadsUserTime: 1s888ms
- TotalThreadsVoluntaryContextSwitches: 2.82K (2822)
Fragment Instance Lifecycle Timings:
- ExecTime: 504.889ms
- ExecTreeExecTime: 436.558ms
- OpenTime: 105.468ms
- ExecTreeOpenTime: 39.362us
- PrepareTime: 35.078ms
- ExecTreePrepareTime: 741.854us
DataStreamSender (dst_id=29):(Total: 37.986ms, non-child: 37.986ms, % non-child: 100.00%)
- BytesSent: 5.09 MB (5337854)
- NetworkThroughput(*): 731.72 MB/sec
- OverallThroughput: 134.01 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 112.36K (112359)
- SerializeBatchTime: 30.973ms
- TransmitDataRPCTime: 6.956ms
- UncompressedRowBatchSize: 6.97 MB (7304059)
CodeGen:(Total: 134.764ms, non-child: 134.764ms, % non-child: 100.00%)
- CodegenTime: 3.433ms
- CompileTime: 27.716ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.04K (1041)
- OptimizationTime: 76.560ms
- PeakMemoryUsage: 520.50 KB (532992)
- PrepareTime: 29.786ms
AGGREGATION_NODE (id=6):(Total: 437.269ms, non-child: 268.131ms, % non-child: 61.32%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 203.126us
- GetResultsTime: 4.867ms
- HTResizeTime: 9.102ms
- HashBuckets: 262.14K (262144)
- LargestPartitionPercent: 3 (3)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 21.10 MB (22126445)
- PinTime: 0.000ns
- ReductionFactorEstimate: 100.37
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 112.36K (112359)
- RowsReturnedRate: 256.95 K/sec
- StreamingTime: 259.892ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=5):(Total: 169.137ms, non-child: 169.137ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.75 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0%
File Formats: PARQUET/SNAPPY:90
BytesRead(500.000ms): 289.40 MB
- FooterProcessingTime: (Avg: 11.885ms ; Min: 3.114ms ; Max: 57.629ms ; Number of samples: 30)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.00
- BytesRead: 371.89 MB (389958203)
- BytesReadDataNodeCache: 362.64 MB (380253704)
- BytesReadLocal: 371.89 MB (389958203)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 371.89 MB (389958203)
- DecompressionTime: 778.890ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 30 (30)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 75.14 MB (78789187)
- PerReadThreadRawHdfsThroughput: 38.10 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 161.809ms
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 11.46M (11459388)
- RowsReturned: 199.85K (199852)
- RowsReturnedRate: 1.18 M/sec
- ScanRangesComplete: 30 (30)
- ScannerThreadsInvoluntaryContextSwitches: 71 (71)
- ScannerThreadsTotalWallClockTime: 2s677ms
- MaterializeTupleTime(*): 726.168ms
- ScannerThreadsSysTime: 244.000ms
- ScannerThreadsUserTime: 1s604ms
- ScannerThreadsVoluntaryContextSwitches: 2.53K (2530)
- TotalRawHdfsReadTime(*): 9.531ms
- TotalReadThroughput: 578.80 MB/sec
Instance 514ee9ab39cdc507:47 (host=cdh13.net.cuberonlabs.com:22000):(Total: 621.852ms, non-child: 30.232ms, % non-child: 4.86%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/2.80 GB
MemoryUsage(500.000ms): 49.12 MB
ThreadUsage(500.000ms): 8
- AverageThreadTokens: 8.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 76.25 MB (79955745)
- PerHostPeakMemUsage: 380.17 MB (398636858)
- RowsProduced: 117.26K (117259)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 4.502ms
- TotalStorageWaitTime: 242.949ms
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 3s193ms
- TotalThreadsSysTime: 420.000ms
- TotalThreadsUserTime: 1s676ms
- TotalThreadsVoluntaryContextSwitches: 3.04K (3037)
Fragment Instance Lifecycle Timings:
- ExecTime: 481.211ms
- ExecTreeExecTime: 423.309ms
- OpenTime: 104.672ms
- ExecTreeOpenTime: 42.384us
- PrepareTime: 35.933ms
- ExecTreePrepareTime: 763.140us
DataStreamSender (dst_id=29):(Total: 32.748ms, non-child: 32.748ms, % non-child: 100.00%)
- BytesSent: 5.31 MB (5570881)
- NetworkThroughput(*): 881.00 MB/sec
- OverallThroughput: 162.23 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 117.26K (117259)
- SerializeBatchTime: 26.654ms
- TransmitDataRPCTime: 6.030ms
- UncompressedRowBatchSize: 7.27 MB (7622583)
CodeGen:(Total: 134.809ms, non-child: 134.809ms, % non-child: 100.00%)
- CodegenTime: 3.459ms
- CompileTime: 26.767ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.04K (1041)
- OptimizationTime: 76.743ms
- PeakMemoryUsage: 520.50 KB (532992)
- PrepareTime: 30.558ms
AGGREGATION_NODE (id=6):(Total: 424.062ms, non-child: 204.892ms, % non-child: 48.32%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 214.859us
- GetResultsTime: 3.988ms
- HTResizeTime: 6.145ms
- HashBuckets: 262.14K (262144)
- LargestPartitionPercent: 3 (3)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 21.12 MB (22148937)
- PinTime: 0.000ns
- ReductionFactorEstimate: 98.52
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 117.26K (117259)
- RowsReturnedRate: 276.51 K/sec
- StreamingTime: 198.435ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=5):(Total: 219.170ms, non-child: 219.170ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/2.80 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:93
BytesRead(500.000ms): 223.12 MB
- FooterProcessingTime: (Avg: 13.222ms ; Min: 2.911ms ; Max: 58.156ms ; Number of samples: 31)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.00
- BytesRead: 379.46 MB (397894562)
- BytesReadDataNodeCache: 369.90 MB (387872500)
- BytesReadLocal: 379.46 MB (397894562)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 379.46 MB (397894562)
- DecompressionTime: 715.004ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 31 (31)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 60.63 MB (63573195)
- PerReadThreadRawHdfsThroughput: 34.75 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 216.053ms
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 11.68M (11677391)
- RowsReturned: 214.94K (214943)
- RowsReturnedRate: 980.71 K/sec
- ScanRangesComplete: 31 (31)
- ScannerThreadsInvoluntaryContextSwitches: 0 (0)
- ScannerThreadsTotalWallClockTime: 2s607ms
- MaterializeTupleTime(*): 626.952ms
- ScannerThreadsSysTime: 312.000ms
- ScannerThreadsUserTime: 1s424ms
- ScannerThreadsVoluntaryContextSwitches: 2.60K (2603)
- TotalRawHdfsReadTime(*): 10.665ms
- TotalReadThroughput: 446.23 MB/sec
Instance 514ee9ab39cdc507:51 (host=cdh7.net.cuberonlabs.com:22000):(Total: 549.323ms, non-child: 28.015ms, % non-child: 5.10%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:27/2.46 GB
MemoryUsage(500.000ms): 1.88 MB
ThreadUsage(500.000ms): 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 77.58 MB (81349514)
- PerHostPeakMemUsage: 359.68 MB (377149769)
- RowsProduced: 110.04K (110039)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 6.604ms
- TotalStorageWaitTime: 84.908ms
- TotalThreadsInvoluntaryContextSwitches: 9 (9)
- TotalThreadsTotalWallClockTime: 2s582ms
- TotalThreadsSysTime: 352.000ms
- TotalThreadsUserTime: 1s564ms
- TotalThreadsVoluntaryContextSwitches: 2.81K (2812)
Fragment Instance Lifecycle Timings:
- ExecTime: 407.260ms
- ExecTreeExecTime: 342.510ms
- OpenTime: 106.247ms
- ExecTreeOpenTime: 40.044us
- PrepareTime: 35.781ms
- ExecTreePrepareTime: 790.926us
DataStreamSender (dst_id=29):(Total: 41.570ms, non-child: 41.570ms, % non-child: 100.00%)
- BytesSent: 4.98 MB (5226642)
- NetworkThroughput(*): 322.68 MB/sec
- OverallThroughput: 119.91 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 110.04K (110039)
- SerializeBatchTime: 26.009ms
- TransmitDataRPCTime: 15.447ms
- UncompressedRowBatchSize: 6.82 MB (7153227)
CodeGen:(Total: 136.442ms, non-child: 136.442ms, % non-child: 100.00%)
- CodegenTime: 3.329ms
- CompileTime: 27.337ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.04K (1041)
- OptimizationTime: 77.622ms
- PeakMemoryUsage: 520.50 KB (532992)
- PrepareTime: 30.704ms
AGGREGATION_NODE (id=6):(Total: 343.295ms, non-child: 186.638ms, % non-child: 54.37%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 146.177us
- GetResultsTime: 4.137ms
- HTResizeTime: 6.246ms
- HashBuckets: 262.14K (262144)
- LargestPartitionPercent: 3 (3)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 21.09 MB (22118154)
- PinTime: 0.000ns
- ReductionFactorEstimate: 93.86
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 110.04K (110039)
- RowsReturnedRate: 320.54 K/sec
- StreamingTime: 179.721ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=5):(Total: 156.656ms, non-child: 156.656ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:27/2.46 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 27 out of 27
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:81
BytesRead(500.000ms): 0
- FooterProcessingTime: (Avg: 12.799ms ; Min: 2.893ms ; Max: 49.555ms ; Number of samples: 27)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 331.18 MB (347264442)
- BytesReadDataNodeCache: 322.86 MB (338539012)
- BytesReadLocal: 331.18 MB (347264442)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 331.18 MB (347264442)
- DecompressionTime: 651.733ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 27 (27)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 61.67 MB (64666212)
- PerReadThreadRawHdfsThroughput: 34.71 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 153.607ms
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 10.29M (10293228)
- RowsReturned: 191.42K (191421)
- RowsReturnedRate: 1.22 M/sec
- ScanRangesComplete: 27 (27)
- ScannerThreadsInvoluntaryContextSwitches: 8 (8)
- ScannerThreadsTotalWallClockTime: 2s068ms
- MaterializeTupleTime(*): 583.869ms
- ScannerThreadsSysTime: 228.000ms
- ScannerThreadsUserTime: 1s340ms
- ScannerThreadsVoluntaryContextSwitches: 2.45K (2453)
- TotalRawHdfsReadTime(*): 9.316ms
- TotalReadThroughput: 0.00 /sec
Instance 514ee9ab39cdc507:54 (host=cdh9.net.cuberonlabs.com:22000):(Total: 548.149ms, non-child: 29.599ms, % non-child: 5.40%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/3.02 GB
MemoryUsage(500.000ms): 1.88 MB
ThreadUsage(500.000ms): 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 74.45 MB (78071656)
- PerHostPeakMemUsage: 380.31 MB (398787248)
- RowsProduced: 126.30K (126296)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 3.960ms
- TotalStorageWaitTime: 124.489ms
- TotalThreadsInvoluntaryContextSwitches: 5 (5)
- TotalThreadsTotalWallClockTime: 2s783ms
- TotalThreadsSysTime: 376.000ms
- TotalThreadsUserTime: 1s804ms
- TotalThreadsVoluntaryContextSwitches: 3.00K (3003)
Fragment Instance Lifecycle Timings:
- ExecTime: 407.614ms
- ExecTreeExecTime: 348.574ms
- OpenTime: 104.615ms
- ExecTreeOpenTime: 39.573us
- PrepareTime: 35.886ms
- ExecTreePrepareTime: 775.907us
DataStreamSender (dst_id=29):(Total: 34.399ms, non-child: 34.399ms, % non-child: 100.00%)
- BytesSent: 5.72 MB (5998810)
- NetworkThroughput(*): 893.70 MB/sec
- OverallThroughput: 166.31 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 126.30K (126296)
- SerializeBatchTime: 27.922ms
- TransmitDataRPCTime: 6.401ms
- UncompressedRowBatchSize: 7.83 MB (8210056)
CodeGen:(Total: 134.819ms, non-child: 134.819ms, % non-child: 100.00%)
- CodegenTime: 3.264ms
- CompileTime: 27.778ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.04K (1041)
- OptimizationTime: 75.685ms
- PeakMemoryUsage: 520.50 KB (532992)
- PrepareTime: 30.617ms
AGGREGATION_NODE (id=6):(Total: 349.330ms, non-child: 221.017ms, % non-child: 63.27%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 169.295us
- GetResultsTime: 4.111ms
- HTResizeTime: 6.953ms
- HashBuckets: 262.14K (262144)
- LargestPartitionPercent: 3 (3)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 21.13 MB (22155016)
- PinTime: 0.000ns
- ReductionFactorEstimate: 102.94
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 126.30K (126296)
- RowsReturnedRate: 361.54 K/sec
- StreamingTime: 214.048ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=5):(Total: 128.313ms, non-child: 128.313ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/3.02 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:93
BytesRead(500.000ms): 0
- FooterProcessingTime: (Avg: 8.548ms ; Min: 2.841ms ; Max: 33.365ms ; Number of samples: 31)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 407.14 MB (426915606)
- BytesReadDataNodeCache: 397.58 MB (416888203)
- BytesReadLocal: 407.14 MB (426915606)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 407.14 MB (426915606)
- DecompressionTime: 754.335ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 31 (31)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 56.51 MB (59253309)
- PerReadThreadRawHdfsThroughput: 34.83 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 125.106ms
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 12.71M (12711965)
- RowsReturned: 237.09K (237087)
- RowsReturnedRate: 1.85 M/sec
- ScanRangesComplete: 31 (31)
- ScannerThreadsInvoluntaryContextSwitches: 3 (3)
- ScannerThreadsTotalWallClockTime: 2s271ms
- MaterializeTupleTime(*): 672.484ms
- ScannerThreadsSysTime: 288.000ms
- ScannerThreadsUserTime: 1s516ms
- ScannerThreadsVoluntaryContextSwitches: 2.59K (2588)
- TotalRawHdfsReadTime(*): 11.416ms
- TotalReadThroughput: 0.00 /sec
Instance 514ee9ab39cdc507:49 (host=cdh15.net.cuberonlabs.com:22000):(Total: 543.417ms, non-child: 28.174ms, % non-child: 5.18%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.66 GB
MemoryUsage(500.000ms): 1.36 MB, 6.26 MB
ThreadUsage(500.000ms): 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 69.95 MB (73345882)
- PerHostPeakMemUsage: 345.60 MB (362388576)
- RowsProduced: 111.14K (111139)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 5.502ms
- TotalStorageWaitTime: 135.206ms
- TotalThreadsInvoluntaryContextSwitches: 3 (3)
- TotalThreadsTotalWallClockTime: 2s701ms
- TotalThreadsSysTime: 412.000ms
- TotalThreadsUserTime: 1s616ms
- TotalThreadsVoluntaryContextSwitches: 2.81K (2808)
Fragment Instance Lifecycle Timings:
- ExecTime: 397.878ms
- ExecTreeExecTime: 342.782ms
- OpenTime: 108.406ms
- ExecTreeOpenTime: 46.881us
- PrepareTime: 37.083ms
- ExecTreePrepareTime: 768.778us
DataStreamSender (dst_id=29):(Total: 31.988ms, non-child: 31.988ms, % non-child: 100.00%)
- BytesSent: 5.03 MB (5277069)
- NetworkThroughput(*): 731.96 MB/sec
- OverallThroughput: 157.33 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 111.14K (111139)
- SerializeBatchTime: 25.061ms
- TransmitDataRPCTime: 6.875ms
- UncompressedRowBatchSize: 6.89 MB (7224739)
CodeGen:(Total: 139.727ms, non-child: 139.727ms, % non-child: 100.00%)
- CodegenTime: 3.515ms
- CompileTime: 28.366ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.04K (1041)
- OptimizationTime: 78.859ms
- PeakMemoryUsage: 520.50 KB (532992)
- PrepareTime: 31.750ms
AGGREGATION_NODE (id=6):(Total: 343.527ms, non-child: 190.709ms, % non-child: 55.52%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 134.288us
- GetResultsTime: 3.899ms
- HTResizeTime: 6.013ms
- HashBuckets: 262.14K (262144)
- LargestPartitionPercent: 3 (3)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 21.12 MB (22150937)
- PinTime: 0.000ns
- ReductionFactorEstimate: 94.09
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 111.14K (111139)
- RowsReturnedRate: 323.52 K/sec
- StreamingTime: 184.342ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=5):(Total: 152.817ms, non-child: 152.817ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:30/2.66 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:90
BytesRead(500.000ms): 0
- FooterProcessingTime: (Avg: 9.971ms ; Min: 2.690ms ; Max: 33.392ms ; Number of samples: 30)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 359.86 MB (377336639)
- BytesReadDataNodeCache: 350.60 MB (367631328)
- BytesReadLocal: 359.86 MB (377336639)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 359.86 MB (377336639)
- DecompressionTime: 685.099ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 30 (30)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 54.30 MB (56938047)
- PerReadThreadRawHdfsThroughput: 34.47 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 149.344ms
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 11.11M (11113210)
- RowsReturned: 198.02K (198017)
- RowsReturnedRate: 1.30 M/sec
- ScanRangesComplete: 30 (30)
- ScannerThreadsInvoluntaryContextSwitches: 3 (3)
- ScannerThreadsTotalWallClockTime: 2s195ms
- MaterializeTupleTime(*): 623.552ms
- ScannerThreadsSysTime: 292.000ms
- ScannerThreadsUserTime: 1s392ms
- ScannerThreadsVoluntaryContextSwitches: 2.39K (2389)
- TotalRawHdfsReadTime(*): 10.196ms
- TotalReadThroughput: 0.00 /sec
Instance 514ee9ab39cdc507:52 (host=cdh8.net.cuberonlabs.com:22000):(Total: 542.254ms, non-child: 30.723ms, % non-child: 5.67%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.70 GB
MemoryUsage(500.000ms): 42.09 MB
ThreadUsage(500.000ms): 8
- AverageThreadTokens: 8.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 82.28 MB (86276967)
- PerHostPeakMemUsage: 365.81 MB (383578250)
- RowsProduced: 112.08K (112083)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 5.252ms
- TotalStorageWaitTime: 89.659ms
- TotalThreadsInvoluntaryContextSwitches: 7 (7)
- TotalThreadsTotalWallClockTime: 2s546ms
- TotalThreadsSysTime: 360.000ms
- TotalThreadsUserTime: 1s520ms
- TotalThreadsVoluntaryContextSwitches: 3.91K (3913)
Fragment Instance Lifecycle Timings:
- ExecTime: 389.554ms
- ExecTreeExecTime: 325.322ms
- OpenTime: 109.312ms
- ExecTreeOpenTime: 52.417us
- PrepareTime: 43.357ms
- ExecTreePrepareTime: 822.582us
DataStreamSender (dst_id=29):(Total: 39.330ms, non-child: 39.330ms, % non-child: 100.00%)
- BytesSent: 5.08 MB (5322384)
- NetworkThroughput(*): 434.67 MB/sec
- OverallThroughput: 129.06 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 112.08K (112083)
- SerializeBatchTime: 27.572ms
- TransmitDataRPCTime: 11.677ms
- UncompressedRowBatchSize: 6.95 MB (7286123)
CodeGen:(Total: 146.046ms, non-child: 146.046ms, % non-child: 100.00%)
- CodegenTime: 4.098ms
- CompileTime: 23.188ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.04K (1041)
- OptimizationTime: 84.736ms
- PeakMemoryUsage: 520.50 KB (532992)
- PrepareTime: 37.229ms
AGGREGATION_NODE (id=6):(Total: 326.153ms, non-child: 225.675ms, % non-child: 69.19%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 142.191us
- GetResultsTime: 4.214ms
- HTResizeTime: 8.608ms
- HashBuckets: 262.14K (262144)
- LargestPartitionPercent: 3 (3)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 21.12 MB (22141642)
- PinTime: 0.000ns
- ReductionFactorEstimate: 95.91
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 112.08K (112083)
- RowsReturnedRate: 343.65 K/sec
- StreamingTime: 217.702ms
- UnpinTime: 0.000ns
HDFS_SCAN_NODE (id=5):(Total: 100.478ms, non-child: 100.478ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/2.70 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:84
BytesRead(500.000ms): 329.47 MB
- FooterProcessingTime: (Avg: 11.387ms ; Min: 2.965ms ; Max: 41.363ms ; Number of samples: 28)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 7.00
- BytesRead: 362.83 MB (380457173)
- BytesReadDataNodeCache: 354.20 MB (371403734)
- BytesReadLocal: 362.83 MB (380457173)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 362.83 MB (380457173)
- DecompressionTime: 671.769ms
- MaxCompressedTextFileLength: 0
- NumColumns: 3 (3)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 28 (28)
- NumScannerThreadsStarted: 7 (7)
- PeakMemoryUsage: 63.53 MB (66614002)
- PerReadThreadRawHdfsThroughput: 42.33 GB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 96.697ms
- RowBatchQueuePutWaitTime: 0.000ns
- RowsRead: 11.39M (11388046)
- RowsReturned: 207.74K (207744)
- RowsReturnedRate: 2.07 M/sec
- ScanRangesComplete: 28 (28)
- ScannerThreadsInvoluntaryContextSwitches: 5 (5)
- ScannerThreadsTotalWallClockTime: 2s047ms
- MaterializeTupleTime(*): 556.166ms
- ScannerThreadsSysTime: 248.000ms
- ScannerThreadsUserTime: 1s244ms
- ScannerThreadsVoluntaryContextSwitches: 3.63K (3627)
- TotalRawHdfsReadTime(*): 8.369ms
- TotalReadThroughput: 658.94 MB/sec
Instance 514ee9ab39cdc507:4c (host=cdh2.net.cuberonlabs.com:22000):(Total: 532.170ms, non-child: 34.810ms, % non-child: 6.54%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/3.00 GB
MemoryUsage(500.000ms): 1.88 MB
ThreadUsage(500.000ms): 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 71.15 MB (74603742)
- PerHostPeakMemUsage: 376.21 MB (394489170)
- RowsProduced: 129.24K (129236)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 5.095ms
- TotalStorageWaitTime: 139.914ms
- TotalThreadsInvoluntaryContextSwitches: 2 (2)
- TotalThreadsTotalWallClockTime: 2s938ms
- TotalThreadsSysTime: 440.000ms
- TotalThreadsUserTime: 1s816ms
- TotalThreadsVoluntaryContextSwitches: 2.85K (2854)
Fragment Instance Lifecycle Timings:
- ExecTime: 437.013ms
- ExecTreeExecTime: 367.871ms
- OpenTime: 73.676ms
- ExecTreeOpenTime: 39.260us
- PrepareTime: 21.424ms
- ExecTreePrepareTime: 981.152us
DataStreamSender (dst_id=29):(Total: 39.108ms, non-child: 39.108ms, % non-child: 100.00%)
- BytesSent: 5.85 MB (6135785)
- NetworkThroughput(*): 813.87 MB/sec
- OverallThroughput: 149.62 MB/sec
- PeakMemoryUsage: 1.08 MB (1133560)
- RowsReturned: 129.24K (129236)
- SerializeBatchTime: 31.836ms
- TransmitDataRPCTime: 7.189ms
- UncompressedRowBatchSize: 8.01 MB (8401156)
CodeGen:(Total: 89.416ms, non-child: 89.416ms, % non-child: 100.00%)
- CodegenTime: 1.983ms
- CompileTime: 21.257ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1992760)
- NumFunctions: 56 (56)
- NumInstructions: 1.04K (1041)
- OptimizationTime: 51.691ms
- PeakMemoryUsage: 520.50 KB (532992)
- PrepareTime: 16.023ms
AGGREGATION_NODE (id=6):(Total: 368.835ms, non-child: 221.859ms, % non-child: 60.15%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 179.052us
- GetResultsTime: 4.681ms
- HTResizeTime: 6.629ms
- HashBuckets: 262.14K (262144)
- LargestPartitionPercent: 3 (3)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 21.1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment