Skip to content

Instantly share code, notes, and snippets.

@momohuri

momohuri/no mt_dop on view Secret

Created March 9, 2017 23:22
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save momohuri/5954233819c54376c85c795b006f91ad to your computer and use it in GitHub Desktop.
Save momohuri/5954233819c54376c85c795b006f91ad to your computer and use it in GitHub Desktop.
Download ZIP
Raw
no mt_dop on view
Query (id=9947b1c08dd46d0f:f76e423500000000)
Summary
Session ID: 384d0f41fc5be915:bea73c8cb2e8e7a4
Session Type: HIVESERVER2
HiveServer2 Protocol Version: V6
Start Time: 2017-03-09 15:21:44.566891000
End Time:
Query Type: QUERY
Query State: CREATED
Query Status: OK
Impala Version: impalad version 2.7.0-cdh5.10.0 RELEASE (build 785a073cd07e2540d521ecebb8b38161ccbd2aa2)
User: hdfs
Connected User: hdfs
Delegated User:
Network Address: ::ffff:172.16.0.221:40490
Default Db: wikia_prod
Sql Statement: SELECT `ga_category`, count(*) `y`
FROM
(SELECT `ga_category`
FROM trackingevent
WHERE `cuberon_event_date` BETWEEN "2017-01-31" AND "2017-02-14") Q1
WHERE (`ga_category` LIKE '%editor%'
AND `ga_category` IS NOT NULL)
GROUP BY `ga_category`
ORDER BY `y` DESC LIMIT 10
Coordinator: cdh4.net.cuberonlabs.com:22000
Query Options (non default): QUERY_TIMEOUT_S=600,MT_DOP=0
Plan:
----------------
Estimated Per-Host Requirements: Memory=2.51GB VCores=2
PLAN-ROOT SINK
|
07:MERGING-EXCHANGE [UNPARTITIONED]
| order by: count(*) DESC
| limit: 10
| hosts=17 per-host-mem=unavailable
| tuple-ids=6 row-size=40B cardinality=10
|
04:TOP-N [LIMIT=10]
| order by: count(*) DESC
| hosts=17 per-host-mem=397B
| tuple-ids=6 row-size=40B cardinality=10
|
06:AGGREGATE [FINALIZE]
| output: count:merge(*)
| group by: ga_category
| hosts=17 per-host-mem=10.00MB
| tuple-ids=5 row-size=40B cardinality=170
|
05:EXCHANGE [HASH(ga_category)]
| hosts=17 per-host-mem=0B
| tuple-ids=5 row-size=40B cardinality=170
|
03:AGGREGATE [STREAMING]
| output: count(*)
| group by: ga_category
| hosts=17 per-host-mem=10.00MB
| tuple-ids=5 row-size=40B cardinality=170
|
00:UNION
| hosts=17 per-host-mem=0B
| tuple-ids=2 row-size=32B cardinality=205856830
|
|--02:SCAN HDFS [wikia_prod.trackingevent_streaming, RANDOM]
| partitions=0/0 files=0 size=0B
| predicates: wikia_prod.trackingevent_streaming.ga_category IS NOT NULL, wikia_prod.trackingevent_streaming.ga_category LIKE '%editor%'
| table stats: 0 rows total
| column stats: all
| hosts=1 per-host-mem=0B
| tuple-ids=1 row-size=16B cardinality=0
|
01:SCAN HDFS [wikia_prod.trackingevent_batch, RANDOM]
partitions=14/14 files=361 size=49.59GB
predicates: wikia_prod.trackingevent_batch.ga_category IS NOT NULL, wikia_prod.trackingevent_batch.ga_category LIKE '%editor%'
table stats: 2058568297 rows total
column stats: all
hosts=17 per-host-mem=2.49GB
tuple-ids=0 row-size=32B cardinality=205856830
----------------
Estimated Per-Host Mem: 2696937472
Estimated Per-Host VCores: 2
Request Pool: root.hdfs
Admission result: Admitted immediately
- ComputeScanRangeAssignmentTimer: 957940
- InactiveTotalTime: 0
- TotalTime: 0
Planner Timeline
Analysis finished: 1833977
Equivalence classes computed: 3189281
Single node plan created: 6882370
Runtime filters computed: 6963315
Distributed plan created: 7398176
Lineage info computed: 7538445
Planning finished: 9899458
Query Timeline
Query submitted: 49666
Planning finished: 18203516
Submit for admission: 20379778
Completed admission: 20489496
Ready to start 35 fragment instances: 20965782
All 35 fragment instances started: 35309010
Rows available: 3452007810
First row fetched: 4655696792
ImpalaServer
- ClientFetchWaitTimer: 1203700092
- InactiveTotalTime: 0
- RowMaterializationTimer: 5382646
- TotalTime: 0
Execution Profile 9947b1c08dd46d0f:f76e423500000000
Number of filters: 0
Filter routing table:
ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled
----------------------------------------------------------------------------------------------------------------------------
Fragment instance start latencies: Count: 35, 25th %-ile: 1ms, 50th %-ile: 2ms, 75th %-ile: 3ms, 90th %-ile: 5ms, 95th %-ile: 5ms, 99.9th %-ile: 5ms
Per Node Peak Memory Usage: cdh8.net.cuberonlabs.com:22000(62.90 MB) cdh2.net.cuberonlabs.com:22000(83.45 MB) cdh15.net.cuberonlabs.com:22000(48.00 MB) cdh3.net.cuberonlabs.com:22000(67.53 MB) cdh10.net.cuberonlabs.com:22000(42.30 MB) cdh17.net.cuberonlabs.com:22000(48.19 MB) cdh5.net.cuberonlabs.com:22000(56.69 MB) cdh1.net.cuberonlabs.com:22000(56.34 MB) cdh12.net.cuberonlabs.com:22000(47.09 MB) cdh7.net.cuberonlabs.com:22000(54.27 MB) cdh9.net.cuberonlabs.com:22000(49.07 MB) cdh14.net.cuberonlabs.com:22000(59.59 MB) cdh6.net.cuberonlabs.com:22000(50.50 MB) cdh16.net.cuberonlabs.com:22000(43.66 MB) cdh13.net.cuberonlabs.com:22000(52.47 MB) cdh11.net.cuberonlabs.com:22000(44.66 MB) cdh4.net.cuberonlabs.com:22000(49.80 MB)
- FiltersReceived: 0
- FinalizationTimer: 0
- InactiveTotalTime: 0
- TotalTime: 3435881250
Coordinator Fragment F04
Instance 9947b1c08dd46d0f:f76e423500000000 (host=cdh4.net.cuberonlabs.com:22000)
- AverageThreadTokens: 0.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 275968
- PerHostPeakMemUsage: 52218504
- RowsProduced: 8
- TotalNetworkReceiveTime: 0
- TotalNetworkSendTime: 0
- TotalStorageWaitTime: 0
- TotalThreadsInvoluntaryContextSwitches: 0
- TotalThreadsTotalWallClockTime: 4596679964
- TotalThreadsSysTime: 0
- TotalThreadsUserTime: 52000000
- TotalThreadsVoluntaryContextSwitches: 20
- TotalTime: 4633342006
Fragment Instance Lifecycle Timings
- ExecTime: 1203783020
- ExecTreeExecTime: 23520
- InactiveTotalTime: 0
- OpenTime: 3392933014
- ExecTreeOpenTime: 3341892810
- PrepareTime: 36576980
- ExecTreePrepareTime: 79884
- TotalTime: 0
BlockMgr
- BlockWritesOutstanding: 0
- BlocksCreated: 48
- BlocksRecycled: 0
- BufferedPins: 0
- BytesWritten: 0
- InactiveTotalTime: 0
- MaxBlockSize: 8388608
- MemoryLimit: 51539607552
- PeakMemoryUsage: 802816
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0
- TotalEncryptionTime: 0
- TotalReadBlockTime: 0
- TotalTime: 0
PLAN_ROOT_SINK
- InactiveTotalTime: 0
- PeakMemoryUsage: 0
- TotalTime: 0
CodeGen
- CodegenTime: 1420862
- CompileTime: 3164812
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 28
- NumInstructions: 523
- OptimizationTime: 46354276
- PeakMemoryUsage: 267776
- PrepareTime: 35668786
- TotalTime: 85990856
EXCHANGE_NODE (id=7)
ExecOption: Codegen Enabled
- BytesReceived: 294
- ConvertRowBatchTime: 0
- DeserializeRowBatchTimer: 75902
- FirstBatchArrivalWaitTime: 3341818904
- InactiveTotalTime: 3341827450
- MergeGetNext: 17580
- MergeGetNextBatch: 8614
- PeakMemoryUsage: 0
- RowsReturned: 8
- RowsReturnedRate: 2
- SendersBlockedTimer: 0
- SendersBlockedTotalTimer(*): 0
- TotalTime: 3341910938
Averaged Fragment F03
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:3s424ms max:3s428ms mean: 3s426ms stddev:1.131ms
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 17
- AverageThreadTokens: 1.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 3502840
- PerHostPeakMemUsage: 56531497
- RowsProduced: 0
- TotalNetworkReceiveTime: 3175271071
- TotalNetworkSendTime: 103915
- TotalStorageWaitTime: 0
- TotalThreadsInvoluntaryContextSwitches: 0
- TotalThreadsTotalWallClockTime: 3386473499
- TotalThreadsSysTime: 941176
- TotalThreadsUserTime: 211294117
- TotalThreadsVoluntaryContextSwitches: 54
- TotalTime: 3425329993
Fragment Instance Lifecycle Timings
- ExecTime: 370978
- ExecTreeExecTime: 3424
- InactiveTotalTime: 0
- OpenTime: 3386154491
- ExecTreeOpenTime: 3176341109
- PrepareTime: 38692146
- ExecTreePrepareTime: 601396
- TotalTime: 0
BlockMgr
- BlockWritesOutstanding: 0
- BlocksCreated: 48
- BlocksRecycled: 0
- BufferedPins: 0
- BytesWritten: 0
- InactiveTotalTime: 0
- MaxBlockSize: 8388608
- MemoryLimit: 51539607552
- PeakMemoryUsage: 802816
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0
- TotalEncryptionTime: 0
- TotalReadBlockTime: 0
- TotalTime: 0
DataStreamSender (dst_id=7)
- BytesSent: 17
- InactiveTotalTime: 0
- NetworkThroughput(*): 569681
- OverallThroughput: 176522
- PeakMemoryUsage: 5240
- RowsReturned: 0
- SerializeBatchTime: 12373
- TotalTime: 42176
- TransmitDataRPCTime: 9525
- UncompressedRowBatchSize: 22
CodeGen
- CodegenTime: 4632261
- CompileTime: 41494420
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 113
- NumInstructions: 2157
- OptimizationTime: 166800515
- PeakMemoryUsage: 1104384
- PrepareTime: 34779297
- TotalTime: 243882143
SORT_NODE (id=4)
- InactiveTotalTime: 0
- InsertBatchTime: 3847
- PeakMemoryUsage: 12288
- RowsReturned: 0
- RowsReturnedRate: 0
- TotalTime: 3176941306
AGGREGATION_NODE (id=6)
- BuildTime: 13862
- GetNewBlockTime: 166724
- GetResultsTime: 1334
- HTResizeTime: 3817
- HashBuckets: 481
- InactiveTotalTime: 0
- LargestPartitionPercent: 2
- MaxPartitionLevel: 0
- NumRepartitions: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 2410563
- PinTime: 0
- RowsRepartitioned: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SpilledPartitions: 0
- TotalTime: 3176861609
- UnpinTime: 1017
EXCHANGE_NODE (id=5)
- BytesReceived: 261
- ConvertRowBatchTime: 7819
- DeserializeRowBatchTimer: 39335
- FirstBatchArrivalWaitTime: 2412026763
- InactiveTotalTime: 0
- PeakMemoryUsage: 0
- RowsReturned: 7
- RowsReturnedRate: 2
- SendersBlockedTimer: 0
- SendersBlockedTotalTimer(*): 0
- TotalTime: 3175293567
Fragment F03
Instance 9947b1c08dd46d0f:1f (host=cdh15.net.cuberonlabs.com:22000)
- AverageThreadTokens: 1.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 3502840
- PerHostPeakMemUsage: 50336305
- RowsProduced: 3
- TotalNetworkReceiveTime: 3170790161
- TotalNetworkSendTime: 295191
- TotalStorageWaitTime: 0
- TotalThreadsInvoluntaryContextSwitches: 0
- TotalThreadsTotalWallClockTime: 3387584820
- TotalThreadsSysTime: 0
- TotalThreadsUserTime: 220000000
- TotalThreadsVoluntaryContextSwitches: 51
- TotalTime: 3427174599
Fragment Instance Lifecycle Timings
- ExecTime: 544486
- ExecTreeExecTime: 2787
- InactiveTotalTime: 0
- OpenTime: 3387095069
- ExecTreeOpenTime: 3172197693
- PrepareTime: 39480950
- ExecTreePrepareTime: 517533
- TotalTime: 0
BlockMgr
- BlockWritesOutstanding: 0
- BlocksCreated: 48
- BlocksRecycled: 0
- BufferedPins: 0
- BytesWritten: 0
- InactiveTotalTime: 0
- MaxBlockSize: 8388608
- MemoryLimit: 51539607552
- PeakMemoryUsage: 802816
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0
- TotalEncryptionTime: 0
- TotalReadBlockTime: 0
- TotalTime: 0
DataStreamSender (dst_id=7)
- BytesSent: 83
- InactiveTotalTime: 0
- NetworkThroughput(*): 2548905
- OverallThroughput: 745571
- PeakMemoryUsage: 5240
- RowsReturned: 3
- SerializeBatchTime: 60821
- TotalTime: 111324
- TransmitDataRPCTime: 32563
- UncompressedRowBatchSize: 123
CodeGen
- CodegenTime: 4807028
- CompileTime: 38673708
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 113
- NumInstructions: 2157
- OptimizationTime: 174933889
- PeakMemoryUsage: 1104384
- PrepareTime: 34997653
- TotalTime: 249455201
SORT_NODE (id=4)
ExecOption: Codegen Enabled
- InactiveTotalTime: 0
- InsertBatchTime: 6516
- PeakMemoryUsage: 12288
- RowsReturned: 3
- RowsReturnedRate: 0
- TotalTime: 3172714040
AGGREGATION_NODE (id=6)
ExecOption: Codegen Enabled
- BuildTime: 28184
- GetNewBlockTime: 159289
- GetResultsTime: 9049
- HTResizeTime: 3230
- HashBuckets: 3072
- InactiveTotalTime: 0
- LargestPartitionPercent: 1
- MaxPartitionLevel: 0
- NumRepartitions: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 2462848
- PinTime: 0
- RowsRepartitioned: 0
- RowsReturned: 3
- RowsReturnedRate: 0
- SpilledPartitions: 0
- TotalTime: 3172633531
- UnpinTime: 1059
EXCHANGE_NODE (id=5)
- BytesReceived: 1422
- ConvertRowBatchTime: 28709
- DeserializeRowBatchTimer: 160923
- FirstBatchArrivalWaitTime: 564358862
- InactiveTotalTime: 3170707216
- PeakMemoryUsage: 0
- RowsReturned: 51
- RowsReturnedRate: 16
- SendersBlockedTimer: 0
- SendersBlockedTotalTimer(*): 0
- TotalTime: 3170864825
Instance 9947b1c08dd46d0f:20 (host=cdh2.net.cuberonlabs.com:22000)
- AverageThreadTokens: 1.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 3502840
- PerHostPeakMemUsage: 87508324
- RowsProduced: 1
- TotalNetworkReceiveTime: 3182114576
- TotalNetworkSendTime: 339132
- TotalStorageWaitTime: 0
- TotalThreadsInvoluntaryContextSwitches: 0
- TotalThreadsTotalWallClockTime: 3387434388
- TotalThreadsSysTime: 0
- TotalThreadsUserTime: 204000000
- TotalThreadsVoluntaryContextSwitches: 57
- TotalTime: 3426539236
Fragment Instance Lifecycle Timings
- ExecTime: 620488
- ExecTreeExecTime: 4144
- InactiveTotalTime: 0
- OpenTime: 3386845520
- ExecTreeOpenTime: 3183018048
- PrepareTime: 38950216
- ExecTreePrepareTime: 760676
- TotalTime: 0
BlockMgr
- BlockWritesOutstanding: 0
- BlocksCreated: 48
- BlocksRecycled: 0
- BufferedPins: 0
- BytesWritten: 0
- InactiveTotalTime: 0
- MaxBlockSize: 8388608
- MemoryLimit: 51539607552
- PeakMemoryUsage: 802816
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0
- TotalEncryptionTime: 0
- TotalReadBlockTime: 0
- TotalTime: 0
DataStreamSender (dst_id=7)
- BytesSent: 43
- InactiveTotalTime: 0
- NetworkThroughput(*): 1271587
- OverallThroughput: 457407
- PeakMemoryUsage: 5240
- RowsReturned: 1
- SerializeBatchTime: 37252
- TotalTime: 94008
- TransmitDataRPCTime: 33816
- UncompressedRowBatchSize: 51
CodeGen
- CodegenTime: 4491112
- CompileTime: 40209976
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 113
- NumInstructions: 2157
- OptimizationTime: 162212600
- PeakMemoryUsage: 1104384
- PrepareTime: 34950680
- TotalTime: 238229804
SORT_NODE (id=4)
ExecOption: Codegen Enabled
- InactiveTotalTime: 0
- InsertBatchTime: 13956
- PeakMemoryUsage: 12288
- RowsReturned: 1
- RowsReturnedRate: 0
- TotalTime: 3183778452
AGGREGATION_NODE (id=6)
ExecOption: Codegen Enabled
- BuildTime: 28268
- GetNewBlockTime: 198244
- GetResultsTime: 1496
- HTResizeTime: 3908
- HashBuckets: 1024
- InactiveTotalTime: 0
- LargestPartitionPercent: 25
- MaxPartitionLevel: 0
- NumRepartitions: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 2409600
- PinTime: 0
- RowsRepartitioned: 0
- RowsReturned: 1
- RowsReturnedRate: 0
- SpilledPartitions: 0
- TotalTime: 3183678472
- UnpinTime: 1160
EXCHANGE_NODE (id=5)
- BytesReceived: 172
- ConvertRowBatchTime: 8492
- DeserializeRowBatchTimer: 36192
- FirstBatchArrivalWaitTime: 633807004
- InactiveTotalTime: 3182083688
- PeakMemoryUsage: 0
- RowsReturned: 4
- RowsReturnedRate: 1
- SendersBlockedTimer: 0
- SendersBlockedTotalTimer(*): 0
- TotalTime: 3182140360
Instance 9947b1c08dd46d0f:21 (host=cdh4.net.cuberonlabs.com:22000)
- AverageThreadTokens: 1.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 3502840
- PerHostPeakMemUsage: 52218504
- RowsProduced: 0
- TotalNetworkReceiveTime: 3184477008
- TotalNetworkSendTime: 318
- TotalStorageWaitTime: 0
- TotalThreadsInvoluntaryContextSwitches: 1
- TotalThreadsTotalWallClockTime: 3386803964
- TotalThreadsSysTime: 0
- TotalThreadsUserTime: 204000000
- TotalThreadsVoluntaryContextSwitches: 12
- TotalTime: 3426517232
Fragment Instance Lifecycle Timings
- ExecTime: 154714
- ExecTreeExecTime: 4234
- InactiveTotalTime: 0
- OpenTime: 3386685536
- ExecTreeOpenTime: 3186232922
- PrepareTime: 39064100
- ExecTreePrepareTime: 1024264
- TotalTime: 0
DataStreamSender (dst_id=7)
- BytesSent: 0
- InactiveTotalTime: 0
- NetworkThroughput(*): 0
- OverallThroughput: 0
- PeakMemoryUsage: 5240
- RowsReturned: 0
- SerializeBatchTime: 0
- TotalTime: 20304
- TransmitDataRPCTime: 0
- UncompressedRowBatchSize: 0
CodeGen
- CodegenTime: 4883206
- CompileTime: 38850180
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 113
- NumInstructions: 2157
- OptimizationTime: 160027268
- PeakMemoryUsage: 1104384
- PrepareTime: 34753838
- TotalTime: 234455238
SORT_NODE (id=4)
ExecOption: Codegen Enabled
- InactiveTotalTime: 0
- InsertBatchTime: 838
- PeakMemoryUsage: 12288
- RowsReturned: 0
- RowsReturnedRate: 0
- TotalTime: 3187257008
AGGREGATION_NODE (id=6)
ExecOption: Codegen Enabled
- BuildTime: 7316
- GetNewBlockTime: 414326
- GetResultsTime: 0
- HTResizeTime: 3964
- HashBuckets: 0
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- MaxPartitionLevel: 0
- NumRepartitions: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 2393216
- PinTime: 0
- RowsRepartitioned: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SpilledPartitions: 0
- TotalTime: 3187165376
- UnpinTime: 990
EXCHANGE_NODE (id=5)
- BytesReceived: 0
- ConvertRowBatchTime: 396
- DeserializeRowBatchTimer: 0
- FirstBatchArrivalWaitTime: 3184472570
- InactiveTotalTime: 3184473624
- PeakMemoryUsage: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SendersBlockedTimer: 0
- SendersBlockedTotalTimer(*): 0
- TotalTime: 3184512388
Instance 9947b1c08dd46d0f:1c (host=cdh10.net.cuberonlabs.com:22000)
- AverageThreadTokens: 1.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 3502840
- PerHostPeakMemUsage: 44353775
- RowsProduced: 0
- TotalNetworkReceiveTime: 3160765405
- TotalNetworkSendTime: 314
- TotalStorageWaitTime: 0
- TotalThreadsInvoluntaryContextSwitches: 1
- TotalThreadsTotalWallClockTime: 3387338308
- TotalThreadsSysTime: 4000000
- TotalThreadsUserTime: 224000000
- TotalThreadsVoluntaryContextSwitches: 100
- TotalTime: 3426229962
Fragment Instance Lifecycle Timings
- ExecTime: 192369
- ExecTreeExecTime: 3323
- InactiveTotalTime: 0
- OpenTime: 3387202925
- ExecTreeOpenTime: 3161874340
- PrepareTime: 38764601
- ExecTreePrepareTime: 633435
- TotalTime: 0
BlockMgr
- BlockWritesOutstanding: 0
- BlocksCreated: 48
- BlocksRecycled: 0
- BufferedPins: 0
- BytesWritten: 0
- InactiveTotalTime: 0
- MaxBlockSize: 8388608
- MemoryLimit: 51539607552
- PeakMemoryUsage: 802816
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0
- TotalEncryptionTime: 0
- TotalReadBlockTime: 0
- TotalTime: 0
DataStreamSender (dst_id=7)
- BytesSent: 0
- InactiveTotalTime: 0
- NetworkThroughput(*): 0
- OverallThroughput: 0
- PeakMemoryUsage: 5240
- RowsReturned: 0
- SerializeBatchTime: 0
- TotalTime: 15891
- TransmitDataRPCTime: 0
- UncompressedRowBatchSize: 0
CodeGen
- CodegenTime: 4238460
- CompileTime: 40413181
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 113
- NumInstructions: 2157
- OptimizationTime: 182879642
- PeakMemoryUsage: 1104384
- PrepareTime: 35461971
- TotalTime: 259533963
SORT_NODE (id=4)
ExecOption: Codegen Enabled
- InactiveTotalTime: 0
- InsertBatchTime: 494
- PeakMemoryUsage: 12288
- RowsReturned: 0
- RowsReturnedRate: 0
- TotalTime: 3162506529
AGGREGATION_NODE (id=6)
ExecOption: Codegen Enabled
- BuildTime: 3248
- GetNewBlockTime: 163783
- GetResultsTime: 0
- HTResizeTime: 1862
- HashBuckets: 0
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- MaxPartitionLevel: 0
- NumRepartitions: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 2393216
- PinTime: 0
- RowsRepartitioned: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SpilledPartitions: 0
- TotalTime: 3162431649
- UnpinTime: 1027
EXCHANGE_NODE (id=5)
- BytesReceived: 0
- ConvertRowBatchTime: 418
- DeserializeRowBatchTimer: 0
- FirstBatchArrivalWaitTime: 3160762762
- InactiveTotalTime: 3160763405
- PeakMemoryUsage: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SendersBlockedTimer: 0
- SendersBlockedTotalTimer(*): 0
- TotalTime: 3160767104
Instance 9947b1c08dd46d0f:22 (host=cdh8.net.cuberonlabs.com:22000)
- AverageThreadTokens: 1.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 3502840
- PerHostPeakMemUsage: 65950508
- RowsProduced: 0
- TotalNetworkReceiveTime: 3172952664
- TotalNetworkSendTime: 367
- TotalStorageWaitTime: 0
- TotalThreadsInvoluntaryContextSwitches: 0
- TotalThreadsTotalWallClockTime: 3385592568
- TotalThreadsSysTime: 4000000
- TotalThreadsUserTime: 212000000
- TotalThreadsVoluntaryContextSwitches: 50
- TotalTime: 3426131294
Fragment Instance Lifecycle Timings
- ExecTime: 346296
- ExecTreeExecTime: 3431
- InactiveTotalTime: 0
- OpenTime: 3385295136
- ExecTreeOpenTime: 3174020987
- PrepareTime: 40402309
- ExecTreePrepareTime: 547997
- TotalTime: 0
BlockMgr
- BlockWritesOutstanding: 0
- BlocksCreated: 48
- BlocksRecycled: 0
- BufferedPins: 0
- BytesWritten: 0
- InactiveTotalTime: 0
- MaxBlockSize: 8388608
- MemoryLimit: 51539607552
- PeakMemoryUsage: 802816
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0
- TotalEncryptionTime: 0
- TotalReadBlockTime: 0
- TotalTime: 0
DataStreamSender (dst_id=7)
- BytesSent: 0
- InactiveTotalTime: 0
- NetworkThroughput(*): 0
- OverallThroughput: 0
- PeakMemoryUsage: 5240
- RowsReturned: 0
- SerializeBatchTime: 0
- TotalTime: 27201
- TransmitDataRPCTime: 0
- UncompressedRowBatchSize: 0
CodeGen
- CodegenTime: 5028275
- CompileTime: 41687874
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 113
- NumInstructions: 2157
- OptimizationTime: 167825159
- PeakMemoryUsage: 1104384
- PrepareTime: 36359810
- TotalTime: 246707494
SORT_NODE (id=4)
ExecOption: Codegen Enabled
- InactiveTotalTime: 0
- InsertBatchTime: 620
- PeakMemoryUsage: 12288
- RowsReturned: 0
- RowsReturnedRate: 0
- TotalTime: 3174567687
AGGREGATION_NODE (id=6)
ExecOption: Codegen Enabled
- BuildTime: 7636
- GetNewBlockTime: 132195
- GetResultsTime: 0
- HTResizeTime: 4877
- HashBuckets: 0
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- MaxPartitionLevel: 0
- NumRepartitions: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 2393216
- PinTime: 0
- RowsRepartitioned: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SpilledPartitions: 0
- TotalTime: 3174489651
- UnpinTime: 1117
EXCHANGE_NODE (id=5)
- BytesReceived: 0
- ConvertRowBatchTime: 600
- DeserializeRowBatchTimer: 0
- FirstBatchArrivalWaitTime: 3172947782
- InactiveTotalTime: 3172948992
- PeakMemoryUsage: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SendersBlockedTimer: 0
- SendersBlockedTotalTimer(*): 0
- TotalTime: 3172955281
Instance 9947b1c08dd46d0f:1e (host=cdh3.net.cuberonlabs.com:22000)
- AverageThreadTokens: 1.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 3502840
- PerHostPeakMemUsage: 70810001
- RowsProduced: 0
- TotalNetworkReceiveTime: 3167096502
- TotalNetworkSendTime: 272
- TotalStorageWaitTime: 0
- TotalThreadsInvoluntaryContextSwitches: 0
- TotalThreadsTotalWallClockTime: 3385328094
- TotalThreadsSysTime: 0
- TotalThreadsUserTime: 220000000
- TotalThreadsVoluntaryContextSwitches: 72
- TotalTime: 3426050848
Fragment Instance Lifecycle Timings
- ExecTime: 353368
- ExecTreeExecTime: 4536
- InactiveTotalTime: 0
- OpenTime: 3385026952
- ExecTreeOpenTime: 3168105472
- PrepareTime: 40593646
- ExecTreePrepareTime: 553404
- TotalTime: 0
BlockMgr
- BlockWritesOutstanding: 0
- BlocksCreated: 48
- BlocksRecycled: 0
- BufferedPins: 0
- BytesWritten: 0
- InactiveTotalTime: 0
- MaxBlockSize: 8388608
- MemoryLimit: 51539607552
- PeakMemoryUsage: 802816
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0
- TotalEncryptionTime: 0
- TotalReadBlockTime: 0
- TotalTime: 0
DataStreamSender (dst_id=7)
- BytesSent: 0
- InactiveTotalTime: 0
- NetworkThroughput(*): 0
- OverallThroughput: 0
- PeakMemoryUsage: 5240
- RowsReturned: 0
- SerializeBatchTime: 0
- TotalTime: 23322
- TransmitDataRPCTime: 0
- UncompressedRowBatchSize: 0
CodeGen
- CodegenTime: 5190120
- CompileTime: 46111964
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 113
- NumInstructions: 2157
- OptimizationTime: 169334384
- PeakMemoryUsage: 1104384
- PrepareTime: 36577204
- TotalTime: 252854030
SORT_NODE (id=4)
ExecOption: Codegen Enabled
- InactiveTotalTime: 0
- InsertBatchTime: 588
- PeakMemoryUsage: 12288
- RowsReturned: 0
- RowsReturnedRate: 0
- TotalTime: 3168657746
AGGREGATION_NODE (id=6)
ExecOption: Codegen Enabled
- BuildTime: 7336
- GetNewBlockTime: 137858
- GetResultsTime: 0
- HTResizeTime: 3776
- HashBuckets: 0
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- MaxPartitionLevel: 0
- NumRepartitions: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 2393216
- PinTime: 0
- RowsRepartitioned: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SpilledPartitions: 0
- TotalTime: 3168570814
- UnpinTime: 1164
EXCHANGE_NODE (id=5)
- BytesReceived: 0
- ConvertRowBatchTime: 618
- DeserializeRowBatchTimer: 0
- FirstBatchArrivalWaitTime: 3167090852
- InactiveTotalTime: 3167092348
- PeakMemoryUsage: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SendersBlockedTimer: 0
- SendersBlockedTotalTimer(*): 0
- TotalTime: 3167099272
Instance 9947b1c08dd46d0f:19 (host=cdh14.net.cuberonlabs.com:22000)
- AverageThreadTokens: 1.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 3502840
- PerHostPeakMemUsage: 62486493
- RowsProduced: 2
- TotalNetworkReceiveTime: 3189588303
- TotalNetworkSendTime: 345850
- TotalStorageWaitTime: 0
- TotalThreadsInvoluntaryContextSwitches: 0
- TotalThreadsTotalWallClockTime: 3390419757
- TotalThreadsSysTime: 0
- TotalThreadsUserTime: 204000000
- TotalThreadsVoluntaryContextSwitches: 23
- TotalTime: 3425818099
Fragment Instance Lifecycle Timings
- ExecTime: 599091
- ExecTreeExecTime: 2870
- InactiveTotalTime: 0
- OpenTime: 3389882580
- ExecTreeOpenTime: 3190957916
- PrepareTime: 35273948
- ExecTreePrepareTime: 445184
- TotalTime: 0
BlockMgr
- BlockWritesOutstanding: 0
- BlocksCreated: 48
- BlocksRecycled: 0
- BufferedPins: 0
- BytesWritten: 0
- InactiveTotalTime: 0
- MaxBlockSize: 8388608
- MemoryLimit: 51539607552
- PeakMemoryUsage: 802816
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0
- TotalEncryptionTime: 0
- TotalReadBlockTime: 0
- TotalTime: 0
DataStreamSender (dst_id=7)
- BytesSent: 79
- InactiveTotalTime: 0
- NetworkThroughput(*): 3428968
- OverallThroughput: 772487
- PeakMemoryUsage: 5240
- RowsReturned: 2
- SerializeBatchTime: 62394
- TotalTime: 102267
- TransmitDataRPCTime: 23039
- UncompressedRowBatchSize: 97
CodeGen
- CodegenTime: 4310650
- CompileTime: 39664601
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 113
- NumInstructions: 2157
- OptimizationTime: 158072536
- PeakMemoryUsage: 1104384
- PrepareTime: 31352000
- TotalTime: 229781805
SORT_NODE (id=4)
ExecOption: Codegen Enabled
- InactiveTotalTime: 0
- InsertBatchTime: 7080
- PeakMemoryUsage: 12288
- RowsReturned: 2
- RowsReturnedRate: 0
- TotalTime: 3191401490
AGGREGATION_NODE (id=6)
ExecOption: Codegen Enabled
- BuildTime: 27588
- GetNewBlockTime: 108358
- GetResultsTime: 5554
- HTResizeTime: 3889
- HashBuckets: 2048
- InactiveTotalTime: 0
- LargestPartitionPercent: 2
- MaxPartitionLevel: 0
- NumRepartitions: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 2462848
- PinTime: 0
- RowsRepartitioned: 0
- RowsReturned: 2
- RowsReturnedRate: 0
- SpilledPartitions: 0
- TotalTime: 3191318824
- UnpinTime: 921
EXCHANGE_NODE (id=5)
- BytesReceived: 1333
- ConvertRowBatchTime: 31483
- DeserializeRowBatchTimer: 108277
- FirstBatchArrivalWaitTime: 582698588
- InactiveTotalTime: 3189511761
- PeakMemoryUsage: 0
- RowsReturned: 34
- RowsReturnedRate: 10
- SendersBlockedTimer: 0
- SendersBlockedTotalTimer(*): 0
- TotalTime: 3189656553
Instance 9947b1c08dd46d0f:1d (host=cdh17.net.cuberonlabs.com:22000)
- AverageThreadTokens: 1.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 3502840
- PerHostPeakMemUsage: 50533357
- RowsProduced: 0
- TotalNetworkReceiveTime: 3170063079
- TotalNetworkSendTime: 323
- TotalStorageWaitTime: 0
- TotalThreadsInvoluntaryContextSwitches: 0
- TotalThreadsTotalWallClockTime: 3386135307
- TotalThreadsSysTime: 0
- TotalThreadsUserTime: 220000000
- TotalThreadsVoluntaryContextSwitches: 59
- TotalTime: 3425700495
Fragment Instance Lifecycle Timings
- ExecTime: 293928
- ExecTreeExecTime: 3754
- InactiveTotalTime: 0
- OpenTime: 3385897173
- ExecTreeOpenTime: 3171003440
- PrepareTime: 39414073
- ExecTreePrepareTime: 563605
- TotalTime: 0
BlockMgr
- BlockWritesOutstanding: 0
- BlocksCreated: 48
- BlocksRecycled: 0
- BufferedPins: 0
- BytesWritten: 0
- InactiveTotalTime: 0
- MaxBlockSize: 8388608
- MemoryLimit: 51539607552
- PeakMemoryUsage: 802816
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0
- TotalEncryptionTime: 0
- TotalReadBlockTime: 0
- TotalTime: 0
DataStreamSender (dst_id=7)
- BytesSent: 0
- InactiveTotalTime: 0
- NetworkThroughput(*): 0
- OverallThroughput: 0
- PeakMemoryUsage: 5240
- RowsReturned: 0
- SerializeBatchTime: 0
- TotalTime: 20361
- TransmitDataRPCTime: 0
- UncompressedRowBatchSize: 0
CodeGen
- CodegenTime: 4819679
- CompileTime: 42232899
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 113
- NumInstructions: 2157
- OptimizationTime: 171116393
- PeakMemoryUsage: 1104384
- PrepareTime: 35586145
- TotalTime: 249775003
SORT_NODE (id=4)
ExecOption: Codegen Enabled
- InactiveTotalTime: 0
- InsertBatchTime: 594
- PeakMemoryUsage: 12288
- RowsReturned: 0
- RowsReturnedRate: 0
- TotalTime: 3171565885
AGGREGATION_NODE (id=6)
ExecOption: Codegen Enabled
- BuildTime: 7837
- GetNewBlockTime: 135894
- GetResultsTime: 0
- HTResizeTime: 4646
- HashBuckets: 0
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- MaxPartitionLevel: 0
- NumRepartitions: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 2393216
- PinTime: 0
- RowsRepartitioned: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SpilledPartitions: 0
- TotalTime: 3171486510
- UnpinTime: 983
EXCHANGE_NODE (id=5)
- BytesReceived: 0
- ConvertRowBatchTime: 480
- DeserializeRowBatchTimer: 0
- FirstBatchArrivalWaitTime: 3170058432
- InactiveTotalTime: 3170059641
- PeakMemoryUsage: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SendersBlockedTimer: 0
- SendersBlockedTotalTimer(*): 0
- TotalTime: 3170065412
Instance 9947b1c08dd46d0f:1b (host=cdh5.net.cuberonlabs.com:22000)
- AverageThreadTokens: 1.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 3502840
- PerHostPeakMemUsage: 59438533
- RowsProduced: 1
- TotalNetworkReceiveTime: 3173612196
- TotalNetworkSendTime: 386174
- TotalStorageWaitTime: 0
- TotalThreadsInvoluntaryContextSwitches: 0
- TotalThreadsTotalWallClockTime: 3384760152
- TotalThreadsSysTime: 4000000
- TotalThreadsUserTime: 208000000
- TotalThreadsVoluntaryContextSwitches: 29
- TotalTime: 3425692918
Fragment Instance Lifecycle Timings
- ExecTime: 710950
- ExecTreeExecTime: 2774
- InactiveTotalTime: 0
- OpenTime: 3384099340
- ExecTreeOpenTime: 3174700718
- PrepareTime: 40732732
- ExecTreePrepareTime: 563026
- TotalTime: 0
BlockMgr
- BlockWritesOutstanding: 0
- BlocksCreated: 48
- BlocksRecycled: 0
- BufferedPins: 0
- BytesWritten: 0
- InactiveTotalTime: 0
- MaxBlockSize: 8388608
- MemoryLimit: 51539607552
- PeakMemoryUsage: 802816
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0
- TotalEncryptionTime: 0
- TotalReadBlockTime: 0
- TotalTime: 0
DataStreamSender (dst_id=7)
- BytesSent: 55
- InactiveTotalTime: 0
- NetworkThroughput(*): 1457185
- OverallThroughput: 549637
- PeakMemoryUsage: 5240
- RowsReturned: 1
- SerializeBatchTime: 38440
- TotalTime: 100066
- TransmitDataRPCTime: 37744
- UncompressedRowBatchSize: 63
CodeGen
- CodegenTime: 5006894
- CompileTime: 40702884
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 113
- NumInstructions: 2157
- OptimizationTime: 166832788
- PeakMemoryUsage: 1104384
- PrepareTime: 36649174
- TotalTime: 245019620
SORT_NODE (id=4)
ExecOption: Codegen Enabled
- InactiveTotalTime: 0
- InsertBatchTime: 12754
- PeakMemoryUsage: 12288
- RowsReturned: 1
- RowsReturnedRate: 0
- TotalTime: 3175261770
AGGREGATION_NODE (id=6)
ExecOption: Codegen Enabled
- BuildTime: 38910
- GetNewBlockTime: 150398
- GetResultsTime: 1352
- HTResizeTime: 4640
- HashBuckets: 1024
- InactiveTotalTime: 0
- LargestPartitionPercent: 5
- MaxPartitionLevel: 0
- NumRepartitions: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 2462848
- PinTime: 0
- RowsRepartitioned: 0
- RowsReturned: 1
- RowsReturnedRate: 0
- SpilledPartitions: 0
- TotalTime: 3175169322
- UnpinTime: 1350
EXCHANGE_NODE (id=5)
- BytesReceived: 935
- ConvertRowBatchTime: 28026
- DeserializeRowBatchTimer: 151336
- FirstBatchArrivalWaitTime: 566970148
- InactiveTotalTime: 3173496534
- PeakMemoryUsage: 0
- RowsReturned: 17
- RowsReturnedRate: 5
- SendersBlockedTimer: 0
- SendersBlockedTotalTimer(*): 0
- TotalTime: 3173687076
Instance 9947b1c08dd46d0f:17 (host=cdh12.net.cuberonlabs.com:22000)
- AverageThreadTokens: 1.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 3502840
- PerHostPeakMemUsage: 49382097
- RowsProduced: 0
- TotalNetworkReceiveTime: 3187634453
- TotalNetworkSendTime: 300
- TotalStorageWaitTime: 0
- TotalThreadsInvoluntaryContextSwitches: 0
- TotalThreadsTotalWallClockTime: 3389022723
- TotalThreadsSysTime: 0
- TotalThreadsUserTime: 200000000
- TotalThreadsVoluntaryContextSwitches: 12
- TotalTime: 3425657158
Fragment Instance Lifecycle Timings
- ExecTime: 264877
- ExecTreeExecTime: 3377
- InactiveTotalTime: 0
- OpenTime: 3388822302
- ExecTreeOpenTime: 3188672929
- PrepareTime: 36514946
- ExecTreePrepareTime: 563512
- TotalTime: 0
BlockMgr
- BlockWritesOutstanding: 0
- BlocksCreated: 48
- BlocksRecycled: 0
- BufferedPins: 0
- BytesWritten: 0
- InactiveTotalTime: 0
- MaxBlockSize: 8388608
- MemoryLimit: 51539607552
- PeakMemoryUsage: 802816
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0
- TotalEncryptionTime: 0
- TotalReadBlockTime: 0
- TotalTime: 0
DataStreamSender (dst_id=7)
- BytesSent: 0
- InactiveTotalTime: 0
- NetworkThroughput(*): 0
- OverallThroughput: 0
- PeakMemoryUsage: 5240
- RowsReturned: 0
- SerializeBatchTime: 0
- TotalTime: 15935
- TransmitDataRPCTime: 0
- UncompressedRowBatchSize: 0
CodeGen
- CodegenTime: 4080610
- CompileTime: 37875307
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 113
- NumInstructions: 2157
- OptimizationTime: 160878809
- PeakMemoryUsage: 1104384
- PrepareTime: 33213647
- TotalTime: 232742792
SORT_NODE (id=4)
ExecOption: Codegen Enabled
- InactiveTotalTime: 0
- InsertBatchTime: 523
- PeakMemoryUsage: 12288
- RowsReturned: 0
- RowsReturnedRate: 0
- TotalTime: 3189235803
AGGREGATION_NODE (id=6)
ExecOption: Codegen Enabled
- BuildTime: 5016
- GetNewBlockTime: 162288
- GetResultsTime: 0
- HTResizeTime: 3006
- HashBuckets: 0
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- MaxPartitionLevel: 0
- NumRepartitions: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 2393216
- PinTime: 0
- RowsRepartitioned: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SpilledPartitions: 0
- TotalTime: 3189170255
- UnpinTime: 771
EXCHANGE_NODE (id=5)
- BytesReceived: 0
- ConvertRowBatchTime: 445
- DeserializeRowBatchTimer: 0
- FirstBatchArrivalWaitTime: 3187630995
- InactiveTotalTime: 3187631806
- PeakMemoryUsage: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SendersBlockedTimer: 0
- SendersBlockedTotalTimer(*): 0
- TotalTime: 3187636256
Instance 9947b1c08dd46d0f:1a (host=cdh1.net.cuberonlabs.com:22000)
- AverageThreadTokens: 1.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 3502840
- PerHostPeakMemUsage: 59072571
- RowsProduced: 0
- TotalNetworkReceiveTime: 3180126656
- TotalNetworkSendTime: 308
- TotalStorageWaitTime: 0
- TotalThreadsInvoluntaryContextSwitches: 1
- TotalThreadsTotalWallClockTime: 3386798960
- TotalThreadsSysTime: 0
- TotalThreadsUserTime: 212000000
- TotalThreadsVoluntaryContextSwitches: 9
- TotalTime: 3425115616
Fragment Instance Lifecycle Timings
- ExecTime: 260856
- ExecTreeExecTime: 3908
- InactiveTotalTime: 0
- OpenTime: 3386596692
- ExecTreeOpenTime: 3181021056
- PrepareTime: 38152680
- ExecTreePrepareTime: 559132
- TotalTime: 0
BlockMgr
- BlockWritesOutstanding: 0
- BlocksCreated: 48
- BlocksRecycled: 0
- BufferedPins: 0
- BytesWritten: 0
- InactiveTotalTime: 0
- MaxBlockSize: 8388608
- MemoryLimit: 51539607552
- PeakMemoryUsage: 802816
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0
- TotalEncryptionTime: 0
- TotalReadBlockTime: 0
- TotalTime: 0
DataStreamSender (dst_id=7)
- BytesSent: 0
- InactiveTotalTime: 0
- NetworkThroughput(*): 0
- OverallThroughput: 0
- PeakMemoryUsage: 5240
- RowsReturned: 0
- SerializeBatchTime: 0
- TotalTime: 26924
- TransmitDataRPCTime: 0
- UncompressedRowBatchSize: 0
CodeGen
- CodegenTime: 4786776
- CompileTime: 40792416
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 113
- NumInstructions: 2157
- OptimizationTime: 163275520
- PeakMemoryUsage: 1104384
- PrepareTime: 34275136
- TotalTime: 239151148
SORT_NODE (id=4)
ExecOption: Codegen Enabled
- InactiveTotalTime: 0
- InsertBatchTime: 604
- PeakMemoryUsage: 12288
- RowsReturned: 0
- RowsReturnedRate: 0
- TotalTime: 3181579316
AGGREGATION_NODE (id=6)
ExecOption: Codegen Enabled
- BuildTime: 8464
- GetNewBlockTime: 147656
- GetResultsTime: 0
- HTResizeTime: 5208
- HashBuckets: 0
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- MaxPartitionLevel: 0
- NumRepartitions: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 2393216
- PinTime: 0
- RowsRepartitioned: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SpilledPartitions: 0
- TotalTime: 3181501576
- UnpinTime: 1216
EXCHANGE_NODE (id=5)
- BytesReceived: 0
- ConvertRowBatchTime: 500
- DeserializeRowBatchTimer: 0
- FirstBatchArrivalWaitTime: 3180121428
- InactiveTotalTime: 3180122848
- PeakMemoryUsage: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SendersBlockedTimer: 0
- SendersBlockedTotalTimer(*): 0
- TotalTime: 3180129192
Instance 9947b1c08dd46d0f:16 (host=cdh7.net.cuberonlabs.com:22000)
- AverageThreadTokens: 1.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 3502840
- PerHostPeakMemUsage: 56906441
- RowsProduced: 1
- TotalNetworkReceiveTime: 3170666187
- TotalNetworkSendTime: 396649
- TotalStorageWaitTime: 0
- TotalThreadsInvoluntaryContextSwitches: 1
- TotalThreadsTotalWallClockTime: 3384262360
- TotalThreadsSysTime: 0
- TotalThreadsUserTime: 212000000
- TotalThreadsVoluntaryContextSwitches: 36
- TotalTime: 3424773728
Fragment Instance Lifecycle Timings
- ExecTime: 635548
- ExecTreeExecTime: 3400
- InactiveTotalTime: 0
- OpenTime: 3383683116
- ExecTreeOpenTime: 3171749628
- PrepareTime: 40359556
- ExecTreePrepareTime: 595635
- TotalTime: 0
BlockMgr
- BlockWritesOutstanding: 0
- BlocksCreated: 48
- BlocksRecycled: 0
- BufferedPins: 0
- BytesWritten: 0
- InactiveTotalTime: 0
- MaxBlockSize: 8388608
- MemoryLimit: 51539607552
- PeakMemoryUsage: 802816
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0
- TotalEncryptionTime: 0
- TotalReadBlockTime: 0
- TotalTime: 0
DataStreamSender (dst_id=7)
- BytesSent: 34
- InactiveTotalTime: 0
- NetworkThroughput(*): 977938
- OverallThroughput: 475777
- PeakMemoryUsage: 5240
- RowsReturned: 1
- SerializeBatchTime: 11437
- TotalTime: 71462
- TransmitDataRPCTime: 34767
- UncompressedRowBatchSize: 42
CodeGen
- CodegenTime: 4993159
- CompileTime: 40989315
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 113
- NumInstructions: 2157
- OptimizationTime: 169199688
- PeakMemoryUsage: 1104384
- PrepareTime: 36405680
- TotalTime: 247422920
SORT_NODE (id=4)
ExecOption: Codegen Enabled
- InactiveTotalTime: 0
- InsertBatchTime: 18234
- PeakMemoryUsage: 12288
- RowsReturned: 1
- RowsReturnedRate: 0
- TotalTime: 3172344161
AGGREGATION_NODE (id=6)
ExecOption: Codegen Enabled
- BuildTime: 37264
- GetNewBlockTime: 138471
- GetResultsTime: 5237
- HTResizeTime: 5457
- HashBuckets: 1024
- InactiveTotalTime: 0
- LargestPartitionPercent: 5
- MaxPartitionLevel: 0
- NumRepartitions: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 2462848
- PinTime: 0
- RowsRepartitioned: 0
- RowsReturned: 1
- RowsReturnedRate: 0
- SpilledPartitions: 0
- TotalTime: 3172233060
- UnpinTime: 993
EXCHANGE_NODE (id=5)
- BytesReceived: 576
- ConvertRowBatchTime: 30804
- DeserializeRowBatchTimer: 211982
- FirstBatchArrivalWaitTime: 563834138
- InactiveTotalTime: 3170557644
- PeakMemoryUsage: 0
- RowsReturned: 17
- RowsReturnedRate: 5
- SendersBlockedTimer: 0
- SendersBlockedTotalTimer(*): 0
- TotalTime: 3170745437
Instance 9947b1c08dd46d0f:18 (host=cdh9.net.cuberonlabs.com:22000)
- AverageThreadTokens: 1.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 3502840
- PerHostPeakMemUsage: 51455130
- RowsProduced: 0
- TotalNetworkReceiveTime: 3171616656
- TotalNetworkSendTime: 323
- TotalStorageWaitTime: 0
- TotalThreadsInvoluntaryContextSwitches: 0
- TotalThreadsTotalWallClockTime: 3384004198
- TotalThreadsSysTime: 4000000
- TotalThreadsUserTime: 208000000
- TotalThreadsVoluntaryContextSwitches: 43
- TotalTime: 3424460037
Fragment Instance Lifecycle Timings
- ExecTime: 348880
- ExecTreeExecTime: 3894
- InactiveTotalTime: 0
- OpenTime: 3383695539
- ExecTreeOpenTime: 3172371601
- PrepareTime: 40342028
- ExecTreePrepareTime: 805446
- TotalTime: 0
BlockMgr
- BlockWritesOutstanding: 0
- BlocksCreated: 48
- BlocksRecycled: 0
- BufferedPins: 0
- BytesWritten: 0
- InactiveTotalTime: 0
- MaxBlockSize: 8388608
- MemoryLimit: 51539607552
- PeakMemoryUsage: 802816
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0
- TotalEncryptionTime: 0
- TotalReadBlockTime: 0
- TotalTime: 0
DataStreamSender (dst_id=7)
- BytesSent: 0
- InactiveTotalTime: 0
- NetworkThroughput(*): 0
- OverallThroughput: 0
- PeakMemoryUsage: 5240
- RowsReturned: 0
- SerializeBatchTime: 0
- TotalTime: 21320
- TransmitDataRPCTime: 0
- UncompressedRowBatchSize: 0
CodeGen
- CodegenTime: 4734638
- CompileTime: 41723587
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 113
- NumInstructions: 2157
- OptimizationTime: 167886447
- PeakMemoryUsage: 1104384
- PrepareTime: 36216550
- TotalTime: 246659716
SORT_NODE (id=4)
ExecOption: Codegen Enabled
- InactiveTotalTime: 0
- InsertBatchTime: 547
- PeakMemoryUsage: 12288
- RowsReturned: 0
- RowsReturnedRate: 0
- TotalTime: 3173176335
AGGREGATION_NODE (id=6)
ExecOption: Codegen Enabled
- BuildTime: 6430
- GetNewBlockTime: 197906
- GetResultsTime: 0
- HTResizeTime: 3421
- HashBuckets: 0
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- MaxPartitionLevel: 0
- NumRepartitions: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 2393216
- PinTime: 0
- RowsRepartitioned: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SpilledPartitions: 0
- TotalTime: 3173095820
- UnpinTime: 1177
EXCHANGE_NODE (id=5)
- BytesReceived: 0
- ConvertRowBatchTime: 520
- DeserializeRowBatchTimer: 0
- FirstBatchArrivalWaitTime: 3171611373
- InactiveTotalTime: 3171612576
- PeakMemoryUsage: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SendersBlockedTimer: 0
- SendersBlockedTotalTimer(*): 0
- TotalTime: 3171619873
Instance 9947b1c08dd46d0f:13 (host=cdh13.net.cuberonlabs.com:22000)
- AverageThreadTokens: 1.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 3502840
- PerHostPeakMemUsage: 55014090
- RowsProduced: 0
- TotalNetworkReceiveTime: 3173887314
- TotalNetworkSendTime: 337
- TotalStorageWaitTime: 0
- TotalThreadsInvoluntaryContextSwitches: 1
- TotalThreadsTotalWallClockTime: 3386284085
- TotalThreadsSysTime: 0
- TotalThreadsUserTime: 212000000
- TotalThreadsVoluntaryContextSwitches: 90
- TotalTime: 3424338621
Fragment Instance Lifecycle Timings
- ExecTime: 260122
- ExecTreeExecTime: 3227
- InactiveTotalTime: 0
- OpenTime: 3386077293
- ExecTreeOpenTime: 3174925841
- PrepareTime: 37932472
- ExecTreePrepareTime: 482900
- TotalTime: 0
BlockMgr
- BlockWritesOutstanding: 0
- BlocksCreated: 48
- BlocksRecycled: 0
- BufferedPins: 0
- BytesWritten: 0
- InactiveTotalTime: 0
- MaxBlockSize: 8388608
- MemoryLimit: 51539607552
- PeakMemoryUsage: 802816
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0
- TotalEncryptionTime: 0
- TotalReadBlockTime: 0
- TotalTime: 0
DataStreamSender (dst_id=7)
- BytesSent: 0
- InactiveTotalTime: 0
- NetworkThroughput(*): 0
- OverallThroughput: 0
- PeakMemoryUsage: 5240
- RowsReturned: 0
- SerializeBatchTime: 0
- TotalTime: 17691
- TransmitDataRPCTime: 0
- UncompressedRowBatchSize: 0
CodeGen
- CodegenTime: 4493225
- CompileTime: 42229882
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 113
- NumInstructions: 2157
- OptimizationTime: 167653556
- PeakMemoryUsage: 1104384
- PrepareTime: 34030898
- TotalTime: 244699510
SORT_NODE (id=4)
ExecOption: Codegen Enabled
- InactiveTotalTime: 0
- InsertBatchTime: 463
- PeakMemoryUsage: 12288
- RowsReturned: 0
- RowsReturnedRate: 0
- TotalTime: 3175405249
AGGREGATION_NODE (id=6)
ExecOption: Codegen Enabled
- BuildTime: 6180
- GetNewBlockTime: 146660
- GetResultsTime: 0
- HTResizeTime: 3829
- HashBuckets: 0
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- MaxPartitionLevel: 0
- NumRepartitions: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 2393216
- PinTime: 0
- RowsRepartitioned: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SpilledPartitions: 0
- TotalTime: 3175339904
- UnpinTime: 979
EXCHANGE_NODE (id=5)
- BytesReceived: 0
- ConvertRowBatchTime: 300
- DeserializeRowBatchTimer: 0
- FirstBatchArrivalWaitTime: 3173883527
- InactiveTotalTime: 3173884317
- PeakMemoryUsage: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SendersBlockedTimer: 0
- SendersBlockedTotalTimer(*): 0
- TotalTime: 3173889117
Instance 9947b1c08dd46d0f:15 (host=cdh6.net.cuberonlabs.com:22000)
- AverageThreadTokens: 1.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 3502840
- PerHostPeakMemUsage: 52956442
- RowsProduced: 0
- TotalNetworkReceiveTime: 3180886068
- TotalNetworkSendTime: 298
- TotalStorageWaitTime: 0
- TotalThreadsInvoluntaryContextSwitches: 0
- TotalThreadsTotalWallClockTime: 3385039414
- TotalThreadsSysTime: 0
- TotalThreadsUserTime: 204000000
- TotalThreadsVoluntaryContextSwitches: 6
- TotalTime: 3423550048
Fragment Instance Lifecycle Timings
- ExecTime: 252336
- ExecTreeExecTime: 3248
- InactiveTotalTime: 0
- OpenTime: 3384823470
- ExecTreeOpenTime: 3181595676
- PrepareTime: 38411038
- ExecTreePrepareTime: 640172
- TotalTime: 0
BlockMgr
- BlockWritesOutstanding: 0
- BlocksCreated: 48
- BlocksRecycled: 0
- BufferedPins: 0
- BytesWritten: 0
- InactiveTotalTime: 0
- MaxBlockSize: 8388608
- MemoryLimit: 51539607552
- PeakMemoryUsage: 802816
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0
- TotalEncryptionTime: 0
- TotalReadBlockTime: 0
- TotalTime: 0
DataStreamSender (dst_id=7)
- BytesSent: 0
- InactiveTotalTime: 0
- NetworkThroughput(*): 0
- OverallThroughput: 0
- PeakMemoryUsage: 5240
- RowsReturned: 0
- SerializeBatchTime: 0
- TotalTime: 23096
- TransmitDataRPCTime: 0
- UncompressedRowBatchSize: 0
CodeGen
- CodegenTime: 4288592
- CompileTime: 38904274
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 113
- NumInstructions: 2157
- OptimizationTime: 162749676
- PeakMemoryUsage: 1104384
- PrepareTime: 34542342
- TotalTime: 237033242
SORT_NODE (id=4)
ExecOption: Codegen Enabled
- InactiveTotalTime: 0
- InsertBatchTime: 434
- PeakMemoryUsage: 12288
- RowsReturned: 0
- RowsReturnedRate: 0
- TotalTime: 3182235424
AGGREGATION_NODE (id=6)
ExecOption: Codegen Enabled
- BuildTime: 6520
- GetNewBlockTime: 172970
- GetResultsTime: 0
- HTResizeTime: 3424
- HashBuckets: 0
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- MaxPartitionLevel: 0
- NumRepartitions: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 2393216
- PinTime: 0
- RowsRepartitioned: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SpilledPartitions: 0
- TotalTime: 3182178126
- UnpinTime: 1032
EXCHANGE_NODE (id=5)
- BytesReceived: 0
- ConvertRowBatchTime: 398
- DeserializeRowBatchTimer: 0
- FirstBatchArrivalWaitTime: 3180881738
- InactiveTotalTime: 3180882684
- PeakMemoryUsage: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SendersBlockedTimer: 0
- SendersBlockedTotalTimer(*): 0
- TotalTime: 3180888004
Instance 9947b1c08dd46d0f:14 (host=cdh16.net.cuberonlabs.com:22000)
- AverageThreadTokens: 1.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 3502840
- PerHostPeakMemUsage: 45785037
- RowsProduced: 0
- TotalNetworkReceiveTime: 3177103418
- TotalNetworkSendTime: 180
- TotalStorageWaitTime: 0
- TotalThreadsInvoluntaryContextSwitches: 0
- TotalThreadsTotalWallClockTime: 3388374179
- TotalThreadsSysTime: 0
- TotalThreadsUserTime: 212000000
- TotalThreadsVoluntaryContextSwitches: 161
- TotalTime: 3423535276
Fragment Instance Lifecycle Timings
- ExecTime: 236462
- ExecTreeExecTime: 2186
- InactiveTotalTime: 0
- OpenTime: 3388217079
- ExecTreeOpenTime: 3178031306
- PrepareTime: 35017788
- ExecTreePrepareTime: 381688
- TotalTime: 0
BlockMgr
- BlockWritesOutstanding: 0
- BlocksCreated: 48
- BlocksRecycled: 0
- BufferedPins: 0
- BytesWritten: 0
- InactiveTotalTime: 0
- MaxBlockSize: 8388608
- MemoryLimit: 51539607552
- PeakMemoryUsage: 802816
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0
- TotalEncryptionTime: 0
- TotalReadBlockTime: 0
- TotalTime: 0
DataStreamSender (dst_id=7)
- BytesSent: 0
- InactiveTotalTime: 0
- NetworkThroughput(*): 0
- OverallThroughput: 0
- PeakMemoryUsage: 5240
- RowsReturned: 0
- SerializeBatchTime: 0
- TotalTime: 8445
- TransmitDataRPCTime: 0
- UncompressedRowBatchSize: 0
CodeGen
- CodegenTime: 4506970
- CompileTime: 43534899
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 113
- NumInstructions: 2157
- OptimizationTime: 165423055
- PeakMemoryUsage: 1104384
- PrepareTime: 31467221
- TotalTime: 241175285
SORT_NODE (id=4)
ExecOption: Codegen Enabled
- InactiveTotalTime: 0
- InsertBatchTime: 358
- PeakMemoryUsage: 12288
- RowsReturned: 0
- RowsReturnedRate: 0
- TotalTime: 3178411312
AGGREGATION_NODE (id=6)
ExecOption: Codegen Enabled
- BuildTime: 3963
- GetNewBlockTime: 115686
- GetResultsTime: 0
- HTResizeTime: 2629
- HashBuckets: 0
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- MaxPartitionLevel: 0
- NumRepartitions: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 2393216
- PinTime: 0
- RowsRepartitioned: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SpilledPartitions: 0
- TotalTime: 3178349512
- UnpinTime: 383
EXCHANGE_NODE (id=5)
- BytesReceived: 0
- ConvertRowBatchTime: 280
- DeserializeRowBatchTimer: 0
- FirstBatchArrivalWaitTime: 3177100788
- InactiveTotalTime: 3177101297
- PeakMemoryUsage: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SendersBlockedTimer: 0
- SendersBlockedTotalTimer(*): 0
- TotalTime: 3177104976
Instance 9947b1c08dd46d0f:12 (host=cdh11.net.cuberonlabs.com:22000)
- AverageThreadTokens: 1.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 3502840
- PerHostPeakMemUsage: 46827848
- RowsProduced: 0
- TotalNetworkReceiveTime: 3166227566
- TotalNetworkSendTime: 233
- TotalStorageWaitTime: 0
- TotalThreadsInvoluntaryContextSwitches: 3
- TotalThreadsTotalWallClockTime: 3384866220
- TotalThreadsSysTime: 0
- TotalThreadsUserTime: 216000000
- TotalThreadsVoluntaryContextSwitches: 118
- TotalTime: 3423324724
Fragment Instance Lifecycle Timings
- ExecTime: 231860
- ExecTreeExecTime: 3121
- InactiveTotalTime: 0
- OpenTime: 3384680639
- ExecTreeOpenTime: 3167319290
- PrepareTime: 38359415
- ExecTreePrepareTime: 586125
- TotalTime: 0
BlockMgr
- BlockWritesOutstanding: 0
- BlocksCreated: 48
- BlocksRecycled: 0
- BufferedPins: 0
- BytesWritten: 0
- InactiveTotalTime: 0
- MaxBlockSize: 8388608
- MemoryLimit: 51539607552
- PeakMemoryUsage: 802816
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0
- TotalEncryptionTime: 0
- TotalReadBlockTime: 0
- TotalTime: 0
DataStreamSender (dst_id=7)
- BytesSent: 0
- InactiveTotalTime: 0
- NetworkThroughput(*): 0
- OverallThroughput: 0
- PeakMemoryUsage: 5240
- RowsReturned: 0
- SerializeBatchTime: 0
- TotalTime: 17377
- TransmitDataRPCTime: 0
- UncompressedRowBatchSize: 0
CodeGen
- CodegenTime: 4089054
- CompileTime: 50808206
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 113
- NumInstructions: 2157
- OptimizationTime: 165307354
- PeakMemoryUsage: 1104384
- PrepareTime: 34408107
- TotalTime: 251299674
SORT_NODE (id=4)
ExecOption: Codegen Enabled
- InactiveTotalTime: 0
- InsertBatchTime: 810
- PeakMemoryUsage: 12288
- RowsReturned: 0
- RowsReturnedRate: 0
- TotalTime: 3167904002
AGGREGATION_NODE (id=6)
ExecOption: Codegen Enabled
- BuildTime: 5496
- GetNewBlockTime: 152329
- GetResultsTime: 0
- HTResizeTime: 3134
- HashBuckets: 0
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- MaxPartitionLevel: 0
- NumRepartitions: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 2393216
- PinTime: 0
- RowsRepartitioned: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SpilledPartitions: 0
- TotalTime: 3167834959
- UnpinTime: 983
EXCHANGE_NODE (id=5)
- BytesReceived: 0
- ConvertRowBatchTime: 462
- DeserializeRowBatchTimer: 0
- FirstBatchArrivalWaitTime: 3166223990
- InactiveTotalTime: 3166224830
- PeakMemoryUsage: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- SendersBlockedTimer: 0
- SendersBlockedTotalTimer(*): 0
- TotalTime: 3166229522
Averaged Fragment F02
split sizes: min: 1.05 GB, max: 7.42 GB, avg: 2.92 GB, stddev: 1.75 GB
completion times: min:816.017ms max:3s420ms mean: 1s401ms stddev:775.203ms
execution rates: min:1.19 GB/sec max:2.79 GB/sec mean:2.05 GB/sec stddev:405.56 MB/sec
num instances: 17
- AverageThreadTokens: 6.373529411764705
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 54124828
- PerHostPeakMemUsage: 56531497
- RowsProduced: 7
- TotalNetworkReceiveTime: 0
- TotalNetworkSendTime: 1334148
- TotalStorageWaitTime: 83824030
- TotalThreadsInvoluntaryContextSwitches: 21
- TotalThreadsTotalWallClockTime: 8317772085
- TotalThreadsSysTime: 619294117
- TotalThreadsUserTime: 6627294117
- TotalThreadsVoluntaryContextSwitches: 768
- TotalTime: 1399892114
Fragment Instance Lifecycle Timings
- ExecTime: 1220824870
- ExecTreeExecTime: 1215749117
- InactiveTotalTime: 0
- OpenTime: 139716866
- ExecTreeOpenTime: 23397629
- PrepareTime: 39304441
- ExecTreePrepareTime: 699616
- TotalTime: 0
DataStreamSender (dst_id=5)
- BytesSent: 261
- InactiveTotalTime: 0
- NetworkThroughput(*): 2183498
- OverallThroughput: 976506
- PeakMemoryUsage: 106427
- RowsReturned: 7
- SerializeBatchTime: 104145
- TotalTime: 274913
- TransmitDataRPCTime: 124755
- UncompressedRowBatchSize: 337
CodeGen
- CodegenTime: 4044579
- CompileTime: 29475728
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 60
- NumInstructions: 1115
- OptimizationTime: 85450339
- PeakMemoryUsage: 570880
- PrepareTime: 32919641
- TotalTime: 148615500
AGGREGATION_NODE (id=3)
- GetNewBlockTime: 93726
- GetResultsTime: 18957
- HTResizeTime: 429554
- HashBuckets: 10721
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 1675392
- PinTime: 0
- ReductionFactorEstimate: 0.0
- ReductionFactorThresholdToExpand: 0.0
- RowsPassedThrough: 0
- RowsReturned: 7
- RowsReturnedRate: 7
- StreamingTime: 41534551
- TotalTime: 1239838169
- UnpinTime: 0
UNION_NODE (id=0)
- InactiveTotalTime: 0
- PeakMemoryUsage: 8454538
- RowsReturned: 920215
- RowsReturnedRate: 808561
- TotalTime: 1195668298
HDFS_SCAN_NODE (id=2)
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 0.0
- BytesRead: 0
- BytesReadDataNodeCache: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumDisksAccessed: 0
- NumScannerThreadsStarted: 0
- PeakMemoryUsage: 4096
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 0
- RowBatchQueuePutWaitTime: 0
- RowsRead: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- ScanRangesComplete: 0
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0
- MaterializeTupleTime(*): 0
- ScannerThreadsSysTime: 0
- ScannerThreadsUserTime: 0
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 0
- TotalTime: 401925
HDFS_SCAN_NODE (id=1)
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 6.176470588235294
- BytesRead: 96229056
- BytesReadDataNodeCache: 91927098
- BytesReadLocal: 96229056
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 96229056
- DecompressionTime: 199356025
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumColumns: 1
- NumDisksAccessed: 0
- NumRowGroups: 21
- NumScannerThreadsStarted: 8
- PeakMemoryUsage: 49709845
- PerReadThreadRawHdfsThroughput: 988327396
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 783551868
- RowBatchQueuePutWaitTime: 0
- RowsRead: 121092252
- RowsReturned: 920215
- RowsReturnedRate: 1264433
- ScanRangesComplete: 21
- ScannerThreadsInvoluntaryContextSwitches: 18
- ScannerThreadsTotalWallClockTime: 6957295552
- MaterializeTupleTime(*): 6455898746
- ScannerThreadsSysTime: 326117647
- ScannerThreadsUserTime: 6342352941
- ScannerThreadsVoluntaryContextSwitches: 198
- TotalRawHdfsReadTime(*): 2616522
- TotalReadThroughput: 75236907
- TotalTime: 789808472
Fragment F02
Instance 9947b1c08dd46d0f:3 (host=cdh16.net.cuberonlabs.com:22000)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:38/7.42 GB
- AverageThreadTokens: 6.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 43378375
- PerHostPeakMemUsage: 45785037
- RowsProduced: 7
- TotalNetworkReceiveTime: 0
- TotalNetworkSendTime: 1130629
- TotalStorageWaitTime: 16830772
- TotalThreadsInvoluntaryContextSwitches: 61
- TotalThreadsTotalWallClockTime: 19490950837
- TotalThreadsSysTime: 1644000000
- TotalThreadsUserTime: 15556000000
- TotalThreadsVoluntaryContextSwitches: 1223
- TotalTime: 3418325627
Fragment Instance Lifecycle Timings
- ExecTime: 3218059837
- ExecTreeExecTime: 3213216145
- InactiveTotalTime: 0
- OpenTime: 159410967
- ExecTreeOpenTime: 40095069
- PrepareTime: 40816816
- ExecTreePrepareTime: 725837
- TotalTime: 0
DataStreamSender (dst_id=5)
- BytesSent: 252
- InactiveTotalTime: 0
- NetworkThroughput(*): 1991292
- OverallThroughput: 1093802
- PeakMemoryUsage: 105464
- RowsReturned: 7
- SerializeBatchTime: 66389
- TotalTime: 230389
- TransmitDataRPCTime: 126551
- UncompressedRowBatchSize: 325
CodeGen
- CodegenTime: 4205083
- CompileTime: 30523631
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 60
- NumInstructions: 1115
- OptimizationTime: 87365831
- PeakMemoryUsage: 570880
- PrepareTime: 34132951
- TotalTime: 152806534
AGGREGATION_NODE (id=3)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 76064
- GetResultsTime: 17494
- HTResizeTime: 366713
- HashBuckets: 10240
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 1675392
- PinTime: 0
- ReductionFactorEstimate: 0.0
- ReductionFactorThresholdToExpand: 0.0
- RowsPassedThrough: 0
- RowsReturned: 7
- RowsReturnedRate: 2
- StreamingTime: 41797103
- TotalTime: 3254030036
- UnpinTime: 0
UNION_NODE (id=0)
- InactiveTotalTime: 0
- PeakMemoryUsage: 8454553
- RowsReturned: 935895
- RowsReturnedRate: 291670
- TotalTime: 3208741784
HDFS_SCAN_NODE (id=2)
Hdfs split stats (<volume id>:<# splits>/<split lengths>):
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
ExecOption: Codegen enabled: 0 out of 0
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 0.0
- BytesRead: 0
- BytesReadDataNodeCache: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumDisksAccessed: 0
- NumScannerThreadsStarted: 0
- PeakMemoryUsage: 4096
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 0
- RowBatchQueuePutWaitTime: 0
- RowsRead: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- ScanRangesComplete: 0
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0
- MaterializeTupleTime(*): 0
- ScannerThreadsSysTime: 0
- ScannerThreadsUserTime: 0
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 0
- TotalTime: 383272
HDFS_SCAN_NODE (id=1)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:38/7.42 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 38 out of 38
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:38
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 5.0
- BytesRead: 245440407
- BytesReadDataNodeCache: 245440407
- BytesReadLocal: 245440407
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 245440407
- DecompressionTime: 470515812
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumColumns: 1
- NumDisksAccessed: 0
- NumRowGroups: 38
- NumScannerThreadsStarted: 5
- PeakMemoryUsage: 39393744
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 2164295620
- RowBatchQueuePutWaitTime: 0
- RowsRead: 308762467
- RowsReturned: 935895
- RowsReturnedRate: 430585
- ScanRangesComplete: 38
- ScannerThreadsInvoluntaryContextSwitches: 60
- ScannerThreadsTotalWallClockTime: 16113550271
- MaterializeTupleTime(*): 15465944195
- ScannerThreadsSysTime: 840000000
- ScannerThreadsUserTime: 15144000000
- ScannerThreadsVoluntaryContextSwitches: 386
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 70125830
- TotalTime: 2173540650
Instance 9947b1c08dd46d0f:b (host=cdh10.net.cuberonlabs.com:22000)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:44/6.27 GB
- AverageThreadTokens: 6.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 41947129
- PerHostPeakMemUsage: 44353775
- RowsProduced: 8
- TotalNetworkReceiveTime: 0
- TotalNetworkSendTime: 1382898
- TotalStorageWaitTime: 19141678
- TotalThreadsInvoluntaryContextSwitches: 28
- TotalThreadsTotalWallClockTime: 15962034888
- TotalThreadsSysTime: 1328000000
- TotalThreadsUserTime: 12792000000
- TotalThreadsVoluntaryContextSwitches: 2632
- TotalTime: 2922963269
Fragment Instance Lifecycle Timings
- ExecTime: 2730068191
- ExecTreeExecTime: 2724924797
- InactiveTotalTime: 0
- OpenTime: 156408140
- ExecTreeOpenTime: 15914392
- PrepareTime: 36407950
- ExecTreePrepareTime: 840618
- TotalTime: 0
DataStreamSender (dst_id=5)
- BytesSent: 296
- InactiveTotalTime: 0
- NetworkThroughput(*): 3649590
- OverallThroughput: 1380159
- PeakMemoryUsage: 109560
- RowsReturned: 8
- SerializeBatchTime: 88943
- TotalTime: 214468
- TransmitDataRPCTime: 81105
- UncompressedRowBatchSize: 376
CodeGen
- CodegenTime: 3581501
- CompileTime: 30788678
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 60
- NumInstructions: 1115
- OptimizationTime: 108414168
- PeakMemoryUsage: 570880
- PrepareTime: 30256209
- TotalTime: 170154839
AGGREGATION_NODE (id=3)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 78141
- GetResultsTime: 27980
- HTResizeTime: 674314
- HashBuckets: 12288
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 1675392
- PinTime: 0
- ReductionFactorEstimate: 0.0
- ReductionFactorThresholdToExpand: 0.0
- RowsPassedThrough: 0
- RowsReturned: 8
- RowsReturnedRate: 2
- StreamingTime: 132527331
- TotalTime: 2741669601
- UnpinTime: 0
UNION_NODE (id=0)
- InactiveTotalTime: 0
- PeakMemoryUsage: 8454642
- RowsReturned: 3128432
- RowsReturnedRate: 1202801
- TotalTime: 2600953721
HDFS_SCAN_NODE (id=2)
Hdfs split stats (<volume id>:<# splits>/<split lengths>):
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0%
ExecOption: Codegen enabled: 0 out of 0
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 0.0
- BytesRead: 0
- BytesReadDataNodeCache: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumDisksAccessed: 0
- NumScannerThreadsStarted: 0
- PeakMemoryUsage: 4096
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 0
- RowBatchQueuePutWaitTime: 0
- RowsRead: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- ScanRangesComplete: 0
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0
- MaterializeTupleTime(*): 0
- ScannerThreadsSysTime: 0
- ScannerThreadsUserTime: 0
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 0
- TotalTime: 473341
HDFS_SCAN_NODE (id=1)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:44/6.27 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 44 out of 44
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0%
File Formats: PARQUET/SNAPPY:44
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 5.0
- BytesRead: 203512290
- BytesReadDataNodeCache: 203512290
- BytesReadLocal: 203512290
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 203512290
- DecompressionTime: 385414945
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumColumns: 1
- NumDisksAccessed: 0
- NumRowGroups: 44
- NumScannerThreadsStarted: 5
- PeakMemoryUsage: 37586022
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 1714795354
- RowBatchQueuePutWaitTime: 0
- RowsRead: 259854768
- RowsReturned: 3128432
- RowsReturnedRate: 1809742
- ScanRangesComplete: 44
- ScannerThreadsInvoluntaryContextSwitches: 14
- ScannerThreadsTotalWallClockTime: 13075626679
- MaterializeTupleTime(*): 12487058862
- ScannerThreadsSysTime: 728000000
- ScannerThreadsUserTime: 12208000000
- ScannerThreadsVoluntaryContextSwitches: 326
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 81076798
- TotalTime: 1728661486
Instance 9947b1c08dd46d0f:1 (host=cdh11.net.cuberonlabs.com:22000)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/4.64 GB
- AverageThreadTokens: 4.6
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 44421186
- PerHostPeakMemUsage: 46827848
- RowsProduced: 8
- TotalNetworkReceiveTime: 0
- TotalNetworkSendTime: 1442458
- TotalStorageWaitTime: 17770030
- TotalThreadsInvoluntaryContextSwitches: 26
- TotalThreadsTotalWallClockTime: 12547537926
- TotalThreadsSysTime: 1088000000
- TotalThreadsUserTime: 9860000000
- TotalThreadsVoluntaryContextSwitches: 1087
- TotalTime: 2371517447
Fragment Instance Lifecycle Timings
- ExecTime: 2201089264
- ExecTreeExecTime: 2196085065
- InactiveTotalTime: 0
- OpenTime: 133520745
- ExecTreeOpenTime: 22751256
- PrepareTime: 36862646
- ExecTreePrepareTime: 780170
- TotalTime: 0
DataStreamSender (dst_id=5)
- BytesSent: 295
- InactiveTotalTime: 0
- NetworkThroughput(*): 3082324
- OverallThroughput: 1376909
- PeakMemoryUsage: 109560
- RowsReturned: 8
- SerializeBatchTime: 79536
- TotalTime: 214248
- TransmitDataRPCTime: 95707
- UncompressedRowBatchSize: 376
CodeGen
- CodegenTime: 3606036
- CompileTime: 28674367
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 60
- NumInstructions: 1115
- OptimizationTime: 80956077
- PeakMemoryUsage: 570880
- PrepareTime: 30740902
- TotalTime: 141106096
AGGREGATION_NODE (id=3)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 76695
- GetResultsTime: 21436
- HTResizeTime: 285636
- HashBuckets: 12288
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 1675392
- PinTime: 0
- ReductionFactorEstimate: 0.0
- ReductionFactorThresholdToExpand: 0.0
- RowsPassedThrough: 0
- RowsReturned: 8
- RowsReturnedRate: 3
- StreamingTime: 47876344
- TotalTime: 2219610180
- UnpinTime: 0
UNION_NODE (id=0)
- InactiveTotalTime: 0
- PeakMemoryUsage: 8454571
- RowsReturned: 1058639
- RowsReturnedRate: 488194
- TotalTime: 2168479359
HDFS_SCAN_NODE (id=2)
Hdfs split stats (<volume id>:<# splits>/<split lengths>):
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0%
ExecOption: Codegen enabled: 0 out of 0
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 0.0
- BytesRead: 0
- BytesReadDataNodeCache: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumDisksAccessed: 0
- NumScannerThreadsStarted: 0
- PeakMemoryUsage: 4096
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 0
- RowBatchQueuePutWaitTime: 0
- RowsRead: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- ScanRangesComplete: 0
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0
- MaterializeTupleTime(*): 0
- ScannerThreadsSysTime: 0
- ScannerThreadsUserTime: 0
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 0
- TotalTime: 410651
HDFS_SCAN_NODE (id=1)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/4.64 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0%
File Formats: PARQUET/SNAPPY:32
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 4.5
- BytesRead: 153833845
- BytesReadDataNodeCache: 153833845
- BytesReadLocal: 153833845
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 153833845
- DecompressionTime: 297558347
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumColumns: 1
- NumDisksAccessed: 0
- NumRowGroups: 32
- NumScannerThreadsStarted: 5
- PeakMemoryUsage: 39622372
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 1485106106
- RowBatchQueuePutWaitTime: 0
- RowsRead: 194020601
- RowsReturned: 1058639
- RowsReturnedRate: 709621
- ScanRangesComplete: 32
- ScannerThreadsInvoluntaryContextSwitches: 20
- ScannerThreadsTotalWallClockTime: 10212991744
- MaterializeTupleTime(*): 9755305385
- ScannerThreadsSysTime: 540000000
- ScannerThreadsUserTime: 9552000000
- ScannerThreadsVoluntaryContextSwitches: 269
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 61533538
- TotalTime: 1491836916
Instance 9947b1c08dd46d0f:e (host=cdh15.net.cuberonlabs.com:22000)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:29/3.95 GB
- AverageThreadTokens: 5.25
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 47929659
- PerHostPeakMemUsage: 50336305
- RowsProduced: 7
- TotalNetworkReceiveTime: 0
- TotalNetworkSendTime: 1099115
- TotalStorageWaitTime: 30632448
- TotalThreadsInvoluntaryContextSwitches: 23
- TotalThreadsTotalWallClockTime: 10702902501
- TotalThreadsSysTime: 908000000
- TotalThreadsUserTime: 8580000000
- TotalThreadsVoluntaryContextSwitches: 922
- TotalTime: 1858163534
Fragment Instance Lifecycle Timings
- ExecTime: 1691195721
- ExecTreeExecTime: 1686481291
- InactiveTotalTime: 0
- OpenTime: 129303455
- ExecTreeOpenTime: 15893071
- PrepareTime: 37624727
- ExecTreePrepareTime: 622454
- TotalTime: 0
DataStreamSender (dst_id=5)
- BytesSent: 251
- InactiveTotalTime: 0
- NetworkThroughput(*): 2132341
- OverallThroughput: 1068385
- PeakMemoryUsage: 105464
- RowsReturned: 7
- SerializeBatchTime: 80893
- TotalTime: 234934
- TransmitDataRPCTime: 117711
- UncompressedRowBatchSize: 325
CodeGen
- CodegenTime: 3641695
- CompileTime: 29050499
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 60
- NumInstructions: 1115
- OptimizationTime: 83248988
- PeakMemoryUsage: 570880
- PrepareTime: 31394750
- TotalTime: 144396610
AGGREGATION_NODE (id=3)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 80674
- GetResultsTime: 16634
- HTResizeTime: 224740
- HashBuckets: 10240
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 1675392
- PinTime: 0
- ReductionFactorEstimate: 0.0
- ReductionFactorThresholdToExpand: 0.0
- RowsPassedThrough: 0
- RowsReturned: 7
- RowsReturnedRate: 4
- StreamingTime: 50090198
- TotalTime: 1702990577
- UnpinTime: 0
UNION_NODE (id=0)
- InactiveTotalTime: 0
- PeakMemoryUsage: 8454574
- RowsReturned: 948862
- RowsReturnedRate: 574955
- TotalTime: 1650323243
HDFS_SCAN_NODE (id=2)
Hdfs split stats (<volume id>:<# splits>/<split lengths>):
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
ExecOption: Codegen enabled: 0 out of 0
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 0.0
- BytesRead: 0
- BytesReadDataNodeCache: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumDisksAccessed: 0
- NumScannerThreadsStarted: 0
- PeakMemoryUsage: 4096
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 0
- RowBatchQueuePutWaitTime: 0
- RowsRead: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- ScanRangesComplete: 0
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0
- MaterializeTupleTime(*): 0
- ScannerThreadsSysTime: 0
- ScannerThreadsUserTime: 0
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 0
- TotalTime: 391563
HDFS_SCAN_NODE (id=1)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:29/3.95 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 29 out of 29
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:29
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 5.666666666666667
- BytesRead: 131356084
- BytesReadDataNodeCache: 131356084
- BytesReadLocal: 131356084
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 131356084
- DecompressionTime: 261795648
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumColumns: 1
- NumDisksAccessed: 0
- NumRowGroups: 29
- NumScannerThreadsStarted: 6
- PeakMemoryUsage: 43438467
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 1069233023
- RowBatchQueuePutWaitTime: 0
- RowsRead: 164502129
- RowsReturned: 948862
- RowsReturnedRate: 882125
- ScanRangesComplete: 29
- ScannerThreadsInvoluntaryContextSwitches: 17
- ScannerThreadsTotalWallClockTime: 8882460154
- MaterializeTupleTime(*): 8443289994
- ScannerThreadsSysTime: 480000000
- ScannerThreadsUserTime: 8256000000
- ScannerThreadsVoluntaryContextSwitches: 299
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 87570722
- TotalTime: 1075654411
Instance 9947b1c08dd46d0f:2 (host=cdh13.net.cuberonlabs.com:22000)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/3.54 GB
- AverageThreadTokens: 5.666666666666667
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 52607412
- PerHostPeakMemUsage: 55014090
- RowsProduced: 7
- TotalNetworkReceiveTime: 0
- TotalNetworkSendTime: 1314624
- TotalStorageWaitTime: 64012164
- TotalThreadsInvoluntaryContextSwitches: 16
- TotalThreadsTotalWallClockTime: 9860576856
- TotalThreadsSysTime: 716000000
- TotalThreadsUserTime: 8080000000
- TotalThreadsVoluntaryContextSwitches: 831
- TotalTime: 1500952134
Fragment Instance Lifecycle Timings
- ExecTime: 1334681863
- ExecTreeExecTime: 1329639946
- InactiveTotalTime: 0
- OpenTime: 129286577
- ExecTreeOpenTime: 17999912
- PrepareTime: 36943267
- ExecTreePrepareTime: 646035
- TotalTime: 0
DataStreamSender (dst_id=5)
- BytesSent: 251
- InactiveTotalTime: 0
- NetworkThroughput(*): 2697010
- OverallThroughput: 1168566
- PeakMemoryUsage: 105464
- RowsReturned: 7
- SerializeBatchTime: 85488
- TotalTime: 214793
- TransmitDataRPCTime: 93066
- UncompressedRowBatchSize: 325
CodeGen
- CodegenTime: 3786310
- CompileTime: 28673623
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 60
- NumInstructions: 1115
- OptimizationTime: 81413242
- PeakMemoryUsage: 570880
- PrepareTime: 30952904
- TotalTime: 141766492
AGGREGATION_NODE (id=3)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 74676
- GetResultsTime: 14659
- HTResizeTime: 294732
- HashBuckets: 10240
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 1675392
- PinTime: 0
- ReductionFactorEstimate: 0.0
- ReductionFactorThresholdToExpand: 0.0
- RowsPassedThrough: 0
- RowsReturned: 7
- RowsReturnedRate: 5
- StreamingTime: 42159909
- TotalTime: 1348279444
- UnpinTime: 0
UNION_NODE (id=0)
- InactiveTotalTime: 0
- PeakMemoryUsage: 8454567
- RowsReturned: 1015783
- RowsReturnedRate: 779228
- TotalTime: 1303575709
HDFS_SCAN_NODE (id=2)
Hdfs split stats (<volume id>:<# splits>/<split lengths>):
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
ExecOption: Codegen enabled: 0 out of 0
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 0.0
- BytesRead: 0
- BytesReadDataNodeCache: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumDisksAccessed: 0
- NumScannerThreadsStarted: 0
- PeakMemoryUsage: 4096
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 0
- RowBatchQueuePutWaitTime: 0
- RowsRead: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- ScanRangesComplete: 0
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0
- MaterializeTupleTime(*): 0
- ScannerThreadsSysTime: 0
- ScannerThreadsUserTime: 0
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 0
- TotalTime: 465182
HDFS_SCAN_NODE (id=1)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/3.54 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:28
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 7.0
- BytesRead: 116908889
- BytesReadDataNodeCache: 116908889
- BytesReadLocal: 116908889
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 116908889
- DecompressionTime: 239912031
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumColumns: 1
- NumDisksAccessed: 0
- NumRowGroups: 28
- NumScannerThreadsStarted: 8
- PeakMemoryUsage: 49152576
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 826847480
- RowBatchQueuePutWaitTime: 0
- RowsRead: 145695183
- RowsReturned: 1015783
- RowsReturnedRate: 1219887
- ScanRangesComplete: 28
- ScannerThreadsInvoluntaryContextSwitches: 16
- ScannerThreadsTotalWallClockTime: 8396672872
- MaterializeTupleTime(*): 7894893753
- ScannerThreadsSysTime: 332000000
- ScannerThreadsUserTime: 7824000000
- ScannerThreadsVoluntaryContextSwitches: 230
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 77939259
- TotalTime: 832686043
Instance 9947b1c08dd46d0f:6 (host=cdh12.net.cuberonlabs.com:22000)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.40 GB
- AverageThreadTokens: 5.5
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 46975419
- PerHostPeakMemUsage: 49382097
- RowsProduced: 7
- TotalNetworkReceiveTime: 0
- TotalNetworkSendTime: 1043980
- TotalStorageWaitTime: 38752266
- TotalThreadsInvoluntaryContextSwitches: 16
- TotalThreadsTotalWallClockTime: 7095341274
- TotalThreadsSysTime: 580000000
- TotalThreadsUserTime: 5516000000
- TotalThreadsVoluntaryContextSwitches: 861
- TotalTime: 1412706445
Fragment Instance Lifecycle Timings
- ExecTime: 1260340089
- ExecTreeExecTime: 1255560683
- InactiveTotalTime: 0
- OpenTime: 116134451
- ExecTreeOpenTime: 11781727
- PrepareTime: 36192605
- ExecTreePrepareTime: 427665
- TotalTime: 0
DataStreamSender (dst_id=5)
- BytesSent: 251
- InactiveTotalTime: 0
- NetworkThroughput(*): 2686072
- OverallThroughput: 1003763
- PeakMemoryUsage: 105464
- RowsReturned: 7
- SerializeBatchTime: 130461
- TotalTime: 250059
- TransmitDataRPCTime: 93445
- UncompressedRowBatchSize: 325
CodeGen
- CodegenTime: 3743728
- CompileTime: 25324291
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 60
- NumInstructions: 1115
- OptimizationTime: 77276303
- PeakMemoryUsage: 570880
- PrepareTime: 31912164
- TotalTime: 135308930
AGGREGATION_NODE (id=3)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 56578
- GetResultsTime: 14466
- HTResizeTime: 333881
- HashBuckets: 10240
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 1675392
- PinTime: 0
- ReductionFactorEstimate: 0.0
- ReductionFactorThresholdToExpand: 0.0
- RowsPassedThrough: 0
- RowsReturned: 7
- RowsReturnedRate: 5
- StreamingTime: 38616702
- TotalTime: 1267763553
- UnpinTime: 0
UNION_NODE (id=0)
- InactiveTotalTime: 0
- PeakMemoryUsage: 8454537
- RowsReturned: 1036782
- RowsReturnedRate: 845243
- TotalTime: 1226607996
HDFS_SCAN_NODE (id=2)
Hdfs split stats (<volume id>:<# splits>/<split lengths>):
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0%
ExecOption: Codegen enabled: 0 out of 0
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 0.0
- BytesRead: 0
- BytesReadDataNodeCache: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumDisksAccessed: 0
- NumScannerThreadsStarted: 0
- PeakMemoryUsage: 4096
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 0
- RowBatchQueuePutWaitTime: 0
- RowsRead: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- ScanRangesComplete: 0
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0
- MaterializeTupleTime(*): 0
- ScannerThreadsSysTime: 0
- ScannerThreadsUserTime: 0
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 0
- TotalTime: 296470
HDFS_SCAN_NODE (id=1)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.40 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 26 out of 26
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0%
File Formats: PARQUET/SNAPPY:26
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 4.5
- BytesRead: 79856970
- BytesReadDataNodeCache: 79856970
- BytesReadLocal: 79856970
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 79856970
- DecompressionTime: 170532972
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumColumns: 1
- NumDisksAccessed: 0
- NumRowGroups: 26
- NumScannerThreadsStarted: 6
- PeakMemoryUsage: 42811393
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 839088273
- RowBatchQueuePutWaitTime: 0
- RowsRead: 101015240
- RowsReturned: 1036782
- RowsReturnedRate: 1227279
- ScanRangesComplete: 26
- ScannerThreadsInvoluntaryContextSwitches: 14
- ScannerThreadsTotalWallClockTime: 5718921260
- MaterializeTupleTime(*): 5353160935
- ScannerThreadsSysTime: 300000000
- ScannerThreadsUserTime: 5256000000
- ScannerThreadsVoluntaryContextSwitches: 177
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 79856970
- TotalTime: 844780736
Instance 9947b1c08dd46d0f:8 (host=cdh14.net.cuberonlabs.com:22000)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:25/3.70 GB
- AverageThreadTokens: 8.333333333333334
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 60079815
- PerHostPeakMemUsage: 62486493
- RowsProduced: 7
- TotalNetworkReceiveTime: 0
- TotalNetworkSendTime: 1256288
- TotalStorageWaitTime: 55026711
- TotalThreadsInvoluntaryContextSwitches: 18
- TotalThreadsTotalWallClockTime: 9748913265
- TotalThreadsSysTime: 600000000
- TotalThreadsUserTime: 8264000000
- TotalThreadsVoluntaryContextSwitches: 677
- TotalTime: 1324963032
Fragment Instance Lifecycle Timings
- ExecTime: 1156064722
- ExecTreeExecTime: 1151506299
- InactiveTotalTime: 0
- OpenTime: 130588200
- ExecTreeOpenTime: 17645121
- PrepareTime: 38270504
- ExecTreePrepareTime: 622682
- TotalTime: 0
DataStreamSender (dst_id=5)
- BytesSent: 253
- InactiveTotalTime: 0
- NetworkThroughput(*): 1698476
- OverallThroughput: 953910
- PeakMemoryUsage: 105464
- RowsReturned: 7
- SerializeBatchTime: 70039
- TotalTime: 265224
- TransmitDataRPCTime: 148957
- UncompressedRowBatchSize: 325
CodeGen
- CodegenTime: 3864415
- CompileTime: 29377690
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 60
- NumInstructions: 1115
- OptimizationTime: 82369883
- PeakMemoryUsage: 570880
- PrepareTime: 32228230
- TotalTime: 144735330
AGGREGATION_NODE (id=3)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 77699
- GetResultsTime: 17749
- HTResizeTime: 274109
- HashBuckets: 10240
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 1675392
- PinTime: 0
- ReductionFactorEstimate: 0.0
- ReductionFactorThresholdToExpand: 0.0
- RowsPassedThrough: 0
- RowsReturned: 7
- RowsReturnedRate: 5
- StreamingTime: 38445157
- TotalTime: 1169766407
- UnpinTime: 0
UNION_NODE (id=0)
- InactiveTotalTime: 0
- PeakMemoryUsage: 8454542
- RowsReturned: 797175
- RowsReturnedRate: 705981
- TotalTime: 1129173069
HDFS_SCAN_NODE (id=2)
Hdfs split stats (<volume id>:<# splits>/<split lengths>):
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
ExecOption: Codegen enabled: 0 out of 0
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 0.0
- BytesRead: 0
- BytesReadDataNodeCache: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumDisksAccessed: 0
- NumScannerThreadsStarted: 0
- PeakMemoryUsage: 4096
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 0
- RowBatchQueuePutWaitTime: 0
- RowsRead: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- ScanRangesComplete: 0
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0
- MaterializeTupleTime(*): 0
- ScannerThreadsSysTime: 0
- ScannerThreadsUserTime: 0
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 0
- TotalTime: 460695
HDFS_SCAN_NODE (id=1)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:25/3.70 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 25 out of 25
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:25
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 7.333333333333333
- BytesRead: 121434677
- BytesReadDataNodeCache: 121434677
- BytesReadLocal: 121434677
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 121434677
- DecompressionTime: 248843152
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumColumns: 1
- NumDisksAccessed: 0
- NumRowGroups: 25
- NumScannerThreadsStarted: 8
- PeakMemoryUsage: 55671019
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 657577677
- RowBatchQueuePutWaitTime: 0
- RowsRead: 153042338
- RowsReturned: 797175
- RowsReturnedRate: 1201865
- ScanRangesComplete: 25
- ScannerThreadsInvoluntaryContextSwitches: 16
- ScannerThreadsTotalWallClockTime: 8462324343
- MaterializeTupleTime(*): 7962734787
- ScannerThreadsSysTime: 308000000
- ScannerThreadsUserTime: 7928000000
- ScannerThreadsVoluntaryContextSwitches: 174
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 80956451
- TotalTime: 663281462
Instance 9947b1c08dd46d0f:c (host=cdh17.net.cuberonlabs.com:22000)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:24/2.37 GB
- AverageThreadTokens: 6.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 48126679
- PerHostPeakMemUsage: 50533357
- RowsProduced: 8
- TotalNetworkReceiveTime: 0
- TotalNetworkSendTime: 1715652
- TotalStorageWaitTime: 58094867
- TotalThreadsInvoluntaryContextSwitches: 8
- TotalThreadsTotalWallClockTime: 6732130612
- TotalThreadsSysTime: 348000000
- TotalThreadsUserTime: 5544000000
- TotalThreadsVoluntaryContextSwitches: 1155
- TotalTime: 1213433101
Fragment Instance Lifecycle Timings
- ExecTime: 1033847626
- ExecTreeExecTime: 1028114768
- InactiveTotalTime: 0
- OpenTime: 140800561
- ExecTreeOpenTime: 22343033
- PrepareTime: 38740139
- ExecTreePrepareTime: 686266
- TotalTime: 0
DataStreamSender (dst_id=5)
- BytesSent: 296
- InactiveTotalTime: 0
- NetworkThroughput(*): 2217610
- OverallThroughput: 863225
- PeakMemoryUsage: 109560
- RowsReturned: 8
- SerializeBatchTime: 163651
- TotalTime: 342900
- TransmitDataRPCTime: 133477
- UncompressedRowBatchSize: 376
CodeGen
- CodegenTime: 3975191
- CompileTime: 31324013
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 60
- NumInstructions: 1115
- OptimizationTime: 85768847
- PeakMemoryUsage: 570880
- PrepareTime: 33558971
- TotalTime: 151374065
AGGREGATION_NODE (id=3)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 96548
- GetResultsTime: 27373
- HTResizeTime: 417760
- HashBuckets: 12288
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 1675392
- PinTime: 0
- ReductionFactorEstimate: 0.0
- ReductionFactorThresholdToExpand: 0.0
- RowsPassedThrough: 0
- RowsReturned: 8
- RowsReturnedRate: 7
- StreamingTime: 106821073
- TotalTime: 1051132388
- UnpinTime: 0
UNION_NODE (id=0)
- InactiveTotalTime: 0
- PeakMemoryUsage: 8454555
- RowsReturned: 2670287
- RowsReturnedRate: 2839499
- TotalTime: 940407516
HDFS_SCAN_NODE (id=2)
Hdfs split stats (<volume id>:<# splits>/<split lengths>):
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
ExecOption: Codegen enabled: 0 out of 0
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 0.0
- BytesRead: 0
- BytesReadDataNodeCache: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumDisksAccessed: 0
- NumScannerThreadsStarted: 0
- PeakMemoryUsage: 4096
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 0
- RowBatchQueuePutWaitTime: 0
- RowsRead: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- ScanRangesComplete: 0
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0
- MaterializeTupleTime(*): 0
- ScannerThreadsSysTime: 0
- ScannerThreadsUserTime: 0
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 0
- TotalTime: 565150
HDFS_SCAN_NODE (id=1)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:24/2.37 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 24 out of 24
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:24
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 5.0
- BytesRead: 75011561
- BytesReadDataNodeCache: 75011561
- BytesReadLocal: 75011561
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 75011561
- DecompressionTime: 170308810
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumColumns: 1
- NumDisksAccessed: 0
- NumRowGroups: 24
- NumScannerThreadsStarted: 8
- PeakMemoryUsage: 43391654
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 555278948
- RowBatchQueuePutWaitTime: 0
- RowsRead: 97659250
- RowsReturned: 2670287
- RowsReturnedRate: 4723918
- ScanRangesComplete: 24
- ScannerThreadsInvoluntaryContextSwitches: 7
- ScannerThreadsTotalWallClockTime: 5557534353
- MaterializeTupleTime(*): 5081917111
- ScannerThreadsSysTime: 188000000
- ScannerThreadsUserTime: 5080000000
- ScannerThreadsVoluntaryContextSwitches: 192
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 75011561
- TotalTime: 565269507
Instance 9947b1c08dd46d0f:d (host=cdh3.net.cuberonlabs.com:22000)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:13/2.49 GB
- AverageThreadTokens: 5.5
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 68403323
- PerHostPeakMemUsage: 70810001
- RowsProduced: 7
- TotalNetworkReceiveTime: 0
- TotalNetworkSendTime: 1367482
- TotalStorageWaitTime: 176368538
- TotalThreadsInvoluntaryContextSwitches: 22
- TotalThreadsTotalWallClockTime: 7943039344
- TotalThreadsSysTime: 552000000
- TotalThreadsUserTime: 6396000000
- TotalThreadsVoluntaryContextSwitches: 519
- TotalTime: 971182154
Fragment Instance Lifecycle Timings
- ExecTime: 775033596
- ExecTreeExecTime: 769820092
- InactiveTotalTime: 0
- OpenTime: 157243316
- ExecTreeOpenTime: 42550734
- PrepareTime: 38861820
- ExecTreePrepareTime: 656724
- TotalTime: 0
DataStreamSender (dst_id=5)
- BytesSent: 250
- InactiveTotalTime: 0
- NetworkThroughput(*): 2167241
- OverallThroughput: 810630
- PeakMemoryUsage: 105464
- RowsReturned: 7
- SerializeBatchTime: 142320
- TotalTime: 308402
- TransmitDataRPCTime: 115354
- UncompressedRowBatchSize: 325
CodeGen
- CodegenTime: 4206274
- CompileTime: 29380894
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 60
- NumInstructions: 1115
- OptimizationTime: 83829086
- PeakMemoryUsage: 570880
- PrepareTime: 32789948
- TotalTime: 146779420
AGGREGATION_NODE (id=3)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 103530
- GetResultsTime: 16358
- HTResizeTime: 464042
- HashBuckets: 10240
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 1675392
- PinTime: 0
- ReductionFactorEstimate: 0.0
- ReductionFactorThresholdToExpand: 0.0
- RowsPassedThrough: 0
- RowsReturned: 7
- RowsReturnedRate: 8
- StreamingTime: 23223558
- TotalTime: 813019994
- UnpinTime: 0
UNION_NODE (id=0)
- InactiveTotalTime: 0
- PeakMemoryUsage: 8454656
- RowsReturned: 362660
- RowsReturnedRate: 460184
- TotalTime: 788075176
HDFS_SCAN_NODE (id=2)
Hdfs split stats (<volume id>:<# splits>/<split lengths>):
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
ExecOption: Codegen enabled: 0 out of 0
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 0.0
- BytesRead: 0
- BytesReadDataNodeCache: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumDisksAccessed: 0
- NumScannerThreadsStarted: 0
- PeakMemoryUsage: 4096
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 0
- RowBatchQueuePutWaitTime: 0
- RowsRead: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- ScanRangesComplete: 0
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0
- MaterializeTupleTime(*): 0
- ScannerThreadsSysTime: 0
- ScannerThreadsUserTime: 0
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 0
- TotalTime: 410626
HDFS_SCAN_NODE (id=1)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:13/2.49 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:13
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 9.0
- BytesRead: 82516123
- BytesReadDataNodeCache: 82516123
- BytesReadLocal: 82516123
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 82516123
- DecompressionTime: 178972508
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumColumns: 1
- NumDisksAccessed: 0
- NumRowGroups: 13
- NumScannerThreadsStarted: 13
- PeakMemoryUsage: 62881202
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 491999652
- RowBatchQueuePutWaitTime: 0
- RowsRead: 102158030
- RowsReturned: 362660
- RowsReturnedRate: 729755
- ScanRangesComplete: 13
- ScannerThreadsInvoluntaryContextSwitches: 22
- ScannerThreadsTotalWallClockTime: 7010832062
- MaterializeTupleTime(*): 6347396996
- ScannerThreadsSysTime: 320000000
- ScannerThreadsUserTime: 6192000000
- ScannerThreadsVoluntaryContextSwitches: 225
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 82516123
- TotalTime: 496961084
Instance 9947b1c08dd46d0f:11 (host=cdh8.net.cuberonlabs.com:22000)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:16/2.06 GB
- AverageThreadTokens: 6.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 63543862
- PerHostPeakMemUsage: 65950508
- RowsProduced: 7
- TotalNetworkReceiveTime: 0
- TotalNetworkSendTime: 1496641
- TotalStorageWaitTime: 137778434
- TotalThreadsInvoluntaryContextSwitches: 24
- TotalThreadsTotalWallClockTime: 6610887417
- TotalThreadsSysTime: 392000000
- TotalThreadsUserTime: 5240000000
- TotalThreadsVoluntaryContextSwitches: 416
- TotalTime: 953248170
Fragment Instance Lifecycle Timings
- ExecTime: 769771883
- ExecTreeExecTime: 764483657
- InactiveTotalTime: 0
- OpenTime: 142600818
- ExecTreeOpenTime: 27052598
- PrepareTime: 40833089
- ExecTreePrepareTime: 671768
- TotalTime: 0
DataStreamSender (dst_id=5)
- BytesSent: 251
- InactiveTotalTime: 0
- NetworkThroughput(*): 1946264
- OverallThroughput: 926247
- PeakMemoryUsage: 105464
- RowsReturned: 7
- SerializeBatchTime: 85552
- TotalTime: 270986
- TransmitDataRPCTime: 128965
- UncompressedRowBatchSize: 325
CodeGen
- CodegenTime: 4175937
- CompileTime: 29505095
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 60
- NumInstructions: 1115
- OptimizationTime: 84596670
- PeakMemoryUsage: 570880
- PrepareTime: 34297827
- TotalTime: 149246526
AGGREGATION_NODE (id=3)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 106068
- GetResultsTime: 20112
- HTResizeTime: 486617
- HashBuckets: 10240
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 1675392
- PinTime: 0
- ReductionFactorEstimate: 0.0
- ReductionFactorThresholdToExpand: 0.0
- RowsPassedThrough: 0
- RowsReturned: 7
- RowsReturnedRate: 8
- StreamingTime: 31151695
- TotalTime: 792199529
- UnpinTime: 0
UNION_NODE (id=0)
- InactiveTotalTime: 0
- PeakMemoryUsage: 8454527
- RowsReturned: 528644
- RowsReturnedRate: 696405
- TotalTime: 759103214
HDFS_SCAN_NODE (id=2)
Hdfs split stats (<volume id>:<# splits>/<split lengths>):
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
ExecOption: Codegen enabled: 0 out of 0
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 0.0
- BytesRead: 0
- BytesReadDataNodeCache: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumDisksAccessed: 0
- NumScannerThreadsStarted: 0
- PeakMemoryUsage: 4096
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 0
- RowBatchQueuePutWaitTime: 0
- RowsRead: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- ScanRangesComplete: 0
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0
- MaterializeTupleTime(*): 0
- ScannerThreadsSysTime: 0
- ScannerThreadsUserTime: 0
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 0
- TotalTime: 383678
HDFS_SCAN_NODE (id=1)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:16/2.06 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 16 out of 16
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:16
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 5.0
- BytesRead: 68019764
- BytesReadDataNodeCache: 68019764
- BytesReadLocal: 68019764
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 68019764
- DecompressionTime: 150296719
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumColumns: 1
- NumDisksAccessed: 0
- NumRowGroups: 16
- NumScannerThreadsStarted: 13
- PeakMemoryUsage: 58313245
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 472137340
- RowBatchQueuePutWaitTime: 0
- RowsRead: 84294342
- RowsReturned: 528644
- RowsReturnedRate: 1106280
- ScanRangesComplete: 16
- ScannerThreadsInvoluntaryContextSwitches: 14
- ScannerThreadsTotalWallClockTime: 5698585432
- MaterializeTupleTime(*): 5031587595
- ScannerThreadsSysTime: 184000000
- ScannerThreadsUserTime: 5008000000
- ScannerThreadsVoluntaryContextSwitches: 170
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 68019764
- TotalTime: 477857138
Instance 9947b1c08dd46d0f:4 (host=cdh6.net.cuberonlabs.com:22000)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.05 GB
- AverageThreadTokens: 3.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 50549796
- PerHostPeakMemUsage: 52956442
- RowsProduced: 7
- TotalNetworkReceiveTime: 0
- TotalNetworkSendTime: 1180046
- TotalStorageWaitTime: 105204254
- TotalThreadsInvoluntaryContextSwitches: 9
- TotalThreadsTotalWallClockTime: 3606534442
- TotalThreadsSysTime: 312000000
- TotalThreadsUserTime: 2540000000
- TotalThreadsVoluntaryContextSwitches: 354
- TotalTime: 885042538
Fragment Instance Lifecycle Timings
- ExecTime: 694975004
- ExecTreeExecTime: 690083810
- InactiveTotalTime: 0
- OpenTime: 145526082
- ExecTreeOpenTime: 22803414
- PrepareTime: 44494152
- ExecTreePrepareTime: 774564
- TotalTime: 0
DataStreamSender (dst_id=5)
- BytesSent: 251
- InactiveTotalTime: 0
- NetworkThroughput(*): 1942063
- OverallThroughput: 904308
- PeakMemoryUsage: 105464
- RowsReturned: 7
- SerializeBatchTime: 97184
- TotalTime: 277560
- TransmitDataRPCTime: 129244
- UncompressedRowBatchSize: 325
CodeGen
- CodegenTime: 4481596
- CompileTime: 31146906
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 60
- NumInstructions: 1115
- OptimizationTime: 89841416
- PeakMemoryUsage: 570880
- PrepareTime: 36701350
- TotalTime: 158545670
AGGREGATION_NODE (id=3)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 101100
- GetResultsTime: 20918
- HTResizeTime: 497112
- HashBuckets: 10240
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 1675392
- PinTime: 0
- ReductionFactorEstimate: 0.0
- ReductionFactorThresholdToExpand: 0.0
- RowsPassedThrough: 0
- RowsReturned: 7
- RowsReturnedRate: 9
- StreamingTime: 15494144
- TotalTime: 713652916
- UnpinTime: 0
UNION_NODE (id=0)
- InactiveTotalTime: 0
- PeakMemoryUsage: 8454146
- RowsReturned: 382331
- RowsReturnedRate: 548796
- TotalTime: 696671530
HDFS_SCAN_NODE (id=2)
Hdfs split stats (<volume id>:<# splits>/<split lengths>):
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
ExecOption: Codegen enabled: 0 out of 0
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 0.0
- BytesRead: 0
- BytesReadDataNodeCache: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumDisksAccessed: 0
- NumScannerThreadsStarted: 0
- PeakMemoryUsage: 4096
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 0
- RowBatchQueuePutWaitTime: 0
- RowsRead: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- ScanRangesComplete: 0
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0
- MaterializeTupleTime(*): 0
- ScannerThreadsSysTime: 0
- ScannerThreadsUserTime: 0
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 0
- TotalTime: 368224
HDFS_SCAN_NODE (id=1)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.05 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:10
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 4.0
- BytesRead: 34416056
- BytesReadDataNodeCache: 18189782
- BytesReadLocal: 34416056
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 34416056
- DecompressionTime: 81938608
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumColumns: 1
- NumDisksAccessed: 1
- NumRowGroups: 10
- NumScannerThreadsStarted: 7
- PeakMemoryUsage: 47128680
- PerReadThreadRawHdfsThroughput: 3625615751
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 537550650
- RowBatchQueuePutWaitTime: 0
- RowsRead: 43978209
- RowsReturned: 382331
- RowsReturnedRate: 706426
- ScanRangesComplete: 10
- ScannerThreadsInvoluntaryContextSwitches: 9
- ScannerThreadsTotalWallClockTime: 2766081530
- MaterializeTupleTime(*): 2474316498
- ScannerThreadsSysTime: 188000000
- ScannerThreadsUserTime: 2360000000
- ScannerThreadsVoluntaryContextSwitches: 84
- TotalRawHdfsReadTime(*): 9492472
- TotalReadThroughput: 34416056
- TotalTime: 541218292
Instance 9947b1c08dd46d0f:f (host=cdh2.net.cuberonlabs.com:22000)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:17/2.00 GB
- AverageThreadTokens: 9.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 85101646
- PerHostPeakMemUsage: 87508324
- RowsProduced: 8
- TotalNetworkReceiveTime: 0
- TotalNetworkSendTime: 1634748
- TotalStorageWaitTime: 184085080
- TotalThreadsInvoluntaryContextSwitches: 23
- TotalThreadsTotalWallClockTime: 6451501400
- TotalThreadsSysTime: 484000000
- TotalThreadsUserTime: 5084000000
- TotalThreadsVoluntaryContextSwitches: 553
- TotalTime: 866884980
Fragment Instance Lifecycle Timings
- ExecTime: 688360612
- ExecTreeExecTime: 683088204
- InactiveTotalTime: 0
- OpenTime: 137708164
- ExecTreeOpenTime: 24583448
- PrepareTime: 40767532
- ExecTreePrepareTime: 819348
- TotalTime: 0
DataStreamSender (dst_id=5)
- BytesSent: 294
- InactiveTotalTime: 0
- NetworkThroughput(*): 1733367
- OverallThroughput: 977419
- PeakMemoryUsage: 109560
- RowsReturned: 8
- SerializeBatchTime: 80244
- TotalTime: 300792
- TransmitDataRPCTime: 169612
- UncompressedRowBatchSize: 376
CodeGen
- CodegenTime: 4223624
- CompileTime: 27866372
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 60
- NumInstructions: 1115
- OptimizationTime: 83824628
- PeakMemoryUsage: 570880
- PrepareTime: 34352472
- TotalTime: 146887648
AGGREGATION_NODE (id=3)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 102024
- GetResultsTime: 23084
- HTResizeTime: 543860
- HashBuckets: 12288
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 1675392
- PinTime: 0
- ReductionFactorEstimate: 0.0
- ReductionFactorThresholdToExpand: 0.0
- RowsPassedThrough: 0
- RowsReturned: 8
- RowsReturnedRate: 11
- StreamingTime: 28160112
- TotalTime: 708483552
- UnpinTime: 0
UNION_NODE (id=0)
- InactiveTotalTime: 0
- PeakMemoryUsage: 8454525
- RowsReturned: 713815
- RowsReturnedRate: 1052804
- TotalTime: 678012884
HDFS_SCAN_NODE (id=2)
Hdfs split stats (<volume id>:<# splits>/<split lengths>):
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
ExecOption: Codegen enabled: 0 out of 0
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 0.0
- BytesRead: 0
- BytesReadDataNodeCache: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumDisksAccessed: 0
- NumScannerThreadsStarted: 0
- PeakMemoryUsage: 4096
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 0
- RowBatchQueuePutWaitTime: 0
- RowsRead: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- ScanRangesComplete: 0
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0
- MaterializeTupleTime(*): 0
- ScannerThreadsSysTime: 0
- ScannerThreadsUserTime: 0
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 0
- TotalTime: 296484
HDFS_SCAN_NODE (id=1)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:17/2.00 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:17
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 8.0
- BytesRead: 66359165
- BytesReadDataNodeCache: 42075050
- BytesReadLocal: 66359165
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 66359165
- DecompressionTime: 158706876
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumColumns: 1
- NumDisksAccessed: 1
- NumRowGroups: 17
- NumScannerThreadsStarted: 11
- PeakMemoryUsage: 80070818
- PerReadThreadRawHdfsThroughput: 4166003190
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 400835640
- RowBatchQueuePutWaitTime: 0
- RowsRead: 83616139
- RowsReturned: 713815
- RowsReturnedRate: 1760834
- ScanRangesComplete: 17
- ScannerThreadsInvoluntaryContextSwitches: 23
- ScannerThreadsTotalWallClockTime: 5625514012
- MaterializeTupleTime(*): 4975076360
- ScannerThreadsSysTime: 276000000
- ScannerThreadsUserTime: 4868000000
- ScannerThreadsVoluntaryContextSwitches: 181
- TotalRawHdfsReadTime(*): 15928736
- TotalReadThroughput: 132718330
- TotalTime: 405384596
Instance 9947b1c08dd46d0f:5 (host=cdh7.net.cuberonlabs.com:22000)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.28 GB
- AverageThreadTokens: 3.5
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 54499763
- PerHostPeakMemUsage: 56906441
- RowsProduced: 7
- TotalNetworkReceiveTime: 0
- TotalNetworkSendTime: 1382822
- TotalStorageWaitTime: 96188500
- TotalThreadsInvoluntaryContextSwitches: 9
- TotalThreadsTotalWallClockTime: 4270415571
- TotalThreadsSysTime: 304000000
- TotalThreadsUserTime: 3200000000
- TotalThreadsVoluntaryContextSwitches: 360
- TotalTime: 827382305
Fragment Instance Lifecycle Timings
- ExecTime: 654281788
- ExecTreeExecTime: 649297297
- InactiveTotalTime: 0
- OpenTime: 134167378
- ExecTreeOpenTime: 19732651
- PrepareTime: 38886328
- ExecTreePrepareTime: 776042
- TotalTime: 0
DataStreamSender (dst_id=5)
- BytesSent: 250
- InactiveTotalTime: 0
- NetworkThroughput(*): 1573762
- OverallThroughput: 827795
- PeakMemoryUsage: 105464
- RowsReturned: 7
- SerializeBatchTime: 92541
- TotalTime: 302007
- TransmitDataRPCTime: 158855
- UncompressedRowBatchSize: 325
CodeGen
- CodegenTime: 4337606
- CompileTime: 29466966
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 60
- NumInstructions: 1115
- OptimizationTime: 83634453
- PeakMemoryUsage: 570880
- PrepareTime: 32486672
- TotalTime: 146366842
AGGREGATION_NODE (id=3)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 97871
- GetResultsTime: 16293
- HTResizeTime: 639036
- HashBuckets: 10240
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 1675392
- PinTime: 0
- ReductionFactorEstimate: 0.0
- ReductionFactorThresholdToExpand: 0.0
- RowsPassedThrough: 0
- RowsReturned: 7
- RowsReturnedRate: 10
- StreamingTime: 14084918
- TotalTime: 669797992
- UnpinTime: 0
UNION_NODE (id=0)
- InactiveTotalTime: 0
- PeakMemoryUsage: 8454561
- RowsReturned: 309503
- RowsReturnedRate: 473292
- TotalTime: 653935594
HDFS_SCAN_NODE (id=2)
Hdfs split stats (<volume id>:<# splits>/<split lengths>):
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
ExecOption: Codegen enabled: 0 out of 0
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 0.0
- BytesRead: 0
- BytesReadDataNodeCache: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumDisksAccessed: 0
- NumScannerThreadsStarted: 0
- PeakMemoryUsage: 4096
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 0
- RowBatchQueuePutWaitTime: 0
- RowsRead: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- ScanRangesComplete: 0
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0
- MaterializeTupleTime(*): 0
- ScannerThreadsSysTime: 0
- ScannerThreadsUserTime: 0
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 0
- TotalTime: 408567
HDFS_SCAN_NODE (id=1)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.28 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:10
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 5.0
- BytesRead: 43032952
- BytesReadDataNodeCache: 26846975
- BytesReadLocal: 43032952
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 43032952
- DecompressionTime: 94711851
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumColumns: 1
- NumDisksAccessed: 1
- NumRowGroups: 10
- NumScannerThreadsStarted: 10
- PeakMemoryUsage: 50843994
- PerReadThreadRawHdfsThroughput: 4816007341
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 479957886
- RowBatchQueuePutWaitTime: 0
- RowsRead: 53096875
- RowsReturned: 309503
- RowsReturnedRate: 639873
- ScanRangesComplete: 10
- ScannerThreadsInvoluntaryContextSwitches: 9
- ScannerThreadsTotalWallClockTime: 3482045350
- MaterializeTupleTime(*): 3119780011
- ScannerThreadsSysTime: 180000000
- ScannerThreadsUserTime: 3016000000
- ScannerThreadsVoluntaryContextSwitches: 99
- TotalRawHdfsReadTime(*): 8935400
- TotalReadThroughput: 43032952
- TotalTime: 483694061
Instance 9947b1c08dd46d0f:10 (host=cdh4.net.cuberonlabs.com:22000)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:14/1.67 GB
- AverageThreadTokens: 9.5
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 49803557
- PerHostPeakMemUsage: 52218504
- RowsProduced: 7
- TotalNetworkReceiveTime: 0
- TotalNetworkSendTime: 1122678
- TotalStorageWaitTime: 103949814
- TotalThreadsInvoluntaryContextSwitches: 36
- TotalThreadsTotalWallClockTime: 5344181890
- TotalThreadsSysTime: 280000000
- TotalThreadsUserTime: 4308000000
- TotalThreadsVoluntaryContextSwitches: 365
- TotalTime: 822465258
Fragment Instance Lifecycle Timings
- ExecTime: 642689920
- ExecTreeExecTime: 637702060
- InactiveTotalTime: 0
- OpenTime: 138014552
- ExecTreeOpenTime: 23542800
- PrepareTime: 41713512
- ExecTreePrepareTime: 745760
- TotalTime: 0
DataStreamSender (dst_id=5)
- BytesSent: 251
- InactiveTotalTime: 0
- NetworkThroughput(*): 2136170
- OverallThroughput: 873256
- PeakMemoryUsage: 105464
- RowsReturned: 7
- SerializeBatchTime: 111908
- TotalTime: 287430
- TransmitDataRPCTime: 117500
- UncompressedRowBatchSize: 325
CodeGen
- CodegenTime: 4063382
- CompileTime: 29055368
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 60
- NumInstructions: 1115
- OptimizationTime: 84019058
- PeakMemoryUsage: 570880
- PrepareTime: 33957092
- TotalTime: 147729220
AGGREGATION_NODE (id=3)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 158936
- GetResultsTime: 21428
- HTResizeTime: 657534
- HashBuckets: 10240
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 1675392
- PinTime: 0
- ReductionFactorEstimate: 0.0
- ReductionFactorThresholdToExpand: 0.0
- RowsPassedThrough: 0
- RowsReturned: 7
- RowsReturnedRate: 10
- StreamingTime: 34441094
- TotalTime: 661980838
- UnpinTime: 0
UNION_NODE (id=0)
- InactiveTotalTime: 0
- PeakMemoryUsage: 8454627
- RowsReturned: 549998
- RowsReturnedRate: 879352
- TotalTime: 625457786
HDFS_SCAN_NODE (id=2)
Hdfs split stats (<volume id>:<# splits>/<split lengths>):
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
ExecOption: Codegen enabled: 0 out of 0
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 0.0
- BytesRead: 0
- BytesReadDataNodeCache: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumDisksAccessed: 0
- NumScannerThreadsStarted: 0
- PeakMemoryUsage: 4096
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 0
- RowBatchQueuePutWaitTime: 0
- RowsRead: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- ScanRangesComplete: 0
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0
- MaterializeTupleTime(*): 0
- ScannerThreadsSysTime: 0
- ScannerThreadsUserTime: 0
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 0
- TotalTime: 388938
HDFS_SCAN_NODE (id=1)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:14/1.67 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 14 out of 14
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:14
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 8.5
- BytesRead: 55110625
- BytesReadDataNodeCache: 55110625
- BytesReadLocal: 55110625
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 55110625
- DecompressionTime: 129547920
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumColumns: 1
- NumDisksAccessed: 0
- NumRowGroups: 14
- NumScannerThreadsStarted: 11
- PeakMemoryUsage: 45642174
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 382968912
- RowBatchQueuePutWaitTime: 0
- RowsRead: 69434238
- RowsReturned: 549998
- RowsReturnedRate: 1416133
- ScanRangesComplete: 14
- ScannerThreadsInvoluntaryContextSwitches: 32
- ScannerThreadsTotalWallClockTime: 4563535656
- MaterializeTupleTime(*): 4070793906
- ScannerThreadsSysTime: 124000000
- ScannerThreadsUserTime: 4068000000
- ScannerThreadsVoluntaryContextSwitches: 146
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 55110625
- TotalTime: 388379940
Instance 9947b1c08dd46d0f:a (host=cdh5.net.cuberonlabs.com:22000)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:9/1.28 GB
- AverageThreadTokens: 6.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 57031871
- PerHostPeakMemUsage: 59438533
- RowsProduced: 7
- TotalNetworkReceiveTime: 0
- TotalNetworkSendTime: 1216378
- TotalStorageWaitTime: 74576988
- TotalThreadsInvoluntaryContextSwitches: 6
- TotalThreadsTotalWallClockTime: 4081640038
- TotalThreadsSysTime: 284000000
- TotalThreadsUserTime: 3152000000
- TotalThreadsVoluntaryContextSwitches: 331
- TotalTime: 819072818
Fragment Instance Lifecycle Timings
- ExecTime: 638884536
- ExecTreeExecTime: 633581214
- InactiveTotalTime: 0
- OpenTime: 138034216
- ExecTreeOpenTime: 17802376
- PrepareTime: 42101726
- ExecTreePrepareTime: 643892
- TotalTime: 0
DataStreamSender (dst_id=5)
- BytesSent: 245
- InactiveTotalTime: 0
- NetworkThroughput(*): 1678174
- OverallThroughput: 692990
- PeakMemoryUsage: 105464
- RowsReturned: 7
- SerializeBatchTime: 155088
- TotalTime: 353540
- TransmitDataRPCTime: 145992
- UncompressedRowBatchSize: 325
CodeGen
- CodegenTime: 4330836
- CompileTime: 31008338
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 60
- NumInstructions: 1115
- OptimizationTime: 87670832
- PeakMemoryUsage: 570880
- PrepareTime: 34645554
- TotalTime: 154114612
AGGREGATION_NODE (id=3)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 95766
- GetResultsTime: 16966
- HTResizeTime: 450712
- HashBuckets: 10240
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 1675392
- PinTime: 0
- ReductionFactorEstimate: 0.0
- ReductionFactorThresholdToExpand: 0.0
- RowsPassedThrough: 0
- RowsReturned: 7
- RowsReturnedRate: 10
- StreamingTime: 13929670
- TotalTime: 652017048
- UnpinTime: 0
UNION_NODE (id=0)
- InactiveTotalTime: 0
- PeakMemoryUsage: 8454487
- RowsReturned: 289276
- RowsReturnedRate: 454440
- TotalTime: 636553742
HDFS_SCAN_NODE (id=2)
Hdfs split stats (<volume id>:<# splits>/<split lengths>):
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
ExecOption: Codegen enabled: 0 out of 0
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 0.0
- BytesRead: 0
- BytesReadDataNodeCache: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumDisksAccessed: 0
- NumScannerThreadsStarted: 0
- PeakMemoryUsage: 4096
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 0
- RowBatchQueuePutWaitTime: 0
- RowsRead: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- ScanRangesComplete: 0
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0
- MaterializeTupleTime(*): 0
- ScannerThreadsSysTime: 0
- ScannerThreadsUserTime: 0
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 0
- TotalTime: 403816
HDFS_SCAN_NODE (id=1)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:9/1.28 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:9
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 5.0
- BytesRead: 42460609
- BytesReadDataNodeCache: 26023676
- BytesReadLocal: 42460609
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 42460609
- DecompressionTime: 97575624
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumColumns: 1
- NumDisksAccessed: 1
- NumRowGroups: 9
- NumScannerThreadsStarted: 8
- PeakMemoryUsage: 52953859
- PerReadThreadRawHdfsThroughput: 4193939459
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 445741990
- RowBatchQueuePutWaitTime: 0
- RowsRead: 53642219
- RowsReturned: 289276
- RowsReturnedRate: 642859
- ScanRangesComplete: 9
- ScannerThreadsInvoluntaryContextSwitches: 6
- ScannerThreadsTotalWallClockTime: 3304775992
- MaterializeTupleTime(*): 3008225452
- ScannerThreadsSysTime: 148000000
- ScannerThreadsUserTime: 2956000000
- ScannerThreadsVoluntaryContextSwitches: 84
- TotalRawHdfsReadTime(*): 10124278
- TotalReadThroughput: 84921218
- TotalTime: 449983012
Instance 9947b1c08dd46d0f:9 (host=cdh1.net.cuberonlabs.com:22000)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:15/2.04 GB
- AverageThreadTokens: 11.5
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 56665925
- PerHostPeakMemUsage: 59072571
- RowsProduced: 7
- TotalNetworkReceiveTime: 0
- TotalNetworkSendTime: 1473800
- TotalStorageWaitTime: 139034176
- TotalThreadsInvoluntaryContextSwitches: 29
- TotalThreadsTotalWallClockTime: 6298301524
- TotalThreadsSysTime: 428000000
- TotalThreadsUserTime: 4968000000
- TotalThreadsVoluntaryContextSwitches: 415
- TotalTime: 816215940
Fragment Instance Lifecycle Timings
- ExecTime: 634434404
- ExecTreeExecTime: 629398720
- InactiveTotalTime: 0
- OpenTime: 142703520
- ExecTreeOpenTime: 28464428
- PrepareTime: 39031340
- ExecTreePrepareTime: 661684
- TotalTime: 0
DataStreamSender (dst_id=5)
- BytesSent: 250
- InactiveTotalTime: 0
- NetworkThroughput(*): 1993111
- OverallThroughput: 735848
- PeakMemoryUsage: 105464
- RowsReturned: 7
- SerializeBatchTime: 162504
- TotalTime: 339744
- TransmitDataRPCTime: 125432
- UncompressedRowBatchSize: 325
CodeGen
- CodegenTime: 4234004
- CompileTime: 29440944
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 60
- NumInstructions: 1115
- OptimizationTime: 83375236
- PeakMemoryUsage: 570880
- PrepareTime: 32476400
- TotalTime: 146064676
AGGREGATION_NODE (id=3)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 104072
- GetResultsTime: 12744
- HTResizeTime: 325096
- HashBuckets: 10240
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 1675392
- PinTime: 0
- ReductionFactorEstimate: 0.0
- ReductionFactorThresholdToExpand: 0.0
- RowsPassedThrough: 0
- RowsReturned: 7
- RowsReturnedRate: 10
- StreamingTime: 25341068
- TotalTime: 658516948
- UnpinTime: 0
UNION_NODE (id=0)
- InactiveTotalTime: 0
- PeakMemoryUsage: 8454571
- RowsReturned: 496622
- RowsReturnedRate: 786338
- TotalTime: 631562784
HDFS_SCAN_NODE (id=2)
Hdfs split stats (<volume id>:<# splits>/<split lengths>):
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
ExecOption: Codegen enabled: 0 out of 0
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 0.0
- BytesRead: 0
- BytesReadDataNodeCache: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumDisksAccessed: 0
- NumScannerThreadsStarted: 0
- PeakMemoryUsage: 4096
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 0
- RowBatchQueuePutWaitTime: 0
- RowsRead: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- ScanRangesComplete: 0
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0
- MaterializeTupleTime(*): 0
- ScannerThreadsSysTime: 0
- ScannerThreadsUserTime: 0
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 0
- TotalTime: 323212
HDFS_SCAN_NODE (id=1)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:15/2.04 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 15 out of 15
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:15
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 10.5
- BytesRead: 69026665
- BytesReadDataNodeCache: 69026665
- BytesReadLocal: 69026665
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 69026665
- DecompressionTime: 145594592
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumColumns: 1
- NumDisksAccessed: 0
- NumRowGroups: 15
- NumScannerThreadsStarted: 13
- PeakMemoryUsage: 52382686
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 373257236
- RowBatchQueuePutWaitTime: 0
- RowsRead: 84459663
- RowsReturned: 496622
- RowsReturnedRate: 1311020
- ScanRangesComplete: 15
- ScannerThreadsInvoluntaryContextSwitches: 27
- ScannerThreadsTotalWallClockTime: 5521247600
- MaterializeTupleTime(*): 4852709680
- ScannerThreadsSysTime: 260000000
- ScannerThreadsUserTime: 4736000000
- ScannerThreadsVoluntaryContextSwitches: 193
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 69026665
- TotalTime: 378805684
Instance 9947b1c08dd46d0f:7 (host=cdh9.net.cuberonlabs.com:22000)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.44 GB
- AverageThreadTokens: 7.0
- BloomFilterBytes: 0
- InactiveTotalTime: 0
- PeakMemoryUsage: 49056674
- PerHostPeakMemUsage: 51455130
- RowsProduced: 7
- TotalNetworkReceiveTime: 0
- TotalNetworkSendTime: 1420289
- TotalStorageWaitTime: 107561805
- TotalThreadsInvoluntaryContextSwitches: 5
- TotalThreadsTotalWallClockTime: 4655235669
- TotalThreadsSysTime: 280000000
- TotalThreadsUserTime: 3584000000
- TotalThreadsVoluntaryContextSwitches: 357
- TotalTime: 813647186
Fragment Instance Lifecycle Timings
- ExecTime: 630243744
- ExecTreeExecTime: 624750942
- InactiveTotalTime: 0
- OpenTime: 143735591
- ExecTreeOpenTime: 26803667
- PrepareTime: 39627352
- ExecTreePrepareTime: 791965
- TotalTime: 0
DataStreamSender (dst_id=5)
- BytesSent: 251
- InactiveTotalTime: 0
- NetworkThroughput(*): 1794613
- OverallThroughput: 943396
- PeakMemoryUsage: 105464
- RowsReturned: 7
- SerializeBatchTime: 77740
- TotalTime: 266060
- TransmitDataRPCTime: 139863
- UncompressedRowBatchSize: 325
CodeGen
- CodegenTime: 4300637
- CompileTime: 30479714
- InactiveTotalTime: 0
- LoadTime: 0
- ModuleBitcodeSize: 1997792
- NumFunctions: 60
- NumInstructions: 1115
- OptimizationTime: 85051052
- PeakMemoryUsage: 570880
- PrepareTime: 32749517
- TotalTime: 149079998
AGGREGATION_NODE (id=3)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 106901
- GetResultsTime: 16591
- HTResizeTime: 366526
- HashBuckets: 10240
- InactiveTotalTime: 0
- LargestPartitionPercent: 0
- PartitionsCreated: 16
- PeakMemoryUsage: 1675392
- PinTime: 0
- ReductionFactorEstimate: 0.0
- ReductionFactorThresholdToExpand: 0.0
- RowsPassedThrough: 0
- RowsReturned: 7
- RowsReturnedRate: 10
- StreamingTime: 21927293
- TotalTime: 652337882
- UnpinTime: 0
UNION_NODE (id=0)
- InactiveTotalTime: 0
- PeakMemoryUsage: 8454520
- RowsReturned: 418963
- RowsReturnedRate: 666368
- TotalTime: 628725970
HDFS_SCAN_NODE (id=2)
Hdfs split stats (<volume id>:<# splits>/<split lengths>):
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
ExecOption: Codegen enabled: 0 out of 0
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 0.0
- BytesRead: 0
- BytesReadDataNodeCache: 0
- BytesReadLocal: 0
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumDisksAccessed: 0
- NumScannerThreadsStarted: 0
- PeakMemoryUsage: 4096
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 0
- RowBatchQueuePutWaitTime: 0
- RowsRead: 0
- RowsReturned: 0
- RowsReturnedRate: 0
- ScanRangesComplete: 0
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0
- MaterializeTupleTime(*): 0
- ScannerThreadsSysTime: 0
- ScannerThreadsUserTime: 0
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 0
- TotalTime: 402872
HDFS_SCAN_NODE (id=1)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.44 GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0%
File Formats: PARQUET/SNAPPY:11
- AverageHdfsReadThreadConcurrency: 0.0
- AverageScannerThreadConcurrency: 6.0
- BytesRead: 47597284
- BytesReadDataNodeCache: 47597284
- BytesReadLocal: 47597284
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 47597284
- DecompressionTime: 106826019
- InactiveTotalTime: 0
- MaxCompressedTextFileLength: 0
- NumColumns: 1
- NumDisksAccessed: 0
- NumRowGroups: 11
- NumScannerThreadsStarted: 11
- PeakMemoryUsage: 43783476
- PerReadThreadRawHdfsThroughput: 0
- RemoteScanRanges: 0
- RowBatchQueueGetWaitTime: 423709978
- RowBatchQueuePutWaitTime: 0
- RowsRead: 59336606
- RowsReturned: 418963
- RowsReturnedRate: 977175
- ScanRangesComplete: 11
- ScannerThreadsInvoluntaryContextSwitches: 5
- ScannerThreadsTotalWallClockTime: 3881325083
- MaterializeTupleTime(*): 3426087168
- ScannerThreadsSysTime: 148000000
- ScannerThreadsUserTime: 3368000000
- ScannerThreadsVoluntaryContextSwitches: 133
- TotalRawHdfsReadTime(*): 0
- TotalReadThroughput: 95194568
- TotalTime: 428749017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment