-
-
Save momohuri/9ad4ba8f6fbd1d180068c8c102291f69 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Query (id=394167ef5bc5c023:bc2a538e00000000) | |
| Summary | |
| Session ID: 924b3699404150b7:2f61ff06673d1986 | |
| Session Type: HIVESERVER2 | |
| HiveServer2 Protocol Version: V6 | |
| Start Time: 2017-03-09 13:34:33.693127000 | |
| End Time: | |
| Query Type: QUERY | |
| Query State: CREATED | |
| Query Status: OK | |
| Impala Version: impalad version 2.7.0-cdh5.10.0 RELEASE (build 785a073cd07e2540d521ecebb8b38161ccbd2aa2) | |
| User: hdfs | |
| Connected User: hdfs | |
| Delegated User: | |
| Network Address: ::ffff:172.16.0.221:53821 | |
| Default Db: wikia_prod | |
| Sql Statement: SELECT `ga_category`, count(*) `y` | |
| FROM | |
| (SELECT `ga_category` | |
| FROM trackingevent | |
| WHERE `cuberon_event_date` BETWEEN "2017-01-31" AND "2017-02-14") Q1 | |
| WHERE (`ga_category` LIKE '%editor%' | |
| AND `ga_category` IS NOT NULL) | |
| GROUP BY `ga_category` | |
| ORDER BY `y` DESC LIMIT 10 | |
| Coordinator: cdh9.net.cuberonlabs.com:22000 | |
| Query Options (non default): QUERY_TIMEOUT_S=600,MT_DOP=10 | |
| Plan: | |
| ---------------- | |
| Estimated Per-Host Requirements: Memory=108.00MB VCores=2 | |
| WARNING: The following tables are missing relevant table and/or column statistics. | |
| wikia_prod.trackingevent_batch | |
| WARNING: Spilling is disabled for this query as a safety guard. | |
| Reason: Query option disable_unsafe_spills is set, at least one table | |
| is missing relevant stats, and no plan hints were given. | |
| PLAN-ROOT SINK | |
| | | |
| 07:MERGING-EXCHANGE [UNPARTITIONED] | |
| | order by: count(*) DESC | |
| | limit: 10 | |
| | hosts=17 per-host-mem=unavailable | |
| | tuple-ids=6 row-size=40B cardinality=10 | |
| | | |
| 04:TOP-N [LIMIT=10] | |
| | order by: count(*) DESC | |
| | hosts=17 per-host-mem=397B | |
| | tuple-ids=6 row-size=40B cardinality=10 | |
| | | |
| 06:AGGREGATE [FINALIZE] | |
| | output: count:merge(*) | |
| | group by: ga_category | |
| | hosts=17 per-host-mem=10.00MB | |
| | tuple-ids=5 row-size=40B cardinality=166 | |
| | | |
| 05:EXCHANGE [HASH(ga_category)] | |
| | hosts=17 per-host-mem=0B | |
| | tuple-ids=5 row-size=40B cardinality=166 | |
| | | |
| 03:AGGREGATE [STREAMING] | |
| | output: count(*) | |
| | group by: ga_category | |
| | hosts=17 per-host-mem=10.00MB | |
| | tuple-ids=5 row-size=40B cardinality=166 | |
| | | |
| 00:UNION | |
| | hosts=17 per-host-mem=0B | |
| | tuple-ids=2 row-size=32B cardinality=140142587 | |
| | | |
| |--02:SCAN HDFS [wikia_prod.trackingevent_streaming, RANDOM] | |
| | partitions=0/0 files=0 size=0B | |
| | predicates: wikia_prod.trackingevent_streaming.ga_category IS NOT NULL, wikia_prod.trackingevent_streaming.ga_category LIKE '%editor%' | |
| | table stats: 0 rows total | |
| | column stats: all | |
| | hosts=1 per-host-mem=0B | |
| | tuple-ids=1 row-size=16B cardinality=0 | |
| | | |
| 01:SCAN HDFS [wikia_prod.trackingevent_batch, RANDOM] | |
| partitions=13/13 files=346 size=46.14GB | |
| predicates: wikia_prod.trackingevent_batch.ga_category IS NOT NULL, wikia_prod.trackingevent_batch.ga_category LIKE '%editor%' | |
| table stats: 1401425865 rows total (3 partition(s) missing stats) | |
| column stats: all | |
| hosts=17 per-host-mem=88.00MB | |
| tuple-ids=0 row-size=32B cardinality=140142587 | |
| ---------------- | |
| Estimated Per-Host Mem: 113246208 | |
| Estimated Per-Host VCores: 2 | |
| Tables Missing Stats: wikia_prod.trackingevent_batch | |
| Request Pool: root.hdfs | |
| Admission result: Admitted immediately | |
| - ComputeScanRangeAssignmentTimer: 929289 | |
| - InactiveTotalTime: 0 | |
| - TotalTime: 0 | |
| Planner Timeline | |
| Analysis finished: 1894528 | |
| Equivalence classes computed: 3259566 | |
| Single node plan created: 6172671 | |
| Runtime filters computed: 6240193 | |
| Distributed plan created: 6705881 | |
| Lineage info computed: 6851763 | |
| Parallel plans created: 6909062 | |
| Planning finished: 9004241 | |
| Query Timeline | |
| Query submitted: 129323 | |
| Planning finished: 17069706 | |
| Submit for admission: 19041659 | |
| Completed admission: 19145941 | |
| Ready to start 35 fragment instances: 19738944 | |
| All 35 fragment instances started: 34961374 | |
| Rows available: 11831935278 | |
| First row fetched: 12757101568 | |
| ImpalaServer | |
| - ClientFetchWaitTimer: 925179288 | |
| - InactiveTotalTime: 0 | |
| - RowMaterializationTimer: 5902804 | |
| - TotalTime: 0 | |
| Execution Profile 394167ef5bc5c023:bc2a538e00000000 | |
| Fragment instance start latencies: Count: 35, 25th %-ile: 1ms, 50th %-ile: 2ms, 75th %-ile: 3ms, 90th %-ile: 4ms, 95th %-ile: 4ms, 99.9th %-ile: 5ms | |
| Per Node Peak Memory Usage: cdh4.net.cuberonlabs.com:22000(12.12 MB) cdh7.net.cuberonlabs.com:22000(20.12 MB) cdh5.net.cuberonlabs.com:22000(20.14 MB) cdh1.net.cuberonlabs.com:22000(20.12 MB) cdh2.net.cuberonlabs.com:22000(20.12 MB) cdh3.net.cuberonlabs.com:22000(12.12 MB) cdh10.net.cuberonlabs.com:22000(12.12 MB) cdh17.net.cuberonlabs.com:22000(12.87 MB) cdh12.net.cuberonlabs.com:22000(12.16 MB) cdh8.net.cuberonlabs.com:22000(12.15 MB) cdh16.net.cuberonlabs.com:22000(12.12 MB) cdh15.net.cuberonlabs.com:22000(12.12 MB) cdh13.net.cuberonlabs.com:22000(12.12 MB) cdh11.net.cuberonlabs.com:22000(12.12 MB) cdh6.net.cuberonlabs.com:22000(20.12 MB) cdh9.net.cuberonlabs.com:22000(12.13 MB) cdh14.net.cuberonlabs.com:22000(12.12 MB) | |
| - FiltersReceived: 0 | |
| - FinalizationTimer: 0 | |
| - InactiveTotalTime: 0 | |
| - TotalTime: 11817545142 | |
| Coordinator Fragment F04 | |
| Instance 394167ef5bc5c023:bc2a538e00000000 (host=cdh9.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 0.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 275968 | |
| - PerHostPeakMemUsage: 12714171 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 0 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 12697526845 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 48000000 | |
| - TotalThreadsVoluntaryContextSwitches: 17 | |
| - TotalTime: 12734542940 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 925285392 | |
| - ExecTreeExecTime: 19523 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 11772282009 | |
| - ExecTreeOpenTime: 11721536574 | |
| - PrepareTime: 36891477 | |
| - ExecTreePrepareTime: 101215 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| PLAN_ROOT_SINK | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 0 | |
| - TotalTime: 0 | |
| CodeGen | |
| - CodegenTime: 1317934 | |
| - CompileTime: 2964427 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 28 | |
| - NumInstructions: 523 | |
| - OptimizationTime: 46200068 | |
| - PeakMemoryUsage: 267776 | |
| - PrepareTime: 35661268 | |
| - TotalTime: 85664011 | |
| EXCHANGE_NODE (id=7) | |
| ExecOption: Codegen Enabled | |
| - BytesReceived: 298 | |
| - ConvertRowBatchTime: 0 | |
| - DeserializeRowBatchTimer: 577723 | |
| - FirstBatchArrivalWaitTime: 11721464632 | |
| - InactiveTotalTime: 11721472733 | |
| - MergeGetNext: 14457 | |
| - MergeGetNextBatch: 6322 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 11721551578 | |
| Averaged Fragment F03 | |
| split sizes: min: 0, max: 0, avg: 0, stddev: 0 | |
| completion times: min:11s806ms max:11s809ms mean: 11s808ms stddev:1.116ms | |
| execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec | |
| num instances: 17 | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 15225424 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 11561282255 | |
| - TotalNetworkSendTime: 137685 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 11767948018 | |
| - TotalThreadsSysTime: 1176470 | |
| - TotalThreadsUserTime: 208235294 | |
| - TotalThreadsVoluntaryContextSwitches: 10 | |
| - TotalTime: 11806977511 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 435319 | |
| - ExecTreeExecTime: 3685 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 11767559151 | |
| - ExecTreeOpenTime: 11562245142 | |
| - PrepareTime: 38904887 | |
| - ExecTreePrepareTime: 665251 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 17 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 469213 | |
| - OverallThroughput: 157566 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 15399 | |
| - TotalTime: 47720 | |
| - TransmitDataRPCTime: 11312 | |
| - UncompressedRowBatchSize: 22 | |
| CodeGen | |
| - CodegenTime: 4692536 | |
| - CompileTime: 38086017 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 165759920 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 35091444 | |
| - TotalTime: 239740771 | |
| SORT_NODE (id=4) | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 3677 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 11562909824 | |
| AGGREGATION_NODE (id=6) | |
| - BuildTime: 13946 | |
| - GetNewBlockTime: 137694 | |
| - GetResultsTime: 1572 | |
| - HTResizeTime: 4221 | |
| - HashBuckets: 481 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 2 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2410563 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 11562825086 | |
| - UnpinTime: 981 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 261 | |
| - ConvertRowBatchTime: 10200 | |
| - DeserializeRowBatchTimer: 77186 | |
| - FirstBatchArrivalWaitTime: 8707843224 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 11561309670 | |
| Fragment F03 | |
| Instance 394167ef5bc5c023:21 (host=cdh6.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 21094045 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 11559534146 | |
| - TotalNetworkSendTime: 394 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 11767690776 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 208000000 | |
| - TotalThreadsVoluntaryContextSwitches: 10 | |
| - TotalTime: 11808418372 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 352656 | |
| - ExecTreeExecTime: 4020 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 11767400104 | |
| - ExecTreeOpenTime: 11560564936 | |
| - PrepareTime: 40574086 | |
| - ExecTreePrepareTime: 721390 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 21248 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4817174 | |
| - CompileTime: 38788912 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 166475538 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 36303752 | |
| - TotalTime: 242390018 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 788 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 11561286648 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 9372 | |
| - GetNewBlockTime: 130534 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 5060 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 11561197484 | |
| - UnpinTime: 1068 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 560 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 11559528606 | |
| - InactiveTotalTime: 11559530176 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 11559536656 | |
| Instance 394167ef5bc5c023:1c (host=cdh3.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12706041 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 11556785186 | |
| - TotalNetworkSendTime: 344 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 11767661630 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 212000000 | |
| - TotalThreadsVoluntaryContextSwitches: 8 | |
| - TotalTime: 11808362828 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 291844 | |
| - ExecTreeExecTime: 4548 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 11767423992 | |
| - ExecTreeOpenTime: 11557802290 | |
| - PrepareTime: 40551138 | |
| - ExecTreePrepareTime: 679464 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 24238 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 5181186 | |
| - CompileTime: 39557130 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 168485052 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 36454114 | |
| - TotalTime: 245330924 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 502 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 11558481682 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 8740 | |
| - GetNewBlockTime: 128084 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 5272 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 11558390344 | |
| - UnpinTime: 1140 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 856 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 11556778922 | |
| - InactiveTotalTime: 11556780566 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 11556788250 | |
| Instance 394167ef5bc5c023:20 (host=cdh7.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 21093972 | |
| - RowsProduced: 1 | |
| - TotalNetworkReceiveTime: 11558595187 | |
| - TotalNetworkSendTime: 339423 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 11767987796 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 212000000 | |
| - TotalThreadsVoluntaryContextSwitches: 9 | |
| - TotalTime: 11808159203 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 666391 | |
| - ExecTreeExecTime: 3828 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 11767352558 | |
| - ExecTreeOpenTime: 11559594880 | |
| - PrepareTime: 40063291 | |
| - ExecTreePrepareTime: 615821 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 43 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1108676 | |
| - OverallThroughput: 407401 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 1 | |
| - SerializeBatchTime: 42481 | |
| - TotalTime: 105547 | |
| - TransmitDataRPCTime: 38785 | |
| - UncompressedRowBatchSize: 51 | |
| CodeGen | |
| - CodegenTime: 4952991 | |
| - CompileTime: 38579612 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 167535620 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 36143957 | |
| - TotalTime: 243049146 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 13314 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 11560209638 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 22274 | |
| - GetNewBlockTime: 118057 | |
| - GetResultsTime: 1428 | |
| - HTResizeTime: 3478 | |
| - HashBuckets: 1024 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 25 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2409600 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 11560113389 | |
| - UnpinTime: 753 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 172 | |
| - ConvertRowBatchTime: 7693 | |
| - DeserializeRowBatchTimer: 29948 | |
| - FirstBatchArrivalWaitTime: 3598778239 | |
| - InactiveTotalTime: 11558563901 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 4 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 11558616995 | |
| Instance 394167ef5bc5c023:1f (host=cdh5.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 21114387 | |
| - RowsProduced: 3 | |
| - TotalNetworkReceiveTime: 11558320716 | |
| - TotalNetworkSendTime: 371292 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 11766541910 | |
| - TotalThreadsSysTime: 4000000 | |
| - TotalThreadsUserTime: 208000000 | |
| - TotalThreadsVoluntaryContextSwitches: 25 | |
| - TotalTime: 11808093232 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 688042 | |
| - ExecTreeExecTime: 4462 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 11765894158 | |
| - ExecTreeOpenTime: 11559515816 | |
| - PrepareTime: 41430510 | |
| - ExecTreePrepareTime: 839580 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 85 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1737246 | |
| - OverallThroughput: 496831 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 3 | |
| - SerializeBatchTime: 100994 | |
| - TotalTime: 171084 | |
| - TransmitDataRPCTime: 48928 | |
| - UncompressedRowBatchSize: 123 | |
| CodeGen | |
| - CodegenTime: 5033542 | |
| - CompileTime: 38492688 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 166306856 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 37154062 | |
| - TotalTime: 242819046 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 8658 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 3 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 11560355474 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 40298 | |
| - GetNewBlockTime: 212360 | |
| - GetResultsTime: 12090 | |
| - HTResizeTime: 5548 | |
| - HashBuckets: 3072 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 1 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2462848 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 3 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 11560245560 | |
| - UnpinTime: 1250 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 1426 | |
| - ConvertRowBatchTime: 40768 | |
| - DeserializeRowBatchTimer: 335314 | |
| - FirstBatchArrivalWaitTime: 1421190412 | |
| - InactiveTotalTime: 11558179058 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 51 | |
| - RowsReturnedRate: 4 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 11558424230 | |
| Instance 394167ef5bc5c023:22 (host=cdh4.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12706012 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 11559199434 | |
| - TotalNetworkSendTime: 312 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 1 | |
| - TotalThreadsTotalWallClockTime: 11767012948 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 212000000 | |
| - TotalThreadsVoluntaryContextSwitches: 4 | |
| - TotalTime: 11808089184 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 307116 | |
| - ExecTreeExecTime: 4506 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 11766759714 | |
| - ExecTreeOpenTime: 11560148756 | |
| - PrepareTime: 40945858 | |
| - ExecTreePrepareTime: 465268 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 22978 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 5115052 | |
| - CompileTime: 38445876 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 166566188 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 37048978 | |
| - TotalTime: 242907374 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 638 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 11560614178 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 7830 | |
| - GetNewBlockTime: 99170 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 5056 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 11560536976 | |
| - UnpinTime: 498 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 608 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 11559193732 | |
| - InactiveTotalTime: 11559195268 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 11559202402 | |
| Instance 394167ef5bc5c023:1b (host=cdh17.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 13491290 | |
| - RowsProduced: 1 | |
| - TotalNetworkReceiveTime: 11555119026 | |
| - TotalNetworkSendTime: 490811 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 11766583770 | |
| - TotalThreadsSysTime: 4000000 | |
| - TotalThreadsUserTime: 212000000 | |
| - TotalThreadsVoluntaryContextSwitches: 23 | |
| - TotalTime: 11807713111 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 729616 | |
| - ExecTreeExecTime: 3470 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 11765907604 | |
| - ExecTreeOpenTime: 11556210240 | |
| - PrepareTime: 40981862 | |
| - ExecTreePrepareTime: 679566 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 55 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1431061 | |
| - OverallThroughput: 751109 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 1 | |
| - SerializeBatchTime: 12870 | |
| - TotalTime: 73225 | |
| - TransmitDataRPCTime: 38433 | |
| - UncompressedRowBatchSize: 63 | |
| CodeGen | |
| - CodegenTime: 4983652 | |
| - CompileTime: 38195767 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 169856122 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 37073876 | |
| - TotalTime: 245949942 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 15053 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 11556888583 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 29166 | |
| - GetNewBlockTime: 133667 | |
| - GetResultsTime: 1384 | |
| - HTResizeTime: 3985 | |
| - HashBuckets: 1024 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 5 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2462848 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 11556780108 | |
| - UnpinTime: 915 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 935 | |
| - ConvertRowBatchTime: 44209 | |
| - DeserializeRowBatchTimer: 281037 | |
| - FirstBatchArrivalWaitTime: 1418079230 | |
| - InactiveTotalTime: 11555002643 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 17 | |
| - RowsReturnedRate: 1 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 11555221175 | |
| Instance 394167ef5bc5c023:1d (host=cdh2.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 21093814 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 11559144572 | |
| - TotalNetworkSendTime: 352 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 11766540488 | |
| - TotalThreadsSysTime: 4000000 | |
| - TotalThreadsUserTime: 208000000 | |
| - TotalThreadsVoluntaryContextSwitches: 4 | |
| - TotalTime: 11807469400 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 291960 | |
| - ExecTreeExecTime: 4836 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 11766311552 | |
| - ExecTreeOpenTime: 11560173416 | |
| - PrepareTime: 40758288 | |
| - ExecTreePrepareTime: 682048 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 20268 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4953528 | |
| - CompileTime: 38277312 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 166314852 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 36700660 | |
| - TotalTime: 242146176 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 596 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 11560855304 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 7424 | |
| - GetNewBlockTime: 137528 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 4176 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 11560766560 | |
| - UnpinTime: 1200 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 500 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 11559139536 | |
| - InactiveTotalTime: 11559141016 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 11559147204 | |
| Instance 394167ef5bc5c023:1e (host=cdh1.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 21093682 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 11561074420 | |
| - TotalNetworkSendTime: 336 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 11767571572 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 208000000 | |
| - TotalThreadsVoluntaryContextSwitches: 4 | |
| - TotalTime: 11807375844 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 287864 | |
| - ExecTreeExecTime: 4372 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 11767342176 | |
| - ExecTreeOpenTime: 11562125332 | |
| - PrepareTime: 39651332 | |
| - ExecTreePrepareTime: 746268 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 21660 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4733288 | |
| - CompileTime: 37494280 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 166246120 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 35487896 | |
| - TotalTime: 240044360 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 656 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 11562871396 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 8652 | |
| - GetNewBlockTime: 142452 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 5204 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 11562776616 | |
| - UnpinTime: 1224 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 588 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 11561069000 | |
| - InactiveTotalTime: 11561070616 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 11561077296 | |
| Instance 394167ef5bc5c023:18 (host=cdh14.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12705927 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 11562244655 | |
| - TotalNetworkSendTime: 317 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 11769708169 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 212000000 | |
| - TotalThreadsVoluntaryContextSwitches: 4 | |
| - TotalTime: 11807356760 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 313736 | |
| - ExecTreeExecTime: 3027 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 11769439267 | |
| - ExecTreeOpenTime: 11563095010 | |
| - PrepareTime: 37544638 | |
| - ExecTreePrepareTime: 556465 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 17004 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4427928 | |
| - CompileTime: 37345701 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 167871649 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 34000043 | |
| - TotalTime: 239993620 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 647 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 11563650592 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 6867 | |
| - GetNewBlockTime: 110115 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 4233 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 11563579878 | |
| - UnpinTime: 1007 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 290 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 11562241080 | |
| - InactiveTotalTime: 11562241994 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 11562246643 | |
| Instance 394167ef5bc5c023:1a (host=cdh10.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12706042 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 11567550016 | |
| - TotalNetworkSendTime: 180 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 1 | |
| - TotalThreadsTotalWallClockTime: 11769036424 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 204000000 | |
| - TotalThreadsVoluntaryContextSwitches: 8 | |
| - TotalTime: 11807335523 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 242604 | |
| - ExecTreeExecTime: 2328 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 11768829239 | |
| - ExecTreeOpenTime: 11568127595 | |
| - PrepareTime: 38202917 | |
| - ExecTreePrepareTime: 610605 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 16377 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4423292 | |
| - CompileTime: 37316253 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 162134901 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 34776152 | |
| - TotalTime: 234972346 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 342 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 11568736552 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 4269 | |
| - GetNewBlockTime: 125880 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 2419 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 11568687253 | |
| - UnpinTime: 1076 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 611 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 11567546557 | |
| - InactiveTotalTime: 11567547642 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 11567552295 | |
| Instance 394167ef5bc5c023:19 (host=cdh12.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12750339 | |
| - RowsProduced: 2 | |
| - TotalNetworkReceiveTime: 11558126796 | |
| - TotalNetworkSendTime: 359114 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 1 | |
| - TotalThreadsTotalWallClockTime: 11766199009 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 212000000 | |
| - TotalThreadsVoluntaryContextSwitches: 23 | |
| - TotalTime: 11806965364 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 750761 | |
| - ExecTreeExecTime: 3520 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 11765496811 | |
| - ExecTreeOpenTime: 11559145896 | |
| - PrepareTime: 40619773 | |
| - ExecTreePrepareTime: 729427 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 81 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2782166 | |
| - OverallThroughput: 536139 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 2 | |
| - SerializeBatchTime: 94995 | |
| - TotalTime: 151080 | |
| - TransmitDataRPCTime: 29114 | |
| - UncompressedRowBatchSize: 97 | |
| CodeGen | |
| - CodegenTime: 4897925 | |
| - CompileTime: 37917851 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 166774859 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 36617831 | |
| - TotalTime: 242165115 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 12703 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 2 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 11559874327 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 28385 | |
| - GetNewBlockTime: 145159 | |
| - GetResultsTime: 7182 | |
| - HTResizeTime: 3977 | |
| - HashBuckets: 2048 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 2 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2462848 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 2 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 11559788857 | |
| - UnpinTime: 1138 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 1333 | |
| - ConvertRowBatchTime: 38667 | |
| - DeserializeRowBatchTimer: 235659 | |
| - FirstBatchArrivalWaitTime: 1420979236 | |
| - InactiveTotalTime: 11557994122 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 34 | |
| - RowsReturnedRate: 2 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 11558239712 | |
| Instance 394167ef5bc5c023:16 (host=cdh8.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12738682 | |
| - RowsProduced: 1 | |
| - TotalNetworkReceiveTime: 11557832785 | |
| - TotalNetworkSendTime: 776245 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 11767186690 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 212000000 | |
| - TotalThreadsVoluntaryContextSwitches: 22 | |
| - TotalTime: 11806262170 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 1096347 | |
| - ExecTreeExecTime: 3141 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 11766130993 | |
| - ExecTreeOpenTime: 11558711745 | |
| - PrepareTime: 38968969 | |
| - ExecTreePrepareTime: 775972 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 34 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 917480 | |
| - OverallThroughput: 487147 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 1 | |
| - SerializeBatchTime: 10459 | |
| - TotalTime: 69794 | |
| - TransmitDataRPCTime: 37058 | |
| - UncompressedRowBatchSize: 42 | |
| CodeGen | |
| - CodegenTime: 4524053 | |
| - CompileTime: 38225358 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 167670946 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 34944433 | |
| - TotalTime: 241693426 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 5812 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 11559485697 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 29970 | |
| - GetNewBlockTime: 192436 | |
| - GetResultsTime: 4644 | |
| - HTResizeTime: 3271 | |
| - HashBuckets: 1024 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 5 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2462848 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 11559407495 | |
| - UnpinTime: 974 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 577 | |
| - ConvertRowBatchTime: 35602 | |
| - DeserializeRowBatchTimer: 430207 | |
| - FirstBatchArrivalWaitTime: 1420555398 | |
| - InactiveTotalTime: 11557715424 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 17 | |
| - RowsReturnedRate: 1 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 11557929100 | |
| Instance 394167ef5bc5c023:17 (host=cdh9.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12714171 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 11562707134 | |
| - TotalNetworkSendTime: 381 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 11765527652 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 204000000 | |
| - TotalThreadsVoluntaryContextSwitches: 11 | |
| - TotalTime: 11805993348 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 183794 | |
| - ExecTreeExecTime: 5529 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 11765385041 | |
| - ExecTreeOpenTime: 11563990543 | |
| - PrepareTime: 40342983 | |
| - ExecTreePrepareTime: 1152088 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 38995 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4827729 | |
| - CompileTime: 38794722 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 160605860 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 36265066 | |
| - TotalTime: 236383378 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 824 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 11565142320 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 10020 | |
| - GetNewBlockTime: 234034 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 6002 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 11564987479 | |
| - UnpinTime: 1034 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 677 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 11562702991 | |
| - InactiveTotalTime: 11562704118 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 11562710690 | |
| Instance 394167ef5bc5c023:14 (host=cdh13.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12705953 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 11566626071 | |
| - TotalNetworkSendTime: 296 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 11769278409 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 204000000 | |
| - TotalThreadsVoluntaryContextSwitches: 4 | |
| - TotalTime: 11805579206 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 328248 | |
| - ExecTreeExecTime: 2939 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 11768995940 | |
| - ExecTreeOpenTime: 11567500470 | |
| - PrepareTime: 36182061 | |
| - ExecTreePrepareTime: 528188 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 16281 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4175374 | |
| - CompileTime: 37040723 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 163327082 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 32848987 | |
| - TotalTime: 233933261 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 551 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 11568027718 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 6597 | |
| - GetNewBlockTime: 100425 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 4084 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 11567965796 | |
| - UnpinTime: 916 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 413 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 11566622732 | |
| - InactiveTotalTime: 11566623450 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 11566628186 | |
| Instance 394167ef5bc5c023:15 (host=cdh16.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12705954 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 11564135652 | |
| - TotalNetworkSendTime: 264 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 11771655950 | |
| - TotalThreadsSysTime: 4000000 | |
| - TotalThreadsUserTime: 208000000 | |
| - TotalThreadsVoluntaryContextSwitches: 5 | |
| - TotalTime: 11805226734 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 255359 | |
| - ExecTreeExecTime: 2716 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 11771435777 | |
| - ExecTreeOpenTime: 11564946746 | |
| - PrepareTime: 33491663 | |
| - ExecTreePrepareTime: 361428 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 9826 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4749402 | |
| - CompileTime: 37874229 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 167297959 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 30227591 | |
| - TotalTime: 236199401 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 430 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 11565308118 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 4987 | |
| - GetNewBlockTime: 87801 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 2675 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 11565258860 | |
| - UnpinTime: 351 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 495 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 11564133102 | |
| - InactiveTotalTime: 11564133859 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 11564137462 | |
| Instance 394167ef5bc5c023:13 (host=cdh15.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12705940 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 11562624508 | |
| - TotalNetworkSendTime: 314 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 11768371912 | |
| - TotalThreadsSysTime: 4000000 | |
| - TotalThreadsUserTime: 204000000 | |
| - TotalThreadsVoluntaryContextSwitches: 15 | |
| - TotalTime: 11805112922 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 302831 | |
| - ExecTreeExecTime: 2676 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 11768109464 | |
| - ExecTreeOpenTime: 11563480189 | |
| - PrepareTime: 36640729 | |
| - ExecTreePrepareTime: 586566 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 15800 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4194428 | |
| - CompileTime: 37949121 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 165448335 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 33283089 | |
| - TotalTime: 237429932 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 500 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 11564066405 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 5976 | |
| - GetNewBlockTime: 112990 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 3464 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 11564000625 | |
| - UnpinTime: 1142 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 343 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 11562621378 | |
| - InactiveTotalTime: 11562622112 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 11562626107 | |
| Instance 394167ef5bc5c023:12 (host=cdh11.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12705963 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 11572178034 | |
| - TotalNetworkSendTime: 283 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 11770561205 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 200000000 | |
| - TotalThreadsVoluntaryContextSwitches: 5 | |
| - TotalTime: 11805104489 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 311266 | |
| - ExecTreeExecTime: 2732 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 11770291181 | |
| - ExecTreeOpenTime: 11573033564 | |
| - PrepareTime: 34432996 | |
| - ExecTreePrepareTime: 579132 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 15846 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 3782579 | |
| - CompileTime: 37166755 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 159000717 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 31224071 | |
| - TotalTime: 228185644 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 495 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 11573612390 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 6255 | |
| - GetNewBlockTime: 130107 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 3869 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 11573543186 | |
| - UnpinTime: 999 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 528 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 11572174669 | |
| - InactiveTotalTime: 11572175578 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 11572179996 | |
| Averaged Fragment F02 | |
| split sizes: min: 826.05 MB, max: 5.78 GB, avg: 2.71 GB, stddev: 1.39 GB | |
| completion times: min:1s661ms max:11s802ms mean: 5s617ms stddev:2s928ms | |
| execution rates: min:419.54 MB/sec max:550.94 MB/sec mean:496.70 MB/sec stddev:33.18 MB/sec | |
| num instances: 17 | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 12766331 | |
| - PerHostPeakMemUsage: 15225424 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1521511 | |
| - TotalStorageWaitTime: 3922053 | |
| - TotalThreadsInvoluntaryContextSwitches: 7 | |
| - TotalThreadsTotalWallClockTime: 5576148349 | |
| - TotalThreadsSysTime: 616941176 | |
| - TotalThreadsUserTime: 4909882352 | |
| - TotalThreadsVoluntaryContextSwitches: 127 | |
| - TotalTime: 5615657754 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 5429567697 | |
| - ExecTreeExecTime: 5424134022 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 146607180 | |
| - ExecTreeOpenTime: 30633232 | |
| - PrepareTime: 39442713 | |
| - ExecTreePrepareTime: 807677 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 261 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1846335 | |
| - OverallThroughput: 922040 | |
| - PeakMemoryUsage: 106427 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 92548 | |
| - TotalTime: 286107 | |
| - TransmitDataRPCTime: 143863 | |
| - UncompressedRowBatchSize: 337 | |
| CodeGen | |
| - CodegenTime: 4059344 | |
| - CompileTime: 30078598 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 84545454 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 33233975 | |
| - TotalTime: 148647851 | |
| AGGREGATION_NODE (id=3) | |
| - GetNewBlockTime: 94790 | |
| - GetResultsTime: 12621 | |
| - HTResizeTime: 429210 | |
| - HashBuckets: 10721 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 1 | |
| - StreamingTime: 25063403 | |
| - TotalTime: 5455568347 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454538 | |
| - RowsReturned: 859940 | |
| - RowsReturnedRate: 173250 | |
| - TotalTime: 5428707910 | |
| HDFS_SCAN_NODE (id=2) | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 317774 | |
| HDFS_SCAN_NODE (id=1) | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 89660474 | |
| - BytesReadDataNodeCache: 85358515 | |
| - BytesReadLocal: 89660474 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 89660474 | |
| - DecompressionTime: 164624673 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 20 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 2635556 | |
| - PerReadThreadRawHdfsThroughput: 2298675395 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 112446491 | |
| - RowsReturned: 859940 | |
| - RowsReturnedRate: 182214 | |
| - ScanRangesComplete: 20 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 4880728869 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 2323021 | |
| - TotalReadThroughput: 15739896 | |
| - TotalTime: 5132648652 | |
| Fragment F02 | |
| Instance 394167ef5bc5c023:4 (host=cdh16.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/5.19 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299276 | |
| - PerHostPeakMemUsage: 12705954 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1273791 | |
| - TotalStorageWaitTime: 45235 | |
| - TotalThreadsInvoluntaryContextSwitches: 11 | |
| - TotalThreadsTotalWallClockTime: 11763037526 | |
| - TotalThreadsSysTime: 1476000000 | |
| - TotalThreadsUserTime: 10228000000 | |
| - TotalThreadsVoluntaryContextSwitches: 144 | |
| - TotalTime: 11801238082 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 11580266995 | |
| - ExecTreeExecTime: 11575487528 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 182794398 | |
| - ExecTreeOpenTime: 67614248 | |
| - PrepareTime: 38136579 | |
| - ExecTreePrepareTime: 836472 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 252 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1685077 | |
| - OverallThroughput: 692766 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 167664 | |
| - TotalTime: 363759 | |
| - TransmitDataRPCTime: 149548 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 3874513 | |
| - CompileTime: 30157970 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 83774501 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 32641158 | |
| - TotalTime: 147294234 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 105175 | |
| - GetResultsTime: 13157 | |
| - HTResizeTime: 317538 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 0 | |
| - StreamingTime: 29434653 | |
| - TotalTime: 11643931517 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454553 | |
| - RowsReturned: 758771 | |
| - RowsReturnedRate: 65342 | |
| - TotalTime: 11612267389 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 342031 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/5.19 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:28 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 171943487 | |
| - BytesReadDataNodeCache: 171943487 | |
| - BytesReadLocal: 171943487 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 171943487 | |
| - DecompressionTime: 335324331 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 28 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168236 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 213352310 | |
| - RowsReturned: 758771 | |
| - RowsReturnedRate: 70094 | |
| - ScanRangesComplete: 28 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 10361245630 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 14328623 | |
| - TotalTime: 10825032361 | |
| Instance 394167ef5bc5c023:9 (host=cdh10.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:42/5.78 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299364 | |
| - PerHostPeakMemUsage: 12706042 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1795623 | |
| - TotalStorageWaitTime: 37874 | |
| - TotalThreadsInvoluntaryContextSwitches: 13 | |
| - TotalThreadsTotalWallClockTime: 11112540552 | |
| - TotalThreadsSysTime: 1388000000 | |
| - TotalThreadsUserTime: 9648000000 | |
| - TotalThreadsVoluntaryContextSwitches: 230 | |
| - TotalTime: 11148234476 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 10926751333 | |
| - ExecTreeExecTime: 10920928681 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 185813280 | |
| - ExecTreeOpenTime: 73388437 | |
| - PrepareTime: 35630986 | |
| - ExecTreePrepareTime: 805787 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 295 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1732298 | |
| - OverallThroughput: 1008940 | |
| - PeakMemoryUsage: 109560 | |
| - RowsReturned: 8 | |
| - SerializeBatchTime: 83943 | |
| - TotalTime: 292386 | |
| - TransmitDataRPCTime: 170294 | |
| - UncompressedRowBatchSize: 376 | |
| CodeGen | |
| - CodegenTime: 3520993 | |
| - CompileTime: 30072376 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 81278605 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 30867845 | |
| - TotalTime: 143103669 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 85630 | |
| - GetResultsTime: 10541 | |
| - HTResizeTime: 323064 | |
| - HashBuckets: 12288 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 0 | |
| - StreamingTime: 55497785 | |
| - TotalTime: 10995116337 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454642 | |
| - RowsReturned: 2322789 | |
| - RowsReturnedRate: 212384 | |
| - TotalTime: 10936724390 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 278884 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:42/5.78 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 42 out of 42 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
| File Formats: PARQUET/SNAPPY:42 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 189417378 | |
| - BytesReadDataNodeCache: 189417378 | |
| - BytesReadLocal: 189417378 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 189417378 | |
| - DecompressionTime: 326121109 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 42 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168235 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 239919598 | |
| - RowsReturned: 2322789 | |
| - RowsReturnedRate: 227352 | |
| - ScanRangesComplete: 42 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 9727212051 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 16907929 | |
| - TotalTime: 10216680043 | |
| Instance 394167ef5bc5c023:1 (host=cdh11.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/4.39 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299285 | |
| - PerHostPeakMemUsage: 12705963 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1901396 | |
| - TotalStorageWaitTime: 34507 | |
| - TotalThreadsInvoluntaryContextSwitches: 11 | |
| - TotalThreadsTotalWallClockTime: 9519558365 | |
| - TotalThreadsSysTime: 1304000000 | |
| - TotalThreadsUserTime: 8152000000 | |
| - TotalThreadsVoluntaryContextSwitches: 156 | |
| - TotalTime: 9556846883 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 9381366396 | |
| - ExecTreeExecTime: 9375492516 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 138217344 | |
| - ExecTreeOpenTime: 22694280 | |
| - PrepareTime: 37225467 | |
| - ExecTreePrepareTime: 719487 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 295 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1535802 | |
| - OverallThroughput: 828882 | |
| - PeakMemoryUsage: 109560 | |
| - RowsReturned: 8 | |
| - SerializeBatchTime: 120326 | |
| - TotalTime: 355901 | |
| - TransmitDataRPCTime: 192082 | |
| - UncompressedRowBatchSize: 376 | |
| CodeGen | |
| - CodegenTime: 3764868 | |
| - CompileTime: 31515095 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 82824970 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 32190797 | |
| - TotalTime: 147268244 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 82610 | |
| - GetResultsTime: 10913 | |
| - HTResizeTime: 426243 | |
| - HashBuckets: 12288 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 0 | |
| - StreamingTime: 39827613 | |
| - TotalTime: 9398900699 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454571 | |
| - RowsReturned: 1044531 | |
| - RowsReturnedRate: 111632 | |
| - TotalTime: 9356857816 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 311500 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/4.39 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
| File Formats: PARQUET/SNAPPY:31 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 146110897 | |
| - BytesReadDataNodeCache: 146110897 | |
| - BytesReadLocal: 146110897 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 146110897 | |
| - DecompressionTime: 288527129 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 31 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168310 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 183618453 | |
| - RowsReturned: 1044531 | |
| - RowsReturnedRate: 118838 | |
| - ScanRangesComplete: 31 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 8371132941 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 15380094 | |
| - TotalTime: 8789497510 | |
| Instance 394167ef5bc5c023:2 (host=cdh15.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/3.70 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299294 | |
| - PerHostPeakMemUsage: 12705940 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1400324 | |
| - TotalStorageWaitTime: 30590 | |
| - TotalThreadsInvoluntaryContextSwitches: 19 | |
| - TotalThreadsTotalWallClockTime: 7856324346 | |
| - TotalThreadsSysTime: 804000000 | |
| - TotalThreadsUserTime: 6976000000 | |
| - TotalThreadsVoluntaryContextSwitches: 142 | |
| - TotalTime: 7893692324 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 7675118716 | |
| - ExecTreeExecTime: 7669668936 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 181229220 | |
| - ExecTreeOpenTime: 69770963 | |
| - PrepareTime: 37307763 | |
| - ExecTreePrepareTime: 747623 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2188107 | |
| - OverallThroughput: 882525 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 122637 | |
| - TotalTime: 284411 | |
| - TransmitDataRPCTime: 114711 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 3698008 | |
| - CompileTime: 29072572 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 81297016 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 32054440 | |
| - TotalTime: 143181075 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 78988 | |
| - GetResultsTime: 12901 | |
| - HTResizeTime: 343394 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 0 | |
| - StreamingTime: 31166290 | |
| - TotalTime: 7740181817 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454574 | |
| - RowsReturned: 937411 | |
| - RowsReturnedRate: 121628 | |
| - TotalTime: 7707186729 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 335399 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/3.70 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:28 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 123174733 | |
| - BytesReadDataNodeCache: 123174733 | |
| - BytesReadLocal: 123174733 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 123174733 | |
| - DecompressionTime: 227253046 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 28 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 170372 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 154045109 | |
| - RowsReturned: 937411 | |
| - RowsReturnedRate: 129376 | |
| - ScanRangesComplete: 28 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 6888271061 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 15337536 | |
| - TotalTime: 7245581327 | |
| Instance 394167ef5bc5c023:7 (host=cdh14.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:25/3.70 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299249 | |
| - PerHostPeakMemUsage: 12705927 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1411191 | |
| - TotalStorageWaitTime: 28366 | |
| - TotalThreadsInvoluntaryContextSwitches: 16 | |
| - TotalThreadsTotalWallClockTime: 7536650048 | |
| - TotalThreadsSysTime: 712000000 | |
| - TotalThreadsUserTime: 6768000000 | |
| - TotalThreadsVoluntaryContextSwitches: 148 | |
| - TotalTime: 7573033391 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 7398093526 | |
| - ExecTreeExecTime: 7392591583 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 138579599 | |
| - ExecTreeOpenTime: 22480889 | |
| - PrepareTime: 36324849 | |
| - ExecTreePrepareTime: 698632 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 253 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1935375 | |
| - OverallThroughput: 874367 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 113552 | |
| - TotalTime: 289352 | |
| - TransmitDataRPCTime: 130724 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 3600456 | |
| - CompileTime: 32434514 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 82577278 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 31075593 | |
| - TotalTime: 146775133 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 84773 | |
| - GetResultsTime: 8833 | |
| - HTResizeTime: 305435 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 0 | |
| - StreamingTime: 28079075 | |
| - TotalTime: 7415765336 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454542 | |
| - RowsReturned: 797175 | |
| - RowsReturnedRate: 107931 | |
| - TotalTime: 7385935023 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 292720 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:25/3.70 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 25 out of 25 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:25 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 121434677 | |
| - BytesReadDataNodeCache: 121434677 | |
| - BytesReadLocal: 121434677 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 121434677 | |
| - DecompressionTime: 231436813 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 25 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168225 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 153042338 | |
| - RowsReturned: 797175 | |
| - RowsReturnedRate: 113470 | |
| - ScanRangesComplete: 25 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 6688135427 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 15128408 | |
| - TotalTime: 7025393911 | |
| Instance 394167ef5bc5c023:3 (host=cdh13.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/3.54 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299275 | |
| - PerHostPeakMemUsage: 12705953 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1422660 | |
| - TotalStorageWaitTime: 25607 | |
| - TotalThreadsInvoluntaryContextSwitches: 11 | |
| - TotalThreadsTotalWallClockTime: 6965487315 | |
| - TotalThreadsSysTime: 760000000 | |
| - TotalThreadsUserTime: 6128000000 | |
| - TotalThreadsVoluntaryContextSwitches: 146 | |
| - TotalTime: 7003136688 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 6828378170 | |
| - ExecTreeExecTime: 6823197445 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 137131927 | |
| - ExecTreeOpenTime: 26049161 | |
| - PrepareTime: 37589691 | |
| - ExecTreePrepareTime: 766726 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1583646 | |
| - OverallThroughput: 970172 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 63455 | |
| - TotalTime: 258717 | |
| - TransmitDataRPCTime: 158495 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 3654635 | |
| - CompileTime: 29293423 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 80631134 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 32424460 | |
| - TotalTime: 143058036 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 75509 | |
| - GetResultsTime: 14465 | |
| - HTResizeTime: 300837 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 1 | |
| - StreamingTime: 25050402 | |
| - TotalTime: 6850007539 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454567 | |
| - RowsReturned: 1015783 | |
| - RowsReturnedRate: 148877 | |
| - TotalTime: 6822940740 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 286043 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/3.54 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:28 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 116908889 | |
| - BytesReadDataNodeCache: 116908889 | |
| - BytesReadLocal: 116908889 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 116908889 | |
| - DecompressionTime: 199920704 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 28 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168225 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 145695183 | |
| - RowsReturned: 1015783 | |
| - RowsReturnedRate: 158476 | |
| - ScanRangesComplete: 28 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 6085691299 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 16625223 | |
| - TotalTime: 6409694721 | |
| Instance 394167ef5bc5c023:b (host=cdh3.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:13/2.49 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299379 | |
| - PerHostPeakMemUsage: 12706041 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1519406 | |
| - TotalStorageWaitTime: 83532 | |
| - TotalThreadsInvoluntaryContextSwitches: 5 | |
| - TotalThreadsTotalWallClockTime: 4936965932 | |
| - TotalThreadsSysTime: 560000000 | |
| - TotalThreadsUserTime: 4344000000 | |
| - TotalThreadsVoluntaryContextSwitches: 93 | |
| - TotalTime: 4977759288 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 4750814130 | |
| - ExecTreeExecTime: 4745097800 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 186185572 | |
| - ExecTreeOpenTime: 67007536 | |
| - PrepareTime: 40716688 | |
| - ExecTreePrepareTime: 797584 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 250 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1908571 | |
| - OverallThroughput: 873905 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 98644 | |
| - TotalTime: 286072 | |
| - TransmitDataRPCTime: 130988 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4455334 | |
| - CompileTime: 30901874 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 86790432 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 34411644 | |
| - TotalTime: 152936068 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 91380 | |
| - GetResultsTime: 14926 | |
| - HTResizeTime: 445248 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 1 | |
| - StreamingTime: 10060158 | |
| - TotalTime: 4812895064 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454656 | |
| - RowsReturned: 362660 | |
| - RowsReturnedRate: 75531 | |
| - TotalTime: 4801440604 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 324278 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:13/2.49 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:13 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 82516123 | |
| - BytesReadDataNodeCache: 82516123 | |
| - BytesReadLocal: 82516123 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 82516123 | |
| - DecompressionTime: 140955664 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 13 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168248 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 102158030 | |
| - RowsReturned: 362660 | |
| - RowsReturnedRate: 78970 | |
| - ScanRangesComplete: 13 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 4392085382 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 16503224 | |
| - TotalTime: 4592340482 | |
| Instance 394167ef5bc5c023:8 (host=cdh12.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:25/2.16 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299237 | |
| - PerHostPeakMemUsage: 12750339 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1190074 | |
| - TotalStorageWaitTime: 24968 | |
| - TotalThreadsInvoluntaryContextSwitches: 3 | |
| - TotalThreadsTotalWallClockTime: 4534704428 | |
| - TotalThreadsSysTime: 536000000 | |
| - TotalThreadsUserTime: 3952000000 | |
| - TotalThreadsVoluntaryContextSwitches: 142 | |
| - TotalTime: 4574268658 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 4398095009 | |
| - ExecTreeExecTime: 4393012498 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 136636484 | |
| - ExecTreeOpenTime: 20712023 | |
| - PrepareTime: 39494680 | |
| - ExecTreePrepareTime: 867925 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1835815 | |
| - OverallThroughput: 1002648 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 61082 | |
| - TotalTime: 250337 | |
| - TransmitDataRPCTime: 136724 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4247178 | |
| - CompileTime: 29705577 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 84888921 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 33921522 | |
| - TotalTime: 149292443 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 105005 | |
| - GetResultsTime: 10884 | |
| - HTResizeTime: 497971 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 1 | |
| - StreamingTime: 30574071 | |
| - TotalTime: 4414585134 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454537 | |
| - RowsReturned: 1020437 | |
| - RowsReturnedRate: 232880 | |
| - TotalTime: 4381805115 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 287415 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:25/2.16 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 25 out of 25 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
| File Formats: PARQUET/SNAPPY:25 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 71687193 | |
| - BytesReadDataNodeCache: 71687193 | |
| - BytesReadLocal: 71687193 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 71687193 | |
| - DecompressionTime: 140169173 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 25 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168216 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 90241798 | |
| - RowsReturned: 1020437 | |
| - RowsReturnedRate: 244833 | |
| - ScanRangesComplete: 25 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 3934754987 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 15764979 | |
| - TotalTime: 4167873641 | |
| Instance 394167ef5bc5c023:d (host=cdh1.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:16/2.29 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 18687036 | |
| - PerHostPeakMemUsage: 21093682 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1401536 | |
| - TotalStorageWaitTime: 7968808 | |
| - TotalThreadsInvoluntaryContextSwitches: 8 | |
| - TotalThreadsTotalWallClockTime: 4434285948 | |
| - TotalThreadsSysTime: 412000000 | |
| - TotalThreadsUserTime: 3984000000 | |
| - TotalThreadsVoluntaryContextSwitches: 97 | |
| - TotalTime: 4475894980 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 4304008748 | |
| - ExecTreeExecTime: 4298549308 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 130306152 | |
| - ExecTreeOpenTime: 11986072 | |
| - PrepareTime: 41534560 | |
| - ExecTreePrepareTime: 935576 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2001275 | |
| - OverallThroughput: 820143 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 100952 | |
| - TotalTime: 306044 | |
| - TransmitDataRPCTime: 125420 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 3901852 | |
| - CompileTime: 30125892 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 86714028 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 34676744 | |
| - TotalTime: 152304636 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 108620 | |
| - GetResultsTime: 14616 | |
| - HTResizeTime: 546276 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 1 | |
| - StreamingTime: 16972908 | |
| - TotalTime: 4311464828 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454571 | |
| - RowsReturned: 510661 | |
| - RowsReturnedRate: 118957 | |
| - TotalTime: 4292786396 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 309796 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:16/2.29 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 16 out of 16 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:16 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 76946032 | |
| - BytesReadDataNodeCache: 69026665 | |
| - BytesReadLocal: 76946032 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 76946032 | |
| - DecompressionTime: 127086124 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 1 | |
| - NumRowGroups: 16 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 8556658 | |
| - PerReadThreadRawHdfsThroughput: 15479009421 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 94803287 | |
| - RowsReturned: 510661 | |
| - RowsReturnedRate: 124476 | |
| - ScanRangesComplete: 16 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 3907444372 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 4970992 | |
| - TotalReadThroughput: 17099118 | |
| - TotalTime: 4102459296 | |
| Instance 394167ef5bc5c023:a (host=cdh17.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:24/2.37 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299263 | |
| - PerHostPeakMemUsage: 13491290 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1990445 | |
| - TotalStorageWaitTime: 17888 | |
| - TotalThreadsInvoluntaryContextSwitches: 4 | |
| - TotalThreadsTotalWallClockTime: 4366276624 | |
| - TotalThreadsSysTime: 380000000 | |
| - TotalThreadsUserTime: 3936000000 | |
| - TotalThreadsVoluntaryContextSwitches: 135 | |
| - TotalTime: 4404554686 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 4209938000 | |
| - ExecTreeExecTime: 4203890694 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 156363175 | |
| - ExecTreeOpenTime: 40633240 | |
| - PrepareTime: 38212429 | |
| - ExecTreePrepareTime: 856724 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 296 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1722131 | |
| - OverallThroughput: 1018722 | |
| - PeakMemoryUsage: 109560 | |
| - RowsReturned: 8 | |
| - SerializeBatchTime: 67291 | |
| - TotalTime: 290560 | |
| - TransmitDataRPCTime: 171880 | |
| - UncompressedRowBatchSize: 376 | |
| CodeGen | |
| - CodegenTime: 4204460 | |
| - CompileTime: 29717948 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 84697373 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 32780458 | |
| - TotalTime: 147930105 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 95218 | |
| - GetResultsTime: 15529 | |
| - HTResizeTime: 296727 | |
| - HashBuckets: 12288 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 1 | |
| - StreamingTime: 59929431 | |
| - TotalTime: 4245374746 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454555 | |
| - RowsReturned: 2670287 | |
| - RowsReturnedRate: 638400 | |
| - TotalTime: 4182774703 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 223399 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:24/2.37 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 24 out of 24 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:24 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 75011561 | |
| - BytesReadDataNodeCache: 75011561 | |
| - BytesReadLocal: 75011561 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 75011561 | |
| - DecompressionTime: 136163584 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 24 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168220 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 97659250 | |
| - RowsReturned: 2670287 | |
| - RowsReturnedRate: 671215 | |
| - ScanRangesComplete: 24 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 3757753968 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 18260831 | |
| - TotalTime: 3978286081 | |
| Instance 394167ef5bc5c023:5 (host=cdh8.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:16/2.06 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299240 | |
| - PerHostPeakMemUsage: 12738682 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1388301 | |
| - TotalStorageWaitTime: 15869 | |
| - TotalThreadsInvoluntaryContextSwitches: 6 | |
| - TotalThreadsTotalWallClockTime: 3898470828 | |
| - TotalThreadsSysTime: 440000000 | |
| - TotalThreadsUserTime: 3424000000 | |
| - TotalThreadsVoluntaryContextSwitches: 101 | |
| - TotalTime: 3940263339 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 3765795043 | |
| - ExecTreeExecTime: 3760462129 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 132703323 | |
| - ExecTreeOpenTime: 14087373 | |
| - PrepareTime: 41724016 | |
| - ExecTreePrepareTime: 824935 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2051759 | |
| - OverallThroughput: 903417 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 105033 | |
| - TotalTime: 277834 | |
| - TransmitDataRPCTime: 122334 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4423015 | |
| - CompileTime: 29761311 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 87369727 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 34446229 | |
| - TotalTime: 152408334 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 105404 | |
| - GetResultsTime: 10618 | |
| - HTResizeTime: 578098 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 1 | |
| - StreamingTime: 14992883 | |
| - TotalTime: 3775368209 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454527 | |
| - RowsReturned: 528644 | |
| - RowsReturnedRate: 140633 | |
| - TotalTime: 3759016542 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 265899 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:16/2.06 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 16 out of 16 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:16 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 68019764 | |
| - BytesReadDataNodeCache: 68019764 | |
| - BytesReadLocal: 68019764 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 68019764 | |
| - DecompressionTime: 110878335 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 16 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168221 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 84294342 | |
| - RowsReturned: 528644 | |
| - RowsReturnedRate: 146984 | |
| - ScanRangesComplete: 16 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 3423363467 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 16903288 | |
| - TotalTime: 3596590279 | |
| Instance 394167ef5bc5c023:c (host=cdh2.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:16/1.76 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 18687136 | |
| - PerHostPeakMemUsage: 21093814 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1883424 | |
| - TotalStorageWaitTime: 14978524 | |
| - TotalThreadsInvoluntaryContextSwitches: 5 | |
| - TotalThreadsTotalWallClockTime: 3802352992 | |
| - TotalThreadsSysTime: 468000000 | |
| - TotalThreadsUserTime: 3284000000 | |
| - TotalThreadsVoluntaryContextSwitches: 95 | |
| - TotalTime: 3842133056 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 3666599224 | |
| - ExecTreeExecTime: 3660846812 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 135781816 | |
| - ExecTreeOpenTime: 20319548 | |
| - PrepareTime: 39710808 | |
| - ExecTreePrepareTime: 782896 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 294 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1810344 | |
| - OverallThroughput: 917328 | |
| - PeakMemoryUsage: 109560 | |
| - RowsReturned: 8 | |
| - SerializeBatchTime: 102108 | |
| - TotalTime: 320496 | |
| - TransmitDataRPCTime: 162400 | |
| - UncompressedRowBatchSize: 376 | |
| CodeGen | |
| - CodegenTime: 4283028 | |
| - CompileTime: 29531536 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 84445076 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 33309104 | |
| - TotalTime: 148036096 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 88736 | |
| - GetResultsTime: 20112 | |
| - HTResizeTime: 568636 | |
| - HashBuckets: 12288 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 2 | |
| - StreamingTime: 20336064 | |
| - TotalTime: 3681941776 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454525 | |
| - RowsReturned: 699776 | |
| - RowsReturnedRate: 191192 | |
| - TotalTime: 3660066620 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 356032 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:16/1.76 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 16 out of 16 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:16 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 58439798 | |
| - BytesReadDataNodeCache: 42075050 | |
| - BytesReadLocal: 58439798 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 58439798 | |
| - DecompressionTime: 111995084 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 1 | |
| - NumRowGroups: 16 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 8556679 | |
| - PerReadThreadRawHdfsThroughput: 6705659761 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 73272515 | |
| - RowsReturned: 699776 | |
| - RowsReturnedRate: 200206 | |
| - ScanRangesComplete: 16 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 3305312224 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 8714996 | |
| - TotalReadThroughput: 16697085 | |
| - TotalTime: 3495275240 | |
| Instance 394167ef5bc5c023:6 (host=cdh9.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.44 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299224 | |
| - PerHostPeakMemUsage: 12714171 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1455317 | |
| - TotalStorageWaitTime: 68261 | |
| - TotalThreadsInvoluntaryContextSwitches: 5 | |
| - TotalThreadsTotalWallClockTime: 3482528112 | |
| - TotalThreadsSysTime: 304000000 | |
| - TotalThreadsUserTime: 3144000000 | |
| - TotalThreadsVoluntaryContextSwitches: 69 | |
| - TotalTime: 3522446004 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 3345852014 | |
| - ExecTreeExecTime: 3340565310 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 136703603 | |
| - ExecTreeOpenTime: 21871322 | |
| - PrepareTime: 39844923 | |
| - ExecTreePrepareTime: 1047052 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1574309 | |
| - OverallThroughput: 928323 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 69780 | |
| - TotalTime: 270380 | |
| - TransmitDataRPCTime: 159435 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4042591 | |
| - CompileTime: 29146057 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 84197977 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 32167254 | |
| - TotalTime: 146346869 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 105260 | |
| - GetResultsTime: 11704 | |
| - HTResizeTime: 546752 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 2 | |
| - StreamingTime: 17756663 | |
| - TotalTime: 3363475644 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454520 | |
| - RowsReturned: 418963 | |
| - RowsReturnedRate: 125283 | |
| - TotalTime: 3344128914 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 591262 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.44 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:11 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 47597284 | |
| - BytesReadDataNodeCache: 47597284 | |
| - BytesReadLocal: 47597284 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 47597284 | |
| - DecompressionTime: 102022806 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 11 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168225 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 59336606 | |
| - RowsReturned: 418963 | |
| - RowsReturnedRate: 130305 | |
| - ScanRangesComplete: 11 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 3055251534 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 13599224 | |
| - TotalTime: 3215242529 | |
| Instance 394167ef5bc5c023:e (host=cdh5.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.52 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 18687360 | |
| - PerHostPeakMemUsage: 21114387 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1530140 | |
| - TotalStorageWaitTime: 22742696 | |
| - TotalThreadsInvoluntaryContextSwitches: 3 | |
| - TotalThreadsTotalWallClockTime: 3206476402 | |
| - TotalThreadsSysTime: 344000000 | |
| - TotalThreadsUserTime: 2824000000 | |
| - TotalThreadsVoluntaryContextSwitches: 246 | |
| - TotalTime: 3250245772 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 3081460256 | |
| - ExecTreeExecTime: 3076376218 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 125044034 | |
| - ExecTreeOpenTime: 5511536 | |
| - PrepareTime: 43694982 | |
| - ExecTreePrepareTime: 826452 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 250 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1747323 | |
| - OverallThroughput: 909243 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 76654 | |
| - TotalTime: 274954 | |
| - TransmitDataRPCTime: 143076 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4264406 | |
| - CompileTime: 30546926 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 87260592 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 35536480 | |
| - TotalTime: 154211750 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 103774 | |
| - GetResultsTime: 9268 | |
| - HTResizeTime: 395076 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 2 | |
| - StreamingTime: 9484440 | |
| - TotalTime: 3082705822 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454487 | |
| - RowsReturned: 303212 | |
| - RowsReturnedRate: 98716 | |
| - TotalTime: 3071555214 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 331626 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.52 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:10 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 50477353 | |
| - BytesReadDataNodeCache: 26023676 | |
| - BytesReadLocal: 50477353 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 50477353 | |
| - DecompressionTime: 97134430 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 1 | |
| - NumRowGroups: 10 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 8556715 | |
| - PerReadThreadRawHdfsThroughput: 3683244837 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 63821319 | |
| - RowsReturned: 303212 | |
| - RowsReturnedRate: 105004 | |
| - ScanRangesComplete: 10 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 2738102374 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 13704588 | |
| - TotalReadThroughput: 16825784 | |
| - TotalTime: 2887604386 | |
| Instance 394167ef5bc5c023:11 (host=cdh4.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:14/1.67 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299350 | |
| - PerHostPeakMemUsage: 12706012 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1397768 | |
| - TotalStorageWaitTime: 73366 | |
| - TotalThreadsInvoluntaryContextSwitches: 3 | |
| - TotalThreadsTotalWallClockTime: 3145572958 | |
| - TotalThreadsSysTime: 236000000 | |
| - TotalThreadsUserTime: 2876000000 | |
| - TotalThreadsVoluntaryContextSwitches: 93 | |
| - TotalTime: 3186668628 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 3015256774 | |
| - ExecTreeExecTime: 3010034066 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 130345112 | |
| - ExecTreeOpenTime: 14758228 | |
| - PrepareTime: 41039260 | |
| - ExecTreePrepareTime: 741620 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1991020 | |
| - OverallThroughput: 987838 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 71476 | |
| - TotalTime: 254090 | |
| - TransmitDataRPCTime: 126066 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4200500 | |
| - CompileTime: 29675200 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 84462380 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 33952774 | |
| - TotalTime: 148954588 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 91194 | |
| - GetResultsTime: 9924 | |
| - HTResizeTime: 558886 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 2 | |
| - StreamingTime: 15134526 | |
| - TotalTime: 3025527768 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454627 | |
| - RowsReturned: 549998 | |
| - RowsReturnedRate: 182772 | |
| - TotalTime: 3009201108 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 271996 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:14/1.67 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 14 out of 14 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:14 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 55110625 | |
| - BytesReadDataNodeCache: 55110625 | |
| - BytesReadLocal: 55110625 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 55110625 | |
| - DecompressionTime: 98705602 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 14 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168234 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 69434238 | |
| - RowsReturned: 549998 | |
| - RowsReturnedRate: 189933 | |
| - ScanRangesComplete: 14 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 2742284028 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 15746062 | |
| - TotalTime: 2895745514 | |
| Instance 394167ef5bc5c023:f (host=cdh7.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.28 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 18687294 | |
| - PerHostPeakMemUsage: 21093972 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1578535 | |
| - TotalStorageWaitTime: 15042772 | |
| - TotalThreadsInvoluntaryContextSwitches: 2 | |
| - TotalThreadsTotalWallClockTime: 2616475961 | |
| - TotalThreadsSysTime: 228000000 | |
| - TotalThreadsUserTime: 2352000000 | |
| - TotalThreadsVoluntaryContextSwitches: 67 | |
| - TotalTime: 2656019776 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 2484122785 | |
| - ExecTreeExecTime: 2478580655 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 132380955 | |
| - ExecTreeOpenTime: 12706600 | |
| - PrepareTime: 39479393 | |
| - ExecTreePrepareTime: 632126 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 250 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1719737 | |
| - OverallThroughput: 978829 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 70963 | |
| - TotalTime: 255407 | |
| - TransmitDataRPCTime: 145371 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4467443 | |
| - CompileTime: 29812516 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 88459979 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 33569053 | |
| - TotalTime: 152647909 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 91785 | |
| - GetResultsTime: 12268 | |
| - HTResizeTime: 462729 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 2 | |
| - StreamingTime: 11237285 | |
| - TotalTime: 2491912896 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454561 | |
| - RowsReturned: 309503 | |
| - RowsReturnedRate: 124820 | |
| - TotalTime: 2479587900 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 284025 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.28 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:10 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 43032952 | |
| - BytesReadDataNodeCache: 26846975 | |
| - BytesReadLocal: 43032952 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 43032952 | |
| - DecompressionTime: 74263305 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 1 | |
| - NumRowGroups: 10 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 8556715 | |
| - PerReadThreadRawHdfsThroughput: 4802416600 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 53096875 | |
| - RowsReturned: 309503 | |
| - RowsReturnedRate: 129711 | |
| - ScanRangesComplete: 10 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 2260668501 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 8960687 | |
| - TotalReadThroughput: 14344317 | |
| - TotalTime: 2386094657 | |
| Instance 394167ef5bc5c023:10 (host=cdh6.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:9/826.05 MB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 18687367 | |
| - PerHostPeakMemUsage: 21094045 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1325772 | |
| - TotalStorageWaitTime: 5456052 | |
| - TotalThreadsInvoluntaryContextSwitches: 1 | |
| - TotalThreadsTotalWallClockTime: 1616813606 | |
| - TotalThreadsSysTime: 136000000 | |
| - TotalThreadsUserTime: 1448000000 | |
| - TotalThreadsVoluntaryContextSwitches: 63 | |
| - TotalTime: 1659745794 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 1490733734 | |
| - ExecTreeExecTime: 1485496210 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 126106066 | |
| - ExecTreeOpenTime: 9173500 | |
| - PrepareTime: 42859052 | |
| - ExecTreePrepareTime: 842902 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2365113 | |
| - OverallThroughput: 1076634 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 77766 | |
| - TotalTime: 233134 | |
| - TransmitDataRPCTime: 106126 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4405582 | |
| - CompileTime: 29865380 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 85602740 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 34952026 | |
| - TotalTime: 151264278 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 112370 | |
| - GetResultsTime: 13900 | |
| - HTResizeTime: 383672 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 4 | |
| - StreamingTime: 10543614 | |
| - TotalTime: 1495506776 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454146 | |
| - RowsReturned: 368395 | |
| - RowsReturnedRate: 248284 | |
| - TotalTime: 1483759282 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 309854 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:9/826.05 MB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:9 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 26399312 | |
| - BytesReadDataNodeCache: 18189782 | |
| - BytesReadLocal: 26399312 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 26399312 | |
| - DecompressionTime: 50662210 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 1 | |
| - NumRowGroups: 9 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 8556728 | |
| - PerReadThreadRawHdfsThroughput: 8407151105 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 33799109 | |
| - RowsReturned: 368395 | |
| - RowsReturnedRate: 258407 | |
| - ScanRangesComplete: 9 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 1333681536 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 3140102 | |
| - TotalReadThroughput: 12126521 | |
| - TotalTime: 1425635118 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment