-
-
Save momohuri/2263742803326fc2467e96a2e2a9cb5a to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Query (id=4545f1d5e73cb011:253f900200000000) | |
| Summary | |
| Session ID: de4e9ef9c47d43cc:7be89275e8c508ad | |
| Session Type: HIVESERVER2 | |
| HiveServer2 Protocol Version: V6 | |
| Start Time: 2017-03-09 15:23:30.926120000 | |
| End Time: | |
| Query Type: QUERY | |
| Query State: CREATED | |
| Query Status: OK | |
| Impala Version: impalad version 2.7.0-cdh5.10.0 RELEASE (build 785a073cd07e2540d521ecebb8b38161ccbd2aa2) | |
| User: hdfs | |
| Connected User: hdfs | |
| Delegated User: | |
| Network Address: ::ffff:172.16.0.221:55771 | |
| Default Db: wikia_prod | |
| Sql Statement: SELECT `ga_category`, count(*) `y` | |
| FROM | |
| (SELECT `ga_category` | |
| FROM trackingevent | |
| WHERE `cuberon_event_date` BETWEEN "2017-01-31" AND "2017-02-14") Q1 | |
| WHERE (`ga_category` LIKE '%editor%' | |
| AND `ga_category` IS NOT NULL) | |
| GROUP BY `ga_category` | |
| ORDER BY `y` DESC LIMIT 10 | |
| Coordinator: cdh7.net.cuberonlabs.com:22000 | |
| Query Options (non default): QUERY_TIMEOUT_S=600,MT_DOP=10 | |
| Plan: | |
| ---------------- | |
| Estimated Per-Host Requirements: Memory=108.00MB VCores=2 | |
| WARNING: Spilling is disabled for this query as a safety guard. | |
| Reason: Query option disable_unsafe_spills is set, at least one table | |
| is missing relevant stats, and no plan hints were given. | |
| PLAN-ROOT SINK | |
| | | |
| 07:MERGING-EXCHANGE [UNPARTITIONED] | |
| | order by: count(*) DESC | |
| | limit: 10 | |
| | hosts=17 per-host-mem=unavailable | |
| | tuple-ids=6 row-size=40B cardinality=10 | |
| | | |
| 04:TOP-N [LIMIT=10] | |
| | order by: count(*) DESC | |
| | hosts=17 per-host-mem=397B | |
| | tuple-ids=6 row-size=40B cardinality=10 | |
| | | |
| 06:AGGREGATE [FINALIZE] | |
| | output: count:merge(*) | |
| | group by: ga_category | |
| | hosts=17 per-host-mem=10.00MB | |
| | tuple-ids=5 row-size=40B cardinality=170 | |
| | | |
| 05:EXCHANGE [HASH(ga_category)] | |
| | hosts=17 per-host-mem=0B | |
| | tuple-ids=5 row-size=40B cardinality=170 | |
| | | |
| 03:AGGREGATE [STREAMING] | |
| | output: count(*) | |
| | group by: ga_category | |
| | hosts=17 per-host-mem=10.00MB | |
| | tuple-ids=5 row-size=40B cardinality=170 | |
| | | |
| 00:UNION | |
| | hosts=17 per-host-mem=0B | |
| | tuple-ids=2 row-size=32B cardinality=205856830 | |
| | | |
| |--02:SCAN HDFS [wikia_prod.trackingevent_streaming, RANDOM] | |
| | partitions=0/0 files=0 size=0B | |
| | predicates: wikia_prod.trackingevent_streaming.ga_category IS NOT NULL, wikia_prod.trackingevent_streaming.ga_category LIKE '%editor%' | |
| | table stats: 0 rows total | |
| | column stats: all | |
| | hosts=1 per-host-mem=0B | |
| | tuple-ids=1 row-size=16B cardinality=0 | |
| | | |
| 01:SCAN HDFS [wikia_prod.trackingevent_batch, RANDOM] | |
| partitions=14/14 files=361 size=49.59GB | |
| predicates: wikia_prod.trackingevent_batch.ga_category IS NOT NULL, wikia_prod.trackingevent_batch.ga_category LIKE '%editor%' | |
| table stats: 2058568297 rows total | |
| column stats: all | |
| hosts=17 per-host-mem=88.00MB | |
| tuple-ids=0 row-size=32B cardinality=205856830 | |
| ---------------- | |
| Estimated Per-Host Mem: 113246208 | |
| Estimated Per-Host VCores: 2 | |
| Request Pool: root.hdfs | |
| Admission result: Admitted immediately | |
| - ComputeScanRangeAssignmentTimer: 993950 | |
| - InactiveTotalTime: 0 | |
| - TotalTime: 0 | |
| Planner Timeline | |
| Analysis finished: 1834438 | |
| Equivalence classes computed: 3188626 | |
| Single node plan created: 7565192 | |
| Runtime filters computed: 7667323 | |
| Distributed plan created: 8187091 | |
| Lineage info computed: 8352761 | |
| Parallel plans created: 8412064 | |
| Planning finished: 11612404 | |
| Query Timeline | |
| Query submitted: 51782 | |
| Planning finished: 20069332 | |
| Submit for admission: 22094770 | |
| Completed admission: 22212519 | |
| Ready to start 35 fragment instances: 22591965 | |
| All 35 fragment instances started: 38854592 | |
| Rows available: 15262322762 | |
| First row fetched: 16342812990 | |
| ImpalaServer | |
| - ClientFetchWaitTimer: 1080503212 | |
| - InactiveTotalTime: 0 | |
| - RowMaterializationTimer: 7104164 | |
| - TotalTime: 0 | |
| Execution Profile 4545f1d5e73cb011:253f900200000000 | |
| Fragment instance start latencies: Count: 35, 25th %-ile: 1ms, 50th %-ile: 2ms, 75th %-ile: 5ms, 90th %-ile: 6ms, 95th %-ile: 6ms, 99.9th %-ile: 7ms | |
| Per Node Peak Memory Usage: cdh8.net.cuberonlabs.com:22000(12.12 MB) cdh4.net.cuberonlabs.com:22000(12.17 MB) cdh2.net.cuberonlabs.com:22000(20.12 MB) cdh15.net.cuberonlabs.com:22000(12.87 MB) cdh3.net.cuberonlabs.com:22000(12.12 MB) cdh10.net.cuberonlabs.com:22000(12.87 MB) cdh17.net.cuberonlabs.com:22000(12.12 MB) cdh5.net.cuberonlabs.com:22000(20.13 MB) cdh1.net.cuberonlabs.com:22000(12.12 MB) cdh12.net.cuberonlabs.com:22000(12.12 MB) cdh9.net.cuberonlabs.com:22000(12.12 MB) cdh14.net.cuberonlabs.com:22000(12.87 MB) cdh6.net.cuberonlabs.com:22000(20.12 MB) cdh16.net.cuberonlabs.com:22000(12.12 MB) cdh13.net.cuberonlabs.com:22000(12.12 MB) cdh11.net.cuberonlabs.com:22000(12.12 MB) cdh7.net.cuberonlabs.com:22000(20.15 MB) | |
| - FiltersReceived: 0 | |
| - FinalizationTimer: 0 | |
| - InactiveTotalTime: 0 | |
| - TotalTime: 15246317291 | |
| Coordinator Fragment F04 | |
| Instance 4545f1d5e73cb011:253f900200000000 (host=cdh7.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 0.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 275968 | |
| - PerHostPeakMemUsage: 21126809 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 0 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 16282941720 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 52000000 | |
| - TotalThreadsVoluntaryContextSwitches: 15 | |
| - TotalTime: 16319254599 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 1080628520 | |
| - ExecTreeExecTime: 51144 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 15202353953 | |
| - ExecTreeOpenTime: 15151547716 | |
| - PrepareTime: 36040077 | |
| - ExecTreePrepareTime: 58944 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| PLAN_ROOT_SINK | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 0 | |
| - TotalTime: 0 | |
| CodeGen | |
| - CodegenTime: 1426035 | |
| - CompileTime: 3090215 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 28 | |
| - NumInstructions: 523 | |
| - OptimizationTime: 46366492 | |
| - PeakMemoryUsage: 267776 | |
| - PrepareTime: 35156289 | |
| - TotalTime: 85417526 | |
| EXCHANGE_NODE (id=7) | |
| ExecOption: Codegen Enabled | |
| - BytesReceived: 294 | |
| - ConvertRowBatchTime: 0 | |
| - DeserializeRowBatchTimer: 57597 | |
| - FirstBatchArrivalWaitTime: 15151494975 | |
| - InactiveTotalTime: 15151500305 | |
| - MergeGetNext: 44961 | |
| - MergeGetNextBatch: 34148 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 15151593757 | |
| Averaged Fragment F03 | |
| split sizes: min: 0, max: 0, avg: 0, stddev: 0 | |
| completion times: min:15s234ms max:15s238ms mean: 15s236ms stddev:1.144ms | |
| execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec | |
| num instances: 17 | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 14823931 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 14993483842 | |
| - TotalNetworkSendTime: 104548 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 15197850252 | |
| - TotalThreadsSysTime: 1647058 | |
| - TotalThreadsUserTime: 204705882 | |
| - TotalThreadsVoluntaryContextSwitches: 12 | |
| - TotalTime: 15235419876 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 383573 | |
| - ExecTreeExecTime: 3334 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 15197516920 | |
| - ExecTreeOpenTime: 14994435743 | |
| - PrepareTime: 37443006 | |
| - ExecTreePrepareTime: 661904 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 17 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 511161 | |
| - OverallThroughput: 170084 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 12261 | |
| - TotalTime: 41825 | |
| - TransmitDataRPCTime: 10380 | |
| - UncompressedRowBatchSize: 22 | |
| CodeGen | |
| - CodegenTime: 4536330 | |
| - CompileTime: 38062029 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 163517625 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 33637551 | |
| - TotalTime: 235996712 | |
| SORT_NODE (id=4) | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 4949 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 14995096170 | |
| AGGREGATION_NODE (id=6) | |
| - BuildTime: 19716 | |
| - GetNewBlockTime: 152241 | |
| - GetResultsTime: 1264 | |
| - HTResizeTime: 4125 | |
| - HashBuckets: 481 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 2 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2410563 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 14995013337 | |
| - UnpinTime: 1011 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 261 | |
| - ConvertRowBatchTime: 8379 | |
| - DeserializeRowBatchTimer: 59381 | |
| - FirstBatchArrivalWaitTime: 11235066075 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 14993506261 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| Fragment F03 | |
| Instance 4545f1d5e73cb011:1f (host=cdh15.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 13491525 | |
| - RowsProduced: 3 | |
| - TotalNetworkReceiveTime: 14983414804 | |
| - TotalNetworkSendTime: 245552 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 15197105527 | |
| - TotalThreadsSysTime: 4000000 | |
| - TotalThreadsUserTime: 212000000 | |
| - TotalThreadsVoluntaryContextSwitches: 23 | |
| - TotalTime: 15237461471 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 556994 | |
| - ExecTreeExecTime: 2730 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 15196604978 | |
| - ExecTreeOpenTime: 14984805639 | |
| - PrepareTime: 40243572 | |
| - ExecTreePrepareTime: 617057 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 83 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2747434 | |
| - OverallThroughput: 654620 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 3 | |
| - SerializeBatchTime: 79504 | |
| - TotalTime: 126791 | |
| - TransmitDataRPCTime: 30210 | |
| - UncompressedRowBatchSize: 123 | |
| CodeGen | |
| - CodegenTime: 4959055 | |
| - CompileTime: 36655359 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 173869747 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 35625346 | |
| - TotalTime: 246989558 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 11326 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 3 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 14985421295 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 31834 | |
| - GetNewBlockTime: 118533 | |
| - GetResultsTime: 8826 | |
| - HTResizeTime: 3237 | |
| - HashBuckets: 3072 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 1 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2462848 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 3 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 14985332326 | |
| - UnpinTime: 1059 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 1422 | |
| - ConvertRowBatchTime: 30189 | |
| - DeserializeRowBatchTimer: 120993 | |
| - FirstBatchArrivalWaitTime: 1862183823 | |
| - InactiveTotalTime: 14983322543 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 51 | |
| - RowsReturnedRate: 3 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 14983497818 | |
| Instance 4545f1d5e73cb011:19 (host=cdh14.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 13492097 | |
| - RowsProduced: 2 | |
| - TotalNetworkReceiveTime: 14989806055 | |
| - TotalNetworkSendTime: 288369 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 1 | |
| - TotalThreadsTotalWallClockTime: 15198297631 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 208000000 | |
| - TotalThreadsVoluntaryContextSwitches: 32 | |
| - TotalTime: 15236515493 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 615785 | |
| - ExecTreeExecTime: 2627 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 15197749629 | |
| - ExecTreeOpenTime: 14991126743 | |
| - PrepareTime: 38086946 | |
| - ExecTreePrepareTime: 604218 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 79 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2508892 | |
| - OverallThroughput: 653524 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 2 | |
| - SerializeBatchTime: 72261 | |
| - TotalTime: 120883 | |
| - TransmitDataRPCTime: 31488 | |
| - UncompressedRowBatchSize: 97 | |
| CodeGen | |
| - CodegenTime: 4639564 | |
| - CompileTime: 38291977 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 167088656 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 33731847 | |
| - TotalTime: 239882174 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 7844 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 2 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 14991730281 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 25937 | |
| - GetNewBlockTime: 133513 | |
| - GetResultsTime: 5837 | |
| - HTResizeTime: 3152 | |
| - HashBuckets: 2048 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 2 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2462848 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 2 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 14991649371 | |
| - UnpinTime: 1015 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 1333 | |
| - ConvertRowBatchTime: 28978 | |
| - DeserializeRowBatchTimer: 231562 | |
| - FirstBatchArrivalWaitTime: 1868120642 | |
| - InactiveTotalTime: 14989694523 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 34 | |
| - RowsReturnedRate: 2 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 14989876229 | |
| Instance 4545f1d5e73cb011:22 (host=cdh8.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12705918 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 14986473197 | |
| - TotalNetworkSendTime: 300 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 1 | |
| - TotalThreadsTotalWallClockTime: 15194795735 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 212000000 | |
| - TotalThreadsVoluntaryContextSwitches: 4 | |
| - TotalTime: 15236501204 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 247043 | |
| - ExecTreeExecTime: 3690 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 15194602299 | |
| - ExecTreeOpenTime: 14987408989 | |
| - PrepareTime: 41587597 | |
| - ExecTreePrepareTime: 720129 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 24795 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 5240076 | |
| - CompileTime: 38576341 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 166871114 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 37210959 | |
| - TotalTime: 243526506 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 471 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 14988129008 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 8594 | |
| - GetNewBlockTime: 136653 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 5679 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 14988046748 | |
| - UnpinTime: 1101 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 490 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 14986468195 | |
| - InactiveTotalTime: 14986469717 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 14986475544 | |
| Instance 4545f1d5e73cb011:20 (host=cdh2.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 21093798 | |
| - RowsProduced: 1 | |
| - TotalNetworkReceiveTime: 14994985504 | |
| - TotalNetworkSendTime: 332368 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 15197858872 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 204000000 | |
| - TotalThreadsVoluntaryContextSwitches: 10 | |
| - TotalTime: 15236283912 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 649320 | |
| - ExecTreeExecTime: 3536 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 15197240552 | |
| - ExecTreeOpenTime: 14995807252 | |
| - PrepareTime: 38310236 | |
| - ExecTreePrepareTime: 808860 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 43 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1095820 | |
| - OverallThroughput: 441841 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 1 | |
| - SerializeBatchTime: 33304 | |
| - TotalTime: 97320 | |
| - TransmitDataRPCTime: 39240 | |
| - UncompressedRowBatchSize: 51 | |
| CodeGen | |
| - CodegenTime: 4927148 | |
| - CompileTime: 38464628 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 161417040 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 34170860 | |
| - TotalTime: 234860996 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 20876 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 14996615704 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 21992 | |
| - GetNewBlockTime: 205808 | |
| - GetResultsTime: 1404 | |
| - HTResizeTime: 5376 | |
| - HashBuckets: 1024 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 25 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2409600 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 14996504264 | |
| - UnpinTime: 1236 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 172 | |
| - ConvertRowBatchTime: 9904 | |
| - DeserializeRowBatchTimer: 204508 | |
| - FirstBatchArrivalWaitTime: 3588300296 | |
| - InactiveTotalTime: 14994776636 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 4 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 14995014296 | |
| Instance 4545f1d5e73cb011:1c (host=cdh10.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 13492044 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 14999578915 | |
| - TotalNetworkSendTime: 219 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 3 | |
| - TotalThreadsTotalWallClockTime: 15196145503 | |
| - TotalThreadsSysTime: 4000000 | |
| - TotalThreadsUserTime: 196000000 | |
| - TotalThreadsVoluntaryContextSwitches: 10 | |
| - TotalTime: 15236270172 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 236146 | |
| - ExecTreeExecTime: 3045 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 15195967593 | |
| - ExecTreeOpenTime: 15000472201 | |
| - PrepareTime: 40001022 | |
| - ExecTreePrepareTime: 529814 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 20953 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 5009235 | |
| - CompileTime: 38864652 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 155258102 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 36200936 | |
| - TotalTime: 231156561 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 385 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 15001000534 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 4716 | |
| - GetNewBlockTime: 125466 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 2900 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 15000920081 | |
| - UnpinTime: 717 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 858 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 14999575286 | |
| - InactiveTotalTime: 14999576127 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 14999581383 | |
| Instance 4545f1d5e73cb011:1b (host=cdh5.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 21106318 | |
| - RowsProduced: 1 | |
| - TotalNetworkReceiveTime: 14982980570 | |
| - TotalNetworkSendTime: 370504 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 15194681232 | |
| - TotalThreadsSysTime: 8000000 | |
| - TotalThreadsUserTime: 208000000 | |
| - TotalThreadsVoluntaryContextSwitches: 33 | |
| - TotalTime: 15236259874 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 751252 | |
| - ExecTreeExecTime: 2668 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 15193977724 | |
| - ExecTreeOpenTime: 14984119098 | |
| - PrepareTime: 41461160 | |
| - ExecTreePrepareTime: 719788 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 55 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1398210 | |
| - OverallThroughput: 731421 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 1 | |
| - SerializeBatchTime: 12084 | |
| - TotalTime: 75196 | |
| - TransmitDataRPCTime: 39336 | |
| - UncompressedRowBatchSize: 63 | |
| CodeGen | |
| - CodegenTime: 4855374 | |
| - CompileTime: 38062232 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 170273442 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 37008110 | |
| - TotalTime: 246354286 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 33208 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 14984837508 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 41432 | |
| - GetNewBlockTime: 141428 | |
| - GetResultsTime: 1576 | |
| - HTResizeTime: 4830 | |
| - HashBuckets: 1024 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 5 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2462848 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 14984722178 | |
| - UnpinTime: 1442 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 935 | |
| - ConvertRowBatchTime: 34412 | |
| - DeserializeRowBatchTimer: 314512 | |
| - FirstBatchArrivalWaitTime: 1861472420 | |
| - InactiveTotalTime: 14982829500 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 17 | |
| - RowsReturnedRate: 1 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 14983063216 | |
| Instance 4545f1d5e73cb011:21 (host=cdh4.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12756791 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 14986002140 | |
| - TotalNetworkSendTime: 312 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 15194325214 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 208000000 | |
| - TotalThreadsVoluntaryContextSwitches: 5 | |
| - TotalTime: 15236089006 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 214332 | |
| - ExecTreeExecTime: 4476 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 15194165252 | |
| - ExecTreeOpenTime: 14986854016 | |
| - PrepareTime: 41612290 | |
| - ExecTreePrepareTime: 759160 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 21132 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 5172566 | |
| - CompileTime: 38267216 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 167463132 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 37260104 | |
| - TotalTime: 243813408 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 512 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 14987613422 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 7418 | |
| - GetNewBlockTime: 201468 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 4108 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 14987537062 | |
| - UnpinTime: 1026 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 430 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 14985997184 | |
| - InactiveTotalTime: 14985998408 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 14986004224 | |
| Instance 4545f1d5e73cb011:1e (host=cdh3.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12706025 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 14988605984 | |
| - TotalNetworkSendTime: 364 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 15196237194 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 212000000 | |
| - TotalThreadsVoluntaryContextSwitches: 13 | |
| - TotalTime: 15236034118 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 332554 | |
| - ExecTreeExecTime: 3812 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 15195965186 | |
| - ExecTreeOpenTime: 14989540584 | |
| - PrepareTime: 39644800 | |
| - ExecTreePrepareTime: 726216 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 18310 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4979900 | |
| - CompileTime: 39059012 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 165862052 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 35563222 | |
| - TotalTime: 241302314 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 620 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 14990266772 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 7620 | |
| - GetNewBlockTime: 141208 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 4334 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 14990175718 | |
| - UnpinTime: 1058 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 578 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 14988600636 | |
| - InactiveTotalTime: 14988601912 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 14988608800 | |
| Instance 4545f1d5e73cb011:1d (host=cdh17.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12705941 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 14989653195 | |
| - TotalNetworkSendTime: 282 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 15196643411 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 208000000 | |
| - TotalThreadsVoluntaryContextSwitches: 7 | |
| - TotalTime: 15235885800 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 324973 | |
| - ExecTreeExecTime: 3765 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 15196376074 | |
| - ExecTreeOpenTime: 14990501248 | |
| - PrepareTime: 39094439 | |
| - ExecTreePrepareTime: 715033 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 18297 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 5035766 | |
| - CompileTime: 39155446 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 165226005 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 34966443 | |
| - TotalTime: 240205390 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 555 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 14991215202 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 7426 | |
| - GetNewBlockTime: 138045 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 3712 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 14991118922 | |
| - UnpinTime: 1147 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 413 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 14989647891 | |
| - InactiveTotalTime: 14989649421 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 14989655440 | |
| Instance 4545f1d5e73cb011:16 (host=cdh7.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 21126809 | |
| - RowsProduced: 1 | |
| - TotalNetworkReceiveTime: 14988034561 | |
| - TotalNetworkSendTime: 536735 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 15194986187 | |
| - TotalThreadsSysTime: 4000000 | |
| - TotalThreadsUserTime: 204000000 | |
| - TotalThreadsVoluntaryContextSwitches: 34 | |
| - TotalTime: 15235526863 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 706141 | |
| - ExecTreeExecTime: 3080 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 15194318748 | |
| - ExecTreeOpenTime: 14989097570 | |
| - PrepareTime: 40430648 | |
| - ExecTreePrepareTime: 923544 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 34 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 939382 | |
| - OverallThroughput: 410033 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 1 | |
| - SerializeBatchTime: 11292 | |
| - TotalTime: 82920 | |
| - TransmitDataRPCTime: 36194 | |
| - UncompressedRowBatchSize: 42 | |
| CodeGen | |
| - CodegenTime: 4785610 | |
| - CompileTime: 38576913 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 165128302 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 36618454 | |
| - TotalTime: 241086081 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 4573 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 14990020681 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 130174 | |
| - GetNewBlockTime: 202552 | |
| - GetResultsTime: 3846 | |
| - HTResizeTime: 3691 | |
| - HashBuckets: 1024 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 5 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2462848 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 14989907785 | |
| - UnpinTime: 1026 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 576 | |
| - ConvertRowBatchTime: 32263 | |
| - DeserializeRowBatchTimer: 137918 | |
| - FirstBatchArrivalWaitTime: 1866095637 | |
| - InactiveTotalTime: 14987917776 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 17 | |
| - RowsReturnedRate: 1 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 14988122023 | |
| Instance 4545f1d5e73cb011:1a (host=cdh1.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12705958 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 14984726292 | |
| - TotalNetworkSendTime: 332 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 15195661132 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 216000000 | |
| - TotalThreadsVoluntaryContextSwitches: 4 | |
| - TotalTime: 15234980248 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 289508 | |
| - ExecTreeExecTime: 3784 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 15195426888 | |
| - ExecTreeOpenTime: 14985773020 | |
| - PrepareTime: 39186160 | |
| - ExecTreePrepareTime: 621888 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 15892 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4897524 | |
| - CompileTime: 38155436 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 169929192 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 35375448 | |
| - TotalTime: 244318764 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 724 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 14986394844 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 9816 | |
| - GetNewBlockTime: 127744 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 6428 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 14986323544 | |
| - UnpinTime: 1044 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 560 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 14984721028 | |
| - InactiveTotalTime: 14984722492 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 14984728748 | |
| Instance 4545f1d5e73cb011:18 (host=cdh9.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12705870 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 14972837599 | |
| - TotalNetworkSendTime: 340 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 15194539365 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 224000000 | |
| - TotalThreadsVoluntaryContextSwitches: 6 | |
| - TotalTime: 15234959993 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 314859 | |
| - ExecTreeExecTime: 4033 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 15194265706 | |
| - ExecTreeOpenTime: 14973580819 | |
| - PrepareTime: 40309108 | |
| - ExecTreePrepareTime: 639236 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 17378 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4324827 | |
| - CompileTime: 39057563 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 179403368 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 36752856 | |
| - TotalTime: 256037468 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 774 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 14974219671 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 8340 | |
| - GetNewBlockTime: 164871 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 4781 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 14974142190 | |
| - UnpinTime: 1004 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 770 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 14972832258 | |
| - InactiveTotalTime: 14972833920 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 14972840415 | |
| Instance 4545f1d5e73cb011:17 (host=cdh12.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12705915 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 15016028754 | |
| - TotalNetworkSendTime: 221 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 15206985282 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 192000000 | |
| - TotalThreadsVoluntaryContextSwitches: 5 | |
| - TotalTime: 15234331036 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 220749 | |
| - ExecTreeExecTime: 2812 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 15206806873 | |
| - ExecTreeOpenTime: 15016619431 | |
| - PrepareTime: 27239796 | |
| - ExecTreePrepareTime: 572927 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 11422 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4073388 | |
| - CompileTime: 36166943 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 152431428 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 24252480 | |
| - TotalTime: 213553858 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 367 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 15017178843 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 5645 | |
| - GetNewBlockTime: 138650 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 3673 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 15017117746 | |
| - UnpinTime: 806 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 414 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 15016025070 | |
| - InactiveTotalTime: 15016026147 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 15016030431 | |
| Instance 4545f1d5e73cb011:13 (host=cdh13.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12705953 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 15009933099 | |
| - TotalNetworkSendTime: 264 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 15198722885 | |
| - TotalThreadsSysTime: 4000000 | |
| - TotalThreadsUserTime: 188000000 | |
| - TotalThreadsVoluntaryContextSwitches: 4 | |
| - TotalTime: 15234092299 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 286553 | |
| - ExecTreeExecTime: 3540 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 15198490387 | |
| - ExecTreeOpenTime: 15010945032 | |
| - PrepareTime: 35232186 | |
| - ExecTreePrepareTime: 656989 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 17837 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 3191895 | |
| - CompileTime: 38457123 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 148172665 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 31978551 | |
| - TotalTime: 219094186 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 500 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 15011601506 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 5997 | |
| - GetNewBlockTime: 171049 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 3513 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 15011529203 | |
| - UnpinTime: 991 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 407 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 15009930007 | |
| - InactiveTotalTime: 15009930777 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 15009935359 | |
| Instance 4545f1d5e73cb011:14 (host=cdh16.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12705922 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 15049225256 | |
| - TotalNetworkSendTime: 487 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 15213953590 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 164000000 | |
| - TotalThreadsVoluntaryContextSwitches: 7 | |
| - TotalTime: 15233890184 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 237984 | |
| - ExecTreeExecTime: 1762 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 15213761079 | |
| - ExecTreeOpenTime: 15050048789 | |
| - PrepareTime: 19850001 | |
| - ExecTreePrepareTime: 411155 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 8739 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 2630225 | |
| - CompileTime: 36026209 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 126742777 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 17546053 | |
| - TotalTime: 180735174 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 336 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 15050458054 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 4745 | |
| - GetNewBlockTime: 119792 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 2988 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 15050409330 | |
| - UnpinTime: 417 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 526 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 15049221851 | |
| - InactiveTotalTime: 15049222816 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 15049227679 | |
| Instance 4545f1d5e73cb011:15 (host=cdh6.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 21094013 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 14993628550 | |
| - TotalNetworkSendTime: 420 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 15196102886 | |
| - TotalThreadsSysTime: 4000000 | |
| - TotalThreadsUserTime: 200000000 | |
| - TotalThreadsVoluntaryContextSwitches: 4 | |
| - TotalTime: 15233655188 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 270912 | |
| - ExecTreeExecTime: 4466 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 15195870600 | |
| - ExecTreeOpenTime: 14994403276 | |
| - PrepareTime: 37347300 | |
| - ExecTreePrepareTime: 611440 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 16950 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4425548 | |
| - CompileTime: 38178194 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 161799174 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 33785464 | |
| - TotalTime: 234563894 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 510 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 14995013414 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 7962 | |
| - GetNewBlockTime: 171318 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 4656 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 14994938560 | |
| - UnpinTime: 1134 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 572 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 14993623746 | |
| - InactiveTotalTime: 14993624768 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 14993631592 | |
| Instance 4545f1d5e73cb011:12 (host=cdh11.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 12705931 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 14973310855 | |
| - TotalNetworkSendTime: 257 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 15196412654 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 224000000 | |
| - TotalThreadsVoluntaryContextSwitches: 5 | |
| - TotalTime: 15233401036 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 265649 | |
| - ExecTreeExecTime: 2857 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 15196198079 | |
| - ExecTreeOpenTime: 14974303924 | |
| - PrepareTime: 36893846 | |
| - ExecTreePrepareTime: 614916 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=7) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 16224 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 3969920 | |
| - CompileTime: 37039249 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 182863436 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 33791238 | |
| - TotalTime: 254463501 | |
| SORT_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 554 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 14974918155 | |
| AGGREGATION_NODE (id=6) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 5537 | |
| - GetNewBlockTime: 150008 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 3079 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 14974851702 | |
| - UnpinTime: 977 | |
| EXCHANGE_NODE (id=5) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 693 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 14973307308 | |
| - InactiveTotalTime: 14973308230 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 14973313244 | |
| Averaged Fragment F02 | |
| split sizes: min: 1.05 GB, max: 7.42 GB, avg: 2.92 GB, stddev: 1.75 GB | |
| completion times: min:2s107ms max:15s227ms mean: 5s976ms stddev:3s653ms | |
| execution rates: min:421.92 MB/sec max:564.08 MB/sec mean:501.26 MB/sec stddev:40.66 MB/sec | |
| num instances: 17 | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 12272933 | |
| - PerHostPeakMemUsage: 14823931 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1445057 | |
| - TotalStorageWaitTime: 4055957 | |
| - TotalThreadsInvoluntaryContextSwitches: 8 | |
| - TotalThreadsTotalWallClockTime: 5935613875 | |
| - TotalThreadsSysTime: 553882352 | |
| - TotalThreadsUserTime: 5333647058 | |
| - TotalThreadsVoluntaryContextSwitches: 129 | |
| - TotalTime: 5974943630 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 5789429721 | |
| - ExecTreeExecTime: 5784127894 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 146221080 | |
| - ExecTreeOpenTime: 33200325 | |
| - PrepareTime: 39246940 | |
| - ExecTreePrepareTime: 792666 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 261 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2121976 | |
| - OverallThroughput: 967873 | |
| - PeakMemoryUsage: 106427 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 92655 | |
| - TotalTime: 275188 | |
| - TransmitDataRPCTime: 133276 | |
| - UncompressedRowBatchSize: 337 | |
| CodeGen | |
| - CodegenTime: 3785697 | |
| - CompileTime: 29599255 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 82106980 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 31726587 | |
| - TotalTime: 144155075 | |
| AGGREGATION_NODE (id=3) | |
| - GetNewBlockTime: 95763 | |
| - GetResultsTime: 12896 | |
| - HTResizeTime: 407144 | |
| - HashBuckets: 10721 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 1 | |
| - StreamingTime: 26266649 | |
| - TotalTime: 5818113882 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454538 | |
| - RowsReturned: 920215 | |
| - RowsReturnedRate: 166626 | |
| - TotalTime: 5789970253 | |
| HDFS_SCAN_NODE (id=2) | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 329911 | |
| HDFS_SCAN_NODE (id=1) | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 96229056 | |
| - BytesReadDataNodeCache: 91927098 | |
| - BytesReadLocal: 96229056 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 96229056 | |
| - DecompressionTime: 180591798 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 21 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 2142118 | |
| - PerReadThreadRawHdfsThroughput: 1086604672 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 121092252 | |
| - RowsReturned: 920215 | |
| - RowsReturnedRate: 174367 | |
| - ScanRangesComplete: 21 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 5224451543 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 2363220 | |
| - TotalReadThroughput: 16016040 | |
| - TotalTime: 5494014939 | |
| Fragment F02 | |
| Instance 4545f1d5e73cb011:3 (host=cdh16.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:38/7.42 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299276 | |
| - PerHostPeakMemUsage: 12705922 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 997499 | |
| - TotalStorageWaitTime: 57619 | |
| - TotalThreadsInvoluntaryContextSwitches: 36 | |
| - TotalThreadsTotalWallClockTime: 15202950780 | |
| - TotalThreadsSysTime: 1316000000 | |
| - TotalThreadsUserTime: 13800000000 | |
| - TotalThreadsVoluntaryContextSwitches: 224 | |
| - TotalTime: 15226401953 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 15064154417 | |
| - ExecTreeExecTime: 15059858078 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 138841470 | |
| - ExecTreeOpenTime: 48310827 | |
| - PrepareTime: 23378266 | |
| - ExecTreePrepareTime: 547485 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 252 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 3513027 | |
| - OverallThroughput: 1445318 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 78101 | |
| - TotalTime: 174356 | |
| - TransmitDataRPCTime: 71733 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 2295131 | |
| - CompileTime: 28088266 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 61583280 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 18943673 | |
| - TotalTime: 109031819 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 54209 | |
| - GetResultsTime: 11351 | |
| - HTResizeTime: 327873 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 0 | |
| - StreamingTime: 29570433 | |
| - TotalTime: 15108709553 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454553 | |
| - RowsReturned: 935895 | |
| - RowsReturnedRate: 62074 | |
| - TotalTime: 15076877152 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 339610 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:38/7.42 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 38 out of 38 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:38 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 245440407 | |
| - BytesReadDataNodeCache: 245440407 | |
| - BytesReadLocal: 245440407 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 245440407 | |
| - DecompressionTime: 470384380 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 38 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168236 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 308762467 | |
| - RowsReturned: 935895 | |
| - RowsReturnedRate: 65467 | |
| - ScanRangesComplete: 38 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 13646437022 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 16362693 | |
| - TotalTime: 14295555513 | |
| Instance 4545f1d5e73cb011:b (host=cdh10.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:44/6.27 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299364 | |
| - PerHostPeakMemUsage: 13492044 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1634262 | |
| - TotalStorageWaitTime: 42932 | |
| - TotalThreadsInvoluntaryContextSwitches: 22 | |
| - TotalThreadsTotalWallClockTime: 13478478415 | |
| - TotalThreadsSysTime: 1524000000 | |
| - TotalThreadsUserTime: 11892000000 | |
| - TotalThreadsVoluntaryContextSwitches: 241 | |
| - TotalTime: 13510586077 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 13336664139 | |
| - ExecTreeExecTime: 13331085679 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 141861472 | |
| - ExecTreeOpenTime: 41587177 | |
| - PrepareTime: 32019005 | |
| - ExecTreePrepareTime: 895242 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 296 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2379861 | |
| - OverallThroughput: 1245424 | |
| - PeakMemoryUsage: 109560 | |
| - RowsReturned: 8 | |
| - SerializeBatchTime: 65896 | |
| - TotalTime: 237670 | |
| - TransmitDataRPCTime: 124377 | |
| - UncompressedRowBatchSize: 376 | |
| CodeGen | |
| - CodegenTime: 3061841 | |
| - CompileTime: 27350148 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 71841875 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 25761328 | |
| - TotalTime: 125552675 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 85831 | |
| - GetResultsTime: 11493 | |
| - HTResizeTime: 371284 | |
| - HashBuckets: 12288 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 0 | |
| - StreamingTime: 85333942 | |
| - TotalTime: 13373560654 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454642 | |
| - RowsReturned: 3128432 | |
| - RowsReturnedRate: 235504 | |
| - TotalTime: 13283942516 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 338146 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:44/6.27 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 44 out of 44 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
| File Formats: PARQUET/SNAPPY:44 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 203512290 | |
| - BytesReadDataNodeCache: 203512290 | |
| - BytesReadLocal: 203512290 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 203512290 | |
| - DecompressionTime: 396928231 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 44 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168235 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 259854768 | |
| - RowsReturned: 3128432 | |
| - RowsReturnedRate: 253033 | |
| - ScanRangesComplete: 44 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 11810018462 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 14959926 | |
| - TotalTime: 12363707772 | |
| Instance 4545f1d5e73cb011:1 (host=cdh11.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/4.64 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299285 | |
| - PerHostPeakMemUsage: 12705931 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1995345 | |
| - TotalStorageWaitTime: 32946 | |
| - TotalThreadsInvoluntaryContextSwitches: 10 | |
| - TotalThreadsTotalWallClockTime: 9680568873 | |
| - TotalThreadsSysTime: 1304000000 | |
| - TotalThreadsUserTime: 8288000000 | |
| - TotalThreadsVoluntaryContextSwitches: 214 | |
| - TotalTime: 9717312339 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 9563132740 | |
| - ExecTreeExecTime: 9557512994 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 117485547 | |
| - ExecTreeOpenTime: 7243176 | |
| - PrepareTime: 36648512 | |
| - ExecTreePrepareTime: 783964 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 295 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1846901 | |
| - OverallThroughput: 1084251 | |
| - PeakMemoryUsage: 109560 | |
| - RowsReturned: 8 | |
| - SerializeBatchTime: 72286 | |
| - TotalTime: 272077 | |
| - TransmitDataRPCTime: 159727 | |
| - UncompressedRowBatchSize: 376 | |
| CodeGen | |
| - CodegenTime: 3446203 | |
| - CompileTime: 28317541 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 80730918 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 30626347 | |
| - TotalTime: 140384598 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 79746 | |
| - GetResultsTime: 15137 | |
| - HTResizeTime: 426868 | |
| - HashBuckets: 12288 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 0 | |
| - StreamingTime: 31988734 | |
| - TotalTime: 9565533872 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454571 | |
| - RowsReturned: 1058639 | |
| - RowsReturnedRate: 111067 | |
| - TotalTime: 9531455910 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 282629 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/4.64 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
| File Formats: PARQUET/SNAPPY:32 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 153833845 | |
| - BytesReadDataNodeCache: 153833845 | |
| - BytesReadLocal: 153833845 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 153833845 | |
| - DecompressionTime: 294533331 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 32 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168310 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 194020601 | |
| - RowsReturned: 1058639 | |
| - RowsReturnedRate: 119212 | |
| - ScanRangesComplete: 32 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 8432465614 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 15343773 | |
| - TotalTime: 8880291875 | |
| Instance 4545f1d5e73cb011:e (host=cdh15.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:29/3.95 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299294 | |
| - PerHostPeakMemUsage: 13491525 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1009997 | |
| - TotalStorageWaitTime: 24768 | |
| - TotalThreadsInvoluntaryContextSwitches: 8 | |
| - TotalThreadsTotalWallClockTime: 7914197714 | |
| - TotalThreadsSysTime: 1068000000 | |
| - TotalThreadsUserTime: 6804000000 | |
| - TotalThreadsVoluntaryContextSwitches: 151 | |
| - TotalTime: 7951095604 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 7752322504 | |
| - ExecTreeExecTime: 7747671559 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 161914505 | |
| - ExecTreeOpenTime: 50460547 | |
| - PrepareTime: 36813210 | |
| - ExecTreePrepareTime: 764073 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 3924082 | |
| - OverallThroughput: 1070563 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 114665 | |
| - TotalTime: 234456 | |
| - TransmitDataRPCTime: 63964 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 3643642 | |
| - CompileTime: 28946267 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 81363612 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 30704998 | |
| - TotalTime: 141702551 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 80621 | |
| - GetResultsTime: 18471 | |
| - HTResizeTime: 362970 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 0 | |
| - StreamingTime: 24312421 | |
| - TotalTime: 7798890407 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454574 | |
| - RowsReturned: 948862 | |
| - RowsReturnedRate: 122078 | |
| - TotalTime: 7772546751 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 233101 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:29/3.95 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 29 out of 29 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:29 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 131356084 | |
| - BytesReadDataNodeCache: 131356084 | |
| - BytesReadLocal: 131356084 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 131356084 | |
| - DecompressionTime: 238238565 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 29 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 170372 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 164502129 | |
| - RowsReturned: 948862 | |
| - RowsReturnedRate: 129922 | |
| - ScanRangesComplete: 29 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 6968392087 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 16169257 | |
| - TotalTime: 7303281659 | |
| Instance 4545f1d5e73cb011:8 (host=cdh14.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:25/3.70 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299249 | |
| - PerHostPeakMemUsage: 13492097 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1263834 | |
| - TotalStorageWaitTime: 56270 | |
| - TotalThreadsInvoluntaryContextSwitches: 9 | |
| - TotalThreadsTotalWallClockTime: 7127242225 | |
| - TotalThreadsSysTime: 660000000 | |
| - TotalThreadsUserTime: 6428000000 | |
| - TotalThreadsVoluntaryContextSwitches: 130 | |
| - TotalTime: 7165311432 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 6983935169 | |
| - ExecTreeExecTime: 6978764743 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 143357720 | |
| - ExecTreeOpenTime: 30183477 | |
| - PrepareTime: 37980728 | |
| - ExecTreePrepareTime: 790290 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 253 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1998988 | |
| - OverallThroughput: 850234 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 127464 | |
| - TotalTime: 297565 | |
| - TransmitDataRPCTime: 126564 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 3877197 | |
| - CompileTime: 29187950 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 82814999 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 31739513 | |
| - TotalTime: 144500526 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 110682 | |
| - GetResultsTime: 9975 | |
| - HTResizeTime: 272772 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 0 | |
| - StreamingTime: 20379753 | |
| - TotalTime: 7009732977 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454542 | |
| - RowsReturned: 797175 | |
| - RowsReturnedRate: 114080 | |
| - TotalTime: 6987808663 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 320489 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:25/3.70 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 25 out of 25 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:25 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 121434677 | |
| - BytesReadDataNodeCache: 121434677 | |
| - BytesReadLocal: 121434677 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 121434677 | |
| - DecompressionTime: 216090548 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 25 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168225 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 153042338 | |
| - RowsReturned: 797175 | |
| - RowsReturnedRate: 121156 | |
| - ScanRangesComplete: 25 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 6282797581 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 17347811 | |
| - TotalTime: 6579699334 | |
| Instance 4545f1d5e73cb011:2 (host=cdh13.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/3.54 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299275 | |
| - PerHostPeakMemUsage: 12705953 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1409794 | |
| - TotalStorageWaitTime: 22363 | |
| - TotalThreadsInvoluntaryContextSwitches: 10 | |
| - TotalThreadsTotalWallClockTime: 6774593292 | |
| - TotalThreadsSysTime: 684000000 | |
| - TotalThreadsUserTime: 6048000000 | |
| - TotalThreadsVoluntaryContextSwitches: 192 | |
| - TotalTime: 6810296560 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 6658293187 | |
| - ExecTreeExecTime: 6652790025 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 116354128 | |
| - ExecTreeOpenTime: 6375311 | |
| - PrepareTime: 35608400 | |
| - ExecTreePrepareTime: 766119 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1783645 | |
| - OverallThroughput: 849358 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 113081 | |
| - TotalTime: 295517 | |
| - TransmitDataRPCTime: 140723 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 3423202 | |
| - CompileTime: 28341083 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 80506746 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 29161132 | |
| - TotalTime: 138648634 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 77199 | |
| - GetResultsTime: 10185 | |
| - HTResizeTime: 483434 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 1 | |
| - StreamingTime: 27778049 | |
| - TotalTime: 6659925232 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454567 | |
| - RowsReturned: 1015783 | |
| - RowsReturnedRate: 153205 | |
| - TotalTime: 6630199795 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 350603 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/3.54 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:28 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 116908889 | |
| - BytesReadDataNodeCache: 116908889 | |
| - BytesReadLocal: 116908889 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 116908889 | |
| - DecompressionTime: 198572236 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 28 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168225 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 145695183 | |
| - RowsReturned: 1015783 | |
| - RowsReturnedRate: 162801 | |
| - ScanRangesComplete: 28 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 5951257576 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 16701269 | |
| - TotalTime: 6239381002 | |
| Instance 4545f1d5e73cb011:c (host=cdh17.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:24/2.37 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299263 | |
| - PerHostPeakMemUsage: 12705941 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1513297 | |
| - TotalStorageWaitTime: 80224 | |
| - TotalThreadsInvoluntaryContextSwitches: 8 | |
| - TotalThreadsTotalWallClockTime: 5304118635 | |
| - TotalThreadsSysTime: 340000000 | |
| - TotalThreadsUserTime: 4864000000 | |
| - TotalThreadsVoluntaryContextSwitches: 125 | |
| - TotalTime: 5345716073 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 5134868546 | |
| - ExecTreeExecTime: 5129724044 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 169294975 | |
| - ExecTreeOpenTime: 49708221 | |
| - PrepareTime: 41496619 | |
| - ExecTreePrepareTime: 933594 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 296 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1837254 | |
| - OverallThroughput: 1034986 | |
| - PeakMemoryUsage: 109560 | |
| - RowsReturned: 8 | |
| - SerializeBatchTime: 71379 | |
| - TotalTime: 285994 | |
| - TransmitDataRPCTime: 161110 | |
| - UncompressedRowBatchSize: 376 | |
| CodeGen | |
| - CodegenTime: 3997177 | |
| - CompileTime: 32129058 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 86217501 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 35338079 | |
| - TotalTime: 154392941 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 112436 | |
| - GetResultsTime: 17439 | |
| - HTResizeTime: 342820 | |
| - HashBuckets: 12288 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 1 | |
| - StreamingTime: 74244475 | |
| - TotalTime: 5180357030 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454555 | |
| - RowsReturned: 2670287 | |
| - RowsReturnedRate: 523309 | |
| - TotalTime: 5102688282 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 397921 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:24/2.37 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 24 out of 24 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:24 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 75011561 | |
| - BytesReadDataNodeCache: 75011561 | |
| - BytesReadLocal: 75011561 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 75011561 | |
| - DecompressionTime: 165921519 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 24 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168220 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 97659250 | |
| - RowsReturned: 2670287 | |
| - RowsReturnedRate: 546634 | |
| - ScanRangesComplete: 24 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 4568508247 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 13564256 | |
| - TotalTime: 4884959462 | |
| Instance 4545f1d5e73cb011:6 (host=cdh12.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.40 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299237 | |
| - PerHostPeakMemUsage: 12705915 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 972187 | |
| - TotalStorageWaitTime: 69030 | |
| - TotalThreadsInvoluntaryContextSwitches: 5 | |
| - TotalThreadsTotalWallClockTime: 4765187222 | |
| - TotalThreadsSysTime: 608000000 | |
| - TotalThreadsUserTime: 4056000000 | |
| - TotalThreadsVoluntaryContextSwitches: 169 | |
| - TotalTime: 4802201012 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 4647689470 | |
| - ExecTreeExecTime: 4643593318 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 117532120 | |
| - ExecTreeOpenTime: 3668099 | |
| - PrepareTime: 36947009 | |
| - ExecTreePrepareTime: 532353 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2897212 | |
| - OverallThroughput: 993567 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 130509 | |
| - TotalTime: 252625 | |
| - TransmitDataRPCTime: 86635 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 3653785 | |
| - CompileTime: 29272239 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 83433947 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 32010612 | |
| - TotalTime: 145458554 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 65793 | |
| - GetResultsTime: 13213 | |
| - HTResizeTime: 337065 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 1 | |
| - StreamingTime: 27998255 | |
| - TotalTime: 4647785872 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454537 | |
| - RowsReturned: 1036782 | |
| - RowsReturnedRate: 224516 | |
| - TotalTime: 4617841722 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 398852 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.40 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 26 out of 26 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
| File Formats: PARQUET/SNAPPY:26 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 79856970 | |
| - BytesReadDataNodeCache: 79856970 | |
| - BytesReadLocal: 79856970 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 79856970 | |
| - DecompressionTime: 142913643 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 26 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168216 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 101015240 | |
| - RowsReturned: 1036782 | |
| - RowsReturnedRate: 240462 | |
| - ScanRangesComplete: 26 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 4025745690 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 15713793 | |
| - TotalTime: 4311623237 | |
| Instance 4545f1d5e73cb011:d (host=cdh3.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:13/2.49 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299379 | |
| - PerHostPeakMemUsage: 12706025 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1412804 | |
| - TotalStorageWaitTime: 83356 | |
| - TotalThreadsInvoluntaryContextSwitches: 6 | |
| - TotalThreadsTotalWallClockTime: 4649354028 | |
| - TotalThreadsSysTime: 456000000 | |
| - TotalThreadsUserTime: 4172000000 | |
| - TotalThreadsVoluntaryContextSwitches: 84 | |
| - TotalTime: 4690230634 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 4478095052 | |
| - ExecTreeExecTime: 4472764358 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 171300746 | |
| - ExecTreeOpenTime: 53358484 | |
| - PrepareTime: 40786464 | |
| - ExecTreePrepareTime: 893900 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 250 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2432947 | |
| - OverallThroughput: 930890 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 107906 | |
| - TotalTime: 268560 | |
| - TransmitDataRPCTime: 102756 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4305272 | |
| - CompileTime: 31016466 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 85557910 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 34186236 | |
| - TotalTime: 151578298 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 107554 | |
| - GetResultsTime: 14148 | |
| - HTResizeTime: 433830 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 1 | |
| - StreamingTime: 10102810 | |
| - TotalTime: 4527009692 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454656 | |
| - RowsReturned: 362660 | |
| - RowsReturnedRate: 80315 | |
| - TotalTime: 4515435534 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 309068 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:13/2.49 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:13 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 82516123 | |
| - BytesReadDataNodeCache: 82516123 | |
| - BytesReadLocal: 82516123 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 82516123 | |
| - DecompressionTime: 133215320 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 13 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168248 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 102158030 | |
| - RowsReturned: 362660 | |
| - RowsReturnedRate: 83421 | |
| - ScanRangesComplete: 13 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 4165415446 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 17318531 | |
| - TotalTime: 4347321930 | |
| Instance 4545f1d5e73cb011:9 (host=cdh1.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:15/2.04 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299280 | |
| - PerHostPeakMemUsage: 12705958 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1459036 | |
| - TotalStorageWaitTime: 21632 | |
| - TotalThreadsInvoluntaryContextSwitches: 3 | |
| - TotalThreadsTotalWallClockTime: 4479000244 | |
| - TotalThreadsSysTime: 272000000 | |
| - TotalThreadsUserTime: 4184000000 | |
| - TotalThreadsVoluntaryContextSwitches: 87 | |
| - TotalTime: 4520577000 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 4353630456 | |
| - ExecTreeExecTime: 4348210536 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 125397440 | |
| - ExecTreeOpenTime: 7267692 | |
| - PrepareTime: 41499052 | |
| - ExecTreePrepareTime: 850748 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 250 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1900100 | |
| - OverallThroughput: 882145 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 94232 | |
| - TotalTime: 283400 | |
| - TransmitDataRPCTime: 131572 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4261588 | |
| - CompileTime: 30695072 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 85959672 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 34797592 | |
| - TotalTime: 152247556 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 111748 | |
| - GetResultsTime: 12116 | |
| - HTResizeTime: 521552 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 1 | |
| - StreamingTime: 16791996 | |
| - TotalTime: 4356321532 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454571 | |
| - RowsReturned: 496622 | |
| - RowsReturnedRate: 114480 | |
| - TotalTime: 4338059844 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 239044 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:15/2.04 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 15 out of 15 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:15 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 69026665 | |
| - BytesReadDataNodeCache: 69026665 | |
| - BytesReadLocal: 69026665 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 69026665 | |
| - DecompressionTime: 135706424 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 15 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168229 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 84459663 | |
| - RowsReturned: 496622 | |
| - RowsReturnedRate: 117850 | |
| - ScanRangesComplete: 15 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 4019697620 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 15254801 | |
| - TotalTime: 4213992764 | |
| Instance 4545f1d5e73cb011:f (host=cdh2.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:17/2.00 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 18687136 | |
| - PerHostPeakMemUsage: 21093798 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1792348 | |
| - TotalStorageWaitTime: 23013092 | |
| - TotalThreadsInvoluntaryContextSwitches: 4 | |
| - TotalThreadsTotalWallClockTime: 3774583832 | |
| - TotalThreadsSysTime: 204000000 | |
| - TotalThreadsUserTime: 3520000000 | |
| - TotalThreadsVoluntaryContextSwitches: 110 | |
| - TotalTime: 3816243056 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 3649903900 | |
| - ExecTreeExecTime: 3643896316 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 124707296 | |
| - ExecTreeOpenTime: 7315800 | |
| - PrepareTime: 41584776 | |
| - ExecTreePrepareTime: 874320 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 294 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1625962 | |
| - OverallThroughput: 869935 | |
| - PeakMemoryUsage: 109560 | |
| - RowsReturned: 8 | |
| - SerializeBatchTime: 103812 | |
| - TotalTime: 337956 | |
| - TransmitDataRPCTime: 180816 | |
| - UncompressedRowBatchSize: 376 | |
| CodeGen | |
| - CodegenTime: 4105060 | |
| - CompileTime: 30573316 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 85385524 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 35319616 | |
| - TotalTime: 152105656 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 102064 | |
| - GetResultsTime: 16224 | |
| - HTResizeTime: 620108 | |
| - HashBuckets: 12288 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 2 | |
| - StreamingTime: 22954840 | |
| - TotalTime: 3652080108 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454525 | |
| - RowsReturned: 713815 | |
| - RowsReturnedRate: 196779 | |
| - TotalTime: 3627484148 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 331060 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:17/2.00 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:17 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 66359165 | |
| - BytesReadDataNodeCache: 42075050 | |
| - BytesReadLocal: 66359165 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 66359165 | |
| - DecompressionTime: 116076684 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 1 | |
| - NumRowGroups: 17 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 8556679 | |
| - PerReadThreadRawHdfsThroughput: 4857497344 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 83616139 | |
| - RowsReturned: 713815 | |
| - RowsReturnedRate: 204067 | |
| - ScanRangesComplete: 17 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 3306738708 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 13661184 | |
| - TotalReadThroughput: 16589791 | |
| - TotalTime: 3497938800 | |
| Instance 4545f1d5e73cb011:11 (host=cdh8.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:16/2.06 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299240 | |
| - PerHostPeakMemUsage: 12705918 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1519342 | |
| - TotalStorageWaitTime: 82972 | |
| - TotalThreadsInvoluntaryContextSwitches: 4 | |
| - TotalThreadsTotalWallClockTime: 3714508887 | |
| - TotalThreadsSysTime: 240000000 | |
| - TotalThreadsUserTime: 3448000000 | |
| - TotalThreadsVoluntaryContextSwitches: 98 | |
| - TotalTime: 3756482810 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 3543612792 | |
| - ExecTreeExecTime: 3537877909 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 170923373 | |
| - ExecTreeOpenTime: 52537527 | |
| - PrepareTime: 41902431 | |
| - ExecTreePrepareTime: 823021 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1639847 | |
| - OverallThroughput: 833405 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 89276 | |
| - TotalTime: 301174 | |
| - TransmitDataRPCTime: 153063 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4440506 | |
| - CompileTime: 30008814 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 86923436 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 34643191 | |
| - TotalTime: 152359765 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 105871 | |
| - GetResultsTime: 9482 | |
| - HTResizeTime: 389122 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 1 | |
| - StreamingTime: 12857145 | |
| - TotalTime: 3591232230 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454527 | |
| - RowsReturned: 528644 | |
| - RowsReturnedRate: 147786 | |
| - TotalTime: 3577080321 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 311749 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:16/2.06 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 16 out of 16 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:16 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 68019764 | |
| - BytesReadDataNodeCache: 68019764 | |
| - BytesReadLocal: 68019764 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 68019764 | |
| - DecompressionTime: 119813441 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 16 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168221 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 84294342 | |
| - RowsReturned: 528644 | |
| - RowsReturnedRate: 151795 | |
| - ScanRangesComplete: 16 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 3308723682 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 17004941 | |
| - TotalTime: 3482605767 | |
| Instance 4545f1d5e73cb011:5 (host=cdh7.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.28 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 18687294 | |
| - PerHostPeakMemUsage: 21126809 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1882017 | |
| - TotalStorageWaitTime: 14827184 | |
| - TotalThreadsInvoluntaryContextSwitches: 3 | |
| - TotalThreadsTotalWallClockTime: 3068277522 | |
| - TotalThreadsSysTime: 276000000 | |
| - TotalThreadsUserTime: 2760000000 | |
| - TotalThreadsVoluntaryContextSwitches: 74 | |
| - TotalTime: 3107779085 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 2899657992 | |
| - ExecTreeExecTime: 2892630781 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 168646903 | |
| - ExecTreeOpenTime: 54293361 | |
| - PrepareTime: 39402488 | |
| - ExecTreePrepareTime: 903080 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 250 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1696375 | |
| - OverallThroughput: 878759 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 88928 | |
| - TotalTime: 284492 | |
| - TransmitDataRPCTime: 147373 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4301690 | |
| - CompileTime: 29116025 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 83851249 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 32752131 | |
| - TotalTime: 146462956 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 109619 | |
| - GetResultsTime: 17554 | |
| - HTResizeTime: 362381 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 2 | |
| - StreamingTime: 12045440 | |
| - TotalTime: 2947818450 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454561 | |
| - RowsReturned: 309503 | |
| - RowsReturnedRate: 105481 | |
| - TotalTime: 2934179634 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 543712 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.28 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:10 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 43032952 | |
| - BytesReadDataNodeCache: 26846975 | |
| - BytesReadLocal: 43032952 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 43032952 | |
| - DecompressionTime: 86365569 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 1 | |
| - NumRowGroups: 10 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 8556715 | |
| - PerReadThreadRawHdfsThroughput: 5106692286 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 53096875 | |
| - RowsReturned: 309503 | |
| - RowsReturnedRate: 109742 | |
| - ScanRangesComplete: 10 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 2685482229 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 8426776 | |
| - TotalReadThroughput: 14344317 | |
| - TotalTime: 2820260855 | |
| Instance 4545f1d5e73cb011:a (host=cdh5.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:9/1.28 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 18687360 | |
| - PerHostPeakMemUsage: 21106318 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1299714 | |
| - TotalStorageWaitTime: 15365848 | |
| - TotalThreadsInvoluntaryContextSwitches: 3 | |
| - TotalThreadsTotalWallClockTime: 2981210938 | |
| - TotalThreadsSysTime: 96000000 | |
| - TotalThreadsUserTime: 2860000000 | |
| - TotalThreadsVoluntaryContextSwitches: 64 | |
| - TotalTime: 3022426238 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 2816072340 | |
| - ExecTreeExecTime: 2811123028 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 165164578 | |
| - ExecTreeOpenTime: 50274560 | |
| - PrepareTime: 41133176 | |
| - ExecTreePrepareTime: 777818 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 245 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1326877 | |
| - OverallThroughput: 766842 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 82200 | |
| - TotalTime: 319492 | |
| - TransmitDataRPCTime: 184644 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 3858484 | |
| - CompileTime: 29636554 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 83711778 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 33512646 | |
| - TotalTime: 147618286 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 100698 | |
| - GetResultsTime: 11456 | |
| - HTResizeTime: 402382 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 2 | |
| - StreamingTime: 11467268 | |
| - TotalTime: 2862168418 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454487 | |
| - RowsReturned: 289276 | |
| - RowsReturnedRate: 101519 | |
| - TotalTime: 2849453036 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 309078 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:9/1.28 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:9 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 42460609 | |
| - BytesReadDataNodeCache: 26023676 | |
| - BytesReadLocal: 42460609 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 42460609 | |
| - DecompressionTime: 102095486 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 1 | |
| - NumRowGroups: 9 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 8556702 | |
| - PerReadThreadRawHdfsThroughput: 4731044005 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 53642219 | |
| - RowsReturned: 289276 | |
| - RowsReturnedRate: 103629 | |
| - ScanRangesComplete: 9 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 2642077934 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 8974892 | |
| - TotalReadThroughput: 14153536 | |
| - TotalTime: 2791450926 | |
| Instance 4545f1d5e73cb011:10 (host=cdh4.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:14/1.67 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299350 | |
| - PerHostPeakMemUsage: 12756791 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1443192 | |
| - TotalStorageWaitTime: 11784 | |
| - TotalThreadsInvoluntaryContextSwitches: 3 | |
| - TotalThreadsTotalWallClockTime: 2979500126 | |
| - TotalThreadsSysTime: 100000000 | |
| - TotalThreadsUserTime: 2856000000 | |
| - TotalThreadsVoluntaryContextSwitches: 85 | |
| - TotalTime: 3021615864 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 2820643518 | |
| - ExecTreeExecTime: 2815387018 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 158885100 | |
| - ExecTreeOpenTime: 42792842 | |
| - PrepareTime: 42038184 | |
| - ExecTreePrepareTime: 902496 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1835278 | |
| - OverallThroughput: 901075 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 74110 | |
| - TotalTime: 278556 | |
| - TransmitDataRPCTime: 136764 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4070628 | |
| - CompileTime: 29277636 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 85311512 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 34262526 | |
| - TotalTime: 149654324 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 147838 | |
| - GetResultsTime: 8506 | |
| - HTResizeTime: 360140 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 2 | |
| - StreamingTime: 13268758 | |
| - TotalTime: 2859074806 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454627 | |
| - RowsReturned: 549998 | |
| - RowsReturnedRate: 193356 | |
| - TotalTime: 2844480234 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 285874 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:14/1.67 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 14 out of 14 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:14 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 55110625 | |
| - BytesReadDataNodeCache: 55110625 | |
| - BytesReadLocal: 55110625 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 55110625 | |
| - DecompressionTime: 96803958 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 14 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168234 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 69434238 | |
| - RowsReturned: 549998 | |
| - RowsReturnedRate: 197722 | |
| - ScanRangesComplete: 14 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 2638623920 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 18370208 | |
| - TotalTime: 2781670372 | |
| Instance 4545f1d5e73cb011:7 (host=cdh9.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.44 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 10299224 | |
| - PerHostPeakMemUsage: 12705870 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1494141 | |
| - TotalStorageWaitTime: 15399 | |
| - TotalThreadsInvoluntaryContextSwitches: 4 | |
| - TotalThreadsTotalWallClockTime: 2947977356 | |
| - TotalThreadsSysTime: 160000000 | |
| - TotalThreadsUserTime: 2768000000 | |
| - TotalThreadsVoluntaryContextSwitches: 74 | |
| - TotalTime: 3004237909 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 2776420271 | |
| - ExecTreeExecTime: 2771006622 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 171583636 | |
| - ExecTreeOpenTime: 51912873 | |
| - PrepareTime: 56191935 | |
| - ExecTreePrepareTime: 647637 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1590600 | |
| - OverallThroughput: 856895 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 84828 | |
| - TotalTime: 292918 | |
| - TransmitDataRPCTime: 157802 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 3671435 | |
| - CompileTime: 31720301 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 86248577 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 31885648 | |
| - TotalTime: 150585053 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 83792 | |
| - GetResultsTime: 11158 | |
| - HTResizeTime: 367307 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 2 | |
| - StreamingTime: 14437448 | |
| - TotalTime: 2823560039 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454520 | |
| - RowsReturned: 418963 | |
| - RowsReturnedRate: 149210 | |
| - TotalTime: 2807868764 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 309132 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.44 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:11 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 47597284 | |
| - BytesReadDataNodeCache: 47597284 | |
| - BytesReadLocal: 47597284 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 47597284 | |
| - DecompressionTime: 87612417 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 11 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 168225 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 59336606 | |
| - RowsReturned: 418963 | |
| - RowsReturnedRate: 153567 | |
| - ScanRangesComplete: 11 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 2598756478 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 15865761 | |
| - TotalTime: 2728207079 | |
| Instance 4545f1d5e73cb011:4 (host=cdh6.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.05 GB | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 18687367 | |
| - PerHostPeakMemUsage: 21094013 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1467166 | |
| - TotalStorageWaitTime: 15143860 | |
| - TotalThreadsInvoluntaryContextSwitches: 2 | |
| - TotalThreadsTotalWallClockTime: 2063685788 | |
| - TotalThreadsSysTime: 108000000 | |
| - TotalThreadsUserTime: 1924000000 | |
| - TotalThreadsVoluntaryContextSwitches: 74 | |
| - TotalTime: 2105528074 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 1941208780 | |
| - ExecTreeExecTime: 1936277202 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 122507360 | |
| - ExecTreeOpenTime: 7115556 | |
| - PrepareTime: 41767740 | |
| - ExecTreePrepareTime: 789196 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1844638 | |
| - OverallThroughput: 960199 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 76474 | |
| - TotalTime: 261404 | |
| - TransmitDataRPCTime: 136070 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 3944024 | |
| - CompileTime: 29510600 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 60 | |
| - NumInstructions: 1115 | |
| - OptimizationTime: 84376134 | |
| - PeakMemoryUsage: 570880 | |
| - PrepareTime: 33706716 | |
| - TotalTime: 148352086 | |
| AGGREGATION_NODE (id=3) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 92276 | |
| - GetResultsTime: 11324 | |
| - HTResizeTime: 539542 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 1675392 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 3 | |
| - StreamingTime: 11001272 | |
| - TotalTime: 1944175132 | |
| - UnpinTime: 0 | |
| UNION_NODE (id=0) | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 8454146 | |
| - RowsReturned: 382331 | |
| - RowsReturnedRate: 197884 | |
| - TotalTime: 1932092004 | |
| HDFS_SCAN_NODE (id=2) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): | |
| Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| ExecOption: Codegen enabled: 0 out of 0 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 0 | |
| - BytesReadDataNodeCache: 0 | |
| - BytesReadLocal: 0 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumDisksAccessed: 0 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 4096 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 0 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - ScanRangesComplete: 0 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 0 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 0 | |
| - TotalTime: 308426 | |
| HDFS_SCAN_NODE (id=1) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.05 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:10 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 0.0 | |
| - BytesRead: 34416056 | |
| - BytesReadDataNodeCache: 18189782 | |
| - BytesReadLocal: 34416056 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 34416056 | |
| - DecompressionTime: 68788820 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 1 | |
| - NumRowGroups: 10 | |
| - NumScannerThreadsStarted: 0 | |
| - PeakMemoryUsage: 8556728 | |
| - PerReadThreadRawHdfsThroughput: 3777045792 | |
| - RemoteScanRanges: 0 | |
| - RowsRead: 43978209 | |
| - RowsReturned: 382331 | |
| - RowsReturnedRate: 203767 | |
| - ScanRangesComplete: 10 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 0 | |
| - MaterializeTupleTime(*): 1764537936 | |
| - ScannerThreadsSysTime: 0 | |
| - ScannerThreadsUserTime: 0 | |
| - ScannerThreadsVoluntaryContextSwitches: 0 | |
| - TotalRawHdfsReadTime(*): 9111898 | |
| - TotalReadThroughput: 17208028 | |
| - TotalTime: 1876305618 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment