-
-
Save momohuri/62a00d9e381771aa9172b6dea09a5191 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Query (id=284259db5f764ed8:c13f68c400000000) | |
| Summary | |
| Session ID: 5d413aa8da087be1:9b98e1a7d6a7fc95 | |
| Session Type: HIVESERVER2 | |
| HiveServer2 Protocol Version: V6 | |
| Start Time: 2017-03-09 13:41:06.189077000 | |
| End Time: | |
| Query Type: QUERY | |
| Query State: CREATED | |
| Query Status: OK | |
| Impala Version: impalad version 2.7.0-cdh5.10.0 RELEASE (build 785a073cd07e2540d521ecebb8b38161ccbd2aa2) | |
| User: hdfs | |
| Connected User: hdfs | |
| Delegated User: | |
| Network Address: ::ffff:172.16.0.221:46313 | |
| Default Db: wikia_prod | |
| Sql Statement: SELECT `ga_category`, count(*) `y` | |
| FROM | |
| (SELECT `ga_category` | |
| FROM trackingevent_batch | |
| WHERE `cuberon_event_date` BETWEEN "2017-01-31" AND "2017-02-14") Q1 | |
| WHERE (`ga_category` LIKE '%editor%' | |
| AND `ga_category` IS NOT NULL) | |
| GROUP BY `ga_category` | |
| ORDER BY `y` DESC LIMIT 10 | |
| Coordinator: cdh16.net.cuberonlabs.com:22000 | |
| Query Options (non default): QUERY_TIMEOUT_S=600 | |
| Plan: | |
| ---------------- | |
| Estimated Per-Host Requirements: Memory=108.00MB VCores=2 | |
| WARNING: The following tables are missing relevant table and/or column statistics. | |
| wikia_prod.trackingevent_batch | |
| PLAN-ROOT SINK | |
| | | |
| 05:MERGING-EXCHANGE [UNPARTITIONED] | |
| | order by: count(*) DESC | |
| | limit: 10 | |
| | hosts=17 per-host-mem=unavailable | |
| | tuple-ids=3 row-size=40B cardinality=10 | |
| | | |
| 02:TOP-N [LIMIT=10] | |
| | order by: count(*) DESC | |
| | hosts=17 per-host-mem=397B | |
| | tuple-ids=3 row-size=40B cardinality=10 | |
| | | |
| 04:AGGREGATE [FINALIZE] | |
| | output: count:merge(*) | |
| | group by: ga_category | |
| | hosts=17 per-host-mem=10.00MB | |
| | tuple-ids=2 row-size=40B cardinality=166 | |
| | | |
| 03:EXCHANGE [HASH(ga_category)] | |
| | hosts=17 per-host-mem=0B | |
| | tuple-ids=2 row-size=40B cardinality=166 | |
| | | |
| 01:AGGREGATE [STREAMING] | |
| | output: count(*) | |
| | group by: ga_category | |
| | hosts=17 per-host-mem=10.00MB | |
| | tuple-ids=2 row-size=40B cardinality=166 | |
| | | |
| 00:SCAN HDFS [wikia_prod.trackingevent_batch, RANDOM] | |
| partitions=13/13 files=346 size=46.14GB | |
| predicates: wikia_prod.trackingevent_batch.ga_category IS NOT NULL, wikia_prod.trackingevent_batch.ga_category LIKE '%editor%' | |
| table stats: 1401425865 rows total (3 partition(s) missing stats) | |
| column stats: all | |
| hosts=17 per-host-mem=88.00MB | |
| tuple-ids=0 row-size=32B cardinality=140142587 | |
| ---------------- | |
| Estimated Per-Host Mem: 113246208 | |
| Estimated Per-Host VCores: 2 | |
| Tables Missing Stats: wikia_prod.trackingevent_batch | |
| Request Pool: root.hdfs | |
| Admission result: Admitted immediately | |
| - ComputeScanRangeAssignmentTimer: 467781 | |
| - InactiveTotalTime: 0 | |
| - TotalTime: 0 | |
| Planner Timeline | |
| Analysis finished: 1059839 | |
| Equivalence classes computed: 1199473 | |
| Single node plan created: 2418360 | |
| Runtime filters computed: 2467046 | |
| Distributed plan created: 2722415 | |
| Lineage info computed: 2872473 | |
| Planning finished: 4829125 | |
| Query Timeline | |
| Query submitted: 28399 | |
| Planning finished: 10975808 | |
| Submit for admission: 12126800 | |
| Completed admission: 12209129 | |
| Ready to start 35 fragment instances: 12433029 | |
| All 35 fragment instances started: 21157378 | |
| Rows available: 1531136470 | |
| First row fetched: 2397803830 | |
| ImpalaServer | |
| - ClientFetchWaitTimer: 866678201 | |
| - InactiveTotalTime: 0 | |
| - RowMaterializationTimer: 5863329 | |
| - TotalTime: 0 | |
| Execution Profile 284259db5f764ed8:c13f68c400000000 | |
| Number of filters: 0 | |
| Filter routing table: | |
| ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled | |
| ---------------------------------------------------------------------------------------------------------------------------- | |
| Fragment instance start latencies: Count: 35, 25th %-ile: 1ms, 50th %-ile: 2ms, 75th %-ile: 3ms, 90th %-ile: 3ms, 95th %-ile: 3ms, 99.9th %-ile: 4ms | |
| Per Node Peak Memory Usage: cdh11.net.cuberonlabs.com:22000(85.81 MB) cdh15.net.cuberonlabs.com:22000(90.64 MB) cdh13.net.cuberonlabs.com:22000(75.24 MB) cdh8.net.cuberonlabs.com:22000(57.41 MB) cdh12.net.cuberonlabs.com:22000(58.01 MB) cdh17.net.cuberonlabs.com:22000(59.29 MB) cdh10.net.cuberonlabs.com:22000(84.28 MB) cdh3.net.cuberonlabs.com:22000(81.53 MB) cdh2.net.cuberonlabs.com:22000(71.60 MB) cdh1.net.cuberonlabs.com:22000(76.88 MB) cdh5.net.cuberonlabs.com:22000(69.23 MB) cdh7.net.cuberonlabs.com:22000(59.01 MB) cdh14.net.cuberonlabs.com:22000(74.15 MB) cdh9.net.cuberonlabs.com:22000(49.55 MB) cdh6.net.cuberonlabs.com:22000(34.50 MB) cdh4.net.cuberonlabs.com:22000(51.10 MB) cdh16.net.cuberonlabs.com:22000(75.21 MB) | |
| - FiltersReceived: 0 | |
| - FinalizationTimer: 0 | |
| - InactiveTotalTime: 0 | |
| - TotalTime: 1524159620 | |
| Coordinator Fragment F02 | |
| Instance 284259db5f764ed8:c13f68c400000000 (host=cdh16.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 0.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 275968 | |
| - PerHostPeakMemUsage: 78865118 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 0 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 2360104511 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 48000000 | |
| - TotalThreadsVoluntaryContextSwitches: 18 | |
| - TotalTime: 2384623318 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 866827324 | |
| - ExecTreeExecTime: 40020 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 1493304981 | |
| - ExecTreeOpenTime: 1449770234 | |
| - PrepareTime: 24449933 | |
| - ExecTreePrepareTime: 39559 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| PLAN_ROOT_SINK | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 0 | |
| - TotalTime: 0 | |
| CodeGen | |
| - CodegenTime: 1074040 | |
| - CompileTime: 2222378 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 28 | |
| - NumInstructions: 523 | |
| - OptimizationTime: 39563647 | |
| - PeakMemoryUsage: 267776 | |
| - PrepareTime: 24571390 | |
| - TotalTime: 67015977 | |
| EXCHANGE_NODE (id=5) | |
| ExecOption: Codegen Enabled | |
| - BytesReceived: 298 | |
| - ConvertRowBatchTime: 0 | |
| - DeserializeRowBatchTimer: 34114 | |
| - FirstBatchArrivalWaitTime: 1449717682 | |
| - InactiveTotalTime: 1449725407 | |
| - MergeGetNext: 34833 | |
| - MergeGetNextBatch: 27307 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 5 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 1449805718 | |
| Averaged Fragment F01 | |
| split sizes: min: 0, max: 0, avg: 0, stddev: 0 | |
| completion times: min:1s514ms max:1s517ms mean: 1s515ms stddev:994.369us | |
| execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec | |
| num instances: 17 | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 71145200 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 1260669907 | |
| - TotalNetworkSendTime: 69524 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 1478609186 | |
| - TotalThreadsSysTime: 941176 | |
| - TotalThreadsUserTime: 219058823 | |
| - TotalThreadsVoluntaryContextSwitches: 56 | |
| - TotalTime: 1514781154 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 298669 | |
| - ExecTreeExecTime: 3523 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 1478357871 | |
| - ExecTreeOpenTime: 1261659678 | |
| - PrepareTime: 36049052 | |
| - ExecTreePrepareTime: 626322 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 17 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 846452 | |
| - OverallThroughput: 228553 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 11563 | |
| - TotalTime: 37731 | |
| - TransmitDataRPCTime: 7449 | |
| - UncompressedRowBatchSize: 22 | |
| CodeGen | |
| - CodegenTime: 4370938 | |
| - CompileTime: 47244474 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 167825987 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 32766177 | |
| - TotalTime: 248535185 | |
| SORT_NODE (id=2) | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 4275 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 1262284711 | |
| AGGREGATION_NODE (id=4) | |
| - BuildTime: 10876 | |
| - GetNewBlockTime: 158379 | |
| - GetResultsTime: 1321 | |
| - HTResizeTime: 3440 | |
| - HashBuckets: 481 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 2 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2410563 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 1262203129 | |
| - UnpinTime: 975 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 261 | |
| - ConvertRowBatchTime: 6878 | |
| - DeserializeRowBatchTimer: 48671 | |
| - FirstBatchArrivalWaitTime: 1040046930 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 5 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 1260688039 | |
| Fragment F01 | |
| Instance 284259db5f764ed8:20 (host=cdh15.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 95044562 | |
| - RowsProduced: 1 | |
| - TotalNetworkReceiveTime: 1334014419 | |
| - TotalNetworkSendTime: 224519 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 1491299587 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 160000000 | |
| - TotalThreadsVoluntaryContextSwitches: 11 | |
| - TotalTime: 1516303544 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 398865 | |
| - ExecTreeExecTime: 2141 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 1490920302 | |
| - ExecTreeOpenTime: 1334848372 | |
| - PrepareTime: 24931193 | |
| - ExecTreePrepareTime: 518627 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 43 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1738005 | |
| - OverallThroughput: 514477 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 1 | |
| - SerializeBatchTime: 45361 | |
| - TotalTime: 83580 | |
| - TransmitDataRPCTime: 24741 | |
| - UncompressedRowBatchSize: 51 | |
| CodeGen | |
| - CodegenTime: 2740482 | |
| - CompileTime: 35072549 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 120096162 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 22634157 | |
| - TotalTime: 178248519 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 11634 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 1335365399 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 12816 | |
| - GetNewBlockTime: 133510 | |
| - GetResultsTime: 3032 | |
| - HTResizeTime: 3382 | |
| - HashBuckets: 1024 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 25 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2409600 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 1335293906 | |
| - UnpinTime: 838 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 172 | |
| - ConvertRowBatchTime: 5485 | |
| - DeserializeRowBatchTimer: 57923 | |
| - FirstBatchArrivalWaitTime: 601104504 | |
| - InactiveTotalTime: 1333998340 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 4 | |
| - RowsReturnedRate: 2 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 1334030050 | |
| Instance 284259db5f764ed8:21 (host=cdh9.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 51957051 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 1262509590 | |
| - TotalNetworkSendTime: 364 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 1476647608 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 216000000 | |
| - TotalThreadsVoluntaryContextSwitches: 98 | |
| - TotalTime: 1516276711 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 281605 | |
| - ExecTreeExecTime: 3974 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 1476423844 | |
| - ExecTreeOpenTime: 1263563162 | |
| - PrepareTime: 39463548 | |
| - ExecTreePrepareTime: 621437 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 22277 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4915402 | |
| - CompileTime: 43896895 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 167211492 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 35496414 | |
| - TotalTime: 247382745 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 606 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 1264182754 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 6953 | |
| - GetNewBlockTime: 145989 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 4196 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 1264088647 | |
| - UnpinTime: 1002 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 410 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 1262505789 | |
| - InactiveTotalTime: 1262506870 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 1262511699 | |
| Instance 284259db5f764ed8:22 (host=cdh11.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 89977654 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 1269735744 | |
| - TotalNetworkSendTime: 142 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 1479884118 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 212000000 | |
| - TotalThreadsVoluntaryContextSwitches: 42 | |
| - TotalTime: 1516200596 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 215547 | |
| - ExecTreeExecTime: 1912 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 1479708004 | |
| - ExecTreeOpenTime: 1270373927 | |
| - PrepareTime: 36217674 | |
| - ExecTreePrepareTime: 636633 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 15897 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4220049 | |
| - CompileTime: 48096137 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 159811112 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 32914336 | |
| - TotalTime: 241505109 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 467 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 1271008934 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 2718 | |
| - GetNewBlockTime: 154161 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 1645 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 1270956967 | |
| - UnpinTime: 1021 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 299 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 1269733914 | |
| - InactiveTotalTime: 1269734348 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 1269737091 | |
| Instance 284259db5f764ed8:1e (host=cdh16.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 78865118 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 1316741426 | |
| - TotalNetworkSendTime: 241 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 1493988082 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 180000000 | |
| - TotalThreadsVoluntaryContextSwitches: 87 | |
| - TotalTime: 1515945228 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 173543 | |
| - ExecTreeExecTime: 10100 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 1493845239 | |
| - ExecTreeOpenTime: 1318226086 | |
| - PrepareTime: 21882221 | |
| - ExecTreePrepareTime: 978330 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 11542 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 2966240 | |
| - CompileTime: 40497094 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 133647181 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 19610679 | |
| - TotalTime: 194212148 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 562 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 1319210862 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 3573 | |
| - GetNewBlockTime: 327480 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 2234 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 1319125414 | |
| - UnpinTime: 453 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 289 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 1316738855 | |
| - InactiveTotalTime: 1316739552 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 1316742967 | |
| Instance 284259db5f764ed8:1f (host=cdh13.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 78895122 | |
| - RowsProduced: 3 | |
| - TotalNetworkReceiveTime: 1269992945 | |
| - TotalNetworkSendTime: 334193 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 1478471647 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 212000000 | |
| - TotalThreadsVoluntaryContextSwitches: 26 | |
| - TotalTime: 1515760214 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 540695 | |
| - ExecTreeExecTime: 2032 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 1477972652 | |
| - ExecTreeOpenTime: 1270924733 | |
| - PrepareTime: 37181211 | |
| - ExecTreePrepareTime: 750963 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 85 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2635658 | |
| - OverallThroughput: 787015 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 3 | |
| - SerializeBatchTime: 55150 | |
| - TotalTime: 108003 | |
| - TransmitDataRPCTime: 32250 | |
| - UncompressedRowBatchSize: 123 | |
| CodeGen | |
| - CodegenTime: 4208095 | |
| - CompileTime: 42931220 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 162883498 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 33559050 | |
| - TotalTime: 240074466 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 16940 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 3 | |
| - RowsReturnedRate: 2 | |
| - TotalTime: 1271673255 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 24967 | |
| - GetNewBlockTime: 177117 | |
| - GetResultsTime: 7394 | |
| - HTResizeTime: 3175 | |
| - HashBuckets: 3072 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 1 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2462848 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 3 | |
| - RowsReturnedRate: 2 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 1271568039 | |
| - UnpinTime: 996 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 1495 | |
| - ConvertRowBatchTime: 34561 | |
| - DeserializeRowBatchTimer: 418329 | |
| - FirstBatchArrivalWaitTime: 515461091 | |
| - InactiveTotalTime: 1269912671 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 51 | |
| - RowsReturnedRate: 40 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 1270068747 | |
| Instance 284259db5f764ed8:1b (host=cdh12.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 60824020 | |
| - RowsProduced: 1 | |
| - TotalNetworkReceiveTime: 1179917275 | |
| - TotalNetworkSendTime: 205268 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 1483468533 | |
| - TotalThreadsSysTime: 4000000 | |
| - TotalThreadsUserTime: 300000000 | |
| - TotalThreadsVoluntaryContextSwitches: 36 | |
| - TotalTime: 1515531069 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 371070 | |
| - ExecTreeExecTime: 2620 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 1483154600 | |
| - ExecTreeOpenTime: 1180973148 | |
| - PrepareTime: 31954021 | |
| - ExecTreePrepareTime: 535889 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 55 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 3121630 | |
| - OverallThroughput: 1314280 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 1 | |
| - SerializeBatchTime: 8909 | |
| - TotalTime: 41848 | |
| - TransmitDataRPCTime: 17619 | |
| - UncompressedRowBatchSize: 63 | |
| CodeGen | |
| - CodegenTime: 4237275 | |
| - CompileTime: 68426196 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 231464689 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 29901104 | |
| - TotalTime: 330448696 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 6590 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 1181507795 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 22732 | |
| - GetNewBlockTime: 133607 | |
| - GetResultsTime: 2377 | |
| - HTResizeTime: 2931 | |
| - HashBuckets: 1024 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 5 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2462848 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 1181435217 | |
| - UnpinTime: 915 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 935 | |
| - ConvertRowBatchTime: 19104 | |
| - DeserializeRowBatchTimer: 59649 | |
| - FirstBatchArrivalWaitTime: 425592879 | |
| - InactiveTotalTime: 1179834027 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 17 | |
| - RowsReturnedRate: 14 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 1179970532 | |
| Instance 284259db5f764ed8:1c (host=cdh14.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 77750650 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 1264581715 | |
| - TotalNetworkSendTime: 182 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 1472144552 | |
| - TotalThreadsSysTime: 4000000 | |
| - TotalThreadsUserTime: 208000000 | |
| - TotalThreadsVoluntaryContextSwitches: 22 | |
| - TotalTime: 1515291523 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 188670 | |
| - ExecTreeExecTime: 1796 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 1471994316 | |
| - ExecTreeOpenTime: 1265337655 | |
| - PrepareTime: 43043766 | |
| - ExecTreePrepareTime: 671118 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 18053 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4072947 | |
| - CompileTime: 42515298 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 162952808 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 39596588 | |
| - TotalTime: 245799072 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 347 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 1266007039 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 6154 | |
| - GetNewBlockTime: 173555 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 3756 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 1265955835 | |
| - UnpinTime: 1000 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 370 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 1264578927 | |
| - InactiveTotalTime: 1264579710 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 1264583601 | |
| Instance 284259db5f764ed8:1d (host=cdh8.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 60202625 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 1245982176 | |
| - TotalNetworkSendTime: 348 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 1474676675 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 232000000 | |
| - TotalThreadsVoluntaryContextSwitches: 56 | |
| - TotalTime: 1515200144 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 264985 | |
| - ExecTreeExecTime: 4104 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 1474467100 | |
| - ExecTreeOpenTime: 1246990096 | |
| - PrepareTime: 40372867 | |
| - ExecTreePrepareTime: 582741 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 22001 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4969728 | |
| - CompileTime: 55612448 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 170238498 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 36371836 | |
| - TotalTime: 263036232 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 557 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 1247570285 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 7127 | |
| - GetNewBlockTime: 145451 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 4273 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 1247485783 | |
| - UnpinTime: 895 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 433 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 1245978628 | |
| - InactiveTotalTime: 1245979722 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 1245984692 | |
| Instance 284259db5f764ed8:19 (host=cdh17.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 62164859 | |
| - RowsProduced: 2 | |
| - TotalNetworkReceiveTime: 1287457229 | |
| - TotalNetworkSendTime: 137649 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 1488637265 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 204000000 | |
| - TotalThreadsVoluntaryContextSwitches: 58 | |
| - TotalTime: 1515183430 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 376456 | |
| - ExecTreeExecTime: 2594 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 1488294602 | |
| - ExecTreeOpenTime: 1288604652 | |
| - PrepareTime: 26427323 | |
| - ExecTreePrepareTime: 533841 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 81 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 6012470 | |
| - OverallThroughput: 812429 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 2 | |
| - SerializeBatchTime: 74414 | |
| - TotalTime: 99701 | |
| - TransmitDataRPCTime: 13472 | |
| - UncompressedRowBatchSize: 97 | |
| CodeGen | |
| - CodegenTime: 2830311 | |
| - CompileTime: 48675236 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 150061275 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 23964813 | |
| - TotalTime: 223216586 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 15057 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 2 | |
| - RowsReturnedRate: 1 | |
| - TotalTime: 1289135087 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 24963 | |
| - GetNewBlockTime: 120506 | |
| - GetResultsTime: 6327 | |
| - HTResizeTime: 3210 | |
| - HashBuckets: 2048 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 2 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2462848 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 2 | |
| - RowsReturnedRate: 1 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 1289050516 | |
| - UnpinTime: 744 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 1266 | |
| - ConvertRowBatchTime: 25478 | |
| - DeserializeRowBatchTimer: 75089 | |
| - FirstBatchArrivalWaitTime: 533049132 | |
| - InactiveTotalTime: 1287242333 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 34 | |
| - RowsReturnedRate: 26 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 1287525630 | |
| Instance 284259db5f764ed8:1a (host=cdh10.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 88374970 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 1245293300 | |
| - TotalNetworkSendTime: 136 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 1 | |
| - TotalThreadsTotalWallClockTime: 1483613294 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 240000000 | |
| - TotalThreadsVoluntaryContextSwitches: 34 | |
| - TotalTime: 1514623406 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 122914 | |
| - ExecTreeExecTime: 2163 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 1483525778 | |
| - ExecTreeOpenTime: 1246139606 | |
| - PrepareTime: 30935068 | |
| - ExecTreePrepareTime: 489659 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 12790 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4142887 | |
| - CompileTime: 48389648 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 186595472 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 29079357 | |
| - TotalTime: 264669932 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 273 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 1246627005 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 3381 | |
| - GetNewBlockTime: 152065 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 2307 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 1246550525 | |
| - UnpinTime: 741 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 174 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 1245291528 | |
| - InactiveTotalTime: 1245292026 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 1245294314 | |
| Instance 284259db5f764ed8:17 (host=cdh2.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 75074390 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 1223480460 | |
| - TotalNetworkSendTime: 344 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 4 | |
| - TotalThreadsTotalWallClockTime: 1472759592 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 252000000 | |
| - TotalThreadsVoluntaryContextSwitches: 27 | |
| - TotalTime: 1514338032 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 290256 | |
| - ExecTreeExecTime: 3568 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 1472524540 | |
| - ExecTreeOpenTime: 1224524624 | |
| - PrepareTime: 41432956 | |
| - ExecTreePrepareTime: 576772 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 22188 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 5843968 | |
| - CompileTime: 70714432 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 175681240 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 37100600 | |
| - TotalTime: 284281188 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 824 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 1225099620 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 6496 | |
| - GetNewBlockTime: 145176 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 3772 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 1225020296 | |
| - UnpinTime: 1172 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 368 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 1223473088 | |
| - InactiveTotalTime: 1223474204 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 1223482480 | |
| Instance 284259db5f764ed8:16 (host=cdh1.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 80617744 | |
| - RowsProduced: 1 | |
| - TotalNetworkReceiveTime: 1262921964 | |
| - TotalNetworkSendTime: 276876 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 1474500944 | |
| - TotalThreadsSysTime: 8000000 | |
| - TotalThreadsUserTime: 204000000 | |
| - TotalThreadsVoluntaryContextSwitches: 30 | |
| - TotalTime: 1514028504 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 533628 | |
| - ExecTreeExecTime: 3744 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 1474017752 | |
| - ExecTreeOpenTime: 1264038132 | |
| - PrepareTime: 39390828 | |
| - ExecTreePrepareTime: 588404 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 34 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 881925 | |
| - OverallThroughput: 457210 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 1 | |
| - SerializeBatchTime: 12748 | |
| - TotalTime: 74364 | |
| - TransmitDataRPCTime: 38552 | |
| - UncompressedRowBatchSize: 42 | |
| CodeGen | |
| - CodegenTime: 4781376 | |
| - CompileTime: 40567532 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 167901512 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 35408604 | |
| - TotalTime: 244632716 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 15364 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 1264625084 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 30660 | |
| - GetNewBlockTime: 133252 | |
| - GetResultsTime: 3328 | |
| - HTResizeTime: 4520 | |
| - HashBuckets: 1024 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 5 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2462848 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 1264517004 | |
| - UnpinTime: 1136 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 577 | |
| - ConvertRowBatchTime: 27584 | |
| - DeserializeRowBatchTimer: 216420 | |
| - FirstBatchArrivalWaitTime: 508545984 | |
| - InactiveTotalTime: 1262801832 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 17 | |
| - RowsReturnedRate: 13 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 1262994224 | |
| Instance 284259db5f764ed8:18 (host=cdh3.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 85488197 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 1254369192 | |
| - TotalNetworkSendTime: 320 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 1474151550 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 220000000 | |
| - TotalThreadsVoluntaryContextSwitches: 186 | |
| - TotalTime: 1513872558 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 222418 | |
| - ExecTreeExecTime: 3188 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 1473981952 | |
| - ExecTreeOpenTime: 1255334428 | |
| - PrepareTime: 39589532 | |
| - ExecTreePrepareTime: 533328 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 20854 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 5086888 | |
| - CompileTime: 50924588 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 166113970 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 35809530 | |
| - TotalTime: 253609052 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 682 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 1255865066 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 6868 | |
| - GetNewBlockTime: 124862 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 4012 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 1255782874 | |
| - UnpinTime: 1102 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 372 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 1254366212 | |
| - InactiveTotalTime: 1254367136 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 1254371200 | |
| Instance 284259db5f764ed8:14 (host=cdh7.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 61880838 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 1263139734 | |
| - TotalNetworkSendTime: 393 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 1 | |
| - TotalThreadsTotalWallClockTime: 1474253752 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 212000000 | |
| - TotalThreadsVoluntaryContextSwitches: 58 | |
| - TotalTime: 1513557241 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 304126 | |
| - ExecTreeExecTime: 3954 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 1474008372 | |
| - ExecTreeOpenTime: 1264083512 | |
| - PrepareTime: 39150806 | |
| - ExecTreePrepareTime: 622763 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 20280 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4806884 | |
| - CompileTime: 41480174 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 167070480 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 35349967 | |
| - TotalTime: 244699295 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 874 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 1264705111 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 6500 | |
| - GetNewBlockTime: 137238 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 3573 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 1264625568 | |
| - UnpinTime: 1114 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 490 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 1263136088 | |
| - InactiveTotalTime: 1263137163 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 1263141727 | |
| Instance 284259db5f764ed8:15 (host=cdh5.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 72591547 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 1234494576 | |
| - TotalNetworkSendTime: 270 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 1473292674 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 240000000 | |
| - TotalThreadsVoluntaryContextSwitches: 73 | |
| - TotalTime: 1513120308 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 182806 | |
| - ExecTreeExecTime: 4092 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 1473165124 | |
| - ExecTreeOpenTime: 1235349564 | |
| - PrepareTime: 39702318 | |
| - ExecTreePrepareTime: 831174 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 21252 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4627896 | |
| - CompileTime: 42883300 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 191942176 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 37122554 | |
| - TotalTime: 272762736 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 664 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 1236180222 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 5820 | |
| - GetNewBlockTime: 207116 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 3158 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 1236097306 | |
| - UnpinTime: 1150 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 568 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 1234491090 | |
| - InactiveTotalTime: 1234492040 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 1234496804 | |
| Instance 284259db5f764ed8:13 (host=cdh6.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 36179395 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 1254676770 | |
| - TotalNetworkSendTime: 300 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 1472255918 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 220000000 | |
| - TotalThreadsVoluntaryContextSwitches: 99 | |
| - TotalTime: 1513031386 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 322744 | |
| - ExecTreeExecTime: 3692 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 1471991802 | |
| - ExecTreeOpenTime: 1255599158 | |
| - PrepareTime: 40619390 | |
| - ExecTreePrepareTime: 580026 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 23188 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4928150 | |
| - CompileTime: 42321400 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 172345904 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 36575366 | |
| - TotalTime: 252031854 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 730 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 1256178216 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 6116 | |
| - GetNewBlockTime: 141806 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 4152 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 1256089280 | |
| - UnpinTime: 1156 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 496 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 1254673682 | |
| - InactiveTotalTime: 1254674536 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 1254678860 | |
| Instance 284259db5f764ed8:12 (host=cdh4.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 53579662 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 1262079904 | |
| - TotalNetworkSendTime: 364 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 1472310382 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 212000000 | |
| - TotalThreadsVoluntaryContextSwitches: 23 | |
| - TotalTime: 1513015734 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 287048 | |
| - ExecTreeExecTime: 4218 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 1472087842 | |
| - ExecTreeOpenTime: 1263303674 | |
| - PrepareTime: 40539166 | |
| - ExecTreePrepareTime: 595776 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 23616 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4927374 | |
| - CompileTime: 40151912 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 167024316 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 36530066 | |
| - TotalTime: 244487802 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 520 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 1263898354 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 7062 | |
| - GetNewBlockTime: 139564 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 4188 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 1263810022 | |
| - UnpinTime: 1152 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 454 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 1262076420 | |
| - InactiveTotalTime: 1262077472 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 1262082046 | |
| Averaged Fragment F00 | |
| split sizes: min: 826.05 MB, max: 5.78 GB, avg: 2.71 GB, stddev: 1.39 GB | |
| completion times: min:754.823ms max:1s513ms mean: 1s059ms stddev:258.326ms | |
| execution rates: min:1.01 GB/sec max:3.82 GB/sec mean:2.44 GB/sec stddev:777.26 MB/sec | |
| num instances: 17 | |
| - AverageThreadTokens: 7.352941176470589 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 68738938 | |
| - PerHostPeakMemUsage: 71145200 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1093642 | |
| - TotalStorageWaitTime: 172262789 | |
| - TotalThreadsInvoluntaryContextSwitches: 115 | |
| - TotalThreadsTotalWallClockTime: 8256669081 | |
| - TotalThreadsSysTime: 535294117 | |
| - TotalThreadsUserTime: 6699764705 | |
| - TotalThreadsVoluntaryContextSwitches: 758 | |
| - TotalTime: 1058710450 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 912643069 | |
| - ExecTreeExecTime: 908288665 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 109071742 | |
| - ExecTreeOpenTime: 120762 | |
| - PrepareTime: 36958753 | |
| - ExecTreePrepareTime: 637022 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 261 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2571364 | |
| - OverallThroughput: 959905 | |
| - PeakMemoryUsage: 106427 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 124895 | |
| - TotalTime: 283116 | |
| - TransmitDataRPCTime: 111570 | |
| - UncompressedRowBatchSize: 337 | |
| CodeGen | |
| - CodegenTime: 3898186 | |
| - CompileTime: 28697505 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 78801478 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 31729450 | |
| - TotalTime: 139932876 | |
| AGGREGATION_NODE (id=1) | |
| - GetNewBlockTime: 87111 | |
| - GetResultsTime: 22647 | |
| - HTResizeTime: 398786 | |
| - HashBuckets: 8673 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053130 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 8 | |
| - StreamingTime: 342458778 | |
| - TotalTime: 909039597 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 7.019607843137256 | |
| - BytesRead: 89660474 | |
| - BytesReadDataNodeCache: 85358515 | |
| - BytesReadLocal: 89660474 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 89660474 | |
| - DecompressionTime: 199506664 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 20 | |
| - NumScannerThreadsStarted: 12 | |
| - PeakMemoryUsage: 63945604 | |
| - PerReadThreadRawHdfsThroughput: 1662310507 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 557108353 | |
| - RowBatchQueuePutWaitTime: 3995350 | |
| - RowsRead: 112446491 | |
| - RowsReturned: 859940 | |
| - RowsReturnedRate: 1712064 | |
| - ScanRangesComplete: 20 | |
| - ScannerThreadsInvoluntaryContextSwitches: 100 | |
| - ScannerThreadsTotalWallClockTime: 7235030233 | |
| - MaterializeTupleTime(*): 6584797901 | |
| - ScannerThreadsSysTime: 291529411 | |
| - ScannerThreadsUserTime: 6479529411 | |
| - ScannerThreadsVoluntaryContextSwitches: 245 | |
| - TotalRawHdfsReadTime(*): 2908589 | |
| - TotalReadThroughput: 87103617 | |
| - TotalTime: 563733811 | |
| Fragment F00 | |
| Instance 284259db5f764ed8:9 (host=cdh10.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:42/5.78 GB | |
| - AverageThreadTokens: 8.333333333333334 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 85968292 | |
| - PerHostPeakMemUsage: 88374970 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1277435 | |
| - TotalStorageWaitTime: 180368627 | |
| - TotalThreadsInvoluntaryContextSwitches: 515 | |
| - TotalThreadsTotalWallClockTime: 16387738550 | |
| - TotalThreadsSysTime: 888000000 | |
| - TotalThreadsUserTime: 14236000000 | |
| - TotalThreadsVoluntaryContextSwitches: 1662 | |
| - TotalTime: 1511869908 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 1372304205 | |
| - ExecTreeExecTime: 1367659359 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 108329789 | |
| - ExecTreeOpenTime: 160756 | |
| - PrepareTime: 31206397 | |
| - ExecTreePrepareTime: 547234 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 296 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2465454 | |
| - OverallThroughput: 886646 | |
| - PeakMemoryUsage: 109560 | |
| - RowsReturned: 8 | |
| - SerializeBatchTime: 176590 | |
| - TotalTime: 333842 | |
| - TransmitDataRPCTime: 120059 | |
| - UncompressedRowBatchSize: 376 | |
| CodeGen | |
| - CodegenTime: 3704336 | |
| - CompileTime: 24236580 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 82102156 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 27815145 | |
| - TotalTime: 134759255 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 70852 | |
| - GetResultsTime: 18370 | |
| - HTResizeTime: 452269 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053234 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 5 | |
| - StreamingTime: 643385085 | |
| - TotalTime: 1368360450 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:42/5.78 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 42 out of 42 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
| File Formats: PARQUET/SNAPPY:42 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 11.0 | |
| - BytesRead: 189417378 | |
| - BytesReadDataNodeCache: 189417378 | |
| - BytesReadLocal: 189417378 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 189417378 | |
| - DecompressionTime: 413764677 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 42 | |
| - NumScannerThreadsStarted: 13 | |
| - PeakMemoryUsage: 80866921 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 708402216 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 239919598 | |
| - RowsReturned: 2322789 | |
| - RowsReturnedRate: 3227910 | |
| - ScanRangesComplete: 42 | |
| - ScannerThreadsInvoluntaryContextSwitches: 440 | |
| - ScannerThreadsTotalWallClockTime: 14907182971 | |
| - MaterializeTupleTime(*): 13942306026 | |
| - ScannerThreadsSysTime: 460000000 | |
| - ScannerThreadsUserTime: 13896000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 423 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 126278252 | |
| - TotalTime: 719595329 | |
| Instance 284259db5f764ed8:e (host=cdh13.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/3.54 GB | |
| - AverageThreadTokens: 5.666666666666667 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 76488428 | |
| - PerHostPeakMemUsage: 78895122 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1207100 | |
| - TotalStorageWaitTime: 119067376 | |
| - TotalThreadsInvoluntaryContextSwitches: 365 | |
| - TotalThreadsTotalWallClockTime: 11382778305 | |
| - TotalThreadsSysTime: 704000000 | |
| - TotalThreadsUserTime: 9472000000 | |
| - TotalThreadsVoluntaryContextSwitches: 1015 | |
| - TotalTime: 1471104880 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 1324163733 | |
| - ExecTreeExecTime: 1319410601 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 109727004 | |
| - ExecTreeOpenTime: 113075 | |
| - PrepareTime: 37177399 | |
| - ExecTreePrepareTime: 667856 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2053203 | |
| - OverallThroughput: 886675 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 117608 | |
| - TotalTime: 283080 | |
| - TransmitDataRPCTime: 122248 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 3796238 | |
| - CompileTime: 28553052 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 79743810 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 32314761 | |
| - TotalTime: 141340680 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 73518 | |
| - GetResultsTime: 23958 | |
| - HTResizeTime: 295144 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053159 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 5 | |
| - StreamingTime: 474650345 | |
| - TotalTime: 1320184545 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/3.54 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:28 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 7.0 | |
| - BytesRead: 116908889 | |
| - BytesReadDataNodeCache: 116908889 | |
| - BytesReadLocal: 116908889 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 116908889 | |
| - DecompressionTime: 276952940 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 28 | |
| - NumScannerThreadsStarted: 11 | |
| - PeakMemoryUsage: 71413555 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 835088900 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 145695183 | |
| - RowsReturned: 1015783 | |
| - RowsReturnedRate: 1205689 | |
| - ScanRangesComplete: 28 | |
| - ScannerThreadsInvoluntaryContextSwitches: 342 | |
| - ScannerThreadsTotalWallClockTime: 9948994549 | |
| - MaterializeTupleTime(*): 9298293386 | |
| - ScannerThreadsSysTime: 380000000 | |
| - ScannerThreadsUserTime: 9204000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 279 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 77939259 | |
| - TotalTime: 842491354 | |
| Instance 284259db5f764ed8:d (host=cdh16.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/5.19 GB | |
| - AverageThreadTokens: 8.666666666666666 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 76450128 | |
| - PerHostPeakMemUsage: 78865118 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1128210 | |
| - TotalStorageWaitTime: 114256308 | |
| - TotalThreadsInvoluntaryContextSwitches: 49 | |
| - TotalThreadsTotalWallClockTime: 13299406854 | |
| - TotalThreadsSysTime: 892000000 | |
| - TotalThreadsUserTime: 11320000000 | |
| - TotalThreadsVoluntaryContextSwitches: 976 | |
| - TotalTime: 1416769846 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 1299822452 | |
| - ExecTreeExecTime: 1295277978 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 90862128 | |
| - ExecTreeOpenTime: 118915 | |
| - PrepareTime: 26064378 | |
| - ExecTreePrepareTime: 429511 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 253 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2864226 | |
| - OverallThroughput: 1143756 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 105878 | |
| - TotalTime: 221201 | |
| - TransmitDataRPCTime: 88331 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 2535706 | |
| - CompileTime: 27156418 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 62651321 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 22928845 | |
| - TotalTime: 113203811 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 53566 | |
| - GetResultsTime: 18980 | |
| - HTResizeTime: 506695 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053145 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 5 | |
| - StreamingTime: 525970895 | |
| - TotalTime: 1295820537 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/5.19 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:28 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 7.666666666666667 | |
| - BytesRead: 171943487 | |
| - BytesReadDataNodeCache: 171943487 | |
| - BytesReadLocal: 171943487 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 171943487 | |
| - DecompressionTime: 331567255 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 28 | |
| - NumScannerThreadsStarted: 11 | |
| - PeakMemoryUsage: 70832169 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 759267830 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 213352310 | |
| - RowsReturned: 758771 | |
| - RowsReturnedRate: 990032 | |
| - ScanRangesComplete: 28 | |
| - ScannerThreadsInvoluntaryContextSwitches: 28 | |
| - ScannerThreadsTotalWallClockTime: 11908811019 | |
| - MaterializeTupleTime(*): 11229816861 | |
| - ScannerThreadsSysTime: 456000000 | |
| - ScannerThreadsUserTime: 11124000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 354 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 114628991 | |
| - TotalTime: 766409957 | |
| Instance 284259db5f764ed8:b (host=cdh14.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:25/3.70 GB | |
| - AverageThreadTokens: 9.666666666666666 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 75343972 | |
| - PerHostPeakMemUsage: 77750650 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1116608 | |
| - TotalStorageWaitTime: 102373020 | |
| - TotalThreadsInvoluntaryContextSwitches: 23 | |
| - TotalThreadsTotalWallClockTime: 11225885528 | |
| - TotalThreadsSysTime: 744000000 | |
| - TotalThreadsUserTime: 9428000000 | |
| - TotalThreadsVoluntaryContextSwitches: 909 | |
| - TotalTime: 1362623977 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 1196301950 | |
| - ExecTreeExecTime: 1191726806 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 121706542 | |
| - ExecTreeOpenTime: 110558 | |
| - PrepareTime: 44581323 | |
| - ExecTreePrepareTime: 665925 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 253 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2223491 | |
| - OverallThroughput: 898683 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 113091 | |
| - TotalTime: 281523 | |
| - TransmitDataRPCTime: 113785 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4046246 | |
| - CompileTime: 30275699 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 89967676 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 39305951 | |
| - TotalTime: 160380187 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 77129 | |
| - GetResultsTime: 23031 | |
| - HTResizeTime: 484084 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053134 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 5 | |
| - StreamingTime: 448207777 | |
| - TotalTime: 1192496307 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:25/3.70 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 25 out of 25 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:25 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 8.666666666666666 | |
| - BytesRead: 121434677 | |
| - BytesReadDataNodeCache: 121434677 | |
| - BytesReadLocal: 121434677 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 121434677 | |
| - DecompressionTime: 281402824 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 25 | |
| - NumScannerThreadsStarted: 11 | |
| - PeakMemoryUsage: 70877627 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 734973141 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 153042338 | |
| - RowsReturned: 797175 | |
| - RowsReturnedRate: 1075160 | |
| - ScanRangesComplete: 25 | |
| - ScannerThreadsInvoluntaryContextSwitches: 22 | |
| - ScannerThreadsTotalWallClockTime: 9907937999 | |
| - MaterializeTupleTime(*): 9292599939 | |
| - ScannerThreadsSysTime: 432000000 | |
| - ScannerThreadsUserTime: 9156000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 285 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 80956451 | |
| - TotalTime: 741447222 | |
| Instance 284259db5f764ed8:11 (host=cdh11.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/4.39 GB | |
| - AverageThreadTokens: 6.666666666666667 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 87553552 | |
| - PerHostPeakMemUsage: 89977654 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1381523 | |
| - TotalStorageWaitTime: 164471046 | |
| - TotalThreadsInvoluntaryContextSwitches: 259 | |
| - TotalThreadsTotalWallClockTime: 12324168314 | |
| - TotalThreadsSysTime: 748000000 | |
| - TotalThreadsUserTime: 10420000000 | |
| - TotalThreadsVoluntaryContextSwitches: 998 | |
| - TotalTime: 1337970737 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 1197385266 | |
| - ExecTreeExecTime: 1192446983 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 103671939 | |
| - ExecTreeOpenTime: 107514 | |
| - PrepareTime: 36876582 | |
| - ExecTreePrepareTime: 704340 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 296 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2337629 | |
| - OverallThroughput: 1101850 | |
| - PeakMemoryUsage: 109560 | |
| - RowsReturned: 8 | |
| - SerializeBatchTime: 104946 | |
| - TotalTime: 268639 | |
| - TransmitDataRPCTime: 126624 | |
| - UncompressedRowBatchSize: 376 | |
| CodeGen | |
| - CodegenTime: 3742156 | |
| - CompileTime: 26262229 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 76044859 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 32468765 | |
| - TotalTime: 135477098 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 78663 | |
| - GetResultsTime: 22400 | |
| - HTResizeTime: 291061 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053163 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 6 | |
| - StreamingTime: 504478444 | |
| - TotalTime: 1193251716 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:31/4.39 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
| File Formats: PARQUET/SNAPPY:31 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 8.5 | |
| - BytesRead: 146110897 | |
| - BytesReadDataNodeCache: 146110897 | |
| - BytesReadLocal: 146110897 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 146110897 | |
| - DecompressionTime: 310390528 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 31 | |
| - NumScannerThreadsStarted: 13 | |
| - PeakMemoryUsage: 82531175 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 678310275 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 183618453 | |
| - RowsReturned: 1044531 | |
| - RowsReturnedRate: 1523908 | |
| - ScanRangesComplete: 31 | |
| - ScannerThreadsInvoluntaryContextSwitches: 235 | |
| - ScannerThreadsTotalWallClockTime: 11023253097 | |
| - MaterializeTupleTime(*): 10228329007 | |
| - ScannerThreadsSysTime: 368000000 | |
| - ScannerThreadsUserTime: 10176000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 372 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 97407264 | |
| - TotalTime: 685428758 | |
| Instance 284259db5f764ed8:f (host=cdh15.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/3.70 GB | |
| - AverageThreadTokens: 9.5 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 92637868 | |
| - PerHostPeakMemUsage: 95044562 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 874159 | |
| - TotalStorageWaitTime: 179110398 | |
| - TotalThreadsInvoluntaryContextSwitches: 24 | |
| - TotalThreadsTotalWallClockTime: 10876579273 | |
| - TotalThreadsSysTime: 652000000 | |
| - TotalThreadsUserTime: 9100000000 | |
| - TotalThreadsVoluntaryContextSwitches: 865 | |
| - TotalTime: 1213090603 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 1067320418 | |
| - ExecTreeExecTime: 1062731834 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 108982089 | |
| - ExecTreeOpenTime: 109557 | |
| - PrepareTime: 36751457 | |
| - ExecTreePrepareTime: 688545 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 5385572 | |
| - OverallThroughput: 1270210 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 111374 | |
| - TotalTime: 197605 | |
| - TransmitDataRPCTime: 46606 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 3690736 | |
| - CompileTime: 28872411 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 78842984 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 32085473 | |
| - TotalTime: 140511454 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 77873 | |
| - GetResultsTime: 22934 | |
| - HTResizeTime: 336684 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053166 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 6 | |
| - StreamingTime: 403643248 | |
| - TotalTime: 1063521899 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/3.70 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:28 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 8.5 | |
| - BytesRead: 123174733 | |
| - BytesReadDataNodeCache: 123174733 | |
| - BytesReadLocal: 123174733 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 123174733 | |
| - DecompressionTime: 267344488 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 28 | |
| - NumScannerThreadsStarted: 13 | |
| - PeakMemoryUsage: 87202188 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 648830840 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 154045109 | |
| - RowsReturned: 937411 | |
| - RowsReturnedRate: 1428679 | |
| - ScanRangesComplete: 28 | |
| - ScannerThreadsInvoluntaryContextSwitches: 18 | |
| - ScannerThreadsTotalWallClockTime: 9700349145 | |
| - MaterializeTupleTime(*): 8941855389 | |
| - ScannerThreadsSysTime: 336000000 | |
| - ScannerThreadsUserTime: 8884000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 264 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 123174733 | |
| - TotalTime: 656137924 | |
| Instance 284259db5f764ed8:4 (host=cdh5.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.52 GB | |
| - AverageThreadTokens: 5.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 70184842 | |
| - PerHostPeakMemUsage: 72591547 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 979476 | |
| - TotalStorageWaitTime: 100212178 | |
| - TotalThreadsInvoluntaryContextSwitches: 15 | |
| - TotalThreadsTotalWallClockTime: 5440265644 | |
| - TotalThreadsSysTime: 416000000 | |
| - TotalThreadsUserTime: 4152000000 | |
| - TotalThreadsVoluntaryContextSwitches: 533 | |
| - TotalTime: 1038038902 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 866050620 | |
| - ExecTreeExecTime: 861583800 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 130150370 | |
| - ExecTreeOpenTime: 115132 | |
| - PrepareTime: 41790902 | |
| - ExecTreePrepareTime: 796252 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 250 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1919002 | |
| - OverallThroughput: 769808 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 141354 | |
| - TotalTime: 324756 | |
| - TransmitDataRPCTime: 130276 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4905872 | |
| - CompileTime: 32019336 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 95731284 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 34377648 | |
| - TotalTime: 163173184 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 99560 | |
| - GetResultsTime: 13236 | |
| - HTResizeTime: 438924 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053079 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 8 | |
| - StreamingTime: 231017556 | |
| - TotalTime: 862488936 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.52 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:10 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 4.0 | |
| - BytesRead: 50477353 | |
| - BytesReadDataNodeCache: 26023676 | |
| - BytesReadLocal: 50477353 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 50477353 | |
| - DecompressionTime: 125177604 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 1 | |
| - NumRowGroups: 10 | |
| - NumScannerThreadsStarted: 10 | |
| - PeakMemoryUsage: 65975786 | |
| - PerReadThreadRawHdfsThroughput: 3491430744 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 624186506 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 63821319 | |
| - RowsReturned: 303212 | |
| - RowsReturnedRate: 481713 | |
| - ScanRangesComplete: 10 | |
| - ScannerThreadsInvoluntaryContextSwitches: 14 | |
| - ScannerThreadsTotalWallClockTime: 4444127478 | |
| - MaterializeTupleTime(*): 4079433940 | |
| - ScannerThreadsSysTime: 252000000 | |
| - ScannerThreadsUserTime: 3944000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 190 | |
| - TotalRawHdfsReadTime(*): 14457498 | |
| - TotalReadThroughput: 50477353 | |
| - TotalTime: 629444656 | |
| Instance 284259db5f764ed8:c (host=cdh8.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:16/2.06 GB | |
| - AverageThreadTokens: 5.5 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 57795947 | |
| - PerHostPeakMemUsage: 60202625 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1403813 | |
| - TotalStorageWaitTime: 265120778 | |
| - TotalThreadsInvoluntaryContextSwitches: 37 | |
| - TotalThreadsTotalWallClockTime: 7032629337 | |
| - TotalThreadsSysTime: 536000000 | |
| - TotalThreadsUserTime: 5272000000 | |
| - TotalThreadsVoluntaryContextSwitches: 556 | |
| - TotalTime: 1004688448 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 852731726 | |
| - ExecTreeExecTime: 847772574 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 112124825 | |
| - ExecTreeOpenTime: 111598 | |
| - PrepareTime: 39795469 | |
| - ExecTreePrepareTime: 623337 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2013654 | |
| - OverallThroughput: 753032 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 149139 | |
| - TotalTime: 333319 | |
| - TransmitDataRPCTime: 124649 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4354762 | |
| - CompileTime: 28540785 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 81943888 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 33482224 | |
| - TotalTime: 144675149 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 102820 | |
| - GetResultsTime: 20560 | |
| - HTResizeTime: 224818 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053119 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 8 | |
| - StreamingTime: 286040987 | |
| - TotalTime: 848500455 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:16/2.06 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 16 out of 16 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:16 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 4.5 | |
| - BytesRead: 68019764 | |
| - BytesReadDataNodeCache: 68019764 | |
| - BytesReadLocal: 68019764 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 68019764 | |
| - DecompressionTime: 152860436 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 16 | |
| - NumScannerThreadsStarted: 16 | |
| - PeakMemoryUsage: 53670315 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 553807732 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 84294342 | |
| - RowsReturned: 528644 | |
| - RowsReturnedRate: 944109 | |
| - ScanRangesComplete: 16 | |
| - ScannerThreadsInvoluntaryContextSwitches: 37 | |
| - ScannerThreadsTotalWallClockTime: 6067845785 | |
| - MaterializeTupleTime(*): 5277698949 | |
| - ScannerThreadsSysTime: 312000000 | |
| - ScannerThreadsUserTime: 5088000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 196 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 68019764 | |
| - TotalTime: 559939411 | |
| Instance 284259db5f764ed8:1 (host=cdh4.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:14/1.67 GB | |
| - AverageThreadTokens: 6.5 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 51172984 | |
| - PerHostPeakMemUsage: 53579662 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1099076 | |
| - TotalStorageWaitTime: 203031988 | |
| - TotalThreadsInvoluntaryContextSwitches: 81 | |
| - TotalThreadsTotalWallClockTime: 5959965900 | |
| - TotalThreadsSysTime: 392000000 | |
| - TotalThreadsUserTime: 4480000000 | |
| - TotalThreadsVoluntaryContextSwitches: 545 | |
| - TotalTime: 931162088 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 776949208 | |
| - ExecTreeExecTime: 772372980 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 113430852 | |
| - ExecTreeOpenTime: 115380 | |
| - PrepareTime: 40737852 | |
| - ExecTreePrepareTime: 607052 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2071435 | |
| - OverallThroughput: 923248 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 94438 | |
| - TotalTime: 271866 | |
| - TransmitDataRPCTime: 121172 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4205778 | |
| - CompileTime: 28749686 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 83054194 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 33954700 | |
| - TotalTime: 146467030 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 99548 | |
| - GetResultsTime: 25536 | |
| - HTResizeTime: 239560 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053219 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 9 | |
| - StreamingTime: 241981030 | |
| - TotalTime: 773087502 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:14/1.67 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 14 out of 14 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:14 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 5.5 | |
| - BytesRead: 55110625 | |
| - BytesReadDataNodeCache: 55110625 | |
| - BytesReadLocal: 55110625 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 55110625 | |
| - DecompressionTime: 135121598 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 14 | |
| - NumScannerThreadsStarted: 14 | |
| - PeakMemoryUsage: 47147441 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 522450604 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 69434238 | |
| - RowsReturned: 549998 | |
| - RowsReturnedRate: 1040243 | |
| - ScanRangesComplete: 14 | |
| - ScannerThreadsInvoluntaryContextSwitches: 80 | |
| - ScannerThreadsTotalWallClockTime: 5069659490 | |
| - MaterializeTupleTime(*): 4391777540 | |
| - ScannerThreadsSysTime: 220000000 | |
| - ScannerThreadsUserTime: 4284000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 178 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 55110625 | |
| - TotalTime: 528720202 | |
| Instance 284259db5f764ed8:6 (host=cdh2.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:16/1.76 GB | |
| - AverageThreadTokens: 8.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 72675934 | |
| - PerHostPeakMemUsage: 75074390 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1590012 | |
| - TotalStorageWaitTime: 286202880 | |
| - TotalThreadsInvoluntaryContextSwitches: 40 | |
| - TotalThreadsTotalWallClockTime: 6158509964 | |
| - TotalThreadsSysTime: 428000000 | |
| - TotalThreadsUserTime: 4540000000 | |
| - TotalThreadsVoluntaryContextSwitches: 615 | |
| - TotalTime: 910083552 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 756980660 | |
| - ExecTreeExecTime: 751865960 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 114515696 | |
| - ExecTreeOpenTime: 125880 | |
| - PrepareTime: 38544324 | |
| - ExecTreePrepareTime: 622024 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 294 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1919862 | |
| - OverallThroughput: 737855 | |
| - PeakMemoryUsage: 109560 | |
| - RowsReturned: 8 | |
| - SerializeBatchTime: 189876 | |
| - TotalTime: 398452 | |
| - TransmitDataRPCTime: 153136 | |
| - UncompressedRowBatchSize: 376 | |
| CodeGen | |
| - CodegenTime: 4220856 | |
| - CompileTime: 29485076 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 83463428 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 32924156 | |
| - TotalTime: 146605188 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 104404 | |
| - GetResultsTime: 33524 | |
| - HTResizeTime: 250228 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053117 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 10 | |
| - StreamingTime: 248594464 | |
| - TotalTime: 752605392 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:16/1.76 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 16 out of 16 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:16 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 7.0 | |
| - BytesRead: 58439798 | |
| - BytesReadDataNodeCache: 42075050 | |
| - BytesReadLocal: 58439798 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 58439798 | |
| - DecompressionTime: 142993372 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 1 | |
| - NumRowGroups: 16 | |
| - NumScannerThreadsStarted: 16 | |
| - PeakMemoryUsage: 66970549 | |
| - PerReadThreadRawHdfsThroughput: 5679711192 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 495464840 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 73272515 | |
| - RowsReturned: 699776 | |
| - RowsReturnedRate: 1395545 | |
| - ScanRangesComplete: 16 | |
| - ScannerThreadsInvoluntaryContextSwitches: 39 | |
| - ScannerThreadsTotalWallClockTime: 5287090528 | |
| - MaterializeTupleTime(*): 4497148984 | |
| - ScannerThreadsSysTime: 248000000 | |
| - ScannerThreadsUserTime: 4344000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 189 | |
| - TotalRawHdfsReadTime(*): 10289220 | |
| - TotalReadThroughput: 116879596 | |
| - TotalTime: 501435300 | |
| Instance 284259db5f764ed8:7 (host=cdh3.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:13/2.49 GB | |
| - AverageThreadTokens: 11.5 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 83081519 | |
| - PerHostPeakMemUsage: 85488197 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 987298 | |
| - TotalStorageWaitTime: 187617604 | |
| - TotalThreadsInvoluntaryContextSwitches: 35 | |
| - TotalThreadsTotalWallClockTime: 7828203838 | |
| - TotalThreadsSysTime: 536000000 | |
| - TotalThreadsUserTime: 6372000000 | |
| - TotalThreadsVoluntaryContextSwitches: 530 | |
| - TotalTime: 906381230 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 753675208 | |
| - ExecTreeExecTime: 749888930 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 113594244 | |
| - ExecTreeOpenTime: 115098 | |
| - PrepareTime: 39068950 | |
| - ExecTreePrepareTime: 626696 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 250 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1951661 | |
| - OverallThroughput: 805417 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 134988 | |
| - TotalTime: 310398 | |
| - TransmitDataRPCTime: 128096 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4335618 | |
| - CompileTime: 29783336 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 82211952 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 33655042 | |
| - TotalTime: 146397872 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 98942 | |
| - GetResultsTime: 29384 | |
| - HTResizeTime: 321066 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053248 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 9 | |
| - StreamingTime: 314149826 | |
| - TotalTime: 750624122 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:13/2.49 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:13 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 10.5 | |
| - BytesRead: 82516123 | |
| - BytesReadDataNodeCache: 82516123 | |
| - BytesReadLocal: 82516123 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 82516123 | |
| - DecompressionTime: 186205976 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 13 | |
| - NumScannerThreadsStarted: 13 | |
| - PeakMemoryUsage: 77985898 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 428556574 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 102158030 | |
| - RowsReturned: 362660 | |
| - RowsReturnedRate: 835497 | |
| - ScanRangesComplete: 13 | |
| - ScannerThreadsInvoluntaryContextSwitches: 30 | |
| - ScannerThreadsTotalWallClockTime: 6961002310 | |
| - MaterializeTupleTime(*): 6292602130 | |
| - ScannerThreadsSysTime: 288000000 | |
| - ScannerThreadsUserTime: 6176000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 219 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 82516123 | |
| - TotalTime: 434064664 | |
| Instance 284259db5f764ed8:5 (host=cdh1.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:16/2.29 GB | |
| - AverageThreadTokens: 10.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 78211066 | |
| - PerHostPeakMemUsage: 80617744 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 952068 | |
| - TotalStorageWaitTime: 315781032 | |
| - TotalThreadsInvoluntaryContextSwitches: 117 | |
| - TotalThreadsTotalWallClockTime: 7896555544 | |
| - TotalThreadsSysTime: 532000000 | |
| - TotalThreadsUserTime: 6260000000 | |
| - TotalThreadsVoluntaryContextSwitches: 391 | |
| - TotalTime: 900411132 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 752286664 | |
| - ExecTreeExecTime: 748154580 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 108837316 | |
| - ExecTreeOpenTime: 126328 | |
| - PrepareTime: 39249100 | |
| - ExecTreePrepareTime: 603252 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2233096 | |
| - OverallThroughput: 889932 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 116240 | |
| - TotalTime: 282044 | |
| - TransmitDataRPCTime: 112400 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4452156 | |
| - CompileTime: 28360964 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 78687144 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 33469112 | |
| - TotalTime: 141226680 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 97512 | |
| - GetResultsTime: 28268 | |
| - HTResizeTime: 453928 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053163 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 9 | |
| - StreamingTime: 349661384 | |
| - TotalTime: 748876932 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:16/2.29 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 16 out of 16 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:16 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 9.0 | |
| - BytesRead: 76946032 | |
| - BytesReadDataNodeCache: 69026665 | |
| - BytesReadLocal: 76946032 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 76946032 | |
| - DecompressionTime: 191045372 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 1 | |
| - NumRowGroups: 16 | |
| - NumScannerThreadsStarted: 16 | |
| - PeakMemoryUsage: 72818771 | |
| - PerReadThreadRawHdfsThroughput: 10694500394 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 390042336 | |
| - RowBatchQueuePutWaitTime: 1002056 | |
| - RowsRead: 94803287 | |
| - RowsReturned: 510661 | |
| - RowsReturnedRate: 1286321 | |
| - ScanRangesComplete: 16 | |
| - ScannerThreadsInvoluntaryContextSwitches: 90 | |
| - ScannerThreadsTotalWallClockTime: 7035514552 | |
| - MaterializeTupleTime(*): 6146776156 | |
| - ScannerThreadsSysTime: 296000000 | |
| - ScannerThreadsUserTime: 6032000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 202 | |
| - TotalRawHdfsReadTime(*): 7194916 | |
| - TotalReadThroughput: 76946032 | |
| - TotalTime: 396993376 | |
| Instance 284259db5f764ed8:a (host=cdh12.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:25/2.16 GB | |
| - AverageThreadTokens: 9.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 58417326 | |
| - PerHostPeakMemUsage: 60824020 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 624559 | |
| - TotalStorageWaitTime: 199629291 | |
| - TotalThreadsInvoluntaryContextSwitches: 361 | |
| - TotalThreadsTotalWallClockTime: 6411321914 | |
| - TotalThreadsSysTime: 396000000 | |
| - TotalThreadsUserTime: 5000000000 | |
| - TotalThreadsVoluntaryContextSwitches: 729 | |
| - TotalTime: 876982903 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 709178280 | |
| - ExecTreeExecTime: 705996858 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 136549352 | |
| - ExecTreeOpenTime: 159686 | |
| - PrepareTime: 31226508 | |
| - ExecTreePrepareTime: 553728 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 4606096 | |
| - OverallThroughput: 1453884 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 82357 | |
| - TotalTime: 172641 | |
| - TransmitDataRPCTime: 54493 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 3466795 | |
| - CompileTime: 40873555 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 93429512 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 28221562 | |
| - TotalTime: 163164761 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 62791 | |
| - GetResultsTime: 13860 | |
| - HTResizeTime: 458324 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053129 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 9 | |
| - StreamingTime: 279213080 | |
| - TotalTime: 706704503 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:25/2.16 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 25 out of 25 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
| File Formats: PARQUET/SNAPPY:25 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 8.0 | |
| - BytesRead: 71687193 | |
| - BytesReadDataNodeCache: 71687193 | |
| - BytesReadLocal: 71687193 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 71687193 | |
| - DecompressionTime: 152941922 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 25 | |
| - NumScannerThreadsStarted: 13 | |
| - PeakMemoryUsage: 54156028 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 419172095 | |
| - RowBatchQueuePutWaitTime: 66918901 | |
| - RowsRead: 90241798 | |
| - RowsReturned: 1020437 | |
| - RowsReturnedRate: 2399606 | |
| - ScanRangesComplete: 25 | |
| - ScannerThreadsInvoluntaryContextSwitches: 302 | |
| - ScannerThreadsTotalWallClockTime: 5565654617 | |
| - MaterializeTupleTime(*): 4910332703 | |
| - ScannerThreadsSysTime: 236000000 | |
| - ScannerThreadsUserTime: 4744000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 404 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 143374386 | |
| - TotalTime: 425251779 | |
| Instance 284259db5f764ed8:2 (host=cdh6.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:9/826.05 MB | |
| - AverageThreadTokens: 3.5 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 33780939 | |
| - PerHostPeakMemUsage: 36179395 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 890110 | |
| - TotalStorageWaitTime: 80639640 | |
| - TotalThreadsInvoluntaryContextSwitches: 7 | |
| - TotalThreadsTotalWallClockTime: 3059746284 | |
| - TotalThreadsSysTime: 320000000 | |
| - TotalThreadsUserTime: 2012000000 | |
| - TotalThreadsVoluntaryContextSwitches: 376 | |
| - TotalTime: 797335276 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 644913646 | |
| - ExecTreeExecTime: 640819832 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 109692548 | |
| - ExecTreeOpenTime: 111656 | |
| - PrepareTime: 42685722 | |
| - ExecTreePrepareTime: 638310 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2346232 | |
| - OverallThroughput: 889667 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 126344 | |
| - TotalTime: 282128 | |
| - TransmitDataRPCTime: 106980 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4678032 | |
| - CompileTime: 28582710 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 79438480 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 35568748 | |
| - TotalTime: 144359928 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 107906 | |
| - GetResultsTime: 36538 | |
| - HTResizeTime: 510032 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10052738 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 10 | |
| - StreamingTime: 138399156 | |
| - TotalTime: 641563222 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:9/826.05 MB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:9 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 2.5 | |
| - BytesRead: 26399312 | |
| - BytesReadDataNodeCache: 18189782 | |
| - BytesReadLocal: 26399312 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 26399312 | |
| - DecompressionTime: 67169578 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 1 | |
| - NumRowGroups: 9 | |
| - NumScannerThreadsStarted: 9 | |
| - PeakMemoryUsage: 30078058 | |
| - PerReadThreadRawHdfsThroughput: 4813519047 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 497018840 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 33799109 | |
| - RowsReturned: 368395 | |
| - RowsReturnedRate: 734677 | |
| - ScanRangesComplete: 9 | |
| - ScannerThreadsInvoluntaryContextSwitches: 7 | |
| - ScannerThreadsTotalWallClockTime: 2305203516 | |
| - MaterializeTupleTime(*): 2008079952 | |
| - ScannerThreadsSysTime: 212000000 | |
| - ScannerThreadsUserTime: 1864000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 101 | |
| - TotalRawHdfsReadTime(*): 5484410 | |
| - TotalReadThroughput: 26399312 | |
| - TotalTime: 501437618 | |
| Instance 284259db5f764ed8:3 (host=cdh7.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.28 GB | |
| - AverageThreadTokens: 4.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 59482382 | |
| - PerHostPeakMemUsage: 61880838 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1166871 | |
| - TotalStorageWaitTime: 113459160 | |
| - TotalThreadsInvoluntaryContextSwitches: 13 | |
| - TotalThreadsTotalWallClockTime: 4101917656 | |
| - TotalThreadsSysTime: 292000000 | |
| - TotalThreadsUserTime: 3036000000 | |
| - TotalThreadsVoluntaryContextSwitches: 416 | |
| - TotalTime: 786568665 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 673293547 | |
| - ExecTreeExecTime: 668799482 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 84752328 | |
| - ExecTreeOpenTime: 105764 | |
| - PrepareTime: 28478684 | |
| - ExecTreePrepareTime: 796136 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 250 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1646817 | |
| - OverallThroughput: 762839 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 117348 | |
| - TotalTime: 327723 | |
| - TransmitDataRPCTime: 151808 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 2820718 | |
| - CompileTime: 25044076 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 58629390 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 23045588 | |
| - TotalTime: 107179821 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 97355 | |
| - GetResultsTime: 22338 | |
| - HTResizeTime: 568761 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053153 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 10 | |
| - StreamingTime: 181040054 | |
| - TotalTime: 669695928 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.28 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:10 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 3.0 | |
| - BytesRead: 43032952 | |
| - BytesReadDataNodeCache: 26846975 | |
| - BytesReadLocal: 43032952 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 43032952 | |
| - DecompressionTime: 87035107 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 1 | |
| - NumRowGroups: 10 | |
| - NumScannerThreadsStarted: 10 | |
| - PeakMemoryUsage: 55452089 | |
| - PerReadThreadRawHdfsThroughput: 3580117244 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 482978679 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 53096875 | |
| - RowsReturned: 309503 | |
| - RowsReturnedRate: 635860 | |
| - ScanRangesComplete: 10 | |
| - ScannerThreadsInvoluntaryContextSwitches: 12 | |
| - ScannerThreadsTotalWallClockTime: 3343917292 | |
| - MaterializeTupleTime(*): 2984806505 | |
| - ScannerThreadsSysTime: 160000000 | |
| - ScannerThreadsUserTime: 2888000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 111 | |
| - TotalRawHdfsReadTime(*): 12019984 | |
| - TotalReadThroughput: 43032952 | |
| - TotalTime: 486746677 | |
| Instance 284259db5f764ed8:8 (host=cdh17.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:24/2.37 GB | |
| - AverageThreadTokens: 10.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 59758181 | |
| - PerHostPeakMemUsage: 62164859 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 958951 | |
| - TotalStorageWaitTime: 197702072 | |
| - TotalThreadsInvoluntaryContextSwitches: 30 | |
| - TotalThreadsTotalWallClockTime: 6557606680 | |
| - TotalThreadsSysTime: 332000000 | |
| - TotalThreadsUserTime: 5424000000 | |
| - TotalThreadsVoluntaryContextSwitches: 1332 | |
| - TotalTime: 779041998 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 660717582 | |
| - ExecTreeExecTime: 657286409 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 81644664 | |
| - ExecTreeOpenTime: 109904 | |
| - PrepareTime: 36655105 | |
| - ExecTreePrepareTime: 712232 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 295 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 3352463 | |
| - OverallThroughput: 1298592 | |
| - PeakMemoryUsage: 109560 | |
| - RowsReturned: 8 | |
| - SerializeBatchTime: 97368 | |
| - TotalTime: 227169 | |
| - TransmitDataRPCTime: 87995 | |
| - UncompressedRowBatchSize: 376 | |
| CodeGen | |
| - CodegenTime: 3308650 | |
| - CompileTime: 24599085 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 56055876 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 32147666 | |
| - TotalTime: 113557321 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 85797 | |
| - GetResultsTime: 14195 | |
| - HTResizeTime: 572611 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053147 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 12 | |
| - StreamingTime: 352354945 | |
| - TotalTime: 658102946 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:24/2.37 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 24 out of 24 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:24 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 9.0 | |
| - BytesRead: 75011561 | |
| - BytesReadDataNodeCache: 75011561 | |
| - BytesReadLocal: 75011561 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 75011561 | |
| - DecompressionTime: 168951774 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 24 | |
| - NumScannerThreadsStarted: 13 | |
| - PeakMemoryUsage: 54726882 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 290160022 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 97659250 | |
| - RowsReturned: 2670287 | |
| - RowsReturnedRate: 8870507 | |
| - ScanRangesComplete: 24 | |
| - ScannerThreadsInvoluntaryContextSwitches: 18 | |
| - ScannerThreadsTotalWallClockTime: 5815316968 | |
| - MaterializeTupleTime(*): 5152816771 | |
| - ScannerThreadsSysTime: 164000000 | |
| - ScannerThreadsUserTime: 5136000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 272 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 150023122 | |
| - TotalTime: 301029801 | |
| Instance 284259db5f764ed8:10 (host=cdh9.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.44 GB | |
| - AverageThreadTokens: 3.5 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 49558595 | |
| - PerHostPeakMemUsage: 51957051 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 954660 | |
| - TotalStorageWaitTime: 119424019 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 4420094803 | |
| - TotalThreadsSysTime: 292000000 | |
| - TotalThreadsUserTime: 3372000000 | |
| - TotalThreadsVoluntaryContextSwitches: 449 | |
| - TotalTime: 753953511 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 610857008 | |
| - ExecTreeExecTime: 607112348 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 105647939 | |
| - ExecTreeOpenTime: 136159 | |
| - PrepareTime: 37408665 | |
| - ExecTreePrepareTime: 546948 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2323299 | |
| - OverallThroughput: 846291 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 144285 | |
| - TotalTime: 296588 | |
| - TransmitDataRPCTime: 108036 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4004521 | |
| - CompileTime: 26462588 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 77627177 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 31635273 | |
| - TotalTime: 136379484 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 92663 | |
| - GetResultsTime: 17901 | |
| - HTResizeTime: 375188 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053112 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 11 | |
| - StreamingTime: 199010952 | |
| - TotalTime: 607787764 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.44 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:11 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 5.0 | |
| - BytesRead: 47597284 | |
| - BytesReadDataNodeCache: 47597284 | |
| - BytesReadLocal: 47597284 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 47597284 | |
| - DecompressionTime: 100687853 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 11 | |
| - NumScannerThreadsStarted: 11 | |
| - PeakMemoryUsage: 44369830 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 402130580 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 59336606 | |
| - RowsReturned: 418963 | |
| - RowsReturnedRate: 1029644 | |
| - ScanRangesComplete: 11 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 3703652647 | |
| - MaterializeTupleTime(*): 3266890079 | |
| - ScannerThreadsSysTime: 136000000 | |
| - ScannerThreadsUserTime: 3212000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 132 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 47597284 | |
| - TotalTime: 406900762 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment