-
-
Save momohuri/0b91468ae2526c4f5b0c4dba09172147 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Query (id=e14a6ed3f1a25055:c971300a00000000) | |
| Summary | |
| Session ID: 3642f4922c17707f:609063d97272509e | |
| Session Type: HIVESERVER2 | |
| HiveServer2 Protocol Version: V6 | |
| Start Time: 2017-03-09 15:17:40.333148000 | |
| End Time: | |
| Query Type: QUERY | |
| Query State: CREATED | |
| Query Status: OK | |
| Impala Version: impalad version 2.7.0-cdh5.10.0 RELEASE (build 785a073cd07e2540d521ecebb8b38161ccbd2aa2) | |
| User: hdfs | |
| Connected User: hdfs | |
| Delegated User: | |
| Network Address: ::ffff:172.16.0.221:49797 | |
| Default Db: wikia_prod | |
| Sql Statement: SELECT `ga_category`, count(*) `y` | |
| FROM | |
| (SELECT `ga_category` | |
| FROM trackingevent_batch | |
| WHERE `cuberon_event_date` BETWEEN "2017-01-31" AND "2017-02-14") Q1 | |
| WHERE (`ga_category` LIKE '%editor%' | |
| AND `ga_category` IS NOT NULL) | |
| GROUP BY `ga_category` | |
| ORDER BY `y` DESC LIMIT 10 | |
| Coordinator: cdh14.net.cuberonlabs.com:22000 | |
| Query Options (non default): QUERY_TIMEOUT_S=600,MT_DOP=0 | |
| Plan: | |
| ---------------- | |
| Estimated Per-Host Requirements: Memory=108.00MB VCores=2 | |
| PLAN-ROOT SINK | |
| | | |
| 05:MERGING-EXCHANGE [UNPARTITIONED] | |
| | order by: count(*) DESC | |
| | limit: 10 | |
| | hosts=17 per-host-mem=unavailable | |
| | tuple-ids=3 row-size=40B cardinality=10 | |
| | | |
| 02:TOP-N [LIMIT=10] | |
| | order by: count(*) DESC | |
| | hosts=17 per-host-mem=397B | |
| | tuple-ids=3 row-size=40B cardinality=10 | |
| | | |
| 04:AGGREGATE [FINALIZE] | |
| | output: count:merge(*) | |
| | group by: ga_category | |
| | hosts=17 per-host-mem=10.00MB | |
| | tuple-ids=2 row-size=40B cardinality=170 | |
| | | |
| 03:EXCHANGE [HASH(ga_category)] | |
| | hosts=17 per-host-mem=0B | |
| | tuple-ids=2 row-size=40B cardinality=170 | |
| | | |
| 01:AGGREGATE [STREAMING] | |
| | output: count(*) | |
| | group by: ga_category | |
| | hosts=17 per-host-mem=10.00MB | |
| | tuple-ids=2 row-size=40B cardinality=170 | |
| | | |
| 00:SCAN HDFS [wikia_prod.trackingevent_batch, RANDOM] | |
| partitions=14/14 files=361 size=49.59GB | |
| predicates: wikia_prod.trackingevent_batch.ga_category IS NOT NULL, wikia_prod.trackingevent_batch.ga_category LIKE '%editor%' | |
| table stats: 2058568297 rows total | |
| column stats: all | |
| hosts=17 per-host-mem=88.00MB | |
| tuple-ids=0 row-size=32B cardinality=205856830 | |
| ---------------- | |
| Estimated Per-Host Mem: 113246208 | |
| Estimated Per-Host VCores: 2 | |
| Request Pool: root.hdfs | |
| Admission result: Admitted immediately | |
| - ComputeScanRangeAssignmentTimer: 1176670 | |
| - InactiveTotalTime: 0 | |
| - TotalTime: 0 | |
| Planner Timeline | |
| Analysis finished: 1624394 | |
| Equivalence classes computed: 1769666 | |
| Single node plan created: 4232047 | |
| Runtime filters computed: 4278036 | |
| Distributed plan created: 4659575 | |
| Lineage info computed: 4881735 | |
| Planning finished: 7853558 | |
| Query Timeline | |
| Query submitted: 209673 | |
| Planning finished: 31390227 | |
| Submit for admission: 33675933 | |
| Completed admission: 34264796 | |
| Ready to start 35 fragment instances: 34729252 | |
| All 35 fragment instances started: 45147943 | |
| Rows available: 3820596755 | |
| First row fetched: 4198208086 | |
| ImpalaServer | |
| - ClientFetchWaitTimer: 377621079 | |
| - InactiveTotalTime: 0 | |
| - RowMaterializationTimer: 4631348 | |
| - TotalTime: 0 | |
| Execution Profile e14a6ed3f1a25055:c971300a00000000 | |
| Number of filters: 0 | |
| Filter routing table: | |
| ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled | |
| ---------------------------------------------------------------------------------------------------------------------------- | |
| Fragment instance start latencies: Count: 35, 25th %-ile: 1ms, 50th %-ile: 2ms, 75th %-ile: 3ms, 90th %-ile: 3ms, 95th %-ile: 4ms, 99.9th %-ile: 4ms | |
| Per Node Peak Memory Usage: cdh11.net.cuberonlabs.com:22000(42.87 MB) cdh13.net.cuberonlabs.com:22000(57.45 MB) cdh16.net.cuberonlabs.com:22000(43.01 MB) cdh7.net.cuberonlabs.com:22000(55.27 MB) cdh12.net.cuberonlabs.com:22000(40.81 MB) cdh1.net.cuberonlabs.com:22000(59.99 MB) cdh5.net.cuberonlabs.com:22000(55.06 MB) cdh17.net.cuberonlabs.com:22000(41.94 MB) cdh10.net.cuberonlabs.com:22000(44.88 MB) cdh3.net.cuberonlabs.com:22000(78.89 MB) cdh15.net.cuberonlabs.com:22000(47.97 MB) cdh2.net.cuberonlabs.com:22000(78.94 MB) cdh4.net.cuberonlabs.com:22000(49.51 MB) cdh8.net.cuberonlabs.com:22000(58.35 MB) cdh14.net.cuberonlabs.com:22000(55.30 MB) cdh9.net.cuberonlabs.com:22000(46.46 MB) cdh6.net.cuberonlabs.com:22000(51.66 MB) | |
| - FiltersReceived: 0 | |
| - FinalizationTimer: 0 | |
| - InactiveTotalTime: 0 | |
| - TotalTime: 3790392344 | |
| Coordinator Fragment F02 | |
| Instance e14a6ed3f1a25055:c971300a00000000 (host=cdh14.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 0.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 275968 | |
| - PerHostPeakMemUsage: 57982949 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 0 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 4131414425 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 44000000 | |
| - TotalThreadsVoluntaryContextSwitches: 16 | |
| - TotalTime: 4162178166 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 377700026 | |
| - ExecTreeExecTime: 19956 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 3753758774 | |
| - ExecTreeOpenTime: 3709363229 | |
| - PrepareTime: 30662491 | |
| - ExecTreePrepareTime: 54068 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| PLAN_ROOT_SINK | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 0 | |
| - TotalTime: 0 | |
| CodeGen | |
| - CodegenTime: 1123747 | |
| - CompileTime: 2841605 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 28 | |
| - NumInstructions: 523 | |
| - OptimizationTime: 40534538 | |
| - PeakMemoryUsage: 267776 | |
| - PrepareTime: 29570578 | |
| - TotalTime: 73657201 | |
| EXCHANGE_NODE (id=5) | |
| ExecOption: Codegen Enabled | |
| - BytesReceived: 294 | |
| - ConvertRowBatchTime: 0 | |
| - DeserializeRowBatchTimer: 28180 | |
| - FirstBatchArrivalWaitTime: 3709314641 | |
| - InactiveTotalTime: 3709320932 | |
| - MergeGetNext: 16200 | |
| - MergeGetNextBatch: 9442 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 2 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 3709379440 | |
| Averaged Fragment F01 | |
| split sizes: min: 0, max: 0, avg: 0, stddev: 0 | |
| completion times: min:3s780ms max:3s784ms mean: 3s782ms stddev:1.217ms | |
| execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec | |
| num instances: 17 | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 56028008 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 3534187957 | |
| - TotalNetworkSendTime: 89887 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 3743503386 | |
| - TotalThreadsSysTime: 941176 | |
| - TotalThreadsUserTime: 209176470 | |
| - TotalThreadsVoluntaryContextSwitches: 45 | |
| - TotalTime: 3781284407 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 351529 | |
| - ExecTreeExecTime: 3310 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 3743203461 | |
| - ExecTreeOpenTime: 3535257520 | |
| - PrepareTime: 37655048 | |
| - ExecTreePrepareTime: 691895 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 17 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 484289 | |
| - OverallThroughput: 183128 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 11976 | |
| - TotalTime: 44396 | |
| - TransmitDataRPCTime: 10881 | |
| - UncompressedRowBatchSize: 22 | |
| CodeGen | |
| - CodegenTime: 4433406 | |
| - CompileTime: 42524396 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 163999333 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 33803223 | |
| - TotalTime: 241087321 | |
| SORT_NODE (id=2) | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 3852 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 3535948001 | |
| AGGREGATION_NODE (id=4) | |
| - BuildTime: 24631 | |
| - GetNewBlockTime: 169059 | |
| - GetResultsTime: 1417 | |
| - HTResizeTime: 3937 | |
| - HashBuckets: 481 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 2 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2410563 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 3535864450 | |
| - UnpinTime: 1054 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 261 | |
| - ConvertRowBatchTime: 6457 | |
| - DeserializeRowBatchTimer: 80880 | |
| - FirstBatchArrivalWaitTime: 2652519759 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 1 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 3534207408 | |
| Fragment F01 | |
| Instance e14a6ed3f1a25055:1f (host=cdh16.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 45098447 | |
| - RowsProduced: 3 | |
| - TotalNetworkReceiveTime: 3531587084 | |
| - TotalNetworkSendTime: 237403 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 3744698141 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 216000000 | |
| - TotalThreadsVoluntaryContextSwitches: 36 | |
| - TotalTime: 3782708376 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 448643 | |
| - ExecTreeExecTime: 1966 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 3744337315 | |
| - ExecTreeOpenTime: 3532981337 | |
| - PrepareTime: 37863885 | |
| - ExecTreePrepareTime: 595961 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 83 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2419966 | |
| - OverallThroughput: 815420 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 3 | |
| - SerializeBatchTime: 54430 | |
| - TotalTime: 101788 | |
| - TransmitDataRPCTime: 34298 | |
| - UncompressedRowBatchSize: 123 | |
| CodeGen | |
| - CodegenTime: 4703770 | |
| - CompileTime: 40661364 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 169442754 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 33537493 | |
| - TotalTime: 244442156 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 4293 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 3 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 3533575613 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 126832 | |
| - GetNewBlockTime: 161111 | |
| - GetResultsTime: 5036 | |
| - HTResizeTime: 2646 | |
| - HashBuckets: 3072 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 1 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2462848 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 3 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 3533494010 | |
| - UnpinTime: 980 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 1490 | |
| - ConvertRowBatchTime: 21633 | |
| - DeserializeRowBatchTimer: 129506 | |
| - FirstBatchArrivalWaitTime: 524921815 | |
| - InactiveTotalTime: 3531494847 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 51 | |
| - RowsReturnedRate: 14 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 3531657113 | |
| Instance e14a6ed3f1a25055:20 (host=cdh13.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 60238427 | |
| - RowsProduced: 1 | |
| - TotalNetworkReceiveTime: 3544635108 | |
| - TotalNetworkSendTime: 238827 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 3747000500 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 204000000 | |
| - TotalThreadsVoluntaryContextSwitches: 21 | |
| - TotalTime: 3782696817 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 493724 | |
| - ExecTreeExecTime: 3043 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 3746544144 | |
| - ExecTreeOpenTime: 3545787182 | |
| - PrepareTime: 35603003 | |
| - ExecTreePrepareTime: 640492 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 43 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1425115 | |
| - OverallThroughput: 592041 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 1 | |
| - SerializeBatchTime: 25514 | |
| - TotalTime: 72630 | |
| - TransmitDataRPCTime: 30173 | |
| - UncompressedRowBatchSize: 51 | |
| CodeGen | |
| - CodegenTime: 4344657 | |
| - CompileTime: 39507565 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 160034547 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 31930673 | |
| - TotalTime: 232173619 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 8245 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 3546426129 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 13594 | |
| - GetNewBlockTime: 155209 | |
| - GetResultsTime: 3292 | |
| - HTResizeTime: 3018 | |
| - HashBuckets: 1024 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 25 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2409600 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 3546345963 | |
| - UnpinTime: 935 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 172 | |
| - ConvertRowBatchTime: 4833 | |
| - DeserializeRowBatchTimer: 125868 | |
| - FirstBatchArrivalWaitTime: 583526943 | |
| - InactiveTotalTime: 3544613201 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 4 | |
| - RowsReturnedRate: 1 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 3544650260 | |
| Instance e14a6ed3f1a25055:1e (host=cdh10.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 47055727 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 3568079203 | |
| - TotalNetworkSendTime: 300 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 3760778618 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 196000000 | |
| - TotalThreadsVoluntaryContextSwitches: 36 | |
| - TotalTime: 3782545234 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 269525 | |
| - ExecTreeExecTime: 3010 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 3760552291 | |
| - ExecTreeOpenTime: 3569271976 | |
| - PrepareTime: 21657308 | |
| - ExecTreePrepareTime: 544340 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 12188 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 2589078 | |
| - CompileTime: 40659870 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 149612886 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 19249649 | |
| - TotalTime: 209989490 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 387 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 3569814382 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 5422 | |
| - GetNewBlockTime: 135095 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 3329 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 3569739666 | |
| - UnpinTime: 636 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 538 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 3568075420 | |
| - InactiveTotalTime: 3568076297 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 3568081502 | |
| Instance e14a6ed3f1a25055:22 (host=cdh11.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 44951347 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 3542006038 | |
| - TotalNetworkSendTime: 220 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 3745312917 | |
| - TotalThreadsSysTime: 4000000 | |
| - TotalThreadsUserTime: 196000000 | |
| - TotalThreadsVoluntaryContextSwitches: 74 | |
| - TotalTime: 3782439494 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 178914 | |
| - ExecTreeExecTime: 2690 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 3745187028 | |
| - ExecTreeOpenTime: 3543109385 | |
| - PrepareTime: 37026754 | |
| - ExecTreePrepareTime: 590735 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 17137 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4065479 | |
| - CompileTime: 40016572 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 160847155 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 33307452 | |
| - TotalTime: 234945589 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 797 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 3543699029 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 4766 | |
| - GetNewBlockTime: 163074 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 2466 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 3543628124 | |
| - UnpinTime: 973 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 347 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 3542002099 | |
| - InactiveTotalTime: 3542003462 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 3542007998 | |
| Instance e14a6ed3f1a25055:1b (host=cdh12.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 42797395 | |
| - RowsProduced: 1 | |
| - TotalNetworkReceiveTime: 3541650948 | |
| - TotalNetworkSendTime: 300835 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 3745067029 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 204000000 | |
| - TotalThreadsVoluntaryContextSwitches: 24 | |
| - TotalTime: 3782221332 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 485816 | |
| - ExecTreeExecTime: 2797 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 3744651183 | |
| - ExecTreeOpenTime: 3542953116 | |
| - PrepareTime: 37018541 | |
| - ExecTreePrepareTime: 667519 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 55 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1494646 | |
| - OverallThroughput: 865800 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 1 | |
| - SerializeBatchTime: 9034 | |
| - TotalTime: 63525 | |
| - TransmitDataRPCTime: 36798 | |
| - UncompressedRowBatchSize: 63 | |
| CodeGen | |
| - CodegenTime: 3998663 | |
| - CompileTime: 38310843 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 162111110 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 33154723 | |
| - TotalTime: 234339373 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 18748 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 3543619642 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 124645 | |
| - GetNewBlockTime: 168587 | |
| - GetResultsTime: 2926 | |
| - HTResizeTime: 3083 | |
| - HashBuckets: 1024 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 5 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2462848 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 3543524986 | |
| - UnpinTime: 1107 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 935 | |
| - ConvertRowBatchTime: 17299 | |
| - DeserializeRowBatchTimer: 160217 | |
| - FirstBatchArrivalWaitTime: 534781577 | |
| - InactiveTotalTime: 3541560902 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 17 | |
| - RowsReturnedRate: 4 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 3541717157 | |
| Instance e14a6ed3f1a25055:21 (host=cdh9.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 48718055 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 3529986296 | |
| - TotalNetworkSendTime: 353 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 3741936051 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 212000000 | |
| - TotalThreadsVoluntaryContextSwitches: 38 | |
| - TotalTime: 3782121426 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 278388 | |
| - ExecTreeExecTime: 4263 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 3741696410 | |
| - ExecTreeOpenTime: 3530731261 | |
| - PrepareTime: 40075283 | |
| - ExecTreePrepareTime: 703127 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 20702 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4605293 | |
| - CompileTime: 42035021 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 167214539 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 36182543 | |
| - TotalTime: 246270610 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 603 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 3531433040 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 6643 | |
| - GetNewBlockTime: 189015 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 3430 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 3531356691 | |
| - UnpinTime: 1113 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 480 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 3529981708 | |
| - InactiveTotalTime: 3529982931 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 3529988643 | |
| Instance e14a6ed3f1a25055:1c (host=cdh7.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 57951363 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 3529969768 | |
| - TotalNetworkSendTime: 393 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 3741703694 | |
| - TotalThreadsSysTime: 4000000 | |
| - TotalThreadsUserTime: 208000000 | |
| - TotalThreadsVoluntaryContextSwitches: 20 | |
| - TotalTime: 3781994363 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 242647 | |
| - ExecTreeExecTime: 3573 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 3741504025 | |
| - ExecTreeOpenTime: 3530838914 | |
| - PrepareTime: 40176972 | |
| - ExecTreePrepareTime: 703151 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 21520 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4902610 | |
| - CompileTime: 41905388 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 167023345 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 36240495 | |
| - TotalTime: 245967750 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 464 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 3531540557 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 6850 | |
| - GetNewBlockTime: 178023 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 4172 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 3531456283 | |
| - UnpinTime: 983 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 634 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 3529964553 | |
| - InactiveTotalTime: 3529965723 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 3529972298 | |
| Instance e14a6ed3f1a25055:1d (host=cdh6.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 54166547 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 3533501800 | |
| - TotalNetworkSendTime: 434 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 3741886502 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 208000000 | |
| - TotalThreadsVoluntaryContextSwitches: 12 | |
| - TotalTime: 3781895028 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 246642 | |
| - ExecTreeExecTime: 4126 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 3741680120 | |
| - ExecTreeOpenTime: 3534409424 | |
| - PrepareTime: 39864990 | |
| - ExecTreePrepareTime: 688692 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 21078 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4327638 | |
| - CompileTime: 39840108 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 165874262 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 35965044 | |
| - TotalTime: 242486534 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 824 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 3535097094 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 11286 | |
| - GetNewBlockTime: 194196 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 7892 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 3535021424 | |
| - UnpinTime: 966 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 574 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 3533496912 | |
| - InactiveTotalTime: 3533498152 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 3533504238 | |
| Instance e14a6ed3f1a25055:1a (host=cdh14.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 57982949 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 3516853166 | |
| - TotalNetworkSendTime: 237 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 3743342454 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 228000000 | |
| - TotalThreadsVoluntaryContextSwitches: 58 | |
| - TotalTime: 3781599302 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 127004 | |
| - ExecTreeExecTime: 2978 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 3743275801 | |
| - ExecTreeOpenTime: 3518235621 | |
| - PrepareTime: 38085198 | |
| - ExecTreePrepareTime: 1083147 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 17040 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4352301 | |
| - CompileTime: 56345087 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 167454097 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 33725958 | |
| - TotalTime: 258230943 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 394 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 3519317631 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 5154 | |
| - GetNewBlockTime: 396465 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 2984 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 3519228322 | |
| - UnpinTime: 1171 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 246 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 3516850108 | |
| - InactiveTotalTime: 3516851028 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 3516855216 | |
| Instance e14a6ed3f1a25055:19 (host=cdh1.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 62905674 | |
| - RowsProduced: 2 | |
| - TotalNetworkReceiveTime: 3527397800 | |
| - TotalNetworkSendTime: 393396 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 3741073788 | |
| - TotalThreadsSysTime: 4000000 | |
| - TotalThreadsUserTime: 208000000 | |
| - TotalThreadsVoluntaryContextSwitches: 38 | |
| - TotalTime: 3781329968 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 727576 | |
| - ExecTreeExecTime: 3272 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 3740397692 | |
| - ExecTreeOpenTime: 3528626792 | |
| - PrepareTime: 40139020 | |
| - ExecTreePrepareTime: 600788 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 79 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2176068 | |
| - OverallThroughput: 571502 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 2 | |
| - SerializeBatchTime: 79412 | |
| - TotalTime: 138232 | |
| - TransmitDataRPCTime: 36304 | |
| - UncompressedRowBatchSize: 97 | |
| CodeGen | |
| - CodegenTime: 4962616 | |
| - CompileTime: 40144192 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 170079108 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 36101240 | |
| - TotalTime: 247124200 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 14812 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 2 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 3529226196 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 39744 | |
| - GetNewBlockTime: 117900 | |
| - GetResultsTime: 9248 | |
| - HTResizeTime: 4960 | |
| - HashBuckets: 2048 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 2 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2462848 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 2 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 3529120852 | |
| - UnpinTime: 1040 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 1265 | |
| - ConvertRowBatchTime: 33088 | |
| - DeserializeRowBatchTimer: 709924 | |
| - FirstBatchArrivalWaitTime: 520560152 | |
| - InactiveTotalTime: 3527296108 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 34 | |
| - RowsReturnedRate: 9 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 3527478264 | |
| Instance e14a6ed3f1a25055:16 (host=cdh3.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 82717348 | |
| - RowsProduced: 1 | |
| - TotalNetworkReceiveTime: 3525302382 | |
| - TotalNetworkSendTime: 353564 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 3739350792 | |
| - TotalThreadsSysTime: 4000000 | |
| - TotalThreadsUserTime: 212000000 | |
| - TotalThreadsVoluntaryContextSwitches: 53 | |
| - TotalTime: 3780893292 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 807746 | |
| - ExecTreeExecTime: 3782 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 3738606630 | |
| - ExecTreeOpenTime: 3526460666 | |
| - PrepareTime: 41380578 | |
| - ExecTreePrepareTime: 731304 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 34 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 717118 | |
| - OverallThroughput: 268422 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 1 | |
| - SerializeBatchTime: 35214 | |
| - TotalTime: 126666 | |
| - TransmitDataRPCTime: 47412 | |
| - UncompressedRowBatchSize: 42 | |
| CodeGen | |
| - CodegenTime: 5032246 | |
| - CompileTime: 42344168 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 168191972 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 37248374 | |
| - TotalTime: 248599268 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 12224 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 3527190590 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 33460 | |
| - GetNewBlockTime: 130700 | |
| - GetResultsTime: 3588 | |
| - HTResizeTime: 5044 | |
| - HashBuckets: 1024 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 5 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2462848 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 1 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 3527081560 | |
| - UnpinTime: 1204 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 576 | |
| - ConvertRowBatchTime: 27370 | |
| - DeserializeRowBatchTimer: 249450 | |
| - FirstBatchArrivalWaitTime: 518475618 | |
| - InactiveTotalTime: 3525170836 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 17 | |
| - RowsReturnedRate: 4 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 3525373612 | |
| Instance e14a6ed3f1a25055:17 (host=cdh17.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 43978137 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 3569131802 | |
| - TotalNetworkSendTime: 306 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 1 | |
| - TotalThreadsTotalWallClockTime: 3751311594 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 184000000 | |
| - TotalThreadsVoluntaryContextSwitches: 5 | |
| - TotalTime: 3780849795 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 223461 | |
| - ExecTreeExecTime: 3220 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 3751126224 | |
| - ExecTreeOpenTime: 3569991445 | |
| - PrepareTime: 29441448 | |
| - ExecTreePrepareTime: 622156 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 15291 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 3183342 | |
| - CompileTime: 38431413 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 141834597 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 26629246 | |
| - TotalTime: 207409864 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 783 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 3570612521 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 5120 | |
| - GetNewBlockTime: 159406 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 3322 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 3570550866 | |
| - UnpinTime: 1122 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 285 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 3569128420 | |
| - InactiveTotalTime: 3569129244 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 3569133349 | |
| Instance e14a6ed3f1a25055:15 (host=cdh15.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 50297140 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 3530105118 | |
| - TotalNetworkSendTime: 289 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 3741327416 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 212000000 | |
| - TotalThreadsVoluntaryContextSwitches: 30 | |
| - TotalTime: 3780289433 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 269422 | |
| - ExecTreeExecTime: 2794 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 3741111187 | |
| - ExecTreeOpenTime: 3531384624 | |
| - PrepareTime: 38847364 | |
| - ExecTreePrepareTime: 593080 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 18387 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4537289 | |
| - CompileTime: 40434683 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 167959745 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 35034815 | |
| - TotalTime: 244230216 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 505 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 3531976157 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 5067 | |
| - GetNewBlockTime: 113165 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 2656 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 3531895145 | |
| - UnpinTime: 1127 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 360 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 3530101619 | |
| - InactiveTotalTime: 3530102430 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 3530107424 | |
| Instance e14a6ed3f1a25055:18 (host=cdh5.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 57738077 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 3520994700 | |
| - TotalNetworkSendTime: 380 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 3738327612 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 220000000 | |
| - TotalThreadsVoluntaryContextSwitches: 210 | |
| - TotalTime: 3780227322 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 312970 | |
| - ExecTreeExecTime: 3834 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 3738069908 | |
| - ExecTreeOpenTime: 3521975638 | |
| - PrepareTime: 41755872 | |
| - ExecTreePrepareTime: 720412 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 41224 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 5071612 | |
| - CompileTime: 45364980 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 169028378 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 37390246 | |
| - TotalTime: 252651026 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 596 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 3522695334 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 8136 | |
| - GetNewBlockTime: 138606 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 4746 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 3522613928 | |
| - UnpinTime: 1202 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 500 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 3520989894 | |
| - InactiveTotalTime: 3520991372 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 3520997332 | |
| Instance e14a6ed3f1a25055:14 (host=cdh2.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 82778006 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 3527886976 | |
| - TotalNetworkSendTime: 424 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 3740925252 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 212000000 | |
| - TotalThreadsVoluntaryContextSwitches: 19 | |
| - TotalTime: 3779702408 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 279392 | |
| - ExecTreeExecTime: 4032 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 3740684856 | |
| - ExecTreeOpenTime: 3528675088 | |
| - PrepareTime: 38662464 | |
| - ExecTreePrepareTime: 829164 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 23116 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 4522880 | |
| - CompileTime: 43422284 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 166833492 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 34882908 | |
| - TotalTime: 245949452 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 568 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 3529501428 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 7836 | |
| - GetNewBlockTime: 207556 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 4788 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 3529421348 | |
| - UnpinTime: 1216 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 428 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 3527882352 | |
| - InactiveTotalTime: 3527883652 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 3527889468 | |
| Instance e14a6ed3f1a25055:13 (host=cdh4.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 51914887 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 3526832602 | |
| - TotalNetworkSendTime: 370 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 3738644180 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 216000000 | |
| - TotalThreadsVoluntaryContextSwitches: 20 | |
| - TotalTime: 3779283632 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 277364 | |
| - ExecTreeExecTime: 3674 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 3738422126 | |
| - ExecTreeOpenTime: 3527778912 | |
| - PrepareTime: 40502892 | |
| - ExecTreePrepareTime: 736168 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 24328 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 5032264 | |
| - CompileTime: 42607364 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 166446956 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 36277514 | |
| - TotalTime: 246158454 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 656 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 3528514140 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 7348 | |
| - GetNewBlockTime: 142008 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 4370 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 3528418976 | |
| - UnpinTime: 1162 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 616 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 3526828078 | |
| - InactiveTotalTime: 3526829076 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 3526835128 | |
| Instance e14a6ed3f1a25055:12 (host=cdh8.net.cuberonlabs.com:22000) | |
| - AverageThreadTokens: 1.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 3502840 | |
| - PerHostPeakMemUsage: 61186624 | |
| - RowsProduced: 0 | |
| - TotalNetworkReceiveTime: 3515274485 | |
| - TotalNetworkSendTime: 353 | |
| - TotalStorageWaitTime: 0 | |
| - TotalThreadsInvoluntaryContextSwitches: 1 | |
| - TotalThreadsTotalWallClockTime: 3736871026 | |
| - TotalThreadsSysTime: 0 | |
| - TotalThreadsUserTime: 220000000 | |
| - TotalThreadsVoluntaryContextSwitches: 85 | |
| - TotalTime: 3779037707 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 306771 | |
| - ExecTreeExecTime: 3223 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 3736611910 | |
| - ExecTreeOpenTime: 3516166462 | |
| - PrepareTime: 42034259 | |
| - ExecTreePrepareTime: 711990 | |
| - TotalTime: 0 | |
| BlockMgr | |
| - BlockWritesOutstanding: 0 | |
| - BlocksCreated: 48 | |
| - BlocksRecycled: 0 | |
| - BufferedPins: 0 | |
| - BytesWritten: 0 | |
| - InactiveTotalTime: 0 | |
| - MaxBlockSize: 8388608 | |
| - MemoryLimit: 51539607552 | |
| - PeakMemoryUsage: 802816 | |
| - ScratchFileUsedBytes: 0 | |
| - TotalBufferWaitTime: 0 | |
| - TotalEncryptionTime: 0 | |
| - TotalReadBlockTime: 0 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=5) | |
| - BytesSent: 0 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 0 | |
| - OverallThroughput: 0 | |
| - PeakMemoryUsage: 5240 | |
| - RowsReturned: 0 | |
| - SerializeBatchTime: 0 | |
| - TotalTime: 19887 | |
| - TransmitDataRPCTime: 0 | |
| - UncompressedRowBatchSize: 0 | |
| CodeGen | |
| - CodegenTime: 5136174 | |
| - CompileTime: 50883843 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 113 | |
| - NumInstructions: 2157 | |
| - OptimizationTime: 167999724 | |
| - PeakMemoryUsage: 1104384 | |
| - PrepareTime: 37796430 | |
| - TotalTime: 257515924 | |
| SORT_NODE (id=2) | |
| ExecOption: Codegen Enabled | |
| - InactiveTotalTime: 0 | |
| - InsertBatchTime: 597 | |
| - PeakMemoryUsage: 12288 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - TotalTime: 3516876538 | |
| AGGREGATION_NODE (id=4) | |
| ExecOption: Codegen Enabled | |
| - BuildTime: 6833 | |
| - GetNewBlockTime: 123894 | |
| - GetResultsTime: 0 | |
| - HTResizeTime: 4036 | |
| - HashBuckets: 0 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - MaxPartitionLevel: 0 | |
| - NumRepartitions: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 2393216 | |
| - PinTime: 0 | |
| - RowsRepartitioned: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SpilledPartitions: 0 | |
| - TotalTime: 3516797522 | |
| - UnpinTime: 981 | |
| EXCHANGE_NODE (id=3) | |
| - BytesReceived: 0 | |
| - ConvertRowBatchTime: 543 | |
| - DeserializeRowBatchTimer: 0 | |
| - FirstBatchArrivalWaitTime: 3515268650 | |
| - InactiveTotalTime: 3515269877 | |
| - PeakMemoryUsage: 0 | |
| - RowsReturned: 0 | |
| - RowsReturnedRate: 0 | |
| - SendersBlockedTimer: 0 | |
| - SendersBlockedTotalTimer(*): 0 | |
| - TotalTime: 3515276937 | |
| Averaged Fragment F00 | |
| split sizes: min: 1.05 GB, max: 7.42 GB, avg: 2.92 GB, stddev: 1.75 GB | |
| completion times: min:769.103ms max:3s776ms mean: 1s487ms stddev:903.314ms | |
| execution rates: min:1.30 GB/sec max:2.56 GB/sec mean:1.97 GB/sec stddev:402.89 MB/sec | |
| num instances: 17 | |
| - AverageThreadTokens: 5.627170868347339 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 53617698 | |
| - PerHostPeakMemUsage: 56028008 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1309558 | |
| - TotalStorageWaitTime: 75528429 | |
| - TotalThreadsInvoluntaryContextSwitches: 32 | |
| - TotalThreadsTotalWallClockTime: 8629713289 | |
| - TotalThreadsSysTime: 643764705 | |
| - TotalThreadsUserTime: 6816235294 | |
| - TotalThreadsVoluntaryContextSwitches: 868 | |
| - TotalTime: 1486325948 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 1336493973 | |
| - ExecTreeExecTime: 1331619970 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 112025091 | |
| - ExecTreeOpenTime: 114387 | |
| - PrepareTime: 37765404 | |
| - ExecTreePrepareTime: 724538 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 261 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2464803 | |
| - OverallThroughput: 941869 | |
| - PeakMemoryUsage: 106427 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 114350 | |
| - TotalTime: 284704 | |
| - TransmitDataRPCTime: 123201 | |
| - UncompressedRowBatchSize: 337 | |
| CodeGen | |
| - CodegenTime: 3985703 | |
| - CompileTime: 29045441 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 81541754 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 31788209 | |
| - TotalTime: 143131893 | |
| AGGREGATION_NODE (id=1) | |
| - GetNewBlockTime: 88527 | |
| - GetResultsTime: 23918 | |
| - HTResizeTime: 500323 | |
| - HashBuckets: 8673 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053130 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 6 | |
| - StreamingTime: 409532229 | |
| - TotalTime: 1332452168 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 5.694397759103642 | |
| - BytesRead: 96229056 | |
| - BytesReadDataNodeCache: 91927098 | |
| - BytesReadLocal: 96229056 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 96229056 | |
| - DecompressionTime: 203662376 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 21 | |
| - NumScannerThreadsStarted: 8 | |
| - PeakMemoryUsage: 49363443 | |
| - PerReadThreadRawHdfsThroughput: 992013618 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 912985914 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 121092252 | |
| - RowsReturned: 920215 | |
| - RowsReturnedRate: 1082442 | |
| - ScanRangesComplete: 21 | |
| - ScannerThreadsInvoluntaryContextSwitches: 29 | |
| - ScannerThreadsTotalWallClockTime: 7181256473 | |
| - MaterializeTupleTime(*): 6707652459 | |
| - ScannerThreadsSysTime: 337882352 | |
| - ScannerThreadsUserTime: 6584705882 | |
| - ScannerThreadsVoluntaryContextSwitches: 179 | |
| - TotalRawHdfsReadTime(*): 2576950 | |
| - TotalReadThroughput: 64411687 | |
| - TotalTime: 919693471 | |
| Fragment F00 | |
| Instance e14a6ed3f1a25055:e (host=cdh16.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:38/7.42 GB | |
| - AverageThreadTokens: 5.571428571428571 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 42630289 | |
| - PerHostPeakMemUsage: 45098447 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1367123 | |
| - TotalStorageWaitTime: 25070656 | |
| - TotalThreadsInvoluntaryContextSwitches: 96 | |
| - TotalThreadsTotalWallClockTime: 20297620352 | |
| - TotalThreadsSysTime: 1608000000 | |
| - TotalThreadsUserTime: 15844000000 | |
| - TotalThreadsVoluntaryContextSwitches: 1245 | |
| - TotalTime: 3774679635 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 3646224714 | |
| - ExecTreeExecTime: 3641408461 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 95871254 | |
| - ExecTreeOpenTime: 123025 | |
| - PrepareTime: 32548019 | |
| - ExecTreePrepareTime: 755818 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 253 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2617476 | |
| - OverallThroughput: 1062324 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 108028 | |
| - TotalTime: 238157 | |
| - TransmitDataRPCTime: 96658 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 3396949 | |
| - CompileTime: 24953601 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 69731481 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 26776633 | |
| - TotalTime: 122091679 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 76886 | |
| - GetResultsTime: 22083 | |
| - HTResizeTime: 290412 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053145 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 1 | |
| - StreamingTime: 969923629 | |
| - TotalTime: 3642280733 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:38/7.42 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 38 out of 38 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:38 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 4.571428571428571 | |
| - BytesRead: 245440407 | |
| - BytesReadDataNodeCache: 245440407 | |
| - BytesReadLocal: 245440407 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 245440407 | |
| - DecompressionTime: 469401914 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 38 | |
| - NumScannerThreadsStarted: 5 | |
| - PeakMemoryUsage: 39030694 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 2659135436 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 308762467 | |
| - RowsReturned: 935895 | |
| - RowsReturnedRate: 350798 | |
| - ScanRangesComplete: 38 | |
| - ScannerThreadsInvoluntaryContextSwitches: 91 | |
| - ScannerThreadsTotalWallClockTime: 16555589681 | |
| - MaterializeTupleTime(*): 15844139704 | |
| - ScannerThreadsSysTime: 800000000 | |
| - ScannerThreadsUserTime: 15564000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 296 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 70125830 | |
| - TotalTime: 2667897628 | |
| Instance e14a6ed3f1a25055:d (host=cdh10.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:44/6.27 GB | |
| - AverageThreadTokens: 4.857142857142857 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 44649033 | |
| - PerHostPeakMemUsage: 47055727 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1593544 | |
| - TotalStorageWaitTime: 28720784 | |
| - TotalThreadsInvoluntaryContextSwitches: 63 | |
| - TotalThreadsTotalWallClockTime: 18577026209 | |
| - TotalThreadsSysTime: 1584000000 | |
| - TotalThreadsUserTime: 14576000000 | |
| - TotalThreadsVoluntaryContextSwitches: 2517 | |
| - TotalTime: 3461051384 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 3307868547 | |
| - ExecTreeExecTime: 3302772130 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 120081289 | |
| - ExecTreeOpenTime: 109823 | |
| - PrepareTime: 33072841 | |
| - ExecTreePrepareTime: 679867 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 296 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1972150 | |
| - OverallThroughput: 1052538 | |
| - PeakMemoryUsage: 109560 | |
| - RowsReturned: 8 | |
| - SerializeBatchTime: 91738 | |
| - TotalTime: 281225 | |
| - TransmitDataRPCTime: 150090 | |
| - UncompressedRowBatchSize: 376 | |
| CodeGen | |
| - CodegenTime: 3584221 | |
| - CompileTime: 27964768 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 90731893 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 28364170 | |
| - TotalTime: 147704426 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 70891 | |
| - GetResultsTime: 27474 | |
| - HTResizeTime: 584084 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053234 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 2 | |
| - StreamingTime: 976010785 | |
| - TotalTime: 3303553993 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:44/6.27 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 44 out of 44 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
| File Formats: PARQUET/SNAPPY:44 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 4.5 | |
| - BytesRead: 203512290 | |
| - BytesReadDataNodeCache: 203512290 | |
| - BytesReadLocal: 203512290 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 203512290 | |
| - DecompressionTime: 425579253 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 44 | |
| - NumScannerThreadsStarted: 5 | |
| - PeakMemoryUsage: 40479648 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 2301925131 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 259854768 | |
| - RowsReturned: 3128432 | |
| - RowsReturnedRate: 1349324 | |
| - ScanRangesComplete: 44 | |
| - ScannerThreadsInvoluntaryContextSwitches: 58 | |
| - ScannerThreadsTotalWallClockTime: 15149123744 | |
| - MaterializeTupleTime(*): 14525248479 | |
| - ScannerThreadsSysTime: 840000000 | |
| - ScannerThreadsUserTime: 14176000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 288 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 58146368 | |
| - TotalTime: 2318516849 | |
| Instance e14a6ed3f1a25055:11 (host=cdh11.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/4.64 GB | |
| - AverageThreadTokens: 5.4 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 42544669 | |
| - PerHostPeakMemUsage: 44951347 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1831325 | |
| - TotalStorageWaitTime: 17944203 | |
| - TotalThreadsInvoluntaryContextSwitches: 24 | |
| - TotalThreadsTotalWallClockTime: 12528574793 | |
| - TotalThreadsSysTime: 1112000000 | |
| - TotalThreadsUserTime: 9704000000 | |
| - TotalThreadsVoluntaryContextSwitches: 1224 | |
| - TotalTime: 2415183743 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 2268981232 | |
| - ExecTreeExecTime: 2263262884 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 108838361 | |
| - ExecTreeOpenTime: 104196 | |
| - PrepareTime: 37330441 | |
| - ExecTreePrepareTime: 718343 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 296 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1593565 | |
| - OverallThroughput: 853382 | |
| - PeakMemoryUsage: 109560 | |
| - RowsReturned: 8 | |
| - SerializeBatchTime: 119884 | |
| - TotalTime: 346855 | |
| - TransmitDataRPCTime: 185747 | |
| - UncompressedRowBatchSize: 376 | |
| CodeGen | |
| - CodegenTime: 3557365 | |
| - CompileTime: 27927431 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 79683529 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 31735566 | |
| - TotalTime: 140068710 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 75453 | |
| - GetResultsTime: 32614 | |
| - HTResizeTime: 502768 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053163 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 3 | |
| - StreamingTime: 653717612 | |
| - TotalTime: 2264078585 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:32/4.64 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
| File Formats: PARQUET/SNAPPY:32 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 4.4 | |
| - BytesRead: 153833845 | |
| - BytesReadDataNodeCache: 153833845 | |
| - BytesReadLocal: 153833845 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 153833845 | |
| - DecompressionTime: 297915639 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 32 | |
| - NumScannerThreadsStarted: 5 | |
| - PeakMemoryUsage: 38627035 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 1599646014 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 194020601 | |
| - RowsReturned: 1058639 | |
| - RowsReturnedRate: 659073 | |
| - ScanRangesComplete: 32 | |
| - ScannerThreadsInvoluntaryContextSwitches: 21 | |
| - ScannerThreadsTotalWallClockTime: 10150828866 | |
| - MaterializeTupleTime(*): 9693457881 | |
| - ScannerThreadsSysTime: 580000000 | |
| - ScannerThreadsUserTime: 9456000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 256 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 61533538 | |
| - TotalTime: 1606253375 | |
| Instance e14a6ed3f1a25055:4 (host=cdh15.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:29/3.95 GB | |
| - AverageThreadTokens: 5.5 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 47890446 | |
| - PerHostPeakMemUsage: 50297140 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1357765 | |
| - TotalStorageWaitTime: 25173527 | |
| - TotalThreadsInvoluntaryContextSwitches: 22 | |
| - TotalThreadsTotalWallClockTime: 11716218991 | |
| - TotalThreadsSysTime: 936000000 | |
| - TotalThreadsUserTime: 9384000000 | |
| - TotalThreadsVoluntaryContextSwitches: 1010 | |
| - TotalTime: 2000811369 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 1859599747 | |
| - ExecTreeExecTime: 1854405904 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 105797611 | |
| - ExecTreeOpenTime: 95836 | |
| - PrepareTime: 35380407 | |
| - ExecTreePrepareTime: 712917 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2725268 | |
| - OverallThroughput: 894511 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 153369 | |
| - TotalTime: 280600 | |
| - TransmitDataRPCTime: 92101 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 3542747 | |
| - CompileTime: 27604452 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 77047236 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 30086583 | |
| - TotalTime: 135437820 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 77033 | |
| - GetResultsTime: 20171 | |
| - HTResizeTime: 354320 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053166 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 3 | |
| - StreamingTime: 590845771 | |
| - TotalTime: 1855208624 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:29/3.95 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 29 out of 29 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:29 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 6.0 | |
| - BytesRead: 131356084 | |
| - BytesReadDataNodeCache: 131356084 | |
| - BytesReadLocal: 131356084 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 131356084 | |
| - DecompressionTime: 278275957 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 29 | |
| - NumScannerThreadsStarted: 6 | |
| - PeakMemoryUsage: 43642213 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 1253120520 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 164502129 | |
| - RowsReturned: 948862 | |
| - RowsReturnedRate: 752676 | |
| - ScanRangesComplete: 29 | |
| - ScannerThreadsInvoluntaryContextSwitches: 17 | |
| - ScannerThreadsTotalWallClockTime: 9750869324 | |
| - MaterializeTupleTime(*): 9295017953 | |
| - ScannerThreadsSysTime: 464000000 | |
| - ScannerThreadsUserTime: 9140000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 237 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 65485642 | |
| - TotalTime: 1260650364 | |
| Instance e14a6ed3f1a25055:9 (host=cdh14.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:25/3.70 GB | |
| - AverageThreadTokens: 7.333333333333333 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 55567970 | |
| - PerHostPeakMemUsage: 57982949 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1203354 | |
| - TotalStorageWaitTime: 36226451 | |
| - TotalThreadsInvoluntaryContextSwitches: 70 | |
| - TotalThreadsTotalWallClockTime: 10465724119 | |
| - TotalThreadsSysTime: 796000000 | |
| - TotalThreadsUserTime: 8576000000 | |
| - TotalThreadsVoluntaryContextSwitches: 908 | |
| - TotalTime: 1572529236 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 1427269686 | |
| - ExecTreeExecTime: 1422753742 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 107899073 | |
| - ExecTreeOpenTime: 102894 | |
| - PrepareTime: 37323123 | |
| - ExecTreePrepareTime: 744280 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 253 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2139951 | |
| - OverallThroughput: 1016117 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 88761 | |
| - TotalTime: 248987 | |
| - TransmitDataRPCTime: 118227 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 3866045 | |
| - CompileTime: 27971572 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 78696443 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 31475556 | |
| - TotalTime: 138905778 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 103847 | |
| - GetResultsTime: 25545 | |
| - HTResizeTime: 876939 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053134 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 4 | |
| - StreamingTime: 483459398 | |
| - TotalTime: 1423594713 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:25/3.70 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 25 out of 25 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:25 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 6.333333333333333 | |
| - BytesRead: 121434677 | |
| - BytesReadDataNodeCache: 121434677 | |
| - BytesReadLocal: 121434677 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 121434677 | |
| - DecompressionTime: 262072459 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 25 | |
| - NumScannerThreadsStarted: 7 | |
| - PeakMemoryUsage: 51020094 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 931349069 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 153042338 | |
| - RowsReturned: 797175 | |
| - RowsReturnedRate: 850834 | |
| - ScanRangesComplete: 25 | |
| - ScannerThreadsInvoluntaryContextSwitches: 60 | |
| - ScannerThreadsTotalWallClockTime: 8930614395 | |
| - MaterializeTupleTime(*): 8478748047 | |
| - ScannerThreadsSysTime: 440000000 | |
| - ScannerThreadsUserTime: 8324000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 212 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 80956451 | |
| - TotalTime: 936933349 | |
| Instance e14a6ed3f1a25055:a (host=cdh12.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.40 GB | |
| - AverageThreadTokens: 4.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 40390701 | |
| - PerHostPeakMemUsage: 42797395 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1260495 | |
| - TotalStorageWaitTime: 12573798 | |
| - TotalThreadsInvoluntaryContextSwitches: 77 | |
| - TotalThreadsTotalWallClockTime: 7477878769 | |
| - TotalThreadsSysTime: 588000000 | |
| - TotalThreadsUserTime: 5796000000 | |
| - TotalThreadsVoluntaryContextSwitches: 995 | |
| - TotalTime: 1541442501 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 1374543833 | |
| - ExecTreeExecTime: 1370078742 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 133854740 | |
| - ExecTreeOpenTime: 153086 | |
| - PrepareTime: 33015570 | |
| - ExecTreePrepareTime: 617886 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1527126 | |
| - OverallThroughput: 771446 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 124849 | |
| - TotalTime: 325363 | |
| - TransmitDataRPCTime: 164361 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 3574325 | |
| - CompileTime: 39401928 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 92940395 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 27867265 | |
| - TotalTime: 160903411 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 60656 | |
| - GetResultsTime: 23648 | |
| - HTResizeTime: 489462 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053129 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 5 | |
| - StreamingTime: 397462530 | |
| - TotalTime: 1370843815 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:26/2.40 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 26 out of 26 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% | |
| File Formats: PARQUET/SNAPPY:26 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 4.5 | |
| - BytesRead: 79856970 | |
| - BytesReadDataNodeCache: 79856970 | |
| - BytesReadLocal: 79856970 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 79856970 | |
| - DecompressionTime: 172632481 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 26 | |
| - NumScannerThreadsStarted: 5 | |
| - PeakMemoryUsage: 36534643 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 963714907 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 101015240 | |
| - RowsReturned: 1036782 | |
| - RowsReturnedRate: 1068250 | |
| - ScanRangesComplete: 26 | |
| - ScannerThreadsInvoluntaryContextSwitches: 58 | |
| - ScannerThreadsTotalWallClockTime: 5969570834 | |
| - MaterializeTupleTime(*): 5669980366 | |
| - ScannerThreadsSysTime: 304000000 | |
| - ScannerThreadsUserTime: 5532000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 172 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 53237980 | |
| - TotalTime: 970541871 | |
| Instance e14a6ed3f1a25055:f (host=cdh13.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/3.54 GB | |
| - AverageThreadTokens: 8.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 57831733 | |
| - PerHostPeakMemUsage: 60238427 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1088175 | |
| - TotalStorageWaitTime: 63617034 | |
| - TotalThreadsInvoluntaryContextSwitches: 16 | |
| - TotalThreadsTotalWallClockTime: 9444508136 | |
| - TotalThreadsSysTime: 660000000 | |
| - TotalThreadsUserTime: 7812000000 | |
| - TotalThreadsVoluntaryContextSwitches: 885 | |
| - TotalTime: 1380564905 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 1227518676 | |
| - ExecTreeExecTime: 1222897406 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 113226822 | |
| - ExecTreeOpenTime: 108450 | |
| - PrepareTime: 39779234 | |
| - ExecTreePrepareTime: 696905 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2497189 | |
| - OverallThroughput: 1059952 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 97824 | |
| - TotalTime: 236803 | |
| - TransmitDataRPCTime: 100513 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4013561 | |
| - CompileTime: 28814663 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 82985414 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 33795652 | |
| - TotalTime: 146403985 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 84375 | |
| - GetResultsTime: 25934 | |
| - HTResizeTime: 335478 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053159 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 5 | |
| - StreamingTime: 449606119 | |
| - TotalTime: 1223696538 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:28/3.54 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:28 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 7.0 | |
| - BytesRead: 116908889 | |
| - BytesReadDataNodeCache: 116908889 | |
| - BytesReadLocal: 116908889 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 116908889 | |
| - DecompressionTime: 235712022 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 28 | |
| - NumScannerThreadsStarted: 8 | |
| - PeakMemoryUsage: 53248008 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 764349654 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 145695183 | |
| - RowsReturned: 1015783 | |
| - RowsReturnedRate: 1317610 | |
| - ScanRangesComplete: 28 | |
| - ScannerThreadsInvoluntaryContextSwitches: 15 | |
| - ScannerThreadsTotalWallClockTime: 8103836041 | |
| - MaterializeTupleTime(*): 7631581605 | |
| - ScannerThreadsSysTime: 344000000 | |
| - ScannerThreadsUserTime: 7552000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 216 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 77939259 | |
| - TotalTime: 770927958 | |
| Instance e14a6ed3f1a25055:6 (host=cdh17.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:24/2.37 GB | |
| - AverageThreadTokens: 4.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 41571459 | |
| - PerHostPeakMemUsage: 43978137 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1655267 | |
| - TotalStorageWaitTime: 35037008 | |
| - TotalThreadsInvoluntaryContextSwitches: 29 | |
| - TotalThreadsTotalWallClockTime: 6972548316 | |
| - TotalThreadsSysTime: 508000000 | |
| - TotalThreadsUserTime: 5512000000 | |
| - TotalThreadsVoluntaryContextSwitches: 1821 | |
| - TotalTime: 1365734502 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 1215832111 | |
| - ExecTreeExecTime: 1210537316 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 114781980 | |
| - ExecTreeOpenTime: 106216 | |
| - PrepareTime: 35085959 | |
| - ExecTreePrepareTime: 658024 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 295 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2209522 | |
| - OverallThroughput: 1092892 | |
| - PeakMemoryUsage: 109560 | |
| - RowsReturned: 8 | |
| - SerializeBatchTime: 97637 | |
| - TotalTime: 269926 | |
| - TransmitDataRPCTime: 133513 | |
| - UncompressedRowBatchSize: 376 | |
| CodeGen | |
| - CodegenTime: 3715315 | |
| - CompileTime: 29183518 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 84292776 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 30350910 | |
| - TotalTime: 144587535 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 74819 | |
| - GetResultsTime: 21674 | |
| - HTResizeTime: 334264 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053147 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 6 | |
| - StreamingTime: 380560078 | |
| - TotalTime: 1211294859 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:24/2.37 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 24 out of 24 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:24 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 4.5 | |
| - BytesRead: 75011561 | |
| - BytesReadDataNodeCache: 75011561 | |
| - BytesReadLocal: 75011561 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 75011561 | |
| - DecompressionTime: 174736614 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 24 | |
| - NumScannerThreadsStarted: 7 | |
| - PeakMemoryUsage: 37485160 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 815957154 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 97659250 | |
| - RowsReturned: 2670287 | |
| - RowsReturnedRate: 3233784 | |
| - ScanRangesComplete: 24 | |
| - ScannerThreadsInvoluntaryContextSwitches: 28 | |
| - ScannerThreadsTotalWallClockTime: 5641978205 | |
| - MaterializeTupleTime(*): 5297863254 | |
| - ScannerThreadsSysTime: 288000000 | |
| - ScannerThreadsUserTime: 5212000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 180 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 50007707 | |
| - TotalTime: 825746660 | |
| Instance e14a6ed3f1a25055:2 (host=cdh4.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:14/1.67 GB | |
| - AverageThreadTokens: 5.5 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 49508182 | |
| - PerHostPeakMemUsage: 51914887 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1383702 | |
| - TotalStorageWaitTime: 131104626 | |
| - TotalThreadsInvoluntaryContextSwitches: 10 | |
| - TotalThreadsTotalWallClockTime: 5959991460 | |
| - TotalThreadsSysTime: 352000000 | |
| - TotalThreadsUserTime: 4520000000 | |
| - TotalThreadsVoluntaryContextSwitches: 525 | |
| - TotalTime: 1021972912 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 872748242 | |
| - ExecTreeExecTime: 867445498 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 109686622 | |
| - ExecTreeOpenTime: 113172 | |
| - PrepareTime: 39494804 | |
| - ExecTreePrepareTime: 772728 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1681989 | |
| - OverallThroughput: 798900 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 111376 | |
| - TotalTime: 314182 | |
| - TransmitDataRPCTime: 149228 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4266734 | |
| - CompileTime: 28561418 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 79586820 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 32254084 | |
| - TotalTime: 141298560 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 100180 | |
| - GetResultsTime: 24362 | |
| - HTResizeTime: 597040 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053219 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 8 | |
| - StreamingTime: 221212196 | |
| - TotalTime: 868324254 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:14/1.67 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 14 out of 14 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:14 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 4.5 | |
| - BytesRead: 55110625 | |
| - BytesReadDataNodeCache: 55110625 | |
| - BytesReadLocal: 55110625 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 55110625 | |
| - DecompressionTime: 133322510 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 14 | |
| - NumScannerThreadsStarted: 13 | |
| - PeakMemoryUsage: 45533826 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 638901350 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 69434238 | |
| - RowsReturned: 549998 | |
| - RowsReturnedRate: 853047 | |
| - ScanRangesComplete: 14 | |
| - ScannerThreadsInvoluntaryContextSwitches: 9 | |
| - ScannerThreadsTotalWallClockTime: 4977623438 | |
| - MaterializeTupleTime(*): 4405670428 | |
| - ScannerThreadsSysTime: 188000000 | |
| - ScannerThreadsUserTime: 4340000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 147 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 55110625 | |
| - TotalTime: 644745142 | |
| Instance e14a6ed3f1a25055:5 (host=cdh3.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:13/2.49 GB | |
| - AverageThreadTokens: 10.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 80310670 | |
| - PerHostPeakMemUsage: 82717348 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 995114 | |
| - TotalStorageWaitTime: 163610712 | |
| - TotalThreadsInvoluntaryContextSwitches: 69 | |
| - TotalThreadsTotalWallClockTime: 8521597322 | |
| - TotalThreadsSysTime: 564000000 | |
| - TotalThreadsUserTime: 6988000000 | |
| - TotalThreadsVoluntaryContextSwitches: 502 | |
| - TotalTime: 996849914 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 846086132 | |
| - ExecTreeExecTime: 841134562 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 111206528 | |
| - ExecTreeOpenTime: 129170 | |
| - PrepareTime: 39512780 | |
| - ExecTreePrepareTime: 768920 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 250 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 5475251 | |
| - OverallThroughput: 1031089 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 142688 | |
| - TotalTime: 242462 | |
| - TransmitDataRPCTime: 45660 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4476304 | |
| - CompileTime: 28672204 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 80921796 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 33508264 | |
| - TotalTime: 143878976 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 90650 | |
| - GetResultsTime: 28638 | |
| - HTResizeTime: 732126 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053248 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 8 | |
| - StreamingTime: 339349562 | |
| - TotalTime: 842025132 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:13/2.49 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 13 out of 13 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:13 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 9.0 | |
| - BytesRead: 82516123 | |
| - BytesReadDataNodeCache: 82516123 | |
| - BytesReadLocal: 82516123 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 82516123 | |
| - DecompressionTime: 199915504 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 13 | |
| - NumScannerThreadsStarted: 13 | |
| - PeakMemoryUsage: 74627344 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 494756242 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 102158030 | |
| - RowsReturned: 362660 | |
| - RowsReturnedRate: 724941 | |
| - ScanRangesComplete: 13 | |
| - ScannerThreadsInvoluntaryContextSwitches: 61 | |
| - ScannerThreadsTotalWallClockTime: 7564377186 | |
| - MaterializeTupleTime(*): 6903820032 | |
| - ScannerThreadsSysTime: 316000000 | |
| - ScannerThreadsUserTime: 6776000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 179 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 82516123 | |
| - TotalTime: 500261346 | |
| Instance e14a6ed3f1a25055:1 (host=cdh8.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:16/2.06 GB | |
| - AverageThreadTokens: 5.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 58779919 | |
| - PerHostPeakMemUsage: 61186624 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1453787 | |
| - TotalStorageWaitTime: 147073968 | |
| - TotalThreadsInvoluntaryContextSwitches: 21 | |
| - TotalThreadsTotalWallClockTime: 6347362667 | |
| - TotalThreadsSysTime: 364000000 | |
| - TotalThreadsUserTime: 5084000000 | |
| - TotalThreadsVoluntaryContextSwitches: 536 | |
| - TotalTime: 854687020 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 703815115 | |
| - ExecTreeExecTime: 698322217 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 111336895 | |
| - ExecTreeOpenTime: 121178 | |
| - PrepareTime: 39493638 | |
| - ExecTreePrepareTime: 774475 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1813518 | |
| - OverallThroughput: 840634 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 104062 | |
| - TotalTime: 298584 | |
| - TransmitDataRPCTime: 138405 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4249895 | |
| - CompileTime: 29457899 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 80322493 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 32837141 | |
| - TotalTime: 143375923 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 97281 | |
| - GetResultsTime: 23721 | |
| - HTResizeTime: 430432 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053119 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 10 | |
| - StreamingTime: 254889878 | |
| - TotalTime: 699211006 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:16/2.06 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 16 out of 16 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:16 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 8.0 | |
| - BytesRead: 68019764 | |
| - BytesReadDataNodeCache: 68019764 | |
| - BytesReadLocal: 68019764 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 68019764 | |
| - DecompressionTime: 150954072 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 16 | |
| - NumScannerThreadsStarted: 13 | |
| - PeakMemoryUsage: 54066005 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 435805278 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 84294342 | |
| - RowsReturned: 528644 | |
| - RowsReturnedRate: 1196405 | |
| - ScanRangesComplete: 16 | |
| - ScannerThreadsInvoluntaryContextSwitches: 20 | |
| - ScannerThreadsTotalWallClockTime: 5532279699 | |
| - MaterializeTupleTime(*): 4924111965 | |
| - ScannerThreadsSysTime: 160000000 | |
| - ScannerThreadsUserTime: 4908000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 153 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 68019764 | |
| - TotalTime: 441860357 | |
| Instance e14a6ed3f1a25055:b (host=cdh7.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.28 GB | |
| - AverageThreadTokens: 4.5 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 55544685 | |
| - PerHostPeakMemUsage: 57951363 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1121429 | |
| - TotalStorageWaitTime: 95056241 | |
| - TotalThreadsInvoluntaryContextSwitches: 15 | |
| - TotalThreadsTotalWallClockTime: 4274419911 | |
| - TotalThreadsSysTime: 340000000 | |
| - TotalThreadsUserTime: 3212000000 | |
| - TotalThreadsVoluntaryContextSwitches: 379 | |
| - TotalTime: 830832896 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 678968747 | |
| - ExecTreeExecTime: 674282916 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 112009170 | |
| - ExecTreeOpenTime: 120760 | |
| - PrepareTime: 39806076 | |
| - ExecTreePrepareTime: 767335 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 250 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2359848 | |
| - OverallThroughput: 921703 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 108399 | |
| - TotalTime: 271237 | |
| - TransmitDataRPCTime: 105939 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4295030 | |
| - CompileTime: 28755701 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 81755782 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 33816384 | |
| - TotalTime: 145105732 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 106642 | |
| - GetResultsTime: 24333 | |
| - HTResizeTime: 517412 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053153 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 10 | |
| - StreamingTime: 205815444 | |
| - TotalTime: 675163680 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.28 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:10 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 3.5 | |
| - BytesRead: 43032952 | |
| - BytesReadDataNodeCache: 26846975 | |
| - BytesReadLocal: 43032952 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 43032952 | |
| - DecompressionTime: 93674504 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 1 | |
| - NumRowGroups: 10 | |
| - NumScannerThreadsStarted: 10 | |
| - PeakMemoryUsage: 51327432 | |
| - PerReadThreadRawHdfsThroughput: 4447766207 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 462578760 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 53096875 | |
| - RowsReturned: 309503 | |
| - RowsReturnedRate: 662600 | |
| - ScanRangesComplete: 10 | |
| - ScannerThreadsInvoluntaryContextSwitches: 15 | |
| - ScannerThreadsTotalWallClockTime: 3483501347 | |
| - MaterializeTupleTime(*): 3129778179 | |
| - ScannerThreadsSysTime: 184000000 | |
| - ScannerThreadsUserTime: 3040000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 112 | |
| - TotalRawHdfsReadTime(*): 9675183 | |
| - TotalReadThroughput: 43032952 | |
| - TotalTime: 467103658 | |
| Instance e14a6ed3f1a25055:7 (host=cdh5.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:9/1.28 GB | |
| - AverageThreadTokens: 3.5 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 55331372 | |
| - PerHostPeakMemUsage: 57738077 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1191226 | |
| - TotalStorageWaitTime: 53036042 | |
| - TotalThreadsInvoluntaryContextSwitches: 5 | |
| - TotalThreadsTotalWallClockTime: 4102792672 | |
| - TotalThreadsSysTime: 236000000 | |
| - TotalThreadsUserTime: 3184000000 | |
| - TotalThreadsVoluntaryContextSwitches: 338 | |
| - TotalTime: 830128850 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 680567920 | |
| - ExecTreeExecTime: 675770094 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 109917092 | |
| - ExecTreeOpenTime: 113748 | |
| - PrepareTime: 39600962 | |
| - ExecTreePrepareTime: 739442 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 244 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1993724 | |
| - OverallThroughput: 728867 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 150204 | |
| - TotalTime: 334766 | |
| - TransmitDataRPCTime: 122384 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4201886 | |
| - CompileTime: 28525752 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 79805596 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 32377856 | |
| - TotalTime: 141485506 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 103532 | |
| - GetResultsTime: 24094 | |
| - HTResizeTime: 368498 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053079 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 10 | |
| - StreamingTime: 174638890 | |
| - TotalTime: 676616206 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:9/1.28 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:9 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 5.0 | |
| - BytesRead: 42460609 | |
| - BytesReadDataNodeCache: 26023676 | |
| - BytesReadLocal: 42460609 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 42460609 | |
| - DecompressionTime: 98313026 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 1 | |
| - NumRowGroups: 9 | |
| - NumScannerThreadsStarted: 8 | |
| - PeakMemoryUsage: 51692419 | |
| - PerReadThreadRawHdfsThroughput: 4337689382 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 495641464 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 53642219 | |
| - RowsReturned: 289276 | |
| - RowsReturnedRate: 578753 | |
| - ScanRangesComplete: 9 | |
| - ScannerThreadsInvoluntaryContextSwitches: 5 | |
| - ScannerThreadsTotalWallClockTime: 3312356170 | |
| - MaterializeTupleTime(*): 3043124668 | |
| - ScannerThreadsSysTime: 112000000 | |
| - ScannerThreadsUserTime: 3016000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 85 | |
| - TotalRawHdfsReadTime(*): 9788762 | |
| - TotalReadThroughput: 42460609 | |
| - TotalTime: 499825922 | |
| Instance e14a6ed3f1a25055:8 (host=cdh1.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:15/2.04 GB | |
| - AverageThreadTokens: 5.0 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 60498980 | |
| - PerHostPeakMemUsage: 62905674 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 834764 | |
| - TotalStorageWaitTime: 158023592 | |
| - TotalThreadsInvoluntaryContextSwitches: 36 | |
| - TotalThreadsTotalWallClockTime: 6303168572 | |
| - TotalThreadsSysTime: 372000000 | |
| - TotalThreadsUserTime: 5056000000 | |
| - TotalThreadsVoluntaryContextSwitches: 544 | |
| - TotalTime: 826705200 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 673726048 | |
| - ExecTreeExecTime: 669765384 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 111771336 | |
| - ExecTreeOpenTime: 102408 | |
| - PrepareTime: 41161652 | |
| - ExecTreePrepareTime: 789072 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 250 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 2619007 | |
| - OverallThroughput: 1122122 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 74820 | |
| - TotalTime: 222792 | |
| - TransmitDataRPCTime: 95456 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4306000 | |
| - CompileTime: 27478040 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 82742768 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 34571648 | |
| - TotalTime: 145544164 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 97000 | |
| - GetResultsTime: 11764 | |
| - HTResizeTime: 401588 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053163 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 10 | |
| - StreamingTime: 250826764 | |
| - TotalTime: 670652044 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:15/2.04 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 15 out of 15 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:15 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 8.0 | |
| - BytesRead: 69026665 | |
| - BytesReadDataNodeCache: 69026665 | |
| - BytesReadLocal: 69026665 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 69026665 | |
| - DecompressionTime: 140048628 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 15 | |
| - NumScannerThreadsStarted: 13 | |
| - PeakMemoryUsage: 55955582 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 412845888 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 84459663 | |
| - RowsReturned: 496622 | |
| - RowsReturnedRate: 1188163 | |
| - ScanRangesComplete: 15 | |
| - ScannerThreadsInvoluntaryContextSwitches: 31 | |
| - ScannerThreadsTotalWallClockTime: 5517736476 | |
| - MaterializeTupleTime(*): 4925429860 | |
| - ScannerThreadsSysTime: 220000000 | |
| - ScannerThreadsUserTime: 4836000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 154 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 138053330 | |
| - TotalTime: 417974484 | |
| Instance e14a6ed3f1a25055:3 (host=cdh2.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:17/2.00 GB | |
| - AverageThreadTokens: 10.5 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 80371328 | |
| - PerHostPeakMemUsage: 82778006 | |
| - RowsProduced: 8 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1604400 | |
| - TotalStorageWaitTime: 132510300 | |
| - TotalThreadsInvoluntaryContextSwitches: 5 | |
| - TotalThreadsTotalWallClockTime: 5874076132 | |
| - TotalThreadsSysTime: 372000000 | |
| - TotalThreadsUserTime: 4740000000 | |
| - TotalThreadsVoluntaryContextSwitches: 510 | |
| - TotalTime: 817149976 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 668059752 | |
| - ExecTreeExecTime: 662992512 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 110626060 | |
| - ExecTreeOpenTime: 118884 | |
| - PrepareTime: 38380984 | |
| - ExecTreePrepareTime: 736840 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 294 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1457697 | |
| - OverallThroughput: 700673 | |
| - PeakMemoryUsage: 109560 | |
| - RowsReturned: 8 | |
| - SerializeBatchTime: 158668 | |
| - TotalTime: 419596 | |
| - TransmitDataRPCTime: 201688 | |
| - UncompressedRowBatchSize: 376 | |
| CodeGen | |
| - CodegenTime: 4297188 | |
| - CompileTime: 28467936 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 80752796 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 32787676 | |
| - TotalTime: 142771528 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 95364 | |
| - GetResultsTime: 30440 | |
| - HTResizeTime: 691328 | |
| - HashBuckets: 10240 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053117 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 8 | |
| - RowsReturnedRate: 12 | |
| - StreamingTime: 271103208 | |
| - TotalTime: 663840072 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:17/2.00 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:17 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 9.5 | |
| - BytesRead: 66359165 | |
| - BytesReadDataNodeCache: 42075050 | |
| - BytesReadLocal: 66359165 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 66359165 | |
| - DecompressionTime: 148316600 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 1 | |
| - NumRowGroups: 17 | |
| - NumScannerThreadsStarted: 11 | |
| - PeakMemoryUsage: 76140503 | |
| - PerReadThreadRawHdfsThroughput: 4535301092 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 384453980 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 83616139 | |
| - RowsReturned: 713815 | |
| - RowsReturnedRate: 1829317 | |
| - ScanRangesComplete: 17 | |
| - ScannerThreadsInvoluntaryContextSwitches: 5 | |
| - ScannerThreadsTotalWallClockTime: 5095453940 | |
| - MaterializeTupleTime(*): 4576691524 | |
| - ScannerThreadsSysTime: 212000000 | |
| - ScannerThreadsUserTime: 4504000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 168 | |
| - TotalRawHdfsReadTime(*): 14631700 | |
| - TotalReadThroughput: 66359165 | |
| - TotalTime: 390208456 | |
| Instance e14a6ed3f1a25055:c (host=cdh6.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.05 GB | |
| - AverageThreadTokens: 3.5 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 51759842 | |
| - PerHostPeakMemUsage: 54166547 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 919006 | |
| - TotalStorageWaitTime: 56896720 | |
| - TotalThreadsInvoluntaryContextSwitches: 2 | |
| - TotalThreadsTotalWallClockTime: 3343714090 | |
| - TotalThreadsSysTime: 204000000 | |
| - TotalThreadsUserTime: 2464000000 | |
| - TotalThreadsVoluntaryContextSwitches: 390 | |
| - TotalTime: 809191232 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 656539430 | |
| - ExecTreeExecTime: 652367082 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 111935536 | |
| - ExecTreeOpenTime: 106662 | |
| - PrepareTime: 40673454 | |
| - ExecTreePrepareTime: 718920 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 5534973 | |
| - OverallThroughput: 1247800 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 107290 | |
| - TotalTime: 201154 | |
| - TransmitDataRPCTime: 45348 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4087890 | |
| - CompileTime: 29691368 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 80622596 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 33559304 | |
| - TotalTime: 144655408 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 96362 | |
| - GetResultsTime: 16292 | |
| - HTResizeTime: 555494 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10052738 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 10 | |
| - StreamingTime: 139344382 | |
| - TotalTime: 653185982 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:10/1.05 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 10 out of 10 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:10 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 2.5 | |
| - BytesRead: 34416056 | |
| - BytesReadDataNodeCache: 18189782 | |
| - BytesReadLocal: 34416056 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 34416056 | |
| - DecompressionTime: 77142476 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 1 | |
| - NumRowGroups: 10 | |
| - NumScannerThreadsStarted: 7 | |
| - PeakMemoryUsage: 48499219 | |
| - PerReadThreadRawHdfsThroughput: 3543474831 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 508457080 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 43978209 | |
| - RowsReturned: 382331 | |
| - RowsReturnedRate: 746109 | |
| - ScanRangesComplete: 10 | |
| - ScannerThreadsInvoluntaryContextSwitches: 2 | |
| - ScannerThreadsTotalWallClockTime: 2575290980 | |
| - MaterializeTupleTime(*): 2338077936 | |
| - ScannerThreadsSysTime: 104000000 | |
| - ScannerThreadsUserTime: 2308000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 86 | |
| - TotalRawHdfsReadTime(*): 9712516 | |
| - TotalReadThroughput: 34416056 | |
| - TotalTime: 512432996 | |
| Instance e14a6ed3f1a25055:10 (host=cdh9.net.cuberonlabs.com:22000) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.44 GB | |
| - AverageThreadTokens: 3.5 | |
| - BloomFilterBytes: 0 | |
| - InactiveTotalTime: 0 | |
| - PeakMemoryUsage: 46319599 | |
| - PerHostPeakMemUsage: 48718055 | |
| - RowsProduced: 7 | |
| - TotalNetworkReceiveTime: 0 | |
| - TotalNetworkSendTime: 1402024 | |
| - TotalStorageWaitTime: 102307636 | |
| - TotalThreadsInvoluntaryContextSwitches: 0 | |
| - TotalThreadsTotalWallClockTime: 4497903404 | |
| - TotalThreadsSysTime: 348000000 | |
| - TotalThreadsUserTime: 3424000000 | |
| - TotalThreadsVoluntaryContextSwitches: 437 | |
| - TotalTime: 768025851 | |
| Fragment Instance Lifecycle Timings | |
| - ExecTime: 612047617 | |
| - ExecTreeExecTime: 607342641 | |
| - InactiveTotalTime: 0 | |
| - OpenTime: 115586181 | |
| - ExecTreeOpenTime: 115073 | |
| - PrepareTime: 40351929 | |
| - ExecTreePrepareTime: 665385 | |
| - TotalTime: 0 | |
| DataStreamSender (dst_id=3) | |
| - BytesSent: 251 | |
| - InactiveTotalTime: 0 | |
| - NetworkThroughput(*): 1683411 | |
| - OverallThroughput: 816831 | |
| - PeakMemoryUsage: 105464 | |
| - RowsReturned: 7 | |
| - SerializeBatchTime: 104368 | |
| - TotalTime: 307285 | |
| - TransmitDataRPCTime: 149102 | |
| - UncompressedRowBatchSize: 325 | |
| CodeGen | |
| - CodegenTime: 4325499 | |
| - CompileTime: 30340251 | |
| - InactiveTotalTime: 0 | |
| - LoadTime: 0 | |
| - ModuleBitcodeSize: 1997792 | |
| - NumFunctions: 53 | |
| - NumInstructions: 1008 | |
| - OptimizationTime: 83590006 | |
| - PeakMemoryUsage: 516096 | |
| - PrepareTime: 34234861 | |
| - TotalTime: 149023045 | |
| AGGREGATION_NODE (id=1) | |
| ExecOption: Streaming Preaggregation, Codegen Enabled | |
| - GetNewBlockTime: 93999 | |
| - GetResultsTime: 23823 | |
| - HTResizeTime: 443847 | |
| - HashBuckets: 8192 | |
| - InactiveTotalTime: 0 | |
| - LargestPartitionPercent: 0 | |
| - PartitionsCreated: 16 | |
| - PeakMemoryUsage: 10053112 | |
| - PinTime: 0 | |
| - ReductionFactorEstimate: 0.0 | |
| - ReductionFactorThresholdToExpand: 0.0 | |
| - RowsPassedThrough: 0 | |
| - RowsReturned: 7 | |
| - RowsReturnedRate: 11 | |
| - StreamingTime: 203281658 | |
| - TotalTime: 608116626 | |
| - UnpinTime: 0 | |
| HDFS_SCAN_NODE (id=0) | |
| Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:11/1.44 GB | |
| ExecOption: PARQUET Codegen Enabled, Codegen enabled: 11 out of 11 | |
| Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% | |
| File Formats: PARQUET/SNAPPY:11 | |
| - AverageHdfsReadThreadConcurrency: 0.0 | |
| - AverageScannerThreadConcurrency: 5.0 | |
| - BytesRead: 47597284 | |
| - BytesReadDataNodeCache: 47597284 | |
| - BytesReadLocal: 47597284 | |
| - BytesReadRemoteUnexpected: 0 | |
| - BytesReadShortCircuit: 47597284 | |
| - DecompressionTime: 104246747 | |
| - InactiveTotalTime: 0 | |
| - MaxCompressedTextFileLength: 0 | |
| - NumColumns: 1 | |
| - NumDisksAccessed: 0 | |
| - NumRowGroups: 11 | |
| - NumScannerThreadsStarted: 11 | |
| - PeakMemoryUsage: 41268721 | |
| - PerReadThreadRawHdfsThroughput: 0 | |
| - RemoteScanRanges: 0 | |
| - RowBatchQueueGetWaitTime: 398122623 | |
| - RowBatchQueuePutWaitTime: 0 | |
| - RowsRead: 59336606 | |
| - RowsReturned: 418963 | |
| - RowsReturnedRate: 1039846 | |
| - ScanRangesComplete: 11 | |
| - ScannerThreadsInvoluntaryContextSwitches: 0 | |
| - ScannerThreadsTotalWallClockTime: 3770329716 | |
| - MaterializeTupleTime(*): 3347349923 | |
| - ScannerThreadsSysTime: 188000000 | |
| - ScannerThreadsUserTime: 3256000000 | |
| - ScannerThreadsVoluntaryContextSwitches: 116 | |
| - TotalRawHdfsReadTime(*): 0 | |
| - TotalReadThroughput: 47597284 | |
| - TotalTime: 402908592 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment