Skip to content

Instantly share code, notes, and snippets.

@okouaihi

okouaihi/Agg Plan Secret

Last active March 25, 2017 15:33
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save okouaihi/23d01ae9dd9a9ad04a3bea86bb272e72 to your computer and use it in GitHub Desktop.
Save okouaihi/23d01ae9dd9a9ad04a3bea86bb272e72 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
Agg Plan
01:SCAN HDFS [impala_poc_test.event_final_hour ed, RANDOM]
partitions=6/1824 files=6 size=234.07MB
predicates: ((event_date_time >= 20161122170000 AND event_date_time < 20161122180000) OR (event_date_time >= 20161129170000 AND event_date_time < 20161129180000) OR (event_date_time >= 20161206170000 AND event_date_time < 20161206180000) OR (event_date_time >= 20161213170000 AND event_date_time < 20161213180000) OR (event_date_time >= 20161201700000 AND event_date_time < 20161220180000) OR (event_date_time >= 20161227170000 AND event_date_time < 20161227180000))
table stats: 1299660217 rows total
column stats: all
hosts=5 per-host-mem=576.00MB
tuple-ids=3 row-size=584B cardinality=290812
----------------
Estimated Per-Host Mem: 1492518982
Estimated Per-Host VCores: 2
Request Pool: default-pool
Admission result: Admitted immediately
ExecSummary:
Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail
---------------------------------------------------------------------------------------------------------------------------------
10:EXCHANGE 1 0.000ns 0.000ns 0 322.39K 0 -1.00 B UNPARTITIONED
09:AGGREGATE 5 4.999ms 19.000ms 4.84K 322.39K 2.69 MB 27.06 MB FINALIZE
08:EXCHANGE 5 400.000us 2.000ms 40.77K 3.22M 0 0 HASH(name,value)
04:AGGREGATE 5 1s745ms 1s917ms 84.55K 3.22M 10.05 MB 270.56 MB STREAMING
07:AGGREGATE 5 5s213ms 6s022ms 30.03M 5.82M 778.19 MB 423.69 MB FINALIZE
06:EXCHANGE 5 235.600ms 297.000ms 31.91M 5.82M 0 0 HASH(account_id,name,CASE W...
03:AGGREGATE 5 7s756ms 11s435ms 31.91M 5.82M 1.01 GB 423.69 MB STREAMING
02:NESTED LOOP JOIN 5 522.800ms 789.000ms 58.16M 5.82M 1.77 MB 320.00 B CROSS JOIN, BROADCAST
|--05:EXCHANGE 5 0.000ns 0.000ns 20 20 0 0 BROADCAST
| 00:UNION 1 0.000ns 0.000ns 20 20 0 -1.00 B
01:SCAN HDFS 5 53.200ms 68.000ms 2.91M 290.81K 60.32 MB 576.00 MB impala_poc_test.event_...
Planner Timeline: 26.186ms
- Analysis finished: 2.850ms (2.850ms)
- Equivalence classes computed: 5.712ms (2.861ms)
- Single node plan created: 10.809ms (5.096ms)
- Runtime filters computed: 10.904ms (95.092us)
- Distributed plan created: 11.898ms (994.128us)
- Planning finished: 26.186ms (14.288ms)
Query Timeline: 28s413ms
- Query submitted: 0.000ns (0.000ns)
- Planning finished: 37.000ms (37.000ms)
- Submit for admission: 39.000ms (2.000ms)
- Completed admission: 39.000ms (0.000ns)
- Ready to start 17 fragment instances: 39.000ms (0.000ns)
- All 17 fragment instances started: 52.000ms (13.000ms)
- Rows available: 28s381ms (28s329ms)
- First row fetched: 28s384ms (3.000ms)
- Unregister query: 28s395ms (11.000ms)
- ComputeScanRangeAssignmentTimer: 0.000ns
ImpalaServer:
- ClientFetchWaitTimer: 12.000ms
- RowMaterializationTimer: 2.000ms
Execution Profile 644f639b8d2a4480:f8eac30600000000:(Total: 28s338ms, non-child: 0.000ns, % non-child: 0.00%)
Number of filters: 0
Filter routing table:
ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled
----------------------------------------------------------------------------------------------------------------------------
Fragment instance start latencies: Count: 17, 25th %-ile: 3ms, 50th %-ile: 3ms, 75th %-ile: 4ms, 90th %-ile: 5ms, 95th %-ile: 6ms, 99.9th %-ile: 8ms
Per Node Peak Memory Usage: etl002-slv-02:22000(871.29 MB) etl002-slv-03:22000(1.01 GB) etl002-slv-05:22000(840.38 MB) etl002-slv-04:22000(1.63 GB) etl002-slv-01:22000(1.06 GB)
- FiltersReceived: 0 (0)
- FinalizationTimer: 0.000ns
Coordinator Fragment F04:
Instance 644f639b8d2a4480:f8eac30600000000 (host=etl002-slv-01:22000):(Total: 42.000ms, non-child: 0.000ns, % non-child: 0.00%)
MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 8.00 KB (8192)
- PerHostPeakMemUsage: 1.06 GB (1134475162)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 0.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 0.000ns
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 0.000ns
- TotalThreadsVoluntaryContextSwitches: 0 (0)
Fragment Instance Lifecycle Timings:
- OpenTime: 0.000ns
- ExecTreeOpenTime: 0.000ns
- PrepareTime: 42.000ms
- ExecTreePrepareTime: 0.000ns
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 225 (225)
- BlocksRecycled: 47 (47)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 30.05 GB (32263944192)
- PeakMemoryUsage: 1.04 GB (1112014848)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
PLAN_ROOT_SINK:
- PeakMemoryUsage: 0
CodeGen:(Total: 42.000ms, non-child: 42.000ms, % non-child: 100.00%)
- CodegenTime: 0.000ns
- CompileTime: 0.000ns
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 0 (0)
- NumInstructions: 0 (0)
- OptimizationTime: 0.000ns
- PeakMemoryUsage: 0
- PrepareTime: 41.000ms
EXCHANGE_NODE (id=10):
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 0
- ConvertRowBatchTime: 0.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 0
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Averaged Fragment F03:(Total: 11s361ms, non-child: 0.000ns, % non-child: 0.00%)
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:28s346ms max:28s352ms mean: 28s349ms stddev:2.059ms
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 5
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 2.86 MB (2993872)
- PerHostPeakMemUsage: 1.07 GB (1152354395)
- RowsProduced: 968 (968)
- TotalNetworkReceiveTime: 16s742ms
- TotalNetworkSendTime: 1.800ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 11 (11)
- TotalThreadsTotalWallClockTime: 11s317ms
- TotalThreadsSysTime: 3.199ms
- TotalThreadsUserTime: 103.984ms
- TotalThreadsVoluntaryContextSwitches: 44 (44)
Fragment Instance Lifecycle Timings:
- ExecTime: 9.500ms
- ExecTreeExecTime: 3.000ms
- OpenTime: 11s313ms
- ExecTreeOpenTime: 11s209ms
- PrepareTime: 44.599ms
- ExecTreePrepareTime: 2.799ms
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 229 (229)
- BlocksRecycled: 53 (53)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 30.05 GB (32263944192)
- PeakMemoryUsage: 1.06 GB (1134034944)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=10):(Total: 800.000us, non-child: 800.000us, % non-child: 100.00%)
- BytesSent: 49.98 KB (51179)
- NetworkThroughput(*): 48.81 MB/sec
- OverallThroughput: 32.30 MB/sec
- PeakMemoryUsage: 1.58 KB (1616)
- RowsReturned: 968 (968)
- SerializeBatchTime: 400.000us
- TransmitDataRPCTime: 400.000us
- UncompressedRowBatchSize: 120.88 KB (123784)
CodeGen:(Total: 293.599ms, non-child: 293.599ms, % non-child: 100.00%)
- CodegenTime: 5.400ms
- CompileTime: 75.600ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 60 (60)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 180.000ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 36.599ms
AGGREGATION_NODE (id=9):(Total: 11s213ms, non-child: 0.000ns, % non-child: 0.00%)
- BuildTime: 1.400ms
- GetNewBlockTime: 2.000ms
- GetResultsTime: 0.000ns
- HTResizeTime: 200.000us
- HashBuckets: 13.11K (13107)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.53 MB (2654828)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 968 (968)
- RowsReturnedRate: 34.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=8):(Total: 16s742ms, non-child: 16s742ms, % non-child: 100.00%)
- BytesReceived: 406.37 KB (416126)
- ConvertRowBatchTime: 200.000us
- DeserializeRowBatchTimer: 1.000ms
- FirstBatchArrivalWaitTime: 16s562ms
- PeakMemoryUsage: 0
- RowsReturned: 8.15K (8154)
- RowsReturnedRate: 291.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Fragment F03:
Instance 644f639b8d2a4480:d (host=etl002-slv-05:22000):(Total: 28s347ms, non-child: 11.000ms, % non-child: 0.04%)
MemoryUsage(500.000ms): 2.30 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.61 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 2.86 MB (2993872)
- PerHostPeakMemUsage: 840.38 MB (881203619)
- RowsProduced: 2.39K (2389)
- TotalNetworkReceiveTime: 28s036ms
- TotalNetworkSendTime: 7.000ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 29 (29)
- TotalThreadsTotalWallClockTime: 28s309ms
- TotalThreadsSysTime: 9.998ms
- TotalThreadsUserTime: 256.961ms
- TotalThreadsVoluntaryContextSwitches: 116 (116)
Fragment Instance Lifecycle Timings:
- ExecTime: 10.000ms
- ExecTreeExecTime: 2.000ms
- OpenTime: 28s299ms
- ExecTreeOpenTime: 28s040ms
- PrepareTime: 38.999ms
- ExecTreePrepareTime: 999.992us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 203 (203)
- BlocksRecycled: 69 (69)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 30.05 GB (32263944192)
- PeakMemoryUsage: 818.50 MB (858259456)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=10):(Total: 1.000ms, non-child: 1.000ms, % non-child: 100.00%)
- BytesSent: 123.14 KB (126093)
- NetworkThroughput(*): 120.25 MB/sec
- OverallThroughput: 120.25 MB/sec
- PeakMemoryUsage: 1.58 KB (1616)
- RowsReturned: 2.39K (2389)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 1.000ms
- UncompressedRowBatchSize: 298.35 KB (305506)
CodeGen:(Total: 292.999ms, non-child: 292.999ms, % non-child: 100.00%)
- CodegenTime: 5.000ms
- CompileTime: 76.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 60 (60)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 180.000ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 35.999ms
AGGREGATION_NODE (id=9):(Total: 28s042ms, non-child: 4.999ms, % non-child: 0.02%)
ExecOption: Codegen Enabled
- BuildTime: 2.000ms
- GetNewBlockTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 1.000ms
- HashBuckets: 32.77K (32768)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.69 MB (2818257)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.39K (2389)
- RowsReturnedRate: 85.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=8):(Total: 28s038ms, non-child: 2.000ms, % non-child: 0.01%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 670.45 KB
- BytesReceived: 838.07 KB (858185)
- ConvertRowBatchTime: 1.000ms
- DeserializeRowBatchTimer: 2.000ms
- FirstBatchArrivalWaitTime: 27s612ms
- PeakMemoryUsage: 0
- RowsReturned: 16.88K (16875)
- RowsReturnedRate: 601.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 644f639b8d2a4480:10 (host=etl002-slv-01:22000):(Total: 28s341ms, non-child: 14.000ms, % non-child: 0.05%)
MemoryUsage(500.000ms): 2.86 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.66 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 2.86 MB (2993872)
- PerHostPeakMemUsage: 1.06 GB (1134475162)
- RowsProduced: 2.45K (2453)
- TotalNetworkReceiveTime: 28s005ms
- TotalNetworkSendTime: 2.000ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 27 (27)
- TotalThreadsTotalWallClockTime: 28s276ms
- TotalThreadsSysTime: 5.999ms
- TotalThreadsUserTime: 262.960ms
- TotalThreadsVoluntaryContextSwitches: 108 (108)
Fragment Instance Lifecycle Timings:
- ExecTime: 9.000ms
- ExecTreeExecTime: 4.000ms
- OpenTime: 28s267ms
- ExecTreeOpenTime: 28s009ms
- PrepareTime: 65.000ms
- ExecTreePrepareTime: 11.000ms
DataStreamSender (dst_id=10):(Total: 3.000ms, non-child: 3.000ms, % non-child: 100.00%)
- BytesSent: 126.76 KB (129804)
- NetworkThroughput(*): 123.79 MB/sec
- OverallThroughput: 41.26 MB/sec
- PeakMemoryUsage: 1.58 KB (1616)
- RowsReturned: 2.45K (2453)
- SerializeBatchTime: 2.000ms
- TransmitDataRPCTime: 1.000ms
- UncompressedRowBatchSize: 306.07 KB (313417)
CodeGen:(Total: 300.000ms, non-child: 300.000ms, % non-child: 100.00%)
- CodegenTime: 5.000ms
- CompileTime: 76.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 60 (60)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 180.000ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 41.000ms
AGGREGATION_NODE (id=9):(Total: 28s024ms, non-child: 19.000ms, % non-child: 0.07%)
ExecOption: Codegen Enabled
- BuildTime: 4.000ms
- GetNewBlockTime: 10.000ms
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 32.77K (32768)
- LargestPartitionPercent: 1 (1)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.69 MB (2825779)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 2.45K (2453)
- RowsReturnedRate: 87.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=8):(Total: 28s005ms, non-child: 0.000ns, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 343.40 KB
- BytesReceived: 857.73 KB (878311)
- ConvertRowBatchTime: 0.000ns
- DeserializeRowBatchTimer: 3.000ms
- FirstBatchArrivalWaitTime: 27s579ms
- PeakMemoryUsage: 0
- RowsReturned: 17.18K (17177)
- RowsReturnedRate: 613.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 644f639b8d2a4480:f (host=etl002-slv-03:22000):(Total: 40.999ms, non-child: 0.000ns, % non-child: 0.00%)
MemoryUsage(500.000ms): 2.29 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 2.86 MB (2993872)
- PerHostPeakMemUsage: 1.01 GB (1080156572)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 0.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 0.000ns
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 0.000ns
- TotalThreadsVoluntaryContextSwitches: 0 (0)
Fragment Instance Lifecycle Timings:
- OpenTime: 0.000ns
- ExecTreeOpenTime: 0.000ns
- PrepareTime: 40.999ms
- ExecTreePrepareTime: 999.992us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 219 (219)
- BlocksRecycled: 48 (48)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 30.05 GB (32263944192)
- PeakMemoryUsage: 1008.50 MB (1057488896)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=10):
- BytesSent: 0
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 1.58 KB (1616)
- RowsReturned: 0 (0)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 0
CodeGen:(Total: 303.999ms, non-child: 303.999ms, % non-child: 100.00%)
- CodegenTime: 7.000ms
- CompileTime: 79.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 60 (60)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 187.000ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 36.999ms
AGGREGATION_NODE (id=9):(Total: 999.992us, non-child: 999.992us, % non-child: 100.00%)
ExecOption: Codegen Enabled
- BuildTime: 0.000ns
- GetNewBlockTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 0 (0)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.30 MB (2406528)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=8):
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 0
- ConvertRowBatchTime: 0.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 0
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 644f639b8d2a4480:e (host=etl002-slv-02:22000):(Total: 38.999ms, non-child: 0.000ns, % non-child: 0.00%)
MemoryUsage(500.000ms): 2.86 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 2.86 MB (2993872)
- PerHostPeakMemUsage: 871.29 MB (913612163)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 0.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 0.000ns
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 0.000ns
- TotalThreadsVoluntaryContextSwitches: 0 (0)
Fragment Instance Lifecycle Timings:
- OpenTime: 0.000ns
- ExecTreeOpenTime: 0.000ns
- PrepareTime: 38.999ms
- ExecTreePrepareTime: 0.000ns
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 208 (208)
- BlocksRecycled: 64 (64)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 30.05 GB (32263944192)
- PeakMemoryUsage: 850.50 MB (891813888)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=10):
- BytesSent: 0
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 1.58 KB (1616)
- RowsReturned: 0 (0)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 0
CodeGen:(Total: 285.999ms, non-child: 285.999ms, % non-child: 100.00%)
- CodegenTime: 5.000ms
- CompileTime: 74.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 60 (60)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 177.000ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 33.999ms
AGGREGATION_NODE (id=9):
ExecOption: Codegen Enabled
- BuildTime: 0.000ns
- GetNewBlockTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 0 (0)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.30 MB (2406528)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=8):
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
- BytesReceived: 0
- ConvertRowBatchTime: 0.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 0
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 644f639b8d2a4480:c (host=etl002-slv-04:22000):(Total: 38.999ms, non-child: 0.000ns, % non-child: 0.00%)
MemoryUsage(500.000ms): 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.31 MB, 2.65 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 2.86 MB (2993872)
- PerHostPeakMemUsage: 1.63 GB (1752324462)
- RowsProduced: 0 (0)
- TotalNetworkReceiveTime: 27s669ms
- TotalNetworkSendTime: 0.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 0.000ns
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 0.000ns
- TotalThreadsVoluntaryContextSwitches: 0 (0)
Fragment Instance Lifecycle Timings:
- OpenTime: 0.000ns
- ExecTreeOpenTime: 0.000ns
- PrepareTime: 38.999ms
- ExecTreePrepareTime: 999.990us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 286 (286)
- BlocksRecycled: 34 (34)
- BufferedPins: 0 (0)
- BytesWritten: 0
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 30.05 GB (32263944192)
- PeakMemoryUsage: 1.61 GB (1728577536)
- ScratchFileUsedBytes: 0
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=10):
- BytesSent: 0
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 1.58 KB (1616)
- RowsReturned: 0 (0)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 0
CodeGen:(Total: 284.999ms, non-child: 284.999ms, % non-child: 100.00%)
- CodegenTime: 5.000ms
- CompileTime: 73.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 60 (60)
- NumInstructions: 1.14K (1136)
- OptimizationTime: 176.000ms
- PeakMemoryUsage: 568.00 KB (581632)
- PrepareTime: 34.999ms
AGGREGATION_NODE (id=9):(Total: 999.990us, non-child: 0.000ns, % non-child: 0.00%)
ExecOption: Codegen Enabled
- BuildTime: 1.000ms
- GetNewBlockTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 0 (0)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.69 MB (2817052)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 0 (0)
- RowsReturnedRate: 0
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=8):(Total: 27s667ms, non-child: 0.000ns, % non-child: 0.00%)
BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 336.07 KB
- BytesReceived: 336.07 KB (344134)
- ConvertRowBatchTime: 0.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 27s620ms
- PeakMemoryUsage: 0
- RowsReturned: 6.72K (6721)
- RowsReturnedRate: 242.00 /sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Averaged Fragment F02:(Total: 28s113ms, non-child: 21.399ms, % non-child: 0.08%)
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:27s925ms max:28s339ms mean: 28s114ms stddev:152.900ms
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 5
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 788.14 MB (826423385)
- PerHostPeakMemUsage: 1.07 GB (1152354395)
- RowsProduced: 16.91K (16909)
- TotalNetworkReceiveTime: 20s406ms
- TotalNetworkSendTime: 1.400ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 2.62K (2615)
- TotalThreadsTotalWallClockTime: 28s058ms
- TotalThreadsSysTime: 1s346ms
- TotalThreadsUserTime: 7s464ms
- TotalThreadsVoluntaryContextSwitches: 16.98K (16985)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s006ms
- ExecTreeExecTime: 1s990ms
- OpenTime: 26s052ms
- ExecTreeOpenTime: 25s498ms
- PrepareTime: 54.799ms
- ExecTreePrepareTime: 2.199ms
DataStreamSender (dst_id=8):(Total: 4.800ms, non-child: 4.800ms, % non-child: 100.00%)
- BytesSent: 842.38 KB (862602)
- NetworkThroughput(*): 328.88 MB/sec
- OverallThroughput: 185.31 MB/sec
- PeakMemoryUsage: 147.89 KB (151440)
- RowsReturned: 16.91K (16909)
- SerializeBatchTime: 3.800ms
- TransmitDataRPCTime: 1.000ms
- UncompressedRowBatchSize: 2.04 MB (2141509)
CodeGen:(Total: 595.599ms, non-child: 595.599ms, % non-child: 100.00%)
- CodegenTime: 9.999ms
- CompileTime: 175.400ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 85 (85)
- NumInstructions: 2.28K (2282)
- OptimizationTime: 376.000ms
- PeakMemoryUsage: 1.11 MB (1168384)
- PrepareTime: 43.599ms
AGGREGATION_NODE (id=4):(Total: 27s491ms, non-child: 1s745ms, % non-child: 6.35%)
- GetNewBlockTime: 200.000us
- GetResultsTime: 1.400ms
- HTResizeTime: 1.000ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.05 MB (10537088)
- PinTime: 0.000ns
- ReductionFactorEstimate: 591.19
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 16.91K (16909)
- RowsReturnedRate: 614.00 /sec
- StreamingTime: 1s717ms
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=7):(Total: 25s746ms, non-child: 5s213ms, % non-child: 20.25%)
- BuildTime: 4s946ms
- GetNewBlockTime: 2.599ms
- GetResultsTime: 181.200ms
- HTResizeTime: 721.399ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 5 (5)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 778.19 MB (815989388)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 6.01M (6006678)
- RowsReturnedRate: 233.30 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=6):(Total: 20s532ms, non-child: 20s532ms, % non-child: 100.00%)
- BytesReceived: 296.41 MB (310804150)
- ConvertRowBatchTime: 109.000ms
- DeserializeRowBatchTimer: 873.600ms
- FirstBatchArrivalWaitTime: 891.000ms
- PeakMemoryUsage: 0
- RowsReturned: 6.38M (6381626)
- RowsReturnedRate: 311.12 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Fragment F02:
Instance 644f639b8d2a4480:8 (host=etl002-slv-05:22000):(Total: 28s336ms, non-child: 22.000ms, % non-child: 0.08%)
MemoryUsage(500.000ms): 4.74 MB, 3.63 MB, 3.63 MB, 11.50 MB, 13.42 MB, 143.42 MB, 147.45 MB, 147.50 MB, 155.45 MB, 155.47 MB, 155.42 MB, 155.50 MB, 155.53 MB, 171.45 MB, 171.53 MB, 171.53 MB, 171.45 MB, 207.56 MB, 326.81 MB, 331.45 MB, 331.45 MB, 331.53 MB, 331.50 MB, 331.47 MB, 331.50 MB, 347.56 MB, 456.34 MB, 502.57 MB, 523.47 MB, 523.53 MB, 523.42 MB, 523.50 MB, 523.53 MB, 555.45 MB, 603.45 MB, 643.42 MB, 651.48 MB, 651.42 MB, 651.47 MB, 651.47 MB, 651.45 MB, 651.47 MB, 651.42 MB, 651.50 MB, 651.42 MB, 651.53 MB, 715.47 MB, 731.42 MB, 747.45 MB, 779.45 MB, 779.50 MB, 779.47 MB, 788.14 MB, 601.70 MB, 447.76 MB, 301.89 MB, 58.76 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 788.14 MB (826423385)
- PerHostPeakMemUsage: 840.38 MB (881203619)
- RowsProduced: 16.91K (16907)
- TotalNetworkReceiveTime: 20s365ms
- TotalNetworkSendTime: 1.000ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 2.21K (2209)
- TotalThreadsTotalWallClockTime: 28s277ms
- TotalThreadsSysTime: 1s327ms
- TotalThreadsUserTime: 7s877ms
- TotalThreadsVoluntaryContextSwitches: 17.03K (17027)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s230ms
- ExecTreeExecTime: 2s212ms
- OpenTime: 26s047ms
- ExecTreeOpenTime: 25s498ms
- PrepareTime: 59.999ms
- ExecTreePrepareTime: 999.999us
DataStreamSender (dst_id=8):(Total: 7.000ms, non-child: 7.000ms, % non-child: 100.00%)
- BytesSent: 841.50 KB (861701)
- NetworkThroughput(*): 821.78 MB/sec
- OverallThroughput: 117.40 MB/sec
- PeakMemoryUsage: 147.89 KB (151440)
- RowsReturned: 16.91K (16907)
- SerializeBatchTime: 6.000ms
- TransmitDataRPCTime: 1.000ms
- UncompressedRowBatchSize: 2.04 MB (2141163)
CodeGen:(Total: 596.999ms, non-child: 596.999ms, % non-child: 100.00%)
- CodegenTime: 10.000ms
- CompileTime: 173.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 85 (85)
- NumInstructions: 2.28K (2282)
- OptimizationTime: 374.000ms
- PeakMemoryUsage: 1.11 MB (1168384)
- PrepareTime: 49.999ms
AGGREGATION_NODE (id=4):(Total: 27s710ms, non-child: 1s917ms, % non-child: 6.92%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 0.000ns
- GetResultsTime: 1.000ms
- HTResizeTime: 1.000ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.05 MB (10537088)
- PinTime: 0.000ns
- ReductionFactorEstimate: 594.01
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 16.91K (16907)
- RowsReturnedRate: 610.00 /sec
- StreamingTime: 1s889ms
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=7):(Total: 25s793ms, non-child: 5s304ms, % non-child: 20.56%)
ExecOption: Codegen Enabled
- BuildTime: 4s997ms
- GetNewBlockTime: 1.000ms
- GetResultsTime: 221.000ms
- HTResizeTime: 762.000ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 5 (5)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 778.19 MB (815988145)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 6.01M (6008798)
- RowsReturnedRate: 232.96 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=6):(Total: 20s488ms, non-child: 263.000ms, % non-child: 1.28%)
BytesReceived(500.000ms): 0, 0, 0, 484.20 KB, 1.47 MB, 6.05 MB, 10.20 MB, 12.26 MB, 15.94 MB, 18.59 MB, 21.26 MB, 24.90 MB, 28.25 MB, 34.38 MB, 41.14 MB, 48.42 MB, 55.21 MB, 63.33 MB, 71.62 MB, 79.58 MB, 85.50 MB, 91.36 MB, 97.01 MB, 103.76 MB, 114.20 MB, 124.71 MB, 136.70 MB, 149.08 MB, 159.76 MB, 168.87 MB, 174.81 MB, 180.42 MB, 185.94 MB, 191.47 MB, 199.06 MB, 207.63 MB, 216.17 MB, 224.57 MB, 231.61 MB, 237.27 MB, 241.33 MB, 244.29 MB, 249.10 MB, 252.49 MB, 255.38 MB, 260.24 MB, 265.68 MB, 271.16 MB, 276.69 MB, 282.00 MB, 287.14 MB, 292.69 MB
- BytesReceived: 296.48 MB (310884504)
- ConvertRowBatchTime: 99.000ms
- DeserializeRowBatchTimer: 1s069ms
- FirstBatchArrivalWaitTime: 890.000ms
- PeakMemoryUsage: 0
- RowsReturned: 6.38M (6383307)
- RowsReturnedRate: 311.55 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 644f639b8d2a4480:a (host=etl002-slv-03:22000):(Total: 28s185ms, non-child: 16.999ms, % non-child: 0.06%)
MemoryUsage(500.000ms): 3.62 MB, 3.62 MB, 3.63 MB, 4.00 MB, 11.50 MB, 15.50 MB, 147.45 MB, 147.45 MB, 147.47 MB, 155.50 MB, 155.48 MB, 155.47 MB, 155.50 MB, 155.53 MB, 171.45 MB, 171.51 MB, 171.47 MB, 187.47 MB, 307.50 MB, 331.50 MB, 331.47 MB, 331.45 MB, 331.42 MB, 331.47 MB, 331.47 MB, 347.56 MB, 407.47 MB, 475.50 MB, 523.71 MB, 523.50 MB, 523.50 MB, 523.45 MB, 523.50 MB, 523.47 MB, 595.47 MB, 619.42 MB, 651.56 MB, 651.47 MB, 651.45 MB, 651.42 MB, 651.42 MB, 651.47 MB, 651.50 MB, 651.45 MB, 651.50 MB, 651.42 MB, 675.45 MB, 731.50 MB, 747.45 MB, 779.50 MB, 779.45 MB, 779.53 MB, 779.45 MB, 690.89 MB, 545.01 MB, 350.51 MB, 107.39 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 788.14 MB (826423385)
- PerHostPeakMemUsage: 1.01 GB (1080156572)
- RowsProduced: 16.90K (16902)
- TotalNetworkReceiveTime: 19s924ms
- TotalNetworkSendTime: 1.000ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 3.37K (3370)
- TotalThreadsTotalWallClockTime: 28s135ms
- TotalThreadsSysTime: 1s509ms
- TotalThreadsUserTime: 7s825ms
- TotalThreadsVoluntaryContextSwitches: 16.59K (16592)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s078ms
- ExecTreeExecTime: 2s063ms
- OpenTime: 26s056ms
- ExecTreeOpenTime: 25s502ms
- PrepareTime: 50.999ms
- ExecTreePrepareTime: 3.999ms
DataStreamSender (dst_id=8):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%)
- BytesSent: 841.63 KB (861828)
- NetworkThroughput(*): 410.95 MB/sec
- OverallThroughput: 205.48 MB/sec
- PeakMemoryUsage: 147.89 KB (151440)
- RowsReturned: 16.90K (16902)
- SerializeBatchTime: 2.000ms
- TransmitDataRPCTime: 2.000ms
- UncompressedRowBatchSize: 2.04 MB (2140388)
CodeGen:(Total: 595.000ms, non-child: 595.000ms, % non-child: 100.00%)
- CodegenTime: 11.000ms
- CompileTime: 173.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 85 (85)
- NumInstructions: 2.28K (2282)
- OptimizationTime: 379.000ms
- PeakMemoryUsage: 1.11 MB (1168384)
- PrepareTime: 42.000ms
AGGREGATION_NODE (id=4):(Total: 27s569ms, non-child: 1s830ms, % non-child: 6.64%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 0.000ns
- GetResultsTime: 2.000ms
- HTResizeTime: 1.000ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.05 MB (10537088)
- PinTime: 0.000ns
- ReductionFactorEstimate: 583.58
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 16.90K (16902)
- RowsReturnedRate: 613.00 /sec
- StreamingTime: 1s796ms
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=7):(Total: 25s738ms, non-child: 5s686ms, % non-child: 22.09%)
ExecOption: Codegen Enabled
- BuildTime: 5s416ms
- GetNewBlockTime: 3.999ms
- GetResultsTime: 169.000ms
- HTResizeTime: 767.999ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 5 (5)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 778.19 MB (815994305)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 6.00M (6004965)
- RowsReturnedRate: 233.30 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=6):(Total: 20s052ms, non-child: 232.000ms, % non-child: 1.16%)
BytesReceived(500.000ms): 0, 0, 0, 164.02 KB, 485.23 KB, 3.70 MB, 8.29 MB, 11.36 MB, 13.94 MB, 17.06 MB, 20.08 MB, 23.22 MB, 26.40 MB, 31.44 MB, 37.65 MB, 45.15 MB, 52.02 MB, 59.38 MB, 67.75 MB, 76.12 MB, 82.75 MB, 88.69 MB, 94.34 MB, 99.98 MB, 109.43 MB, 119.66 MB, 130.90 MB, 143.32 MB, 154.78 MB, 164.76 MB, 172.09 MB, 177.71 MB, 183.20 MB, 188.80 MB, 195.23 MB, 203.59 MB, 212.21 MB, 220.51 MB, 228.89 MB, 234.55 MB, 239.92 MB, 242.83 MB, 246.53 MB, 251.06 MB, 254.01 MB, 257.72 MB, 263.04 MB, 268.48 MB, 274.01 MB, 279.40 MB, 284.68 MB, 290.03 MB, 295.56 MB
- BytesReceived: 296.34 MB (310734444)
- ConvertRowBatchTime: 117.000ms
- DeserializeRowBatchTimer: 866.000ms
- FirstBatchArrivalWaitTime: 894.000ms
- PeakMemoryUsage: 0
- RowsReturned: 6.38M (6380488)
- RowsReturnedRate: 318.18 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 644f639b8d2a4480:b (host=etl002-slv-01:22000):(Total: 28s161ms, non-child: 32.000ms, % non-child: 0.11%)
MemoryUsage(500.000ms): 4.74 MB, 3.62 MB, 3.63 MB, 12.42 MB, 12.42 MB, 143.50 MB, 147.47 MB, 147.47 MB, 147.47 MB, 155.42 MB, 155.47 MB, 155.50 MB, 155.50 MB, 163.22 MB, 171.56 MB, 171.45 MB, 171.53 MB, 195.56 MB, 307.51 MB, 331.50 MB, 331.45 MB, 331.47 MB, 331.47 MB, 331.45 MB, 331.53 MB, 347.59 MB, 432.58 MB, 475.47 MB, 520.48 MB, 523.47 MB, 523.50 MB, 523.42 MB, 523.50 MB, 523.45 MB, 603.50 MB, 635.56 MB, 651.53 MB, 651.53 MB, 651.45 MB, 651.47 MB, 651.45 MB, 651.45 MB, 651.42 MB, 651.45 MB, 651.47 MB, 651.50 MB, 683.42 MB, 731.50 MB, 747.47 MB, 779.50 MB, 779.45 MB, 779.45 MB, 779.50 MB, 690.89 MB, 504.45 MB, 301.89 MB, 58.76 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 788.14 MB (826423385)
- PerHostPeakMemUsage: 1.06 GB (1134475162)
- RowsProduced: 16.92K (16916)
- TotalNetworkReceiveTime: 19s578ms
- TotalNetworkSendTime: 2.000ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 2.91K (2906)
- TotalThreadsTotalWallClockTime: 28s087ms
- TotalThreadsSysTime: 1s429ms
- TotalThreadsUserTime: 7s945ms
- TotalThreadsVoluntaryContextSwitches: 16.71K (16708)
Fragment Instance Lifecycle Timings:
- ExecTime: 2s052ms
- ExecTreeExecTime: 2s037ms
- OpenTime: 26s035ms
- ExecTreeOpenTime: 25s482ms
- PrepareTime: 74.000ms
- ExecTreePrepareTime: 2.000ms
DataStreamSender (dst_id=8):(Total: 3.000ms, non-child: 3.000ms, % non-child: 100.00%)
- BytesSent: 843.16 KB (863394)
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 274.47 MB/sec
- PeakMemoryUsage: 147.89 KB (151440)
- RowsReturned: 16.92K (16916)
- SerializeBatchTime: 3.000ms
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 2.04 MB (2142434)
CodeGen:(Total: 605.000ms, non-child: 605.000ms, % non-child: 100.00%)
- CodegenTime: 10.000ms
- CompileTime: 173.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 85 (85)
- NumInstructions: 2.28K (2282)
- OptimizationTime: 378.000ms
- PeakMemoryUsage: 1.11 MB (1168384)
- PrepareTime: 53.000ms
AGGREGATION_NODE (id=4):(Total: 27s521ms, non-child: 1s778ms, % non-child: 6.46%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 1.000ms
- GetResultsTime: 1.000ms
- HTResizeTime: 2.000ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.05 MB (10537088)
- PinTime: 0.000ns
- ReductionFactorEstimate: 587.29
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 16.92K (16916)
- RowsReturnedRate: 614.00 /sec
- StreamingTime: 1s751ms
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=7):(Total: 25s743ms, non-child: 6s022ms, % non-child: 23.39%)
ExecOption: Codegen Enabled
- BuildTime: 5s735ms
- GetNewBlockTime: 1.999ms
- GetResultsTime: 196.000ms
- HTResizeTime: 817.000ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 5 (5)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 778.19 MB (815987972)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 6.01M (6006719)
- RowsReturnedRate: 233.33 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=6):(Total: 19s720ms, non-child: 297.000ms, % non-child: 1.51%)
BytesReceived(500.000ms): 0, 0, 0, 494.92 KB, 494.92 KB, 4.33 MB, 8.74 MB, 11.56 MB, 14.54 MB, 17.34 MB, 20.28 MB, 23.71 MB, 26.76 MB, 32.19 MB, 38.27 MB, 45.93 MB, 52.86 MB, 60.40 MB, 68.71 MB, 77.04 MB, 83.42 MB, 89.31 MB, 94.97 MB, 100.62 MB, 110.65 MB, 120.96 MB, 132.41 MB, 144.80 MB, 156.07 MB, 165.83 MB, 172.78 MB, 178.40 MB, 183.91 MB, 189.45 MB, 196.19 MB, 204.71 MB, 213.29 MB, 221.64 MB, 229.69 MB, 235.37 MB, 240.33 MB, 243.30 MB, 247.24 MB, 251.51 MB, 254.39 MB, 258.45 MB, 263.67 MB, 269.22 MB, 274.72 MB, 280.14 MB, 285.37 MB, 290.78 MB, 296.33 MB
- BytesReceived: 296.45 MB (310851881)
- ConvertRowBatchTime: 122.000ms
- DeserializeRowBatchTimer: 1s161ms
- FirstBatchArrivalWaitTime: 872.000ms
- PeakMemoryUsage: 0
- RowsReturned: 6.38M (6382128)
- RowsReturnedRate: 323.62 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 644f639b8d2a4480:9 (host=etl002-slv-02:22000):(Total: 27s960ms, non-child: 19.000ms, % non-child: 0.07%)
MemoryUsage(500.000ms): 4.74 MB, 3.62 MB, 3.63 MB, 12.42 MB, 12.42 MB, 143.42 MB, 147.50 MB, 147.45 MB, 147.45 MB, 155.45 MB, 155.42 MB, 155.45 MB, 155.45 MB, 167.98 MB, 171.47 MB, 171.50 MB, 171.53 MB, 195.59 MB, 307.47 MB, 331.53 MB, 331.53 MB, 331.45 MB, 331.45 MB, 331.45 MB, 331.47 MB, 347.53 MB, 423.56 MB, 484.25 MB, 519.50 MB, 523.50 MB, 523.45 MB, 523.42 MB, 523.50 MB, 523.47 MB, 603.47 MB, 627.53 MB, 651.56 MB, 651.50 MB, 651.50 MB, 651.45 MB, 651.50 MB, 651.50 MB, 651.47 MB, 651.42 MB, 651.42 MB, 651.50 MB, 691.47 MB, 731.50 MB, 747.45 MB, 779.47 MB, 779.45 MB, 779.42 MB, 779.53 MB, 650.33 MB, 447.76 MB, 204.64 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 788.14 MB (826423385)
- PerHostPeakMemUsage: 871.29 MB (913612163)
- RowsProduced: 16.91K (16907)
- TotalNetworkReceiveTime: 21s543ms
- TotalNetworkSendTime: 1.000ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1.64K (1642)
- TotalThreadsTotalWallClockTime: 27s915ms
- TotalThreadsSysTime: 1s010ms
- TotalThreadsUserTime: 7s173ms
- TotalThreadsVoluntaryContextSwitches: 17.50K (17496)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s854ms
- ExecTreeExecTime: 1s838ms
- OpenTime: 26s061ms
- ExecTreeOpenTime: 25s509ms
- PrepareTime: 45.000ms
- ExecTreePrepareTime: 1.999ms
DataStreamSender (dst_id=8):(Total: 5.000ms, non-child: 5.000ms, % non-child: 100.00%)
- BytesSent: 842.59 KB (862814)
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 164.57 MB/sec
- PeakMemoryUsage: 147.89 KB (151440)
- RowsReturned: 16.91K (16907)
- SerializeBatchTime: 5.000ms
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 2.04 MB (2141420)
CodeGen:(Total: 587.000ms, non-child: 587.000ms, % non-child: 100.00%)
- CodegenTime: 9.999ms
- CompileTime: 178.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 85 (85)
- NumInstructions: 2.28K (2282)
- OptimizationTime: 372.000ms
- PeakMemoryUsage: 1.11 MB (1168384)
- PrepareTime: 37.000ms
AGGREGATION_NODE (id=4):(Total: 27s348ms, non-child: 1s613ms, % non-child: 5.90%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 0.000ns
- GetResultsTime: 3.000ms
- HTResizeTime: 1.000ms
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.05 MB (10537088)
- PinTime: 0.000ns
- ReductionFactorEstimate: 588.41
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 16.91K (16907)
- RowsReturnedRate: 618.00 /sec
- StreamingTime: 1s592ms
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=7):(Total: 25s734ms, non-child: 4s083ms, % non-child: 15.87%)
ExecOption: Codegen Enabled
- BuildTime: 3s844ms
- GetNewBlockTime: 1.000ms
- GetResultsTime: 165.000ms
- HTResizeTime: 634.000ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 5 (5)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 778.19 MB (815988118)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 6.01M (6007218)
- RowsReturnedRate: 233.43 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=6):(Total: 21s651ms, non-child: 187.000ms, % non-child: 0.86%)
BytesReceived(500.000ms): 0, 0, 0, 494.45 KB, 494.45 KB, 4.26 MB, 8.70 MB, 11.54 MB, 14.47 MB, 17.31 MB, 20.28 MB, 23.68 MB, 26.73 MB, 32.17 MB, 38.26 MB, 45.93 MB, 52.83 MB, 60.38 MB, 68.71 MB, 77.06 MB, 83.48 MB, 89.40 MB, 95.02 MB, 100.68 MB, 110.63 MB, 120.86 MB, 132.33 MB, 144.72 MB, 155.96 MB, 165.71 MB, 172.66 MB, 178.30 MB, 183.80 MB, 189.39 MB, 196.06 MB, 204.58 MB, 213.14 MB, 221.41 MB, 229.51 MB, 235.19 MB, 240.19 MB, 243.17 MB, 247.11 MB, 251.38 MB, 254.26 MB, 258.30 MB, 263.59 MB, 269.12 MB, 274.66 MB, 280.04 MB, 285.28 MB, 290.68 MB, 296.24 MB
- BytesReceived: 296.41 MB (310806488)
- ConvertRowBatchTime: 97.000ms
- DeserializeRowBatchTimer: 774.000ms
- FirstBatchArrivalWaitTime: 901.000ms
- PeakMemoryUsage: 0
- RowsReturned: 6.38M (6382207)
- RowsReturnedRate: 294.76 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Instance 644f639b8d2a4480:7 (host=etl002-slv-04:22000):(Total: 27s922ms, non-child: 16.999ms, % non-child: 0.06%)
MemoryUsage(500.000ms): 3.62 MB, 3.63 MB, 3.63 MB, 11.50 MB, 14.03 MB, 147.47 MB, 147.45 MB, 147.42 MB, 155.45 MB, 155.47 MB, 155.50 MB, 155.42 MB, 155.53 MB, 171.50 MB, 171.50 MB, 171.47 MB, 187.53 MB, 307.53 MB, 331.47 MB, 331.50 MB, 331.45 MB, 331.47 MB, 331.47 MB, 331.53 MB, 347.47 MB, 407.47 MB, 459.53 MB, 515.53 MB, 523.42 MB, 523.47 MB, 523.47 MB, 523.47 MB, 523.42 MB, 595.53 MB, 619.50 MB, 651.47 MB, 651.45 MB, 651.47 MB, 651.47 MB, 651.45 MB, 651.45 MB, 651.50 MB, 651.50 MB, 651.42 MB, 651.42 MB, 675.45 MB, 731.47 MB, 739.50 MB, 779.42 MB, 779.42 MB, 779.47 MB, 779.45 MB, 642.26 MB, 496.39 MB, 253.26 MB
ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 788.14 MB (826423385)
- PerHostPeakMemUsage: 1.63 GB (1752324462)
- RowsProduced: 16.91K (16914)
- TotalNetworkReceiveTime: 20s619ms
- TotalNetworkSendTime: 2.000ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 2.95K (2949)
- TotalThreadsTotalWallClockTime: 27s879ms
- TotalThreadsSysTime: 1s454ms
- TotalThreadsUserTime: 6s499ms
- TotalThreadsVoluntaryContextSwitches: 17.11K (17105)
Fragment Instance Lifecycle Timings:
- ExecTime: 1s817ms
- ExecTreeExecTime: 1s802ms
- OpenTime: 26s062ms
- ExecTreeOpenTime: 25s503ms
- PrepareTime: 43.999ms
- ExecTreePrepareTime: 1.999ms
DataStreamSender (dst_id=8):(Total: 5.000ms, non-child: 5.000ms, % non-child: 100.00%)
- BytesSent: 843.04 KB (863275)
- NetworkThroughput(*): 411.64 MB/sec
- OverallThroughput: 164.66 MB/sec
- PeakMemoryUsage: 147.89 KB (151440)
- RowsReturned: 16.91K (16914)
- SerializeBatchTime: 3.000ms
- TransmitDataRPCTime: 2.000ms
- UncompressedRowBatchSize: 2.04 MB (2142142)
CodeGen:(Total: 593.999ms, non-child: 593.999ms, % non-child: 100.00%)
- CodegenTime: 9.000ms
- CompileTime: 180.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 85 (85)
- NumInstructions: 2.28K (2282)
- OptimizationTime: 377.000ms
- PeakMemoryUsage: 1.11 MB (1168384)
- PrepareTime: 35.999ms
AGGREGATION_NODE (id=4):(Total: 27s306ms, non-child: 1s585ms, % non-child: 5.81%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 65.54K (65536)
- LargestPartitionPercent: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 10.05 MB (10537088)
- PinTime: 0.000ns
- ReductionFactorEstimate: 602.66
- ReductionFactorThresholdToExpand: 1.10
- RowsPassedThrough: 0 (0)
- RowsReturned: 16.91K (16914)
- RowsReturnedRate: 619.00 /sec
- StreamingTime: 1s558ms
- UnpinTime: 0.000ns
AGGREGATION_NODE (id=7):(Total: 25s720ms, non-child: 4s972ms, % non-child: 19.33%)
ExecOption: Codegen Enabled
- BuildTime: 4s738ms
- GetNewBlockTime: 5.000ms
- GetResultsTime: 155.000ms
- HTResizeTime: 626.000ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 5 (5)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 778.19 MB (815988401)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 6.01M (6005693)
- RowsReturnedRate: 233.49 K/sec
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=6):(Total: 20s748ms, non-child: 199.000ms, % non-child: 0.96%)
BytesReceived(500.000ms): 0, 0, 0, 485.47 KB, 3.31 MB, 7.94 MB, 11.20 MB, 13.59 MB, 16.84 MB, 19.96 MB, 22.87 MB, 26.09 MB, 30.78 MB, 37.09 MB, 44.39 MB, 51.32 MB, 58.38 MB, 66.80 MB, 75.25 MB, 82.14 MB, 88.07 MB, 93.75 MB, 99.43 MB, 108.29 MB, 118.60 MB, 129.59 MB, 142.08 MB, 153.66 MB, 163.90 MB, 171.57 MB, 177.17 MB, 182.63 MB, 188.24 MB, 194.47 MB, 202.70 MB, 211.33 MB, 219.65 MB, 228.15 MB, 234.03 MB, 239.68 MB, 242.61 MB, 246.02 MB, 250.83 MB, 253.77 MB, 257.22 MB, 262.53 MB, 268.01 MB, 273.47 MB, 278.85 MB, 284.15 MB, 289.44 MB, 294.98 MB
- BytesReceived: 296.35 MB (310743434)
- ConvertRowBatchTime: 110.000ms
- DeserializeRowBatchTimer: 498.000ms
- FirstBatchArrivalWaitTime: 898.000ms
- PeakMemoryUsage: 0
- RowsReturned: 6.38M (6380000)
- RowsReturnedRate: 307.50 K/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Averaged Fragment F00:(Total: 18s793ms, non-child: 5s728ms, % non-child: 30.48%)
split sizes: min: 34.38 MB, max: 75.93 MB, avg: 46.81 MB, stddev: 14.84 MB
completion times: min:14s063ms max:26s107ms mean: 18s797ms stddev:4s312ms
execution rates: min:2.13 MB/sec max:2.91 MB/sec mean:2.47 MB/sec stddev:343.35 KB/sec
num instances: 5
- AverageThreadTokens: 1.59
- BloomFilterBytes: 0
- PeakMemoryUsage: 719.32 MB (754260668)
- PerHostPeakMemUsage: 1.07 GB (1152354395)
- RowsProduced: 6.38M (6381626)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 94.199ms
- TotalStorageWaitTime: 19.000ms
- TotalThreadsInvoluntaryContextSwitches: 9.02K (9018)
- TotalThreadsTotalWallClockTime: 30s822ms
- TotalThreadsSysTime: 1s894ms
- TotalThreadsUserTime: 16s788ms
- TotalThreadsVoluntaryContextSwitches: 700 (700)
Fragment Instance Lifecycle Timings:
- ExecTime: 17s609ms
- ExecTreeExecTime: 8s306ms
- OpenTime: 1s118ms
- ExecTreeOpenTime: 34.400ms
- PrepareTime: 64.999ms
- ExecTreePrepareTime: 999.998us
DataStreamSender (dst_id=6):(Total: 3s609ms, non-child: 3s609ms, % non-child: 100.00%)
- BytesSent: 296.41 MB (310804150)
- NetworkThroughput(*): 700.33 MB/sec
- OverallThroughput: 80.96 MB/sec
- PeakMemoryUsage: 305.01 KB (312326)
- RowsReturned: 6.38M (6381626)
- SerializeBatchTime: 3s184ms
- TransmitDataRPCTime: 422.200ms
- UncompressedRowBatchSize: 627.81 MB (658303919)
CodeGen:(Total: 1s123ms, non-child: 1s123ms, % non-child: 100.00%)
- CodegenTime: 20.199ms
- CompileTime: 229.800ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 252 (252)
- NumInstructions: 5.14K (5141)
- OptimizationTime: 852.200ms
- PeakMemoryUsage: 2.51 MB (2632192)
- PrepareTime: 40.200ms
AGGREGATION_NODE (id=3):(Total: 8s332ms, non-child: 7s756ms, % non-child: 93.09%)
- GetNewBlockTime: 1.200ms
- GetResultsTime: 203.999ms
- HTResizeTime: 679.000ms
- HashBuckets: 10.07M (10066329)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 695.27 MB (729044560)
- PinTime: 0.000ns
- ReductionFactorEstimate: 2.00
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 1.49M (1493567)
- RowsReturned: 6.38M (6381626)
- RowsReturnedRate: 760.30 K/sec
- StreamingTime: 7s405ms
- UnpinTime: 0.000ns
NESTED_LOOP_JOIN_NODE (id=2):(Total: 576.000ms, non-child: 522.800ms, % non-child: 90.76%)
- BuildRows: 20 (20)
- BuildTime: 0.000ns
- PeakMemoryUsage: 1.77 MB (1853577)
- ProbeRows: 1.02K (1024)
- ProbeTime: 0.000ns
- RowsReturned: 11.63M (11632496)
- RowsReturnedRate: 20.23 M/sec
Nested Loop Join Builder:
- PeakMemoryUsage: 12.00 KB (12288)
EXCHANGE_NODE (id=5):
- BytesReceived: 461.00 B (461)
- ConvertRowBatchTime: 0.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 0
- RowsReturned: 20 (20)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HDFS_SCAN_NODE (id=1):(Total: 53.200ms, non-child: 53.200ms, % non-child: 100.00%)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 1.09
- BytesRead: 17.03 MB (17859777)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 17.03 MB (17859777)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 17.03 MB (17859777)
- DecompressionTime: 52.599ms
- MaxCompressedTextFileLength: 0
- NumColumns: 21 (21)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadsStarted: 1 (1)
- PeakMemoryUsage: 44.29 MB (46445746)
- PerReadThreadRawHdfsThroughput: 709.70 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 33.600ms
- RowBatchQueuePutWaitTime: 11s438ms
- RowsRead: 581.62K (581624)
- RowsReturned: 581.62K (581624)
- RowsReturnedRate: 10.76 M/sec
- ScanRangesComplete: 1 (1)
- ScannerThreadsInvoluntaryContextSwitches: 68 (68)
- ScannerThreadsTotalWallClockTime: 12s094ms
- MaterializeTupleTime(*): 553.599ms
- ScannerThreadsSysTime: 294.354ms
- ScannerThreadsUserTime: 422.935ms
- ScannerThreadsVoluntaryContextSwitches: 561 (561)
- TotalRawHdfsReadTime(*): 23.799ms
- TotalReadThroughput: 1.53 MB/sec
Fragment F00:
Instance 644f639b8d2a4480:2 (host=etl002-slv-04:22000):(Total: 26s104ms, non-child: 8s193ms, % non-child: 31.39%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:2/75.93 MB
MemoryUsage(500.000ms): 3.87 MB, 1.36 MB, 211.81 MB, 228.73 MB, 357.08 MB, 357.29 MB, 389.12 MB, 389.54 MB, 517.22 MB, 517.28 MB, 517.64 MB, 517.60 MB, 517.60 MB, 517.36 MB, 517.49 MB, 517.26 MB, 517.36 MB, 517.32 MB, 517.16 MB, 581.57 MB, 581.50 MB, 581.23 MB, 709.75 MB, 709.32 MB, 709.32 MB, 709.39 MB, 837.19 MB, 837.43 MB, 876.76 MB, 964.68 MB, 947.31 MB, 1.03 GB, 1.02 GB, 1.01 GB, 1.01 GB, 968.68 MB, 904.11 MB, 904.13 MB, 839.56 MB, 839.56 MB, 774.98 MB, 710.47 MB, 645.83 MB, 645.81 MB, 581.36 MB, 516.83 MB, 452.20 MB, 323.08 MB, 258.55 MB, 193.95 MB, 129.37 MB, 64.83 MB
ThreadUsage(500.000ms): 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 2.12
- BloomFilterBytes: 0
- PeakMemoryUsage: 1.05 GB (1127942091)
- PerHostPeakMemUsage: 1.63 GB (1752324462)
- RowsProduced: 10.94M (10938449)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 127.999ms
- TotalStorageWaitTime: 41.000ms
- TotalThreadsInvoluntaryContextSwitches: 12.05K (12051)
- TotalThreadsTotalWallClockTime: 55s215ms
- TotalThreadsSysTime: 2s749ms
- TotalThreadsUserTime: 23s498ms
- TotalThreadsVoluntaryContextSwitches: 1.16K (1164)
Fragment Instance Lifecycle Timings:
- ExecTime: 25s057ms
- ExecTreeExecTime: 12s273ms
- OpenTime: 993.000ms
- ExecTreeOpenTime: 29.000ms
- PrepareTime: 54.999ms
- ExecTreePrepareTime: 999.993us
DataStreamSender (dst_id=6):(Total: 4s620ms, non-child: 4s620ms, % non-child: 100.00%)
- BytesSent: 505.43 MB (529976921)
- NetworkThroughput(*): 886.71 MB/sec
- OverallThroughput: 109.40 MB/sec
- PeakMemoryUsage: 311.41 KB (318880)
- RowsReturned: 10.94M (10938449)
- SerializeBatchTime: 4s044ms
- TransmitDataRPCTime: 570.000ms
- UncompressedRowBatchSize: 1.05 GB (1127463036)
CodeGen:(Total: 998.000ms, non-child: 998.000ms, % non-child: 100.00%)
- CodegenTime: 19.000ms
- CompileTime: 143.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 252 (252)
- NumInstructions: 5.14K (5141)
- OptimizationTime: 819.000ms
- PeakMemoryUsage: 2.51 MB (2632192)
- PrepareTime: 35.000ms
AGGREGATION_NODE (id=3):(Total: 12s292ms, non-child: 11s435ms, % non-child: 93.03%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 2.000ms
- GetResultsTime: 222.000ms
- HTResizeTime: 958.000ms
- HashBuckets: 16.78M (16777216)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.01 GB (1086189291)
- PinTime: 0.000ns
- ReductionFactorEstimate: 2.00
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 3.35M (3347342)
- RowsReturned: 10.94M (10938449)
- RowsReturnedRate: 889.81 K/sec
- StreamingTime: 11s002ms
- UnpinTime: 0.000ns
NESTED_LOOP_JOIN_NODE (id=2):(Total: 857.000ms, non-child: 789.000ms, % non-child: 92.07%)
ExecOption: Join Build-Side Prepared Asynchronously
- BuildRows: 20 (20)
- BuildTime: 0.000ns
- PeakMemoryUsage: 1.77 MB (1853776)
- ProbeRows: 1.02K (1024)
- ProbeTime: 0.000ns
- RowsReturned: 18.89M (18890980)
- RowsReturnedRate: 22.04 M/sec
Nested Loop Join Builder:
- PeakMemoryUsage: 12.00 KB (12288)
EXCHANGE_NODE (id=5):
BytesReceived(500.000ms): 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B
- BytesReceived: 461.00 B (461)
- ConvertRowBatchTime: 0.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 0
- RowsReturned: 20 (20)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HDFS_SCAN_NODE (id=1):(Total: 68.000ms, non-child: 68.000ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:2/75.93 MB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
File Formats: PARQUET/SNAPPY:42
BytesRead(500.000ms): 0, 0, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB, 27.65 MB
- FooterProcessingTime: (Avg: 4.500ms ; Min: 4.000ms ; Max: 5.000ms ; Number of samples: 2)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 1.87
- BytesRead: 27.65 MB (28997754)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 27.65 MB (28997754)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 27.65 MB (28997754)
- DecompressionTime: 82.000ms
- MaxCompressedTextFileLength: 0
- NumColumns: 21 (21)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 2 (2)
- NumScannerThreadsStarted: 2 (2)
- PeakMemoryUsage: 60.32 MB (63252848)
- PerReadThreadRawHdfsThroughput: 790.13 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 27.000ms
- RowBatchQueuePutWaitTime: 28s223ms
- RowsRead: 944.55K (944549)
- RowsReturned: 944.55K (944549)
- RowsReturnedRate: 13.89 M/sec
- ScanRangesComplete: 2 (2)
- ScannerThreadsInvoluntaryContextSwitches: 109 (109)
- ScannerThreadsTotalWallClockTime: 29s165ms
- MaterializeTupleTime(*): 775.000ms
- ScannerThreadsSysTime: 436.933ms
- ScannerThreadsUserTime: 631.903ms
- ScannerThreadsVoluntaryContextSwitches: 948 (948)
- TotalRawHdfsReadTime(*): 35.000ms
- TotalReadThroughput: 1.68 MB/sec
Instance 644f639b8d2a4480:6 (host=etl002-slv-01:22000):(Total: 19s945ms, non-child: 5s664ms, % non-child: 28.40%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 1:1/43.24 MB
MemoryUsage(500.000ms): 1.35 MB, 3.87 MB, 1.36 MB, 181.54 MB, 194.16 MB, 210.52 MB, 210.59 MB, 338.68 MB, 339.11 MB, 371.03 MB, 370.87 MB, 371.05 MB, 499.08 MB, 499.12 MB, 498.99 MB, 499.02 MB, 499.27 MB, 511.01 MB, 562.95 MB, 562.69 MB, 562.72 MB, 554.77 MB, 664.44 MB, 653.70 MB, 649.28 MB, 608.69 MB, 568.05 MB, 527.57 MB, 487.00 MB, 446.44 MB, 405.88 MB, 365.36 MB, 324.70 MB, 284.19 MB, 243.67 MB, 203.04 MB, 162.58 MB, 121.92 MB, 81.39 MB, 40.86 MB
ThreadUsage(500.000ms): 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.48
- BloomFilterBytes: 0
- PeakMemoryUsage: 682.97 MB (716142778)
- PerHostPeakMemUsage: 1.06 GB (1134475162)
- RowsProduced: 5.55M (5550426)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 51.000ms
- TotalStorageWaitTime: 13.000ms
- TotalThreadsInvoluntaryContextSwitches: 12.23K (12234)
- TotalThreadsTotalWallClockTime: 29s328ms
- TotalThreadsSysTime: 1s980ms
- TotalThreadsUserTime: 17s498ms
- TotalThreadsVoluntaryContextSwitches: 572 (572)
Fragment Instance Lifecycle Timings:
- ExecTime: 18s536ms
- ExecTreeExecTime: 9s099ms
- OpenTime: 1s321ms
- ExecTreeOpenTime: 34.000ms
- PrepareTime: 88.000ms
- ExecTreePrepareTime: 1.000ms
DataStreamSender (dst_id=6):(Total: 3s825ms, non-child: 3s825ms, % non-child: 100.00%)
- BytesSent: 261.35 MB (274047648)
- NetworkThroughput(*): 759.74 MB/sec
- OverallThroughput: 68.33 MB/sec
- PeakMemoryUsage: 279.41 KB (286112)
- RowsReturned: 5.55M (5550426)
- SerializeBatchTime: 3s478ms
- TransmitDataRPCTime: 344.000ms
- UncompressedRowBatchSize: 546.54 MB (573085067)
CodeGen:(Total: 1s329ms, non-child: 1s329ms, % non-child: 100.00%)
- CodegenTime: 22.000ms
- CompileTime: 322.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 252 (252)
- NumInstructions: 5.14K (5141)
- OptimizationTime: 962.000ms
- PeakMemoryUsage: 2.51 MB (2632192)
- PrepareTime: 44.000ms
AGGREGATION_NODE (id=3):(Total: 9s127ms, non-child: 8s524ms, % non-child: 93.39%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 1.000ms
- GetResultsTime: 218.000ms
- HTResizeTime: 625.000ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 651.67 MB (683322518)
- PinTime: 0.000ns
- ReductionFactorEstimate: 2.00
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 954.00K (953995)
- RowsReturned: 5.55M (5550426)
- RowsReturnedRate: 608.13 K/sec
- StreamingTime: 8s165ms
- UnpinTime: 0.000ns
NESTED_LOOP_JOIN_NODE (id=2):(Total: 603.000ms, non-child: 545.000ms, % non-child: 90.38%)
ExecOption: Join Build-Side Prepared Asynchronously
- BuildRows: 20 (20)
- BuildTime: 0.000ns
- PeakMemoryUsage: 1.77 MB (1851274)
- ProbeRows: 1.02K (1024)
- ProbeTime: 0.000ns
- RowsReturned: 10.72M (10717420)
- RowsReturnedRate: 17.77 M/sec
Nested Loop Join Builder:
- PeakMemoryUsage: 12.00 KB (12288)
EXCHANGE_NODE (id=5):
BytesReceived(500.000ms): 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B
- BytesReceived: 461.00 B (461)
- ConvertRowBatchTime: 0.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 0
- RowsReturned: 20 (20)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HDFS_SCAN_NODE (id=1):(Total: 58.000ms, non-child: 58.000ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 1:1/43.24 MB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
File Formats: PARQUET/SNAPPY:21
BytesRead(500.000ms): 0, 0, 0, 15.66 MB, 15.66 MB, 15.66 MB, 15.66 MB, 15.66 MB, 15.66 MB, 15.66 MB, 15.66 MB, 15.66 MB, 15.66 MB, 15.66 MB, 15.66 MB, 15.66 MB, 15.66 MB, 15.66 MB, 15.66 MB, 15.66 MB, 15.66 MB, 15.66 MB, 15.66 MB, 15.66 MB
- FooterProcessingTime: (Avg: 4.000ms ; Min: 4.000ms ; Max: 4.000ms ; Number of samples: 1)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.90
- BytesRead: 15.66 MB (16421538)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 15.66 MB (16421538)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 15.66 MB (16421538)
- DecompressionTime: 47.000ms
- MaxCompressedTextFileLength: 0
- NumColumns: 21 (21)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadsStarted: 1 (1)
- PeakMemoryUsage: 41.86 MB (43894815)
- PerReadThreadRawHdfsThroughput: 824.25 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 34.000ms
- RowBatchQueuePutWaitTime: 8s812ms
- RowsRead: 535.87K (535871)
- RowsReturned: 535.87K (535871)
- RowsReturnedRate: 9.24 M/sec
- ScanRangesComplete: 1 (1)
- ScannerThreadsInvoluntaryContextSwitches: 77 (77)
- ScannerThreadsTotalWallClockTime: 9s471ms
- MaterializeTupleTime(*): 578.000ms
- ScannerThreadsSysTime: 285.956ms
- ScannerThreadsUserTime: 425.935ms
- ScannerThreadsVoluntaryContextSwitches: 513 (513)
- TotalRawHdfsReadTime(*): 19.000ms
- TotalReadThroughput: 1.31 MB/sec
Instance 644f639b8d2a4480:5 (host=etl002-slv-03:22000):(Total: 19s023ms, non-child: 5s833ms, % non-child: 30.67%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/40.53 MB
MemoryUsage(500.000ms): 1.34 MB, 3.87 MB, 1.36 MB, 184.67 MB, 196.20 MB, 209.56 MB, 337.83 MB, 337.91 MB, 337.95 MB, 369.78 MB, 369.86 MB, 369.81 MB, 497.89 MB, 498.11 MB, 497.81 MB, 498.21 MB, 497.86 MB, 497.96 MB, 497.87 MB, 497.68 MB, 565.59 MB, 561.44 MB, 537.94 MB, 526.13 MB, 609.19 MB, 568.66 MB, 528.14 MB, 487.54 MB, 455.02 MB, 381.88 MB, 349.36 MB, 308.75 MB, 268.15 MB, 227.59 MB, 195.07 MB, 154.44 MB, 113.91 MB, 81.45 MB, 214.67 KB
ThreadUsage(500.000ms): 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.49
- BloomFilterBytes: 0
- PeakMemoryUsage: 612.01 MB (641735523)
- PerHostPeakMemUsage: 1.01 GB (1080156572)
- RowsProduced: 5.79M (5789357)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 45.999ms
- TotalStorageWaitTime: 14.000ms
- TotalThreadsInvoluntaryContextSwitches: 9.54K (9539)
- TotalThreadsTotalWallClockTime: 28s668ms
- TotalThreadsSysTime: 1s817ms
- TotalThreadsUserTime: 17s052ms
- TotalThreadsVoluntaryContextSwitches: 546 (546)
Fragment Instance Lifecycle Timings:
- ExecTime: 17s821ms
- ExecTreeExecTime: 8s095ms
- OpenTime: 1s146ms
- ExecTreeOpenTime: 37.000ms
- PrepareTime: 55.999ms
- ExecTreePrepareTime: 1.000ms
DataStreamSender (dst_id=6):(Total: 3s926ms, non-child: 3s926ms, % non-child: 100.00%)
- BytesSent: 265.13 MB (278007162)
- NetworkThroughput(*): 643.52 MB/sec
- OverallThroughput: 67.53 MB/sec
- PeakMemoryUsage: 311.41 KB (318880)
- RowsReturned: 5.79M (5789357)
- SerializeBatchTime: 3s512ms
- TransmitDataRPCTime: 412.000ms
- UncompressedRowBatchSize: 569.12 MB (596769511)
CodeGen:(Total: 1s144ms, non-child: 1s144ms, % non-child: 100.00%)
- CodegenTime: 20.000ms
- CompileTime: 270.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 252 (252)
- NumInstructions: 5.14K (5141)
- OptimizationTime: 837.000ms
- PeakMemoryUsage: 2.51 MB (2632192)
- PrepareTime: 36.000ms
AGGREGATION_NODE (id=3):(Total: 8s120ms, non-child: 7s574ms, % non-child: 93.29%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 2.000ms
- GetResultsTime: 208.999ms
- HTResizeTime: 629.000ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 611.86 MB (641586489)
- PinTime: 0.000ns
- ReductionFactorEstimate: 2.00
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 1.63M (1627051)
- RowsReturned: 5.79M (5789357)
- RowsReturnedRate: 712.97 K/sec
- StreamingTime: 7s229ms
- UnpinTime: 0.000ns
NESTED_LOOP_JOIN_NODE (id=2):(Total: 545.000ms, non-child: 495.000ms, % non-child: 90.83%)
ExecOption: Join Build-Side Prepared Asynchronously
- BuildRows: 20 (20)
- BuildTime: 0.000ns
- PeakMemoryUsage: 1.77 MB (1855114)
- ProbeRows: 1.02K (1024)
- ProbeTime: 0.000ns
- RowsReturned: 9.99M (9985420)
- RowsReturnedRate: 18.32 M/sec
Nested Loop Join Builder:
- PeakMemoryUsage: 12.00 KB (12288)
EXCHANGE_NODE (id=5):
BytesReceived(500.000ms): 0, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B
- BytesReceived: 461.00 B (461)
- ConvertRowBatchTime: 0.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 0
- RowsReturned: 20 (20)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HDFS_SCAN_NODE (id=1):(Total: 50.000ms, non-child: 50.000ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/40.53 MB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
File Formats: PARQUET/SNAPPY:21
BytesRead(500.000ms): 0, 0, 0, 14.76 MB, 14.76 MB, 14.76 MB, 14.76 MB, 14.76 MB, 14.76 MB, 14.76 MB, 14.76 MB, 14.76 MB, 14.76 MB, 14.76 MB, 14.76 MB, 14.76 MB, 14.76 MB, 14.76 MB, 14.76 MB, 14.76 MB, 14.76 MB, 14.76 MB, 14.76 MB, 14.76 MB
- FooterProcessingTime: (Avg: 6.000ms ; Min: 6.000ms ; Max: 6.000ms ; Number of samples: 1)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.90
- BytesRead: 14.76 MB (15472293)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 14.76 MB (15472293)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 14.76 MB (15472293)
- DecompressionTime: 50.999ms
- MaxCompressedTextFileLength: 0
- NumColumns: 21 (21)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadsStarted: 1 (1)
- PeakMemoryUsage: 40.68 MB (42659909)
- PerReadThreadRawHdfsThroughput: 641.54 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 37.000ms
- RowBatchQueuePutWaitTime: 9s038ms
- RowsRead: 499.27K (499271)
- RowsReturned: 499.27K (499271)
- RowsReturnedRate: 9.99 M/sec
- ScanRangesComplete: 1 (1)
- ScannerThreadsInvoluntaryContextSwitches: 36 (36)
- ScannerThreadsTotalWallClockTime: 9s700ms
- MaterializeTupleTime(*): 565.999ms
- ScannerThreadsSysTime: 272.958ms
- ScannerThreadsUserTime: 406.938ms
- ScannerThreadsVoluntaryContextSwitches: 478 (478)
- TotalRawHdfsReadTime(*): 22.999ms
- TotalReadThroughput: 1.23 MB/sec
Instance 644f639b8d2a4480:3 (host=etl002-slv-05:22000):(Total: 14s830ms, non-child: 4s473ms, % non-child: 30.17%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 1:1/34.38 MB
MemoryUsage(500.000ms): 3.87 MB, 3.87 MB, 39.65 MB, 190.76 MB, 207.38 MB, 335.76 MB, 367.43 MB, 367.46 MB, 367.28 MB, 495.94 MB, 495.67 MB, 495.29 MB, 495.50 MB, 495.22 MB, 527.18 MB, 539.45 MB, 527.51 MB, 521.25 MB, 456.12 MB, 423.62 MB, 390.98 MB, 325.97 MB, 293.34 MB, 260.74 MB, 228.15 MB, 195.62 MB, 130.51 MB, 97.98 MB, 65.43 MB, 32.78 MB
ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.43
- BloomFilterBytes: 0
- PeakMemoryUsage: 563.18 MB (590539502)
- PerHostPeakMemUsage: 840.38 MB (881203619)
- RowsProduced: 4.71M (4706543)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 72.000ms
- TotalStorageWaitTime: 14.000ms
- TotalThreadsInvoluntaryContextSwitches: 4.25K (4245)
- TotalThreadsTotalWallClockTime: 21s246ms
- TotalThreadsSysTime: 1s507ms
- TotalThreadsUserTime: 13s376ms
- TotalThreadsVoluntaryContextSwitches: 507 (507)
Fragment Instance Lifecycle Timings:
- ExecTime: 13s625ms
- ExecTreeExecTime: 6s169ms
- OpenTime: 1s137ms
- ExecTreeOpenTime: 36.000ms
- PrepareTime: 68.999ms
- ExecTreePrepareTime: 1.000ms
DataStreamSender (dst_id=6):(Total: 3s009ms, non-child: 3s009ms, % non-child: 100.00%)
- BytesSent: 217.12 MB (227671743)
- NetworkThroughput(*): 455.19 MB/sec
- OverallThroughput: 72.16 MB/sec
- PeakMemoryUsage: 311.41 KB (318880)
- RowsReturned: 4.71M (4706543)
- SerializeBatchTime: 2s532ms
- TransmitDataRPCTime: 477.000ms
- UncompressedRowBatchSize: 462.61 MB (485081813)
CodeGen:(Total: 1s150ms, non-child: 1s150ms, % non-child: 100.00%)
- CodegenTime: 19.000ms
- CompileTime: 271.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 252 (252)
- NumInstructions: 5.14K (5141)
- OptimizationTime: 828.000ms
- PeakMemoryUsage: 2.51 MB (2632192)
- PrepareTime: 50.000ms
AGGREGATION_NODE (id=3):(Total: 6s198ms, non-child: 5s724ms, % non-child: 92.35%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 0.000ns
- GetResultsTime: 195.000ms
- HTResizeTime: 637.000ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 525.11 MB (550618240)
- PinTime: 0.000ns
- ReductionFactorEstimate: 2.00
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 990.72K (990719)
- RowsReturned: 4.71M (4706543)
- RowsReturnedRate: 759.36 K/sec
- StreamingTime: 5s403ms
- UnpinTime: 0.000ns
NESTED_LOOP_JOIN_NODE (id=2):(Total: 474.000ms, non-child: 428.000ms, % non-child: 90.30%)
ExecOption: Join Build-Side Prepared Asynchronously
- BuildRows: 20 (20)
- BuildTime: 0.000ns
- PeakMemoryUsage: 1.77 MB (1853386)
- ProbeRows: 1.02K (1024)
- ProbeTime: 0.000ns
- RowsReturned: 8.56M (8555380)
- RowsReturnedRate: 18.05 M/sec
Nested Loop Join Builder:
- PeakMemoryUsage: 12.00 KB (12288)
EXCHANGE_NODE (id=5):
BytesReceived(500.000ms): 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B
- BytesReceived: 461.00 B (461)
- ConvertRowBatchTime: 0.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 0
- RowsReturned: 20 (20)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HDFS_SCAN_NODE (id=1):(Total: 46.000ms, non-child: 46.000ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 1:1/34.38 MB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
File Formats: PARQUET/SNAPPY:21
BytesRead(500.000ms): 0, 0, 12.53 MB, 12.53 MB, 12.53 MB, 12.53 MB, 12.53 MB, 12.53 MB, 12.53 MB, 12.53 MB, 12.53 MB, 12.53 MB, 12.53 MB, 12.53 MB, 12.53 MB, 12.53 MB, 12.53 MB
- FooterProcessingTime: (Avg: 7.000ms ; Min: 7.000ms ; Max: 7.000ms ; Number of samples: 1)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.87
- BytesRead: 12.53 MB (13140512)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 12.53 MB (13140512)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 12.53 MB (13140512)
- DecompressionTime: 36.000ms
- MaxCompressedTextFileLength: 0
- NumColumns: 21 (21)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadsStarted: 1 (1)
- PeakMemoryUsage: 38.19 MB (40042384)
- PerReadThreadRawHdfsThroughput: 659.57 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 35.000ms
- RowBatchQueuePutWaitTime: 6s047ms
- RowsRead: 427.77K (427769)
- RowsReturned: 427.77K (427769)
- RowsReturnedRate: 9.30 M/sec
- ScanRangesComplete: 1 (1)
- ScannerThreadsInvoluntaryContextSwitches: 52 (52)
- ScannerThreadsTotalWallClockTime: 6s484ms
- MaterializeTupleTime(*): 352.000ms
- ScannerThreadsSysTime: 218.966ms
- ScannerThreadsUserTime: 292.955ms
- ScannerThreadsVoluntaryContextSwitches: 402 (402)
- TotalRawHdfsReadTime(*): 19.000ms
- TotalReadThroughput: 1.47 MB/sec
Instance 644f639b8d2a4480:4 (host=etl002-slv-02:22000):(Total: 14s061ms, non-child: 4s477ms, % non-child: 31.84%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/39.99 MB
MemoryUsage(500.000ms): 3.87 MB, 3.87 MB, 40.00 MB, 203.32 MB, 209.64 MB, 369.72 MB, 369.78 MB, 369.84 MB, 497.96 MB, 497.81 MB, 533.72 MB, 561.86 MB, 561.65 MB, 561.39 MB, 653.46 MB, 608.67 MB, 568.11 MB, 527.65 MB, 486.96 MB, 446.45 MB, 405.88 MB, 365.39 MB, 324.81 MB, 284.21 MB, 243.65 MB, 203.04 MB, 121.98 MB, 81.36 MB
ThreadUsage(500.000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.43
- BloomFilterBytes: 0
- PeakMemoryUsage: 662.75 MB (694943450)
- PerHostPeakMemUsage: 871.29 MB (913612163)
- RowsProduced: 4.92M (4923355)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 173.999ms
- TotalStorageWaitTime: 13.000ms
- TotalThreadsInvoluntaryContextSwitches: 7.02K (7024)
- TotalThreadsTotalWallClockTime: 19s653ms
- TotalThreadsSysTime: 1s416ms
- TotalThreadsUserTime: 12s516ms
- TotalThreadsVoluntaryContextSwitches: 713 (713)
Fragment Instance Lifecycle Timings:
- ExecTime: 13s009ms
- ExecTreeExecTime: 5s894ms
- OpenTime: 995.000ms
- ExecTreeOpenTime: 36.000ms
- PrepareTime: 57.000ms
- ExecTreePrepareTime: 1.000ms
DataStreamSender (dst_id=6):(Total: 2s666ms, non-child: 2s666ms, % non-child: 100.00%)
- BytesSent: 233.00 MB (244317277)
- NetworkThroughput(*): 756.49 MB/sec
- OverallThroughput: 87.36 MB/sec
- PeakMemoryUsage: 311.41 KB (318880)
- RowsReturned: 4.92M (4923355)
- SerializeBatchTime: 2s358ms
- TransmitDataRPCTime: 308.000ms
- UncompressedRowBatchSize: 485.53 MB (509120170)
CodeGen:(Total: 993.999ms, non-child: 993.999ms, % non-child: 100.00%)
- CodegenTime: 20.999ms
- CompileTime: 143.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 252 (252)
- NumInstructions: 5.14K (5141)
- OptimizationTime: 815.000ms
- PeakMemoryUsage: 2.51 MB (2632192)
- PrepareTime: 35.999ms
AGGREGATION_NODE (id=3):(Total: 5s923ms, non-child: 5s521ms, % non-child: 93.23%)
ExecOption: Streaming Preaggregation, Codegen Enabled
- GetNewBlockTime: 1.000ms
- GetResultsTime: 176.000ms
- HTResizeTime: 545.999ms
- HashBuckets: 8.39M (8388608)
- LargestPartitionPercent: 2 (2)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 651.84 MB (683506265)
- PinTime: 0.000ns
- ReductionFactorEstimate: 2.00
- ReductionFactorThresholdToExpand: 2.00
- RowsPassedThrough: 548.73K (548728)
- RowsReturned: 4.92M (4923355)
- RowsReturnedRate: 831.23 K/sec
- StreamingTime: 5s227ms
- UnpinTime: 0.000ns
NESTED_LOOP_JOIN_NODE (id=2):(Total: 401.000ms, non-child: 357.000ms, % non-child: 89.03%)
ExecOption: Join Build-Side Prepared Asynchronously
- BuildRows: 20 (20)
- BuildTime: 0.000ns
- PeakMemoryUsage: 1.77 MB (1854337)
- ProbeRows: 1.02K (1024)
- ProbeTime: 0.000ns
- RowsReturned: 10.01M (10013280)
- RowsReturnedRate: 24.97 M/sec
Nested Loop Join Builder:
- PeakMemoryUsage: 12.00 KB (12288)
EXCHANGE_NODE (id=5):
BytesReceived(500.000ms): 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B, 461.00 B
- BytesReceived: 461.00 B (461)
- ConvertRowBatchTime: 0.000ns
- DeserializeRowBatchTimer: 0.000ns
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 0
- RowsReturned: 20 (20)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
HDFS_SCAN_NODE (id=1):(Total: 44.000ms, non-child: 44.000ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/39.99 MB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1
Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0%
File Formats: PARQUET/SNAPPY:21
BytesRead(500.000ms): 0, 0, 14.56 MB, 14.56 MB, 14.56 MB, 14.56 MB, 14.56 MB, 14.56 MB, 14.56 MB, 14.56 MB, 14.56 MB, 14.56 MB, 14.56 MB, 14.56 MB, 14.56 MB
- FooterProcessingTime: (Avg: 4.000ms ; Min: 4.000ms ; Max: 4.000ms ; Number of samples: 1)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.92
- BytesRead: 14.56 MB (15266792)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 14.56 MB (15266792)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 14.56 MB (15266792)
- DecompressionTime: 46.999ms
- MaxCompressedTextFileLength: 0
- NumColumns: 21 (21)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadsStarted: 1 (1)
- PeakMemoryUsage: 40.42 MB (42378776)
- PerReadThreadRawHdfsThroughput: 633.02 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 35.000ms
- RowBatchQueuePutWaitTime: 5s074ms
- RowsRead: 500.66K (500664)
- RowsReturned: 500.66K (500664)
- RowsReturnedRate: 11.38 M/sec
- ScanRangesComplete: 1 (1)
- ScannerThreadsInvoluntaryContextSwitches: 69 (69)
- ScannerThreadsTotalWallClockTime: 5s649ms
- MaterializeTupleTime(*): 496.999ms
- ScannerThreadsSysTime: 256.959ms
- ScannerThreadsUserTime: 356.945ms
- ScannerThreadsVoluntaryContextSwitches: 468 (468)
- TotalRawHdfsReadTime(*): 23.000ms
- TotalReadThroughput: 1.94 MB/sec
Averaged Fragment F01:(Total: 53.000ms, non-child: 18.000ms, % non-child: 33.96%)
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:54.000ms max:54.000ms mean: 54.000ms stddev:0.000ns
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 1
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 96.62 KB (98936)
- PerHostPeakMemUsage: 7.36 MB (7717016)
- RowsProduced: 20 (20)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 10.000ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 6 (6)
- TotalThreadsTotalWallClockTime: 14.000ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 1.000ms
- TotalThreadsVoluntaryContextSwitches: 10 (10)
Fragment Instance Lifecycle Timings:
- ExecTime: 12.000ms
- ExecTreeExecTime: 0.000ns
- OpenTime: 2.000ms
- ExecTreeOpenTime: 0.000ns
- PrepareTime: 39.000ms
- ExecTreePrepareTime: 0.000ns
DataStreamSender (dst_id=5):
- BytesSent: 2.25 KB (2305)
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 37.62 KB (38520)
- RowsReturned: 20 (20)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 3.84 KB (3935)
CodeGen:(Total: 35.000ms, non-child: 35.000ms, % non-child: 100.00%)
- CodegenTime: 0.000ns
- CompileTime: 0.000ns
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 0 (0)
- NumInstructions: 0 (0)
- OptimizationTime: 0.000ns
- PeakMemoryUsage: 0
- PrepareTime: 34.000ms
UNION_NODE (id=0):
- PeakMemoryUsage: 0
- RowsReturned: 20 (20)
- RowsReturnedRate: 0
Fragment F01:
Instance 644f639b8d2a4480:1 (host=etl002-slv-01:22000):(Total: 53.000ms, non-child: 18.000ms, % non-child: 33.96%)
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 96.62 KB (98936)
- PerHostPeakMemUsage: 7.36 MB (7717016)
- RowsProduced: 20 (20)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 10.000ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 6 (6)
- TotalThreadsTotalWallClockTime: 14.000ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 1.000ms
- TotalThreadsVoluntaryContextSwitches: 10 (10)
Fragment Instance Lifecycle Timings:
- ExecTime: 12.000ms
- ExecTreeExecTime: 0.000ns
- OpenTime: 2.000ms
- ExecTreeOpenTime: 0.000ns
- PrepareTime: 39.000ms
- ExecTreePrepareTime: 0.000ns
DataStreamSender (dst_id=5):
- BytesSent: 2.25 KB (2305)
- NetworkThroughput(*): 0.00 /sec
- OverallThroughput: 0.00 /sec
- PeakMemoryUsage: 37.62 KB (38520)
- RowsReturned: 20 (20)
- SerializeBatchTime: 0.000ns
- TransmitDataRPCTime: 0.000ns
- UncompressedRowBatchSize: 3.84 KB (3935)
CodeGen:(Total: 35.000ms, non-child: 35.000ms, % non-child: 100.00%)
- CodegenTime: 0.000ns
- CompileTime: 0.000ns
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.91 MB (1997620)
- NumFunctions: 0 (0)
- NumInstructions: 0 (0)
- OptimizationTime: 0.000ns
- PeakMemoryUsage: 0
- PrepareTime: 34.000ms
UNION_NODE (id=0):
- PeakMemoryUsage: 0
- RowsReturned: 20 (20)
- RowsReturnedRate: 0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment