Details for Query 13

Show the Stage ID and Task ID that corresponds to the max metric
WholeStageCodegen (7) duration: total (min, med, max )11 ms (0 ms, 1 ms, 3 ms )WholeStageCodegen (6) duration: total (min, med, max )522 ms (0 ms, 0 ms, 37 ms )WholeStageCodegen (5) duration: total (min, med, max )285 ms (0 ms, 0 ms, 45 ms )WholeStageCodegen (4) duration: total (min, med, max )954 ms (0 ms, 1 ms, 34 ms )WholeStageCodegen (3) duration: total (min, med, max )15 ms (7 ms, 8 ms, 8 ms )WholeStageCodegen (2) duration: total (min, med, max )9 ms (4 ms, 5 ms, 5 ms )WholeStageCodegen (1) duration: total (min, med, max )13 ms (5 ms, 8 ms, 8 ms )

WriteToDataSourceV2

Sort

sort time total (min, med, max )
0 ms (0 ms, 0 ms, 0 ms )
peak memory total (min, med, max )
512.6 MiB (64.0 KiB, 64.1 MiB, 64.1 MiB )
spill size total (min, med, max )
0.0 B (0.0 B, 0.0 B, 0.0 B )
Exchange

shuffle records written: 12
shuffle write time total (min, med, max )
6 ms (0 ms, 0 ms, 1 ms )
records read: 12
local bytes read total (min, med, max )
1103.0 B (0.0 B, 107.0 B, 346.0 B )
fetch wait time total (min, med, max )
0 ms (0 ms, 0 ms, 0 ms )
remote bytes read total (min, med, max )
115.0 B (0.0 B, 0.0 B, 115.0 B )
local blocks read: 11
remote blocks read: 1
data size total (min, med, max )
832.0 B (0.0 B, 0.0 B, 80.0 B )
shuffle bytes written total (min, med, max )
1218.0 B (0.0 B, 0.0 B, 115.0 B )
HashAggregate

time in aggregation build total (min, med, max )
60 ms (0 ms, 0 ms, 33 ms )
peak memory total (min, med, max )
1636.0 MiB (256.0 KiB, 256.0 KiB, 64.3 MiB )
number of output rows: 24
avg hash probe bucket list iters (min, med, max ):
(1, 1, 1 )
StateStoreSave

number of total state rows: 24
memory used by state total (min, med, max )
129.1 KiB (232.0 B, 400.0 B, 728.0 B )
count of cache hit on states cache in provider: 6,000
number of output rows: 24
estimated size of state only on current version total (min, med, max )
39.6 KiB (88.0 B, 88.0 B, 320.0 B )
time to commit changes total (min, med, max )
16.3 s (21 ms, 27 ms, 100 ms )
time to remove total (min, med, max )
0 ms (0 ms, 0 ms, 0 ms )
number of updated state rows: 6
time to update total (min, med, max )
283 ms (0 ms, 0 ms, 45 ms )
HashAggregate

time in aggregation build total (min, med, max )
43 ms (0 ms, 0 ms, 24 ms )
peak memory total (min, med, max )
484.0 MiB (256.0 KiB, 256.0 KiB, 64.3 MiB )
number of output rows: 6
avg hash probe bucket list iters (min, med, max ):
(1, 1, 1 )
StateStoreRestore

number of output rows: 6
HashAggregate

time in aggregation build total (min, med, max )
8 ms (0 ms, 0 ms, 2 ms )
peak memory total (min, med, max )
484.0 MiB (256.0 KiB, 256.0 KiB, 64.3 MiB )
number of output rows: 6
avg hash probe bucket list iters (min, med, max ):
(1, 1, 1 )
Exchange

shuffle records written: 6
shuffle write time total (min, med, max )
7 ms (3 ms, 4 ms, 4 ms )
records read: 12
local bytes read total (min, med, max )
640.0 B (0.0 B, 0.0 B, 107.0 B )
fetch wait time total (min, med, max )
1 ms (0 ms, 0 ms, 1 ms )
remote bytes read total (min, med, max )
642.0 B (0.0 B, 0.0 B, 107.0 B )
local blocks read: 6
remote blocks read: 6
data size total (min, med, max )
432.0 B (216.0 B, 216.0 B, 216.0 B )
shuffle bytes written total (min, med, max )
641.0 B (320.0 B, 321.0 B, 321.0 B )
HashAggregate

time in aggregation build total (min, med, max )
3 ms (1 ms, 2 ms, 2 ms )
peak memory total (min, med, max )
128.5 MiB (64.3 MiB, 64.3 MiB, 64.3 MiB )
number of output rows: 6
avg hash probe bucket list iters (min, med, max ):
(1, 1, 1 )

Project

Filter

number of output rows: 28
Expand

number of output rows: 28

Project


EventTimeWatermark


Project

Generate

number of output rows: 14

Project

MicroBatchScan

number of output rows: 14
Details