Details for Query 64

Show the Stage ID and Task ID that corresponds to the max metric
WholeStageCodegen (6) duration: total (min, med, max )10.9 s (0 ms, 42 ms, 122 ms )WholeStageCodegen (5) duration: total (min, med, max )678 ms (0 ms, 2 ms, 64 ms )WholeStageCodegen (4) duration: total (min, med, max )1.5 s (0 ms, 5 ms, 229 ms )WholeStageCodegen (3) duration: total (min, med, max )137 ms (43 ms, 94 ms, 94 ms )WholeStageCodegen (2) duration: total (min, med, max )108 ms (32 ms, 76 ms, 76 ms )WholeStageCodegen (1) duration: total (min, med, max )112 ms (34 ms, 78 ms, 78 ms )

WriteToDataSourceV2

HashAggregate

time in aggregation build total (min, med, max )
10.5 s (0 ms, 40 ms, 96 ms )
peak memory total (min, med, max )
177.5 MiB (0.0 B, 256.0 KiB, 64.3 MiB )
number of output rows: 2
avg hash probe bucket list iters (min, med, max ):
(1, 1, 1 )
StateStoreSave

number of total state rows: 2
memory used by state total (min, med, max )
76.2 KiB (0.0 B, 392.0 B, 592.0 B )
count of cache hit on states cache in provider: 396
number of output rows: 2
estimated size of state only on current version total (min, med, max )
20.5 KiB (0.0 B, 104.0 B, 304.0 B )
time to commit changes total (min, med, max )
10.0 s (0 ms, 38 ms, 87 ms )
time to remove total (min, med, max )
9 ms (0 ms, 0 ms, 2 ms )
number of updated state rows: 2
time to update total (min, med, max )
545 ms (0 ms, 2 ms, 63 ms )
HashAggregate

time in aggregation build total (min, med, max )
36 ms (0 ms, 0 ms, 34 ms )
peak memory total (min, med, max )
177.5 MiB (0.0 B, 256.0 KiB, 64.3 MiB )
number of output rows: 2
avg hash probe bucket list iters (min, med, max ):
(1, 1, 1 )
StateStoreRestore

number of output rows: 2
HashAggregate

time in aggregation build total (min, med, max )
192 ms (0 ms, 0 ms, 190 ms )
peak memory total (min, med, max )
177.5 MiB (0.0 B, 256.0 KiB, 64.3 MiB )
number of output rows: 2
avg hash probe bucket list iters (min, med, max ):
(1, 1, 1 )
Exchange

shuffle records written: 4
shuffle write time total (min, med, max )
40 ms (15 ms, 25 ms, 25 ms )
records read: 4
local bytes read total (min, med, max )
157.0 B (0.0 B, 0.0 B, 79.0 B )
fetch wait time total (min, med, max )
1 ms (0 ms, 0 ms, 1 ms )
remote bytes read total (min, med, max )
157.0 B (0.0 B, 0.0 B, 79.0 B )
local blocks read: 2
remote blocks read: 2
data size total (min, med, max )
192.0 B (96.0 B, 96.0 B, 96.0 B )
shuffle bytes written total (min, med, max )
314.0 B (157.0 B, 157.0 B, 157.0 B )
HashAggregate

time in aggregation build total (min, med, max )
101 ms (29 ms, 72 ms, 72 ms )
peak memory total (min, med, max )
128.5 MiB (64.3 MiB, 64.3 MiB, 64.3 MiB )
number of output rows: 4
avg hash probe bucket list iters (min, med, max ):
(1, 1, 1 )

Project

Filter

number of output rows: 16
Expand

number of output rows: 16

EventTimeWatermark


Project

Filter

number of output rows: 8
Generate

number of output rows: 13

Project

MicroBatchScan

number of output rows: 11
Details