Details for Query 6

Show the Stage ID and Task ID that corresponds to the max metric
WholeStageCodegen (6) duration: total (min, med, max )340 ms (0 ms, 0 ms, 28 ms )WholeStageCodegen (5) duration: total (min, med, max )1.7 s (6 ms, 8 ms, 30 ms )WholeStageCodegen (2) duration: total (min, med, max )784 ms (0 ms, 4 ms, 73 ms )WholeStageCodegen (1) duration: total (min, med, max )8.7 s (196 ms, 2.1 s, 2.2 s )WholeStageCodegen (4) duration: total (min, med, max )767 ms (0 ms, 3 ms, 70 ms )WholeStageCodegen (3) duration: total (min, med, max )3.3 s (1.5 s, 1.7 s, 1.7 s )

TakeOrderedAndProject

HashAggregate

time in aggregation build total (min, med, max )
139 ms (0 ms, 0 ms, 13 ms )
peak memory total (min, med, max )
1842.0 MiB (256.0 KiB, 256.0 KiB, 64.3 MiB )
number of output rows: 31
avg hash probe bucket list iters (min, med, max ):
(1, 1, 1 )
Exchange

shuffle records written: 6,200
shuffle write time total (min, med, max )
991 ms (3 ms, 4 ms, 10 ms )
records read: 6,200
local bytes read total (min, med, max )
176.3 KiB (0.0 B, 0.0 B, 8.1 KiB )
fetch wait time total (min, med, max )
11 ms (0 ms, 0 ms, 4 ms )
remote bytes read total (min, med, max )
178.6 KiB (0.0 B, 0.0 B, 8.0 KiB )
local blocks read: 2,780
remote blocks read: 2,820
data size total (min, med, max )
145.3 KiB (744.0 B, 744.0 B, 744.0 B )
shuffle bytes written total (min, med, max )
354.9 KiB (1810.0 B, 1817.0 B, 1826.0 B )
HashAggregate

time in aggregation build total (min, med, max )
285 ms (1 ms, 1 ms, 20 ms )
peak memory total (min, med, max )
50.0 MiB (256.0 KiB, 256.0 KiB, 256.0 KiB )
number of output rows: 6,200

Project

SortMergeJoin

number of output rows: 72,118
Sort

sort time total (min, med, max )
0 ms (0 ms, 0 ms, 0 ms )
peak memory total (min, med, max )
12.5 GiB (64.1 MiB, 64.1 MiB, 64.1 MiB )
spill size total (min, med, max )
0.0 B (0.0 B, 0.0 B, 0.0 B )
Exchange

shuffle records written: 156,095
shuffle write time total (min, med, max )
42 ms (0 ms, 0 ms, 26 ms )
records read: 156,095
local bytes read total (min, med, max )
5.1 MiB (16.0 KiB, 31.3 KiB, 36.1 KiB )
fetch wait time total (min, med, max )
31 ms (0 ms, 0 ms, 16 ms )
remote bytes read total (min, med, max )
4.9 MiB (16.1 KiB, 20.4 KiB, 37.7 KiB )
local blocks read: 200
remote blocks read: 200
data size total (min, med, max )
14.3 MiB (0.0 B, 0.0 B, 9.2 MiB )
shuffle bytes written total (min, med, max )
10.0 MiB (0.0 B, 0.0 B, 6.4 MiB )

Project

Filter

number of output rows: 156,095
Scan csv

number of files read: 1
metadata time: 0 ms
size of files read: 519.0 MiB
number of output rows: 500,001
Sort

sort time total (min, med, max )
1 ms (0 ms, 0 ms, 1 ms )
peak memory total (min, med, max )
12.5 GiB (64.1 MiB, 64.1 MiB, 64.1 MiB )
spill size total (min, med, max )
0.0 B (0.0 B, 0.0 B, 0.0 B )
Exchange

shuffle records written: 171,282
shuffle write time total (min, med, max )
56 ms (26 ms, 29 ms, 29 ms )
records read: 171,282
local bytes read total (min, med, max )
5.7 MiB (24.5 KiB, 29.1 KiB, 34.3 KiB )
fetch wait time total (min, med, max )
0 ms (0 ms, 0 ms, 0 ms )
remote bytes read total (min, med, max )
5.7 MiB (24.4 KiB, 29.0 KiB, 34.6 KiB )
local blocks read: 200
remote blocks read: 200
data size total (min, med, max )
17.0 MiB (8.2 MiB, 8.8 MiB, 8.8 MiB )
shuffle bytes written total (min, med, max )
11.4 MiB (5.5 MiB, 6.0 MiB, 6.0 MiB )

Project

Filter

number of output rows: 171,282
Scan csv

number of files read: 1
metadata time: 0 ms
size of files read: 173.6 MiB
number of output rows: 171,282
Details