3.0.1

NYC Yellow Taxi Data Analysis application UI

Details for Query 6

Show the Stage ID and Task ID that corresponds to the max metric
WholeStageCodegen (4) duration: total (min, med, max )26 ms (1 ms, 4 ms, 12 ms )WholeStageCodegen (3) duration: total (min, med, max )1.5 m (1.5 s, 5.0 s, 5.6 s )WholeStageCodegen (1) duration: 131 ms

CollectLimit

HashAggregate

time in aggregation build total (min, med, max )
16 ms (0 ms, 2 ms, 9 ms )
peak memory total (min, med, max )
257.3 MiB (256.0 KiB, 64.3 MiB, 64.3 MiB )
number of output rows: 12
avg hash probe bucket list iters (min, med, max ):
(1, 1, 1 )
Exchange

shuffle records written: 1,048
shuffle write time total (min, med, max )
176 ms (6 ms, 8 ms, 12 ms )
records read: 42
local bytes read total (min, med, max )
1686.0 B (0.0 B, 419.0 B, 691.0 B )
fetch wait time total (min, med, max )
1 ms (0 ms, 0 ms, 1 ms )
remote bytes read total (min, med, max )
1746.0 B (0.0 B, 365.0 B, 654.0 B )
local blocks read: 15
remote blocks read: 16
data size total (min, med, max )
63.9 KiB (2.7 KiB, 3.1 KiB, 5.6 KiB )
shuffle bytes written total (min, med, max )
94.8 KiB (3.9 KiB, 4.6 KiB, 8.1 KiB )
HashAggregate

time in aggregation build total (min, med, max )
1.5 m (1.5 s, 5.0 s, 5.5 s )
peak memory total (min, med, max )
5.0 MiB (256.0 KiB, 256.0 KiB, 256.0 KiB )
number of output rows: 1,048

Project

BroadcastHashJoin

number of output rows: 22,400,728

Project

BroadcastHashJoin

number of output rows: 22,400,728
Scan csv

number of files read: 7
metadata time: 0 ms
size of files read: 2.2 GiB
number of output rows: 22,400,728
BroadcastExchange

data size: 1026.1 KiB
time to collect: 223 ms
time to build: 7 ms
time to broadcast: 3 ms

Project

Filter

number of output rows: 265
Scan csv

number of files read: 1
metadata time: 0 ms
size of files read: 10.5 KiB
number of output rows: 265
Details