task1 - Details for Query 7

Details for Query 7

Submitted Time: 2024/12/12 01:02:38
Duration: 34 s
Succeeded Jobs: 16 17

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" CollectLimit "]; subgraph cluster1 { isCluster="true"; label="WholeStageCodegen (5)\n \nduration: 0 ms"; 2 [labelType="html" label=" Project "]; } 3 [labelType="html" label="TakeOrderedAndProject shuffle records written: 348 shuffle write time total (min, med, max (stageId: taskId)) 26 ms (0 ms, 0 ms, 0 ms (stage 26.0: task 594)) records read: 348 local bytes read: 12.3 KiB fetch wait time: 0 ms remote bytes read: 14.2 KiB local blocks read: 79 remote blocks read: 89 shuffle bytes written total (min, med, max (stageId: taskId)) 26.4 KiB (0.0 B, 147.0 B, 318.0 B (stage 26.0: task 536))"]; subgraph cluster4 { isCluster="true"; label="WholeStageCodegen (4)\n \nduration: total (min, med, max (stageId: taskId))\n274 ms (0 ms, 2 ms, 4 ms (stage 26.0: task 459))"; 5 [labelType="html" label="HashAggregate time in aggregation build total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 26.0: task 460)) peak memory total (min, med, max (stageId: taskId)) 10.5 GiB (256.0 KiB, 64.3 MiB, 64.3 MiB (stage 26.0: task 460)) number of output rows: 348 avg hash probe bucket list iters (min, med, max (stageId: taskId)): (1, 1, 1 (stage 26.0: task 460))"]; } 6 [labelType="html" label="Exchange shuffle records written: 1,048 shuffle write time total (min, med, max (stageId: taskId)) 85 ms (3 ms, 4 ms, 5 ms (stage 25.0: task 457)) records read: 1,048 local bytes read total (min, med, max (stageId: taskId)) 49.1 KiB (0.0 B, 204.0 B, 791.0 B (stage 26.0: task 524)) fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 26.0: task 460)) remote bytes read total (min, med, max (stageId: taskId)) 45.7 KiB (0.0 B, 203.0 B, 736.0 B (stage 26.0: task 609)) local blocks read: 487 remote blocks read: 450 data size total (min, med, max (stageId: taskId)) 63.9 KiB (2.7 KiB, 3.1 KiB, 5.6 KiB (stage 25.0: task 457)) shuffle bytes written total (min, med, max (stageId: taskId)) 94.8 KiB (3.9 KiB, 4.6 KiB, 8.1 KiB (stage 25.0: task 457))"]; subgraph cluster7 { isCluster="true"; label="WholeStageCodegen (3)\n \nduration: total (min, med, max (stageId: taskId))\n1.1 m (1.1 s, 3.6 s, 4.1 s (stage 25.0: task 448))"; 8 [labelType="html" label="HashAggregate time in aggregation build total (min, med, max (stageId: taskId)) 1.1 m (1.0 s, 3.6 s, 4.1 s (stage 25.0: task 448)) peak memory total (min, med, max (stageId: taskId)) 5.0 MiB (256.0 KiB, 256.0 KiB, 256.0 KiB (stage 25.0: task 440)) number of output rows: 1,048"]; 9 [labelType="html" label=" Project "]; 10 [labelType="html" label="BroadcastHashJoin number of output rows: 22,400,728"]; 11 [labelType="html" label=" Project "]; 12 [labelType="html" label="BroadcastHashJoin number of output rows: 22,400,728"]; } 13 [labelType="html" label="Scan csv number of files read: 7 metadata time: 0 ms size of files read: 2.2 GiB number of output rows: 22,400,728"]; 14 [labelType="html" label="BroadcastExchange data size: 1026.1 KiB time to collect: 74 ms time to build: 5 ms time to broadcast: 31 ms"]; subgraph cluster15 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 25 ms"; 16 [labelType="html" label=" Project "]; 17 [labelType="html" label="Filter number of output rows: 265"]; } 18 [labelType="html" label="Scan csv number of files read: 1 metadata time: 0 ms size of files read: 10.5 KiB number of output rows: 265"]; 2->0; 3->2; 5->3; 6->5; 8->6; 9->8; 10->9; 11->10; 12->11; 13->12; 14->12; 16->14; 17->16; 18->17; 14->10; }

CollectLimit 21

Project [cast(Month#464 as string) AS Month#697, route#442, cast(total_tip_amount#619 as string) AS total_tip_amount#699, cast(total_passenger_count#621 as string) AS total_passenger_count#700, cast(average_tip_per_passenger#626 as string) AS average_tip_per_passenger#701]

WholeStageCodegen (5)

TakeOrderedAndProject(limit=10, orderBy=[average_tip_per_passenger#626 DESC NULLS LAST], output=[Month#464,route#442,total_tip_amount#619,total_passenger_count#621,average_tip_per_passenger#626])

HashAggregate(keys=[Month#464, route#442], functions=[sum(cast(tip_amount#50 as double)), sum(cast(passenger_count#42 as double))])

WholeStageCodegen (4)

Exchange hashpartitioning(Month#464, route#442, 200), true, [id=#521]

HashAggregate(keys=[Month#464, route#442], functions=[partial_sum(cast(tip_amount#50 as double)), partial_sum(cast(passenger_count#42 as double))])

Project [passenger_count#42, tip_amount#50, concat_ws( to , Pickup_Borough#206, Borough#17) AS route#442, month(cast(tpep_pickup_datetime#40 as date)) AS Month#464]

BroadcastHashJoin [cast(DOLocationID#45 as int)], [LocationID#16], LeftOuter, BuildRight

Project [tpep_pickup_datetime#40, passenger_count#42, DOLocationID#45, tip_amount#50, Borough#17 AS Pickup_Borough#206]

BroadcastHashJoin [cast(PULocationID#44 as int)], [LocationID#16], LeftOuter, BuildRight

WholeStageCodegen (3)

FileScan csv [tpep_pickup_datetime#40,passenger_count#42,PULocationID#44,DOLocationID#45,tip_amount#50] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex[s3a://data-repository-bkt/ECS765/nyc_taxi/yellow_tripdata/2023], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<tpep_pickup_datetime:string,passenger_count:string,PULocationID:string,DOLocationID:string...

BroadcastExchange HashedRelationBroadcastMode(List(cast(input[0, int, true] as bigint))), [id=#476]

Project [LocationID#16, Borough#17]

Filter isnotnull(LocationID#16)

WholeStageCodegen (1)

FileScan csv [LocationID#16,Borough#17] Batched: false, DataFilters: [isnotnull(LocationID#16)], Format: CSV, Location: InMemoryFileIndex[s3a://data-repository-bkt/ECS765/nyc_taxi/taxi_zone_lookup.csv], PartitionFilters: [], PushedFilters: [IsNotNull(LocationID)], ReadSchema: struct<LocationID:int,Borough:string>

Details

== Parsed Logical Plan ==
GlobalLimit 21
+- LocalLimit 21
   +- Project [cast(Month#464 as string) AS Month#697, cast(route#442 as string) AS route#698, cast(total_tip_amount#619 as string) AS total_tip_amount#699, cast(total_passenger_count#621 as string) AS total_passenger_count#700, cast(average_tip_per_passenger#626 as string) AS average_tip_per_passenger#701]
      +- GlobalLimit 10
         +- LocalLimit 10
            +- Sort [average_tip_per_passenger#626 DESC NULLS LAST], true
               +- Project [Month#464, route#442, total_tip_amount#619, total_passenger_count#621, (total_tip_amount#619 / total_passenger_count#621) AS average_tip_per_passenger#626]
                  +- Aggregate [Month#464, route#442], [Month#464, route#442, sum(cast(tip_amount#50 as double)) AS total_tip_amount#619, sum(cast(passenger_count#42 as double)) AS total_passenger_count#621]
                     +- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, Pickup_Borough#206, Pickup_Zone#227, Pickup_service_zone#248, Dropoff_Borough#353, Dropoff_Zone#376, Dropoff_service_zone#399, route#442, month(cast(tpep_pickup_datetime#40 as date)) AS Month#464]
                        +- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, Pickup_Borough#206, Pickup_Zone#227, Pickup_service_zone#248, Dropoff_Borough#353, Dropoff_Zone#376, Dropoff_service_zone#399, concat_ws( to , Pickup_Borough#206, Dropoff_Borough#353) AS route#442]
                           +- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, Pickup_Borough#206, Pickup_Zone#227, Pickup_service_zone#248, Dropoff_Borough#353, Dropoff_Zone#376, Dropoff_service_zone#399]
                              +- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, DOLocationID#45, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, Pickup_Borough#206, Pickup_Zone#227, Pickup_service_zone#248, LocationID#16, Dropoff_Borough#353, Dropoff_Zone#376, service_zone#19 AS Dropoff_service_zone#399]
                                 +- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, DOLocationID#45, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, Pickup_Borough#206, Pickup_Zone#227, Pickup_service_zone#248, LocationID#16, Dropoff_Borough#353, Zone#18 AS Dropoff_Zone#376, service_zone#19]
                                    +- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, DOLocationID#45, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, Pickup_Borough#206, Pickup_Zone#227, Pickup_service_zone#248, LocationID#16, Borough#17 AS Dropoff_Borough#353, Zone#18, service_zone#19]
                                       +- Join LeftOuter, (cast(DOLocationID#45 as int) = LocationID#16)
                                          :- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, DOLocationID#45, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, Pickup_Borough#206, Pickup_Zone#227, Pickup_service_zone#248]
                                          :  +- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, PULocationID#44, DOLocationID#45, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, LocationID#16, Pickup_Borough#206, Pickup_Zone#227, service_zone#19 AS Pickup_service_zone#248]
                                          :     +- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, PULocationID#44, DOLocationID#45, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, LocationID#16, Pickup_Borough#206, Zone#18 AS Pickup_Zone#227, service_zone#19]
                                          :        +- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, PULocationID#44, DOLocationID#45, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, LocationID#16, Borough#17 AS Pickup_Borough#206, Zone#18, service_zone#19]
                                          :           +- Join LeftOuter, (cast(PULocationID#44 as int) = LocationID#16)
                                          :              :- Relation[tpep_pickup_datetime#40,tpep_dropoff_datetime#41,passenger_count#42,trip_distance#43,PULocationID#44,DOLocationID#45,payment_type#46,fare_amount#47,extra#48,mta_tax#49,tip_amount#50,tolls_amount#51,total_amount#52,congestion_surcharge#53,airport_fee#54,taxi_type#55] csv
                                          :              +- Relation[LocationID#16,Borough#17,Zone#18,service_zone#19] csv
                                          +- Relation[LocationID#16,Borough#17,Zone#18,service_zone#19] csv

== Analyzed Logical Plan ==
Month: string, route: string, total_tip_amount: string, total_passenger_count: string, average_tip_per_passenger: string
GlobalLimit 21
+- LocalLimit 21
   +- Project [cast(Month#464 as string) AS Month#697, cast(route#442 as string) AS route#698, cast(total_tip_amount#619 as string) AS total_tip_amount#699, cast(total_passenger_count#621 as string) AS total_passenger_count#700, cast(average_tip_per_passenger#626 as string) AS average_tip_per_passenger#701]
      +- GlobalLimit 10
         +- LocalLimit 10
            +- Sort [average_tip_per_passenger#626 DESC NULLS LAST], true
               +- Project [Month#464, route#442, total_tip_amount#619, total_passenger_count#621, (total_tip_amount#619 / total_passenger_count#621) AS average_tip_per_passenger#626]
                  +- Aggregate [Month#464, route#442], [Month#464, route#442, sum(cast(tip_amount#50 as double)) AS total_tip_amount#619, sum(cast(passenger_count#42 as double)) AS total_passenger_count#621]
                     +- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, Pickup_Borough#206, Pickup_Zone#227, Pickup_service_zone#248, Dropoff_Borough#353, Dropoff_Zone#376, Dropoff_service_zone#399, route#442, month(cast(tpep_pickup_datetime#40 as date)) AS Month#464]
                        +- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, Pickup_Borough#206, Pickup_Zone#227, Pickup_service_zone#248, Dropoff_Borough#353, Dropoff_Zone#376, Dropoff_service_zone#399, concat_ws( to , Pickup_Borough#206, Dropoff_Borough#353) AS route#442]
                           +- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, Pickup_Borough#206, Pickup_Zone#227, Pickup_service_zone#248, Dropoff_Borough#353, Dropoff_Zone#376, Dropoff_service_zone#399]
                              +- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, DOLocationID#45, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, Pickup_Borough#206, Pickup_Zone#227, Pickup_service_zone#248, LocationID#16, Dropoff_Borough#353, Dropoff_Zone#376, service_zone#19 AS Dropoff_service_zone#399]
                                 +- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, DOLocationID#45, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, Pickup_Borough#206, Pickup_Zone#227, Pickup_service_zone#248, LocationID#16, Dropoff_Borough#353, Zone#18 AS Dropoff_Zone#376, service_zone#19]
                                    +- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, DOLocationID#45, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, Pickup_Borough#206, Pickup_Zone#227, Pickup_service_zone#248, LocationID#16, Borough#17 AS Dropoff_Borough#353, Zone#18, service_zone#19]
                                       +- Join LeftOuter, (cast(DOLocationID#45 as int) = LocationID#16)
                                          :- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, DOLocationID#45, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, Pickup_Borough#206, Pickup_Zone#227, Pickup_service_zone#248]
                                          :  +- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, PULocationID#44, DOLocationID#45, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, LocationID#16, Pickup_Borough#206, Pickup_Zone#227, service_zone#19 AS Pickup_service_zone#248]
                                          :     +- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, PULocationID#44, DOLocationID#45, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, LocationID#16, Pickup_Borough#206, Zone#18 AS Pickup_Zone#227, service_zone#19]
                                          :        +- Project [tpep_pickup_datetime#40, tpep_dropoff_datetime#41, passenger_count#42, trip_distance#43, PULocationID#44, DOLocationID#45, payment_type#46, fare_amount#47, extra#48, mta_tax#49, tip_amount#50, tolls_amount#51, total_amount#52, congestion_surcharge#53, airport_fee#54, taxi_type#55, LocationID#16, Borough#17 AS Pickup_Borough#206, Zone#18, service_zone#19]
                                          :           +- Join LeftOuter, (cast(PULocationID#44 as int) = LocationID#16)
                                          :              :- Relation[tpep_pickup_datetime#40,tpep_dropoff_datetime#41,passenger_count#42,trip_distance#43,PULocationID#44,DOLocationID#45,payment_type#46,fare_amount#47,extra#48,mta_tax#49,tip_amount#50,tolls_amount#51,total_amount#52,congestion_surcharge#53,airport_fee#54,taxi_type#55] csv
                                          :              +- Relation[LocationID#16,Borough#17,Zone#18,service_zone#19] csv
                                          +- Relation[LocationID#16,Borough#17,Zone#18,service_zone#19] csv

== Optimized Logical Plan ==
GlobalLimit 21
+- LocalLimit 21
   +- Project [cast(Month#464 as string) AS Month#697, route#442, cast(total_tip_amount#619 as string) AS total_tip_amount#699, cast(total_passenger_count#621 as string) AS total_passenger_count#700, cast(average_tip_per_passenger#626 as string) AS average_tip_per_passenger#701]
      +- GlobalLimit 10
         +- LocalLimit 10
            +- Sort [average_tip_per_passenger#626 DESC NULLS LAST], true
               +- Aggregate [Month#464, route#442], [Month#464, route#442, sum(cast(tip_amount#50 as double)) AS total_tip_amount#619, sum(cast(passenger_count#42 as double)) AS total_passenger_count#621, (sum(cast(tip_amount#50 as double)) / sum(cast(passenger_count#42 as double))) AS average_tip_per_passenger#626]
                  +- Project [passenger_count#42, tip_amount#50, concat_ws( to , Pickup_Borough#206, Borough#17) AS route#442, month(cast(tpep_pickup_datetime#40 as date)) AS Month#464]
                     +- Join LeftOuter, (cast(DOLocationID#45 as int) = LocationID#16)
                        :- Project [tpep_pickup_datetime#40, passenger_count#42, DOLocationID#45, tip_amount#50, Borough#17 AS Pickup_Borough#206]
                        :  +- Join LeftOuter, (cast(PULocationID#44 as int) = LocationID#16)
                        :     :- Project [tpep_pickup_datetime#40, passenger_count#42, PULocationID#44, DOLocationID#45, tip_amount#50]
                        :     :  +- Relation[tpep_pickup_datetime#40,tpep_dropoff_datetime#41,passenger_count#42,trip_distance#43,PULocationID#44,DOLocationID#45,payment_type#46,fare_amount#47,extra#48,mta_tax#49,tip_amount#50,tolls_amount#51,total_amount#52,congestion_surcharge#53,airport_fee#54,taxi_type#55] csv
                        :     +- Project [LocationID#16, Borough#17]
                        :        +- Filter isnotnull(LocationID#16)
                        :           +- Relation[LocationID#16,Borough#17,Zone#18,service_zone#19] csv
                        +- Project [LocationID#16, Borough#17]
                           +- Filter isnotnull(LocationID#16)
                              +- Relation[LocationID#16,Borough#17,Zone#18,service_zone#19] csv

== Physical Plan ==
CollectLimit 21
+- *(5) Project [cast(Month#464 as string) AS Month#697, route#442, cast(total_tip_amount#619 as string) AS total_tip_amount#699, cast(total_passenger_count#621 as string) AS total_passenger_count#700, cast(average_tip_per_passenger#626 as string) AS average_tip_per_passenger#701]
   +- TakeOrderedAndProject(limit=10, orderBy=[average_tip_per_passenger#626 DESC NULLS LAST], output=[Month#464,route#442,total_tip_amount#619,total_passenger_count#621,average_tip_per_passenger#626])
      +- *(4) HashAggregate(keys=[Month#464, route#442], functions=[sum(cast(tip_amount#50 as double)), sum(cast(passenger_count#42 as double))], output=[Month#464, route#442, total_tip_amount#619, total_passenger_count#621, average_tip_per_passenger#626])
         +- Exchange hashpartitioning(Month#464, route#442, 200), true, [id=#521]
            +- *(3) HashAggregate(keys=[Month#464, route#442], functions=[partial_sum(cast(tip_amount#50 as double)), partial_sum(cast(passenger_count#42 as double))], output=[Month#464, route#442, sum#649, sum#650])
               +- *(3) Project [passenger_count#42, tip_amount#50, concat_ws( to , Pickup_Borough#206, Borough#17) AS route#442, month(cast(tpep_pickup_datetime#40 as date)) AS Month#464]
                  +- *(3) BroadcastHashJoin [cast(DOLocationID#45 as int)], [LocationID#16], LeftOuter, BuildRight
                     :- *(3) Project [tpep_pickup_datetime#40, passenger_count#42, DOLocationID#45, tip_amount#50, Borough#17 AS Pickup_Borough#206]
                     :  +- *(3) BroadcastHashJoin [cast(PULocationID#44 as int)], [LocationID#16], LeftOuter, BuildRight
                     :     :- FileScan csv [tpep_pickup_datetime#40,passenger_count#42,PULocationID#44,DOLocationID#45,tip_amount#50] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex[s3a://data-repository-bkt/ECS765/nyc_taxi/yellow_tripdata/2023], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<tpep_pickup_datetime:string,passenger_count:string,PULocationID:string,DOLocationID:string...
                     :     +- BroadcastExchange HashedRelationBroadcastMode(List(cast(input[0, int, true] as bigint))), [id=#476]
                     :        +- *(1) Project [LocationID#16, Borough#17]
                     :           +- *(1) Filter isnotnull(LocationID#16)
                     :              +- FileScan csv [LocationID#16,Borough#17] Batched: false, DataFilters: [isnotnull(LocationID#16)], Format: CSV, Location: InMemoryFileIndex[s3a://data-repository-bkt/ECS765/nyc_taxi/taxi_zone_lookup.csv], PartitionFilters: [], PushedFilters: [IsNotNull(LocationID)], ReadSchema: struct<LocationID:int,Borough:string>
                     +- ReusedExchange [LocationID#16, Borough#17], BroadcastExchange HashedRelationBroadcastMode(List(cast(input[0, int, true] as bigint))), [id=#476]