NasaLogSparkStreaming - Details for Query 21

Details for Query 21

Submitted Time: 2024/12/27 14:33:02
Duration: 21 s
Show the Stage ID and Task ID that corresponds to the max metric
Details
== Parsed Logical Plan ==
WriteToDataSourceV2 org.apache.spark.sql.execution.streaming.sources.MicroBatchWrite@5e5ff983
+- Project [logs#5, timestamp#1]
   +- Generate explode(split(value#0,  , -1)), false, [logs#5]
      +- StreamingDataSourceV2Relation [value#0, timestamp#1], org.apache.spark.sql.execution.streaming.sources.TextSocketTable$$anon$1@2d16941a, TextSocketV2[host: stream-emulator.data-science-tools.svc.cluster.local, port: 5551], 2, 19

== Analyzed Logical Plan ==

WriteToDataSourceV2 org.apache.spark.sql.execution.streaming.sources.MicroBatchWrite@5e5ff983
+- Project [logs#5, timestamp#1]
   +- Generate explode(split(value#0,  , -1)), false, [logs#5]
      +- StreamingDataSourceV2Relation [value#0, timestamp#1], org.apache.spark.sql.execution.streaming.sources.TextSocketTable$$anon$1@2d16941a, TextSocketV2[host: stream-emulator.data-science-tools.svc.cluster.local, port: 5551], 2, 19

== Optimized Logical Plan ==
WriteToDataSourceV2 org.apache.spark.sql.execution.streaming.sources.MicroBatchWrite@5e5ff983
+- Project [logs#5, timestamp#1]
   +- Generate explode(split(value#0,  , -1)), [0], false, [logs#5]
      +- StreamingDataSourceV2Relation [value#0, timestamp#1], org.apache.spark.sql.execution.streaming.sources.TextSocketTable$$anon$1@2d16941a, TextSocketV2[host: stream-emulator.data-science-tools.svc.cluster.local, port: 5551], 2, 19

== Physical Plan ==
WriteToDataSourceV2 org.apache.spark.sql.execution.streaming.sources.MicroBatchWrite@5e5ff983
+- *(2) Project [logs#5, timestamp#1]
   +- Generate explode(split(value#0,  , -1)), [timestamp#1], false, [logs#5]
      +- *(1) Project [value#0, timestamp#1]
         +- MicroBatchScan[value#0, timestamp#1] class org.apache.spark.sql.execution.streaming.sources.TextSocketTable$$anon$1