NasaLogSparkStreaming - Details for Query 0

Details for Query 0

Submitted Time: 2024/12/27 14:32:42
Duration: 2 s
Show the Stage ID and Task ID that corresponds to the max metric
Details
== Parsed Logical Plan ==
WriteToDataSourceV2 org.apache.spark.sql.execution.streaming.sources.MicroBatchWrite@45933e5
+- Project [logs#5, timestamp#1]
   +- Generate explode(split(value#0,  , -1)), false, [logs#5]
      +- StreamingDataSourceV2Relation [value#0, timestamp#1], org.apache.spark.sql.execution.streaming.sources.TextSocketTable$$anon$1@2d16941a, TextSocketV2[host: stream-emulator.data-science-tools.svc.cluster.local, port: 5551], -1, -1

== Analyzed Logical Plan ==

WriteToDataSourceV2 org.apache.spark.sql.execution.streaming.sources.MicroBatchWrite@45933e5
+- Project [logs#5, timestamp#1]
   +- Generate explode(split(value#0,  , -1)), false, [logs#5]
      +- StreamingDataSourceV2Relation [value#0, timestamp#1], org.apache.spark.sql.execution.streaming.sources.TextSocketTable$$anon$1@2d16941a, TextSocketV2[host: stream-emulator.data-science-tools.svc.cluster.local, port: 5551], -1, -1

== Optimized Logical Plan ==
WriteToDataSourceV2 org.apache.spark.sql.execution.streaming.sources.MicroBatchWrite@45933e5
+- Project [logs#5, timestamp#1]
   +- Generate explode(split(value#0,  , -1)), [0], false, [logs#5]
      +- StreamingDataSourceV2Relation [value#0, timestamp#1], org.apache.spark.sql.execution.streaming.sources.TextSocketTable$$anon$1@2d16941a, TextSocketV2[host: stream-emulator.data-science-tools.svc.cluster.local, port: 5551], -1, -1

== Physical Plan ==
WriteToDataSourceV2 org.apache.spark.sql.execution.streaming.sources.MicroBatchWrite@45933e5
+- *(2) Project [logs#5, timestamp#1]
   +- Generate explode(split(value#0,  , -1)), [timestamp#1], false, [logs#5]
      +- *(1) Project [value#0, timestamp#1]
         +- MicroBatchScan[value#0, timestamp#1] class org.apache.spark.sql.execution.streaming.sources.TextSocketTable$$anon$1