3.0.1
NasaLogSparkStreaming
application UI
Jobs
Stages
Storage
Environment
Executors
SQL
Details for Stage 49 (Attempt 0)
Total Time Across All Tasks:
26 ms
Locality Level Summary:
Process local: 2
Shuffle Write Size / Records:
920.0 B / 8
Associated Job Ids:
32
DAG Visualization
digraph G { subgraph clusterstage_49 { label="Stage 49"; subgraph cluster692 { label="MicroBatchScan"; 250 [labelType="html" label="DataSourceRDD [250]<br>start at NativeMethodAccessorImpl.java:0"]; 251 [labelType="html" label="MapPartitionsRDD [251]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster689 { label="WholeStageCodegen (1)"; 252 [labelType="html" label="MapPartitionsRDD [252]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster688 { label="Generate"; 253 [labelType="html" label="MapPartitionsRDD [253]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster685 { label="WholeStageCodegen (2)"; 254 [labelType="html" label="MapPartitionsRDD [254]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster684 { label="EventTimeWatermark"; 255 [labelType="html" label="MapPartitionsRDD [255]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster677 { label="WholeStageCodegen (3)"; 256 [labelType="html" label="MapPartitionsRDD [256]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster676 { label="Exchange"; 257 [labelType="html" label="MapPartitionsRDD [257]<br>start at NativeMethodAccessorImpl.java:0"]; } } 250->251; 251->252; 252->253; 253->254; 254->255; 255->256; 256->257; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time
