3.0.1
NasaLogSparkStreaming
application UI
Jobs
Stages
Storage
Environment
Executors
SQL
Details for Stage 0 (Attempt 0)
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 4
Associated Job Ids:
0
DAG Visualization
digraph G { subgraph clusterstage_0 { label="Stage 0"; subgraph cluster31 { label="MicroBatchScan"; 0 [labelType="html" label="DataSourceRDD [0]<br>start at NativeMethodAccessorImpl.java:0"]; 1 [labelType="html" label="MapPartitionsRDD [1]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster28 { label="WholeStageCodegen (1)"; 2 [labelType="html" label="MapPartitionsRDD [2]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster27 { label="Generate"; 3 [labelType="html" label="MapPartitionsRDD [3]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster24 { label="WholeStageCodegen (2)"; 4 [labelType="html" label="MapPartitionsRDD [4]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster23 { label="EventTimeWatermark"; 5 [labelType="html" label="MapPartitionsRDD [5]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster16 { label="WholeStageCodegen (3)"; 6 [labelType="html" label="MapPartitionsRDD [6]<br>start at NativeMethodAccessorImpl.java:0"]; } subgraph cluster15 { label="Exchange"; 7 [labelType="html" label="MapPartitionsRDD [7]<br>start at NativeMethodAccessorImpl.java:0"]; } } 0->1; 1->2; 2->3; 3->4; 4->5; 5->6; 6->7; }
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time
