3.0.1
PythonWordCount
application UI
Jobs
Stages
Storage
Environment
Executors
Details for Stage 3 (Attempt 0)
Total Time Across All Tasks:
43 ms
Locality Level Summary:
Node local: 2
Shuffle Read Size / Records:
286.9 KiB / 60
Associated Job Ids:
1
DAG Visualization
digraph G { subgraph clusterstage_3 { label="Stage 3"; 7 [labelType="html" label="PythonRDD [7]<br>sortBy at /tmp/spark-bb62ec69-9d8f-4e1c-be3e-0262a1da0a28/sherlock.py:33"]; subgraph cluster1 { label="partitionBy"; 4 [labelType="html" label="ShuffledRDD [4]<br>partitionBy at NativeMethodAccessorImpl.java:0"]; } subgraph cluster2 { label="mapPartitions"; 5 [labelType="html" label="MapPartitionsRDD [5]<br>mapPartitions at PythonRDD.scala:133"]; } } 4->5; 5->7; }
3,4
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time