3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-demand-service
application UI
Details for Stage 48 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.7 s
Locality Level Summary:
Node local: 1
Output Size / Records:
35.1 KiB / 26
Shuffle Read Size / Records:
7.1 KiB / 52
Associated Job Ids:
34
DAG Visualization
digraph G { subgraph clusterstage_48 { label="Stage 48"; subgraph cluster385 { label="AQEShuffleRead"; 149 [labelType="html" label="ShuffledRowRDD [149] [Unordered]<br>save at FileStorageHandler.java:305"]; } subgraph cluster382 { label="WholeStageCodegen (4)"; 150 [labelType="html" label="MapPartitionsRDD [150] [Unordered]<br>save at FileStorageHandler.java:305"]; } subgraph cluster390 { label="AQEShuffleRead"; 151 [labelType="html" label="ShuffledRowRDD [151] [Unordered]<br>save at FileStorageHandler.java:305"]; } subgraph cluster387 { label="WholeStageCodegen (5)"; 152 [labelType="html" label="MapPartitionsRDD [152] [Unordered]<br>save at FileStorageHandler.java:305"]; } subgraph cluster377 { label="WholeStageCodegen (6)"; 153 [labelType="html" label="ZippedPartitionsRDD2 [153] [Unordered]<br>save at FileStorageHandler.java:305"]; 154 [labelType="html" label="MapPartitionsRDD [154] [Unordered]<br>save at FileStorageHandler.java:305"]; } subgraph cluster376 { label="WriteFiles"; 155 [labelType="html" label="MapPartitionsRDD [155] [Unordered]<br>save at FileStorageHandler.java:305"]; } } 149->150; 151->152; 150->153; 152->153; 153->154; 154->155; }
148,149
141,151
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time