3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-demand-service
application UI
Details for Stage 51 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Node local: 1; Process local: 49
Shuffle Read Size / Records:
857.0 B / 3
Shuffle Write Size / Records:
5.3 KiB / 50
Associated Job Ids:
36
DAG Visualization
digraph G { subgraph clusterstage_51 { label="Stage 51"; 165 [labelType="html" label="SQLExecutionRDD [165] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; subgraph cluster430 { label="Exchange"; 160 [labelType="html" label="ShuffledRowRDD [160] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster425 { label="WholeStageCodegen (2)"; 161 [labelType="html" label="MapPartitionsRDD [161] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster424 { label="DeserializeToObject"; 162 [labelType="html" label="MapPartitionsRDD [162] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster423 { label="MapPartitions"; 163 [labelType="html" label="MapPartitionsRDD [163] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster420 { label="WholeStageCodegen (3)"; 164 [labelType="html" label="MapPartitionsRDD [164] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster431 { label="map"; 166 [labelType="html" label="Delta Table State #0 - hdlfs://7646b954-15f6-4bdc-91a5-2644c1a43a19.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-demand-service/internal/insights/10000003977/_delta_log [166] [Cached] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster434 { label="WholeStageCodegen (1)"; 167 [labelType="html" label="MapPartitionsRDD [167] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster433 { label="ObjectHashAggregate"; 168 [labelType="html" label="MapPartitionsRDD [168] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster432 { label="Exchange"; 169 [labelType="html" label="MapPartitionsRDD [169] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 160->161; 161->162; 162->163; 163->164; 164->165; 165->166; 166->167; 167->168; 168->169; }
159,160
166
Event Timeline
Enable zooming
Tasks: 50. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time