3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
mc-data-pipeline
application UI
Details for Stage 589 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Process local: 1
Input Size / Records:
0.0 B / 1
Associated Job Ids:
589
DAG Visualization
digraph G { subgraph clusterstage_589 { label="Stage 589"; 2355 [labelType="html" label="SQLExecutionRDD [2355]<br>start at KafkaDataFrameDataSource.scala:46"]; subgraph cluster6471 { label="MicroBatchScan"; 2352 [labelType="html" label="DataSourceRDD [2352]<br>start at KafkaDataFrameDataSource.scala:46"]; 2353 [labelType="html" label="MapPartitionsRDD [2353]<br>start at KafkaDataFrameDataSource.scala:46"]; } subgraph cluster6468 { label="WholeStageCodegen (1)"; 2354 [labelType="html" label="MapPartitionsRDD [2354]<br>start at KafkaDataFrameDataSource.scala:46"]; } subgraph cluster6482 { label="WholeStageCodegen (1)"; 2358 [labelType="html" label="MapPartitionsRDD [2358]<br>start at KafkaDataFrameDataSource.scala:46"]; } subgraph cluster6485 { label="mapPartitionsInternal"; 2359 [labelType="html" label="MapPartitionsRDD [2359]<br>start at KafkaDataFrameDataSource.scala:46"]; } } 2352->2353; 2353->2354; 2354->2355; 2355->2358; 2358->2359; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time