3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
mc-data-pipeline
application UI
Details for Stage 561 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Process local: 1
Input Size / Records:
0.0 B / 1
Associated Job Ids:
561
DAG Visualization
digraph G { subgraph clusterstage_561 { label="Stage 561"; 2243 [labelType="html" label="SQLExecutionRDD [2243]<br>start at KafkaDataFrameDataSource.scala:46"]; subgraph cluster6163 { label="MicroBatchScan"; 2240 [labelType="html" label="DataSourceRDD [2240]<br>start at KafkaDataFrameDataSource.scala:46"]; 2241 [labelType="html" label="MapPartitionsRDD [2241]<br>start at KafkaDataFrameDataSource.scala:46"]; } subgraph cluster6160 { label="WholeStageCodegen (1)"; 2242 [labelType="html" label="MapPartitionsRDD [2242]<br>start at KafkaDataFrameDataSource.scala:46"]; } subgraph cluster6174 { label="WholeStageCodegen (1)"; 2246 [labelType="html" label="MapPartitionsRDD [2246]<br>start at KafkaDataFrameDataSource.scala:46"]; } subgraph cluster6177 { label="mapPartitionsInternal"; 2247 [labelType="html" label="MapPartitionsRDD [2247]<br>start at KafkaDataFrameDataSource.scala:46"]; } } 2240->2241; 2241->2242; 2242->2243; 2243->2246; 2246->2247; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time