3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
mc-data-pipeline
application UI
Details for Stage 605 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Process local: 1
Input Size / Records:
0.0 B / 3
Associated Job Ids:
605
DAG Visualization
digraph G { subgraph clusterstage_605 { label="Stage 605"; 2419 [labelType="html" label="SQLExecutionRDD [2419]<br>start at KafkaDataFrameDataSource.scala:46"]; subgraph cluster6647 { label="MicroBatchScan"; 2416 [labelType="html" label="DataSourceRDD [2416]<br>start at KafkaDataFrameDataSource.scala:46"]; 2417 [labelType="html" label="MapPartitionsRDD [2417]<br>start at KafkaDataFrameDataSource.scala:46"]; } subgraph cluster6644 { label="WholeStageCodegen (1)"; 2418 [labelType="html" label="MapPartitionsRDD [2418]<br>start at KafkaDataFrameDataSource.scala:46"]; } subgraph cluster6658 { label="WholeStageCodegen (1)"; 2422 [labelType="html" label="MapPartitionsRDD [2422]<br>start at KafkaDataFrameDataSource.scala:46"]; } subgraph cluster6661 { label="mapPartitionsInternal"; 2423 [labelType="html" label="MapPartitionsRDD [2423]<br>start at KafkaDataFrameDataSource.scala:46"]; } } 2416->2417; 2417->2418; 2418->2419; 2419->2422; 2422->2423; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time