Uploaded July 2026 | Updated September 2026, 2 weeks ago
Fabric Runtime 2.0 is a major leap forward for running Spark at scale in Microsoft Fabric.
Join members of the Microsoft product team for a deep dive into what’s new and what it means for you. You will get a clear look at the biggest innovations in Spark 4 and Delta 4, along with the Microsoft enhancements that drive better performance, reliability, and developer productivity.
This is your chance to learn directly from the people building the platform and understand how to take advantage of these changes in real-world workloads.
🔗 Register for Data Days: https://aka.ms/datadays
📍 This session is a part of a series, learn more here: https://aka.ms/DataDayslive/spark-y
0:00 Welcome & Session Introduction
2:25 Meet the Speakers & Fabric Runtime 2.0 Overview
5:14 Agenda: Spark 4, Delta Lake & Native Execution Engine
6:08 Apache Spark 4: SQL Enhancements
12:35 Real-Time Streaming in Spark 4
17:17 Observability & Monitoring Improvements
18:58 Delta Lake 4 Overview
20:15 Type Widening & Schema Evolution
23:58 Variant Data Type for Semi-Structured Data
25:55 Identity Columns in Delta Lake
27:30 Table Layout, File Skipping & Performance
33:39 Adaptive File Sizing & Intelligent Optimization
35:01 Liquid Clustering & Auto Reclustering
40:20 Auto Compaction, Vacuum & Performance Features
42:10 Deletion Vectors & Snapshot Acceleration
44:18 Native Execution Engine Architecture
47:03 Enabling Native Execution Engine
49:55 Gluten, Velox & Query Optimization
53:35 Runtime 2.0 Native Engine Enhancements
58:36 Best Practices for Native Execution Engine
1:00:37 Anti-Patterns & Migration Guidance
1:02:42 Q&A Session
1:10:18 Feedback & Closing Remarks
#MSFTReactor #learnconnectbuild
[eventID:27281]
Fabric Runtime 2.0 is a major leap forward for running Spark at scale in Microsoft Fabric.
Join members of the Microsoft product team for a deep dive into what’s new and what it means for you. You will get a clear look at the biggest innovations in Spark 4 and Delta 4, along with the Microsoft enhancements that drive better performance, reliability, and developer productivity.
This is your chance to learn directly from the people building the platform and understand how to take advantage of these changes in real-world workloads.
🔗 Register for Data Days: https://aka.ms/datadays
📍 This session is a part of a series, learn more here: https://aka.ms/DataDayslive/spark-y
0:00 Welcome & Session Introduction
2:25 Meet the Speakers & Fabric Runtime 2.0 Overview
5:14 Agenda: Spark 4, Delta Lake & Native Execution Engine
6:08 Apache Spark 4: SQL Enhancements
12:35 Real-Time Streaming in Spark 4
17:17 Observability & Monitoring Improvements
18:58 Delta Lake 4 Overview
20:15 Type Widening & Schema Evolution
23:58 Variant Data Type for Semi-Structured Data
25:55 Identity Columns in Delta Lake
27:30 Table Layout, File Skipping & Performance
33:39 Adaptive File Sizing & Intelligent Optimization
35:01 Liquid Clustering & Auto Reclustering
40:20 Auto Compaction, Vacuum & Performance Features
42:10 Deletion Vectors & Snapshot Acceleration
44:18 Native Execution Engine Architecture
47:03 Enabling Native Execution Engine
49:55 Gluten, Velox & Query Optimization
53:35 Runtime 2.0 Native Engine Enhancements
58:36 Best Practices for Native Execution Engine
1:00:37 Anti-Patterns & Migration Guidance
1:02:42 Q&A Session
1:10:18 Feedback & Closing Remarks
#MSFTReactor #learnconnectbuild
[eventID:27281]
