Uploaded June 2026 | Updated September 2026, 2 weeks ago
Ready to take your Fabric Spark workloads from idea to production?
Join two members of the Microsoft product team as they walk through how to orchestrate Spark in Microsoft Fabric using proven, real-world best practices. This is your chance to learn directly from the people who build the product and see how these capabilities are designed to scale.
You’ll explore how to scale efficiently, improve price performance with native execution, and secure workloads with enterprise-grade features.
Walk away with a production-ready playbook, actionable steps, and AI-powered tools to confidently orchestrate Spark in Microsoft Fabric.
🔗 Register for Data Days: https://aka.ms/datadays
📍 This session is a part of a series, learn more here: https://aka.ms/DataDayslive/spark-y
Chapters:
0:00 Introduction
1:43 Agenda and Learning Pillars
3:50 Common Customer Challenges
5:01 Production Readiness & Compute Sizing
8:06 Billing Models: Fixed vs. Autoscale
15:40 Monitoring Workspace Usage
17:20 Compute Governance & Starter Pools
18:18 Security: Network, Encryption & Private Links
24:50 Performance Updates: Liquid Clustering & Native Execution
29:50 Pre-warm Clusters and Light Pools
30:51 Performance Tuning & Medallion Architecture
34:35 Adaptive Target File Sizes
37:44 Parallel Snapshot Loading & Connectivity Improvements
41:58 Identifying and Solving Data Skew
43:30 Memory Management & Avoiding Data Spills
44:40 Resource Profiles: Static vs. Auto-update
50:45 High Concurrency Mode and Orchestration
54:28 Importance of Testing & CI/CD
56:45 Early Release Channel
58:12 Library Management
59:25 JDBC/ODBC Connectivity & Livy API
1:01:28 Q&A Session
#MSFTReactor #learnconnectbuild
[eventID:27278]
Ready to take your Fabric Spark workloads from idea to production?
Join two members of the Microsoft product team as they walk through how to orchestrate Spark in Microsoft Fabric using proven, real-world best practices. This is your chance to learn directly from the people who build the product and see how these capabilities are designed to scale.
You’ll explore how to scale efficiently, improve price performance with native execution, and secure workloads with enterprise-grade features.
Walk away with a production-ready playbook, actionable steps, and AI-powered tools to confidently orchestrate Spark in Microsoft Fabric.
🔗 Register for Data Days: https://aka.ms/datadays
📍 This session is a part of a series, learn more here: https://aka.ms/DataDayslive/spark-y
Chapters:
0:00 Introduction
1:43 Agenda and Learning Pillars
3:50 Common Customer Challenges
5:01 Production Readiness & Compute Sizing
8:06 Billing Models: Fixed vs. Autoscale
15:40 Monitoring Workspace Usage
17:20 Compute Governance & Starter Pools
18:18 Security: Network, Encryption & Private Links
24:50 Performance Updates: Liquid Clustering & Native Execution
29:50 Pre-warm Clusters and Light Pools
30:51 Performance Tuning & Medallion Architecture
34:35 Adaptive Target File Sizes
37:44 Parallel Snapshot Loading & Connectivity Improvements
41:58 Identifying and Solving Data Skew
43:30 Memory Management & Avoiding Data Spills
44:40 Resource Profiles: Static vs. Auto-update
50:45 High Concurrency Mode and Orchestration
54:28 Importance of Testing & CI/CD
56:45 Early Release Channel
58:12 Library Management
59:25 JDBC/ODBC Connectivity & Livy API
1:01:28 Q&A Session
#MSFTReactor #learnconnectbuild
[eventID:27278]
