Uploaded April 2026 | Updated September 2026, 2 weeks ago
In this technical session, Anant demonstrates a real-time air traffic control system.
In the POC Apache Spark™️ Real-Time Mode (RTM) achieves sub-300ms end-to-end latency for live flight telemetry, including altitude, speed, and heading updates. Anant explains the unified architecture consisting of Structured Streaming for stateful processing, Lakebase for low-latency serving, and Databricks Apps for the React-based visualization.
He also walks through the Spark code, emphasizing the use of Transform with State for upstream congestion detection and the RTM trigger configuration that enables sub-second streaming.
The session concludes by showing how this architectural pattern for continuous data streams can be applied to fraud detection, industrial IoT, and other mission-critical operations.
In this technical session, Anant demonstrates a real-time air traffic control system.
In the POC Apache Spark™️ Real-Time Mode (RTM) achieves sub-300ms end-to-end latency for live flight telemetry, including altitude, speed, and heading updates. Anant explains the unified architecture consisting of Structured Streaming for stateful processing, Lakebase for low-latency serving, and Databricks Apps for the React-based visualization.
He also walks through the Spark code, emphasizing the use of Transform with State for upstream congestion detection and the RTM trigger configuration that enables sub-second streaming.
The session concludes by showing how this architectural pattern for continuous data streams can be applied to fraud detection, industrial IoT, and other mission-critical operations.
