From Spark to Ray: CSSs Data Revolution with Daft | Ray Summit 2024 @anyscale
From Spark to Ray: CSSs Data Revolution with Daft | Ray Summit 2024  @anyscale
Uploaded October 2024 | Updated September 2026, 2 weeks ago
City Storage Systems (CSS) revolutionizes its machine learning infrastructure by embracing Daft, a powerful DataFrame library seamlessly integrated with Ray. This session unveils how CSS transforms its data processing and ETL workflows, moving beyond traditional Spark clusters to a more unified and efficient Ray-based ecosystem.

Ammar Alrashed, Santosh Jha, and Garret Weaver showcase real-world applications from CloudKitchens, demonstrating how Daft's intuitive interface not only matches but often exceeds PySpark's capabilities. They explore the benefits of consolidating operations across individual and cluster environments, highlighting the synergy between Ray and Daft in supporting end-to-end machine learning pipelines. Attendees gain insights into practical strategies for streamlining data engineering and model development workflows, applicable to a wide range of data-intensive industries.

--

Interested in more?
- Watch the full Day 1 Keynote: youtu.be/jwZHJthQvXo
- Watch the full Day 2 Keynote youtu.be/Lury2ad6KG8
- Check out the Ray Summmit Breakout sessions youtube.com/playlist?list=PLzTswPQNepXntmT8jr9WaNfqQ60QwW7-U&si=qPw-_SxT9lVmbRGE

--

đź”— Connect with us:
- Subscribe to our YouTube channel: youtube.com/@anyscale
- Twitter: https://x.com/anyscalecompute
- LinkedIn: linkedin.com/company/joinanyscale
- Website: anyscale.com
From Spark to Ray: CSSs Data Revolution with Daft | Ray Summit 2024How Rubrik Unlocked AI at Scale with Ray Serve | Ray Summit 2024How Workday Achieved 50x Cheaper Model Serving with Ray Serve | Ray Summit 2025ByteDances Platform for Reinforcement Learning from Human Feedback | Ray Summit 2024Dynamic Scheduling for Large Language Model Serving | Ray Summit 2024How Prime Intellect Builds Scalable Infrastructure for Agentic RL | Ray Summit 2025BentoML or RayServe, You Can Choose Both with BentoRayHow KubeRay Is Evolving for Massive AI Workloads  | Ray Summit 2025RDMA P2P Deep Dive: KvCache Transfer, Weight Updates & MoE Routing at Perplexity | Ray Summit 2025Ray Direct Transport: RDMA Support in Ray Core | Ray Summit 2025Building LLaMA: Metas Director of GenAI Sergey Edunov | Ray Summit 2024Maximizing Compute Efficiency on Anyscale | Ray Summit 2025
Anyscale |

From Spark to Ray: CSS's Data Revolution with Daft | Ray Summit 2024

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER