Uploaded October 2024 | Updated September 2026, 2 weeks ago
The Ray ecosystem expands its horizons with Daft, a powerful Python/Rust library that brings distributed ETL and analytics capabilities to Ray clusters. This lightning talk showcases how Daft transforms Ray into a comprehensive Data and ML/AI solution, scaling effortlessly to meet any challenge.
Jay Chia demonstrates the seamless integration of Daft with Ray, highlighting its superior performance and key features. Attendees learn how Daft leverages Ray's object store for processing larger-than-memory datasets, enables zero-copy data transfer to Ray Data, and integrates smoothly with Ray's ML/AI tools. Through an end-to-end example, Chia illustrates the synergy between Daft and Ray in data exploration, cleaning, processing, and ML/AI training, offering a glimpse into the future of distributed data processing.
--
Interested in more?
- Watch the full Day 1 Keynote: youtu.be/jwZHJthQvXo
- Watch the full Day 2 Keynote youtu.be/Lury2ad6KG8
- Check out the Ray Summmit Breakout sessions youtube.com/playlist?list=PLzTswPQNepXntmT8jr9WaNfqQ60QwW7-U&si=qPw-_SxT9lVmbRGE
--
đź”— Connect with us:
- Subscribe to our YouTube channel: youtube.com/@anyscale
- Twitter: https://x.com/anyscalecompute
- LinkedIn: linkedin.com/company/joinanyscale
- Website: anyscale.com
The Ray ecosystem expands its horizons with Daft, a powerful Python/Rust library that brings distributed ETL and analytics capabilities to Ray clusters. This lightning talk showcases how Daft transforms Ray into a comprehensive Data and ML/AI solution, scaling effortlessly to meet any challenge.
Jay Chia demonstrates the seamless integration of Daft with Ray, highlighting its superior performance and key features. Attendees learn how Daft leverages Ray's object store for processing larger-than-memory datasets, enables zero-copy data transfer to Ray Data, and integrates smoothly with Ray's ML/AI tools. Through an end-to-end example, Chia illustrates the synergy between Daft and Ray in data exploration, cleaning, processing, and ML/AI training, offering a glimpse into the future of distributed data processing.
--
Interested in more?
- Watch the full Day 1 Keynote: youtu.be/jwZHJthQvXo
- Watch the full Day 2 Keynote youtu.be/Lury2ad6KG8
- Check out the Ray Summmit Breakout sessions youtube.com/playlist?list=PLzTswPQNepXntmT8jr9WaNfqQ60QwW7-U&si=qPw-_SxT9lVmbRGE
--
đź”— Connect with us:
- Subscribe to our YouTube channel: youtube.com/@anyscale
- Twitter: https://x.com/anyscalecompute
- LinkedIn: linkedin.com/company/joinanyscale
- Website: anyscale.com
![[Ray Meetup] Ray + vLLM in Action: Lessons from Pinterest and Large Scale Distributed Inference](https://i.ytimg.com/vi/HDSy09hrm2I/mqdefault.jpg "[Ray Meetup] Ray + vLLM in Action: Lessons from Pinterest and Large Scale Distributed Inference
Listen in to our Ray Meetup where we explored batch inference at scale with Ray and vLLM! Learn how Pinterest scales batch inference using Ray, and get a first look at Anyscale’s latest tools—Ray Serve and Data LLM—for orchestrating large-scale LLM inference. We’ll cover topics like batch inference, prefill-decode disaggregation, DP/EP parallelism, and custom request routing.
Speakers:
Chia-Wei Chen, Software Engineer, ML Training Infra, Pinterest
Kourosh Hakhamaneshi, AI Lead, Anyscale")
