Uploaded October 2024 | Updated September 2026, 2 weeks ago
ByteDance's journey in building a robust video data processing pipeline takes center stage in this Ray Summit 2024 presentation. Haibin Lin, Chi Zhang, and Liguang Xie share their experiences in leveraging Ray's ecosystem to tackle the challenges of creating a video generation model capable of producing realistic scenes from text instructions.
Delving into the technical details, the speakers showcase how they harnessed Ray Core, Ray Data, and Ray Serve to develop a scalable pipeline that efficiently handles massive volumes of video data. The ByteDance team explains the crucial role of Ray's capabilities in dynamic computation scaling and heterogeneous resource orchestration in constructing their complex data processing system.
Rounding out the session, Lin, Zhang, and Xie demonstrate ByteDance's approach to managing Ray infrastructure, along with best practices gleaned from their experience. This talk offers significant value for teams working on AI models that require processing and analysis of extensive multimedia datasets, providing a roadmap for implementing similar large-scale data processing solutions.
--
Interested in more?
- Watch the full Day 1 Keynote: youtu.be/jwZHJthQvXo
- Watch the full Day 2 Keynote youtu.be/Lury2ad6KG8
--
đź”— Connect with us:
- Subscribe to our YouTube channel: youtube.com/@anyscale
- Twitter: https://x.com/anyscalecompute
- LinkedIn: linkedin.com/company/joinanyscale
- Website: anyscale.com
ByteDance's journey in building a robust video data processing pipeline takes center stage in this Ray Summit 2024 presentation. Haibin Lin, Chi Zhang, and Liguang Xie share their experiences in leveraging Ray's ecosystem to tackle the challenges of creating a video generation model capable of producing realistic scenes from text instructions.
Delving into the technical details, the speakers showcase how they harnessed Ray Core, Ray Data, and Ray Serve to develop a scalable pipeline that efficiently handles massive volumes of video data. The ByteDance team explains the crucial role of Ray's capabilities in dynamic computation scaling and heterogeneous resource orchestration in constructing their complex data processing system.
Rounding out the session, Lin, Zhang, and Xie demonstrate ByteDance's approach to managing Ray infrastructure, along with best practices gleaned from their experience. This talk offers significant value for teams working on AI models that require processing and analysis of extensive multimedia datasets, providing a roadmap for implementing similar large-scale data processing solutions.
--
Interested in more?
- Watch the full Day 1 Keynote: youtu.be/jwZHJthQvXo
- Watch the full Day 2 Keynote youtu.be/Lury2ad6KG8
--
đź”— Connect with us:
- Subscribe to our YouTube channel: youtube.com/@anyscale
- Twitter: https://x.com/anyscalecompute
- LinkedIn: linkedin.com/company/joinanyscale
- Website: anyscale.com
