Uploaded April 2025 | Updated September 2026, 1 week ago
Catch the latest Ray meetup featuring our friends at LanceDB!
🔍 Topic: LLMs on Ray + LanceDB
🎙️ Speakers:
Jonathan Hsieh (Software Engineer, LanceDB) - Scaling Multimodal Pipelines with LanceDB + Ray
Richard Liaw (Product Manager, Anyscale) - Native Ray APIs for LLM Inference
Modern AI workloads come with unique challenges—especially when it comes to multimodal data, scalability, and reproducibility. In this session:
🚀 Jonathan Hsieh explores how LanceDB is built from the ground up to tackle the multimodal data storage problem, highlighting features like zero-cost schema evolution that boost AI engineer productivity. He also covers how Ray and Ray Data help scale and streamline data processing pipelines.
🧠 Richard Liaw dives into Native Ray APIs for LLM inference, explaining the complexities of working with open-source LLMs. He introduces two powerful new APIs from the latest Ray release:
💾 Batch LLM Inference with Ray Data LLM
☼ Online LLM Inference with Ray Serve LLM
🌐 Learn how Anyscale and LanceDB partnered to level up the AI development experience.
-- --
🔗 Connect with us:
- Subscribe to our YouTube channel: youtube.com/@anyscale
- Twitter: https://x.com/anyscalecompute
- LinkedIn: linkedin.com/company/joinanyscale
- Website: anyscale.com
#LanceDB #Ray #AI #LLM #Anyscale #MultimodalAI #MachineLearning #OpenSource ##LLMInference #RayServe #RayData
Catch the latest Ray meetup featuring our friends at LanceDB!
🔍 Topic: LLMs on Ray + LanceDB
🎙️ Speakers:
Jonathan Hsieh (Software Engineer, LanceDB) - Scaling Multimodal Pipelines with LanceDB + Ray
Richard Liaw (Product Manager, Anyscale) - Native Ray APIs for LLM Inference
Modern AI workloads come with unique challenges—especially when it comes to multimodal data, scalability, and reproducibility. In this session:
🚀 Jonathan Hsieh explores how LanceDB is built from the ground up to tackle the multimodal data storage problem, highlighting features like zero-cost schema evolution that boost AI engineer productivity. He also covers how Ray and Ray Data help scale and streamline data processing pipelines.
🧠 Richard Liaw dives into Native Ray APIs for LLM inference, explaining the complexities of working with open-source LLMs. He introduces two powerful new APIs from the latest Ray release:
💾 Batch LLM Inference with Ray Data LLM
☼ Online LLM Inference with Ray Serve LLM
🌐 Learn how Anyscale and LanceDB partnered to level up the AI development experience.
-- --
🔗 Connect with us:
- Subscribe to our YouTube channel: youtube.com/@anyscale
- Twitter: https://x.com/anyscalecompute
- LinkedIn: linkedin.com/company/joinanyscale
- Website: anyscale.com
#LanceDB #Ray #AI #LLM #Anyscale #MultimodalAI #MachineLearning #OpenSource ##LLMInference #RayServe #RayData
