Uploaded October 2024 | Updated September 2026, 2 weeks ago
Airbnb's transition to Ray as its next-generation infrastructure component marks a pivotal shift in its AI capabilities. In this session, Shaowei Su and Mia Zhao from Airbnb unveil the company's journey in evolving LLM fine-tuning support, leveraging open-source frameworks within the Ray ecosystem.
The presenters detail Airbnb's adoption of efficient fine-tuning techniques using Llama Factory and resource-sharing strategies with Kueue. They then showcase a real-world application in Airbnb's customer support team, demonstrating how Supervised Fine Tuning (SFT) and Direct Preference Optimization (DPO) have been used to align LLMs with curated preference datasets. This talk offers valuable insights into building and implementing advanced ML infrastructure, bridging the gap between theoretical concepts and practical applications in a major tech company.
--
Interested in more?
- Watch the full Day 1 Keynote: youtu.be/jwZHJthQvXo
- Watch the full Day 2 Keynote youtu.be/Lury2ad6KG8
--
đ Connect with us:
- Subscribe to our YouTube channel: youtube.com/@anyscale
- Twitter: https://x.com/anyscalecompute
- LinkedIn: linkedin.com/company/joinanyscale
- Website: anyscale.com
Airbnb's transition to Ray as its next-generation infrastructure component marks a pivotal shift in its AI capabilities. In this session, Shaowei Su and Mia Zhao from Airbnb unveil the company's journey in evolving LLM fine-tuning support, leveraging open-source frameworks within the Ray ecosystem.
The presenters detail Airbnb's adoption of efficient fine-tuning techniques using Llama Factory and resource-sharing strategies with Kueue. They then showcase a real-world application in Airbnb's customer support team, demonstrating how Supervised Fine Tuning (SFT) and Direct Preference Optimization (DPO) have been used to align LLMs with curated preference datasets. This talk offers valuable insights into building and implementing advanced ML infrastructure, bridging the gap between theoretical concepts and practical applications in a major tech company.
--
Interested in more?
- Watch the full Day 1 Keynote: youtu.be/jwZHJthQvXo
- Watch the full Day 2 Keynote youtu.be/Lury2ad6KG8
--
đ Connect with us:
- Subscribe to our YouTube channel: youtube.com/@anyscale
- Twitter: https://x.com/anyscalecompute
- LinkedIn: linkedin.com/company/joinanyscale
- Website: anyscale.com
