Uploaded October 2024 | Updated September 2026, 1 week ago
Vivvix is tackling the monumental task of classifying video ads across millions of categories. In this session, Thierry Steenberghs and James Kim from Mediaradar and Vivvix reveal how they harnessed Ray on Databricks and Spark Structured Streaming to optimize video processing at scale.
The presenters detail their journey from an initial goal of categorizing ads into 30,000 product classes to an ambitious target of six million. They share insights on overcoming the challenges of exponential growth in training time and limited per-class data by leveraging open-source Large Language Models (LLMs). Learn how they achieved a 15% accuracy boost by integrating optimized LLama2 models, and discover their innovative approach of using LLMs as a pre-processing step for machine learning analysis. This talk offers valuable lessons for organizations looking to scale their AI classification tasks to unprecedented levels.
--
Interested in more?
- Watch the full Day 1 Keynote: youtu.be/jwZHJthQvXo
- Watch the full Day 2 Keynote youtu.be/Lury2ad6KG8
--
đ Connect with us:
- Subscribe to our YouTube channel: youtube.com/@anyscale
- Twitter: https://x.com/anyscalecompute
- LinkedIn: linkedin.com/company/joinanyscale
- Website: anyscale.com
Vivvix is tackling the monumental task of classifying video ads across millions of categories. In this session, Thierry Steenberghs and James Kim from Mediaradar and Vivvix reveal how they harnessed Ray on Databricks and Spark Structured Streaming to optimize video processing at scale.
The presenters detail their journey from an initial goal of categorizing ads into 30,000 product classes to an ambitious target of six million. They share insights on overcoming the challenges of exponential growth in training time and limited per-class data by leveraging open-source Large Language Models (LLMs). Learn how they achieved a 15% accuracy boost by integrating optimized LLama2 models, and discover their innovative approach of using LLMs as a pre-processing step for machine learning analysis. This talk offers valuable lessons for organizations looking to scale their AI classification tasks to unprecedented levels.
--
Interested in more?
- Watch the full Day 1 Keynote: youtu.be/jwZHJthQvXo
- Watch the full Day 2 Keynote youtu.be/Lury2ad6KG8
--
đ Connect with us:
- Subscribe to our YouTube channel: youtube.com/@anyscale
- Twitter: https://x.com/anyscalecompute
- LinkedIn: linkedin.com/company/joinanyscale
- Website: anyscale.com
