How a Transformers Model Loads in vLLM | Hugging Face | Ray Summit 2026 @anyscale
How a Transformers Model Loads in vLLM | Hugging Face | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 2 days ago
The Transformers modeling backend for vLLM lets you serve Hugging Face Transformers model implementations at full vLLM speed, with access to all of vLLM's features.

At Ray Summit 2026, Harry Mellor, Machine Learning Engineer at Hugging Face, takes a deep dive into how a Transformers model loads in vLLM and, as a consequence, why its performance and feature access are so strong.

You'll leave understanding the mechanics behind the backend and when to reach for it.

This session was part of the first vLLM Conference at Ray Summit, hosted by Inferact.

Liked this video? Check out other Ray Summit vLLM session recordings: youtube.com/playlist?list=PLXMguE8Nc9o4

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
How a Transformers Model Loads in vLLM | Hugging Face | Ray Summit 2026NVIDIA’s Framework for Scalable Data Curation | Ray Summit 2025Koba: Disaggregated Data Loading for Multimodal Training at Luma AI | Luma AI | Ray Summit 2026A Compiler for Christmas | Brendan Burns #raysummitTowards Clinically Grounded LLMs | SonderMind | Ray Summit 2026Scaling LLM Post-Training at Character.AI | Ray Summit 2025Airbnbs LLM Evolution: Fine-Tuning with Ray | Ray Summit 2024Webinar: Getting Started with Distributed Training at ScaleHighly Compressed Gemma Models with Custom Quantization-Aware Training | DeepMind | Ray Summit 2026Multi-Modal Data Processing Pipelines for AI Systems | Anyscale | Ray Summit 2026Ray Across the Stack Fine Tuning Qwen and Serving 3D Generation at Autodesk with AWS Trainium and InBuilding AV 3.0 for Autonomous Trucking | Felix Heide (Torc Robotics) | Ray Summit 2026
Anyscale |

How a Transformers Model Loads in vLLM | Hugging Face | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER