Uploaded September 2026 | Updated November 2026, 2 days ago
The Transformers modeling backend for vLLM lets you serve Hugging Face Transformers model implementations at full vLLM speed, with access to all of vLLM's features.
At Ray Summit 2026, Harry Mellor, Machine Learning Engineer at Hugging Face, takes a deep dive into how a Transformers model loads in vLLM and, as a consequence, why its performance and feature access are so strong.
You'll leave understanding the mechanics behind the backend and when to reach for it.
This session was part of the first vLLM Conference at Ray Summit, hosted by Inferact.
Liked this video? Check out other Ray Summit vLLM session recordings: youtube.com/playlist?list=PLXMguE8Nc9o4
Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale
đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
The Transformers modeling backend for vLLM lets you serve Hugging Face Transformers model implementations at full vLLM speed, with access to all of vLLM's features.
At Ray Summit 2026, Harry Mellor, Machine Learning Engineer at Hugging Face, takes a deep dive into how a Transformers model loads in vLLM and, as a consequence, why its performance and feature access are so strong.
You'll leave understanding the mechanics behind the backend and when to reach for it.
This session was part of the first vLLM Conference at Ray Summit, hosted by Inferact.
Liked this video? Check out other Ray Summit vLLM session recordings: youtube.com/playlist?list=PLXMguE8Nc9o4
Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale
đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com










