Serving vLLM on Intel GPUs, CPUs, and Gaudi | Intel | Ray Summit 2026 @anyscale
Serving vLLM on Intel GPUs, CPUs, and Gaudi | Intel | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 2 days ago
A technical deep dive into vLLM on Intel platforms.

At Ray Summit 2026, Chendi Xue, AI Software Engineer at Intel, introduces Intel's optimized attention, mixture-of-experts, and GEMM operators powered by Triton and SYCL, shows how Intel's next-generation GPUs support native sub-8-bit microscaling formats (MXFP8/MXFP4), demonstrates how decoupling compute-bound prefill and memory-bound decode onto dedicated nodes eliminates inter-token latency spikes, and highlights Intel's backend support for vLLM-Omni for any-to-any multimodal models spanning text, video, and audio.

You'll leave with a map of vLLM performance across Intel GPUs, CPUs, and Gaudi.

This session was part of the first vLLM Conference at Ray Summit, hosted by Inferact.

Liked this video? Check out other Ray Summit vLLM session recordings: youtube.com/playlist?list=PLXMguE8Nc9o4

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

🔗 Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
Serving vLLM on Intel GPUs, CPUs, and Gaudi | Intel | Ray Summit 2026Elastic Expert Parallelism for vLLM | Ray Summit 2025Post-training Nemotron with Ray | Bryan Catanzaro (Nvidia) | Ray Summit 2026Apple’s Approach to Scalable Machine Learning Infrastructure on Ray | Ray Summit 2025Serving Fast and Smart: Getting the Most Out of Ray Serve LLM on GKE | Google | Ray Summit 2026Anyscale on Azure: Build, Train, and Serve AI in Your Own Tenant | Microsoft | Ray Summit 2026Improved Scheduling Flexibility with Label Selectors in Ray | Ray Summit 2025Meet verl: An RL Framework for LLM Reasoning & Tool Use | Ray Summit 2025Scaling Machine Learning at Discord: Our Journey with Ray and Anyscale | Discord | Ray Summit 2026How BMW Scales Automotive AI Workloads with the Ray Framework | Ray Summit 2025Scaling Frontier AI with Ray on Kubernetes | KubeRay | Ray Summit 2026Ray Train on Anyscale: Observability and Reliability at Scale | Anyscale | Ray Summit 2026
Anyscale |

Serving vLLM on Intel GPUs, CPUs, and Gaudi | Intel | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER