TorchSpec: Speculative Decoding Training at Scale | Together AI | Ray Summit 2026 @anyscale
TorchSpec: Speculative Decoding Training at Scale | Together AI | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 3 days ago
TorchSpec is a torch-native speculative decoding training framework built on Ray, with a disaggregated design that lets each side of drafter training scale independently. Draft models trained with TorchSpec for large models such as Kimi K2.5 have accumulated more than 500K downloads on Hugging Face.

At Ray Summit 2026, Yubo Wang, ML Research Engineer at Together AI / LightSeek, introduces the framework and the disaggregated approach to training speculative decoding draft models.

You'll leave knowing how to train drafters for large models at scale.

This session was part of the first vLLM Conference at Ray Summit, hosted by Inferact.

Liked this video? Check out other Ray Summit breakout session recordings: youtube.com/playlist?list=PLXMguE8Nc9o4

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
TorchSpec: Speculative Decoding Training at Scale | Together AI | Ray Summit 2026Satellite Imagery to Machine-Readable Intelligence | Xoople | Ray Summit 2026One Cluster, End-to-End | AWS | Ray Summit 2026Matrix: Reliable Framework for Data-Centric Experimentation at Scale  | Ray Summit 2025Scaling Massive Transformer Training with KubeRay | Capital One | Ray Summit 2026How Workday Achieved 50x Cheaper Model Serving with Ray Serve | Ray Summit 2025From Reservation to 1,600 GPUs: A Petabyte-Scale Ray Data Pipeline | CoreWeave | Ray Summit 2026How Prime Intellect Builds Scalable Infrastructure for Agentic RL | Ray Summit 2025How KubeRay Is Evolving for Massive AI Workloads  | Ray Summit 2025Production-Ready Distributed Inference with Ray Serve | Anyscale | Ray Summit 2026Petabyte-Scale Video Curation on CoreWeave | CoreWeave | Ray Summit 2026Ray Direct Transport: RDMA Support in Ray Core | Ray Summit 2025
Anyscale |

TorchSpec: Speculative Decoding Training at Scale | Together AI | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER