Uploaded September 2026 | Updated November 2026, 20 hours ago
GPU utilization is a useful first signal, but past a point it decorrelates from real progress: a busy GPU is not always a fast one. Throughput maps directly to faster training, lower cost, and shorter iteration loops, so it is the metric Latitude optimizes against.
At Ray Summit 2026, Nicolas Cebron and Krishna Toshniwal from Latitude AI show how they tune the three stages that determine throughput together, the Ray Data pipeline, data transfer onto the GPU, and the training step, measuring each with Ray actors that report per-stage speed and rolling the signals into a fleet-wide live dashboard with one-click profiles for any run.
You'll leave with the throughput gains this made possible and a blueprint for making training throughput a metric your whole org watches and steadily drives up.
Liked this video? Check out other Ray Summit breakout session recordings: youtube.com/playlist?list=PLZNaJyYZRPdo
Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale
đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
GPU utilization is a useful first signal, but past a point it decorrelates from real progress: a busy GPU is not always a fast one. Throughput maps directly to faster training, lower cost, and shorter iteration loops, so it is the metric Latitude optimizes against.
At Ray Summit 2026, Nicolas Cebron and Krishna Toshniwal from Latitude AI show how they tune the three stages that determine throughput together, the Ray Data pipeline, data transfer onto the GPU, and the training step, measuring each with Ray actors that report per-stage speed and rolling the signals into a fleet-wide live dashboard with one-click profiles for any run.
You'll leave with the throughput gains this made possible and a blueprint for making training throughput a metric your whole org watches and steadily drives up.
Liked this video? Check out other Ray Summit breakout session recordings: youtube.com/playlist?list=PLZNaJyYZRPdo
Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale
đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com










