Live Virtual Hands On Lab: Distributed Training at Scale with Ray and PyTorch @anyscale
Live Virtual Hands On Lab: Distributed Training at Scale with Ray and PyTorch  @anyscale
Uploaded March 2026 | Updated November 2026, 2 days ago
Ready to move beyond single-GPU limits and master distributed systems? Join us for a live virtual hands on lab where ML and platform engineers will explore how to scale model training from a single node to a massive cluster using PyTorch and Ray.

In this virtual session you will learn:
- What is distributed Training ? And do we need it?
- Introduction to Distributed Data Parallel (DDP)
- Utilize advanced DDP techniques with ZeRO-1, ZeRO-2, ZeRO-3, and FSDP
- Introduction to Ray and how you can use Ray Train to train models at scale
- Training a model at scale using Ray Train and PyTorch at scale

This free lab is more than a webinar. You’ll leave with a working understanding of Ray, a reusable project you can build on, and a clear view of how Ray and Anyscale work together to accelerate AI development.
Live Virtual Hands On Lab: Distributed Training at Scale with Ray and PyTorchA Quick Overview of the Ray Libraries Built on Ray Core | Ray Summit ExpoWhat is Anyscale in 8 minScaling LLMs at Apple: Ray Serve + vLLM Deep Dive | Ray Summit 2025Scaling Robot Policy Evaluations to Thousands of Parallel SimulationsWhat Makes RL the Hardest Workload in AI | Robert Nishihara (Anyscale) | Ray Summit 2026Ray Data: Whats New - GPU Shuffle, Unity Catalog, DataSourceV2 | Anyscale | Ray Summit 2026Inside Adobe Firefly: JIT-Embedding with Ray Serve for Faster GenAI Training | Ray Summit 2025Running Embedding Processing for AI Search at Scale | Notion + AnyscaleServing vLLM on Agentic Production Workloads | Inferact | Ray Summit 2026Cost-Effective RL Post-Training with Ray and AWS Trainium | AWS + Anyscale | Ray Summit 2026Ray Serve: Advancing scalability and flexibility | Ray Summit 2025
Anyscale |

Live Virtual Hands On Lab: Distributed Training at Scale with Ray and PyTorch

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER