Uploaded August 2026 | Updated September 2026, 2 weeks ago
Join the Google Cloud & NVIDIA community β https://g.dev/cloud/google-nvidia-community
Scaling deep learning models across multiple GPUs used to mean rewriting hundreds of lines of complex device communication code.
This is part 3 of JAX on NVIDIA GPUs Crash Course.
Watch along and learn about JAX's modern, compiler-driven sharding model, demonstrating how to distribute workloads automatically across physical device meshes.
* *Master sharding concepts:* Understand how Mesh, PartitionSpec, and NamedSharding declare array layouts across multiple devices. * Implement automatic scaling: Write clean training code that allows the compiler to automatically manage multi-GPU gradient synchronization.
* *Incorporate Flax NNX & Orbax:* See how to manage state and serialize model checkpoints in a distributed training run.
Watch more JAX on NVIDIA GPUs Crash Course β https://g.dev/cloud/jax-nvidia-gpu
π Subscribe to Google Cloud Tech β https://goo.gle/GoogleCloudTech
Speakers: Ivan Nardini, Ekaterina Sirazitdinova
Products Mentioned: Google Cloud, JAX
Join the Google Cloud & NVIDIA community β https://g.dev/cloud/google-nvidia-community
Scaling deep learning models across multiple GPUs used to mean rewriting hundreds of lines of complex device communication code.
This is part 3 of JAX on NVIDIA GPUs Crash Course.
Watch along and learn about JAX's modern, compiler-driven sharding model, demonstrating how to distribute workloads automatically across physical device meshes.
* *Master sharding concepts:* Understand how Mesh, PartitionSpec, and NamedSharding declare array layouts across multiple devices. * Implement automatic scaling: Write clean training code that allows the compiler to automatically manage multi-GPU gradient synchronization.
* *Incorporate Flax NNX & Orbax:* See how to manage state and serialize model checkpoints in a distributed training run.
Watch more JAX on NVIDIA GPUs Crash Course β https://g.dev/cloud/jax-nvidia-gpu
π Subscribe to Google Cloud Tech β https://goo.gle/GoogleCloudTech
Speakers: Ivan Nardini, Ekaterina Sirazitdinova
Products Mentioned: Google Cloud, JAX
