Scale JAX models to multi-GPU systems @googlecloudtech
Scale JAX models to multi-GPU systems  @googlecloudtech
Uploaded August 2026 | Updated November 2026, 2 days ago
Access the full course and codelabs β†’ https://g.dev/cloud/nvidia-jaxgpus-learningpathway
Join the Google Cloud & NVIDIA community β†’ https://g.dev/cloud/google-nvidia-community

Scaling deep learning models across multiple GPUs used to mean rewriting hundreds of lines of complex device communication code.

This is part 3 of JAX on NVIDIA GPUs Crash Course.

Watch along and learn about JAX's modern, compiler-driven sharding model, demonstrating how to distribute workloads automatically across physical device meshes.

* *Master sharding concepts:* Understand how Mesh, PartitionSpec, and NamedSharding declare array layouts across multiple devices. * Implement automatic scaling: Write clean training code that allows the compiler to automatically manage multi-GPU gradient synchronization.
* *Incorporate Flax NNX & Orbax:* See how to manage state and serialize model checkpoints in a distributed training run.

Watch more JAX on NVIDIA GPUs Crash Course β†’ https://g.dev/cloud/jax-nvidia-gpu
πŸ”” Subscribe to Google Cloud Tech β†’ https://goo.gle/GoogleCloudTech

Speakers: Ivan Nardini, Ekaterina Sirazitdinova
Products Mentioned: Google Cloud, JAX
Scale JAX models to multi-GPU systemsCan Gemini transcribe a song?What one agent, everywhere you work actually meansBigQuery vs. Production SQL: When should you use a data warehouse instead of a relational database?Build your first Android app in AI Studio in 5 minutesData agent kit: Your coding agent can now query your dataCreate an agent to digest Jira tickets!Security skills for AI agents (From Google security engineers)Build a multi-agent system using ADK & MCPWhat is an Agentic Harness?Gemini Enterprise use cases: Workflow automation for everyoneHow to build a continuous evaluation pipeline for multi-agent systems with Gemini
Google Cloud Tech |

Scale JAX models to multi-GPU systems

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER