Uploaded September 2026 | Updated November 2026, 4 days ago
"Demand for intelligence is effectively infinite, which means AI will always run at the limit of available compute. Once you accept that, efficiency is intelligence.
Bryan Catanzaro is VP of Applied Deep Learning Research at NVIDIA. His research led to the creation of cuDNN, the library beneath nearly every deep learning framework, and he helped lead the teams behind DLSS and Megatron. In this talk, he walks through how NVIDIA builds Nemotron, its open family of models, datasets, and techniques: pre-training in 4-bit arithmetic, hybrid SSM-transformer architectures, an ensemble of domain-expert teacher models distilled into one, and reinforcement learning across 15 environments, coordinated by Ray on thousands of Blackwell GPUs. He also explains why NVL72 exists and why open technologies matter for every company building its own AI.
Liked this video? Check out other Ray Summit keynote sessions:
youtube.com/playlist?list=PLYnBpswCtPo4
Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale
🔗 Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com/"
"Demand for intelligence is effectively infinite, which means AI will always run at the limit of available compute. Once you accept that, efficiency is intelligence.
Bryan Catanzaro is VP of Applied Deep Learning Research at NVIDIA. His research led to the creation of cuDNN, the library beneath nearly every deep learning framework, and he helped lead the teams behind DLSS and Megatron. In this talk, he walks through how NVIDIA builds Nemotron, its open family of models, datasets, and techniques: pre-training in 4-bit arithmetic, hybrid SSM-transformer architectures, an ensemble of domain-expert teacher models distilled into one, and reinforcement learning across 15 environments, coordinated by Ray on thousands of Blackwell GPUs. He also explains why NVL72 exists and why open technologies matter for every company building its own AI.
Liked this video? Check out other Ray Summit keynote sessions:
youtube.com/playlist?list=PLYnBpswCtPo4
Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale
🔗 Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com/"










