Mark Russinovich | Generative AI in the Cloud: Inside Microsoft AI Innovation @stanfordhai
Mark Russinovich | Generative AI in the Cloud: Inside Microsoft AI Innovation  @stanfordhai
Uploaded March 2024 | Updated November 2026, 2 hours ago
In this seminar, Mark Russinovich, Azure CTO and Technical Fellow, gave an under-the-hood look at Microsoft’s AI architecture, including the large-scale supercomputers that train foundational models and the infrastructure that efficiently serves small and large pretrained and fine-tuned models. He covered everything from how the company designs servers, to the AI-aware resource management service that schedules training and inference, to the AI-specific techniques it’s developed for maximizing GPU usage. He also gave insight into advancements and opportunities in trending AI research and confidential AI.

This HAI Seminar took place on March 6, 2024. Upcoming HAI Events can be found here: https://hai.stanford.edu/events
Mark Russinovich | Generative AI in the Cloud: Inside Microsoft AI InnovationPeter Henderson: Environmental Impact of AI (and What Developers Can Do)AI+Education Summit 2026: AI Quests – When Learning Sciences Meet Product Design toward AI LiteracyHAI Seminar with David Engstrom: AI and Access to Justice2025 AI+Education Summit: Daniel Schwartz – The Information Age & The Age of CreationOffScript with Ge Wang and Vanessa Parli : What Do We Want from AI in Early Childhood Education?Session 1: A Multimodal Odyssey into the Human MindConfronting Our AI Future: Welcome from Russell Wald2026 Conference on Physics and AI: Bhargav SiddaniAI+Science: Lightning Talks (Session 2)Hoffman-Yee Symposium 2025: IntroductionRobotics in a Human-Centered World: Opening Remarks
Stanford HAI |

Mark Russinovich | Generative AI in the Cloud: Inside Microsoft AI Innovation

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER