Uploaded January 2026 | Updated September 2026, 7 hours ago
Speaker: Stas Bekman
Abstract: With the aid of the ML Engineering open book we will explore foundational ML engineering skills that will hopefully help you to remain an expert in the environment that changes too fast. We will focus on things that don't change too much while discussing compute, networking and storage performance, and debugging and troubleshooting of the ML workloads.
Speaker: Stas Bekman
Abstract: With the aid of the ML Engineering open book we will explore foundational ML engineering skills that will hopefully help you to remain an expert in the environment that changes too fast. We will focus on things that don't change too much while discussing compute, networking and storage performance, and debugging and troubleshooting of the ML workloads.
![Lecture 75 [ScaleML Series] GPU Programming Fundamentals + ThunderKittens](https://i.ytimg.com/vi/Cl2B_hmg4gA/mqdefault.jpg "Lecture 75 [ScaleML Series] GPU Programming Fundamentals + ThunderKittens
Speakers: William Brandon (Anthropic) and Simran Arora (ThunderKittens)
Full Schedule: https://scale-ml.org/bootcamp/
The GPU MODE x Scale ML speaker series is a 5-day, online event hosted on the GPU MODE YouTube channel where top researchers in AI will talk about various architectural and system-level advances that are integrated into OpenAI’s frontier open-source model, GPT-OSS.
Each day will consist of ~2 hours of talks and discussions (around noon PST, may start at slightly different times each day so please check frequently), covering a different component of the evolving transformer stack—from quirks in the attention mechanism and positional encodings to quantization, MoEs, and custom GPU kernels.")
![Lecture 72: [ScaleML Series] Efficient & Effective Long-Context Modeling for Large Language Models](https://i.ytimg.com/vi/DFcKFDt0QEg/mqdefault.jpg "Lecture 72: [ScaleML Series] Efficient & Effective Long-Context Modeling for Large Language Models
Speaker: Guangxuan Xiao (PhD at MIT)
Full Schedule: https://scale-ml.org/bootcamp/
The GPU MODE x Scale ML speaker series is a 5-day, online event hosted on the GPU MODE YouTube channel where top researchers in AI will talk about various architectural and system-level advances that are integrated into OpenAI’s frontier open-source model, GPT-OSS.
Each day will consist of ~2 hours of talks and discussions, covering a different component of the evolving transformer stack—from quirks in the attention mechanism and positional encodings to quantization, MoEs, and custom GPU kernels.")
