Allen School Colloquium: Productively Programming Accelerated Computing Systems @uwcse

Uploaded February 2026 | Updated September 2026, 2 weeks ago

Title: Productively Programming Accelerated Computing Systems
Speaker: Rohan Yadav (Stanford)
Date: Tuesday, February 17, 2026

Abstract: Modern accelerated computing systems are increasing in scale, becoming more specialized and diverse, and evolving more quickly. While these changes bring significant performance improvements, they also come with the challenges of productively developing software that targets complex and rapidly changing hardware. For software to keep up with modern hardware, programming systems must also evolve to provide new levels of abstraction, portability and composability. In this talk, I will focus on two pieces of work that advance programming systems along these axes.

First, I will discuss a connection between actor-based and task-based programming models, two popular classes of programming models for distributed and accelerated machines. Task-based models provide high-level abstractions over the underlying hardware that enable composability and portability, while actor-based models expose a lower-level interface that offers the best performance. I will show that these two families of programming models are duals of each other, and then leverage this duality to close the performance gap between the models by compiling task-based programs into efficient actor-based programs.

Second, I will discuss Twill, a system that automatically discovers optimal software pipelining (SWP) and warp specialization (WS) strategies for Tensor Core GPUs. Optimal strategies for SWP and WS continue to change across modern GPU generations and are currently derived through expert intuition and compiler heuristics. We show that these strategies are derivable from first-principles in a machine-parametrizable and heuristic-free manner, and re-discover strategies found by experts.

Bio: Rohan Yadav is a final-year computer science Ph.D. student at Stanford University, advised by Alex Aiken and Fredrik Kjolstad, as well as a part-time researcher at NVIDIA. He is generally interested in programming languages and computer systems, with a focus in systems for parallel and accelerated computing.

This video is closed captioned.

Allen School Colloquium: Productively Programming Accelerated Computing Systems

2025 Winter Robotics Colloquium: Katsu Ikeuchi (Principal Researcher at Microsoft)

Parables on the Power of Planning in AI: From Poker to Diplomacy: Noam Brown (OpenAI)

FlowRing: Integrated Microgesture and Surface Interaction Ring for Versatile XR Input

Learning, Reasoning, and Planning with Neuro-Symbolic Concepts–Jiayuan Mao (MIT)

$Pareto-efficient AI systems—Simran Arora (Stanford) Allen School Colloquia Series Title: Pareto-efficient AI systems: Expanding the quality and efficiency frontier of AI Speaker: Simran Arora (Stanford) Date: April 1, 2025 Abstract: We have made exciting progress in AI by scaling massive models on massive amounts of data center compute. However, this represents a small fraction of AI’s potential. My work expands the Pareto frontier between the AI capabilities we can achieve and the long tail of compute constraints. In this talk, we piece-by-piece build up to a language model architecture that expands the Pareto frontier between quality and throughput efficiency. The Transformer, AI’s current workhorse architecture, is memory hungry, limiting its throughput, or amount of data it can process per second. This has led to a Cambrian explosion of alternate architecture candidates proposed across prior work. Prior work paints an exciting picture: there are architectures that are asymptotically faster than the Transformer, while also matching its quality. However, I ask, if we’re using asymptotically faster building blocks, what if anything are we giving up in quality? 1. In part one, we understand the tradeoffs and show indeed, there’s no free lunch. I present my work to identify and explain the fundamental quality and efficiency tradeoffs between different classes of architectures. Methods I developed for this analysis are now ubiquitous in the development of efficient language models. 2. In part two, we measure how existing architecture candidates fare along on the tradeoff space. While many proposed architectures are asymptotically fast, they are not wall-clock fast compared to the Transformer. I present ThunderKittens, a programming library that I built to help AI researchers develop hardware-efficient AI algorithms. 3. In part three, we expand the Pareto frontier of the tradeoff space. I present the BASED architecture, which is built from simple, hardware-efficient components. In culmination, I released a suite of state-of-the-art 8B-405B parameter Transformer-free language models, per standard evaluations, all on an academic budget. Given the massive investment into AI models, this work blending AI and systems has had significant impact and adoption in research, open-source, and industry. Bio: Simran Arora is a PhD student at Stanford University advised by Chris Ré. Her research blends AI and systems towards expanding the Pareto frontier between AI capabilities and efficiency. Her machine learning research has appeared as Oral and Spotlight presentations at NeurIPS, ICML, and ICLR, including an Outstanding Paper award at NeurIPS and Best Paper award at ICML ES-FoMo. Her systems work has appeared at VLDB, SIGMOD, CIDR, and CHI, and her systems artifacts are widely used in research, open-source, and industry. In 2023, Simran created and taught the CS229s Systems for Machine Learning course at Stanford. She has also been supported by a SGF Sequoia Fellowship and the Stanford Computer Science Graduate Fellowship. This video is closed captioned.$

IFDS Workshop–Multi-frequency progressive refinement for learned inverse scattering

OpenThePaths 2025–Keynote: Community-First Autonomy

[Audio Descriptions] Faculty In Focus: Natasha Jaques

[Audio Descriptions] I Am CSE: Ather Sharif

IFDS Workshop Short Talks–Detecting Model Misuse Through LLM fingerprinting

[Audio Descriptions] Faculty In Focus: Stephanie Wang