Uploaded April 2026 | Updated September 2026, 1 week ago
Computer Science Seminar Series
April 14, 2026
“Efficient Interactive Learning: Learning More From Less”
Gokul Swamy, Carnegie Mellon University
Even as we near the limits of what human-generated data we can scrape from the internet, today's decision-making agents—from robots to large language models—are still far from perfect. Thus, as we start to move past the era of simply scaling up training datasets, Gokul Swamy believes the most pressing question in decision-making is how we can learn more from less data. In theory, agents collecting their own data and learning from this experience might allow us to transcend the limits of static datasets. However, there are two core challenges that make delivering on this promise of reinforcement learning (RL) practically challenging. The first is exploration: experiencing the right things. The second is specification: knowing if what you experienced was good or bad. Swamy's research focuses on algorithms that address both of these challenges in tandem. This talk will cover both theoretical advancements and their practical implications. First, Swamy will discuss how we can teach robots to provably recover from their own mistakes without extensive trial-and-error exploration. Second, he will describe provably robust algorithms for training language models from conflicting preferences. Third, he will explain how RL learns more from less without having to create data ex nihilo. To conclude, Swamy will outline what he believes are the most promising directions to enable the next generation of agents to learn even more from less.
Gokul Swamy is a final-year PhD student in at the Carnegie Mellon University Robotics Institute. He works on efficient interactive learning algorithms for training agents like robots and language models. More fundamentally, he is interested in techniques for learning to make good decisions efficiently, even when “good” is hard to specify. Swamy was named a Rising Star in Data Science and Robotics and received an Outstanding Teaching Award for his student mentorship and creation of a new reinforcement learning course. He has also spent summers at Microsoft Research and Google Research.
Computer Science Seminar Series
April 14, 2026
“Efficient Interactive Learning: Learning More From Less”
Gokul Swamy, Carnegie Mellon University
Even as we near the limits of what human-generated data we can scrape from the internet, today's decision-making agents—from robots to large language models—are still far from perfect. Thus, as we start to move past the era of simply scaling up training datasets, Gokul Swamy believes the most pressing question in decision-making is how we can learn more from less data. In theory, agents collecting their own data and learning from this experience might allow us to transcend the limits of static datasets. However, there are two core challenges that make delivering on this promise of reinforcement learning (RL) practically challenging. The first is exploration: experiencing the right things. The second is specification: knowing if what you experienced was good or bad. Swamy's research focuses on algorithms that address both of these challenges in tandem. This talk will cover both theoretical advancements and their practical implications. First, Swamy will discuss how we can teach robots to provably recover from their own mistakes without extensive trial-and-error exploration. Second, he will describe provably robust algorithms for training language models from conflicting preferences. Third, he will explain how RL learns more from less without having to create data ex nihilo. To conclude, Swamy will outline what he believes are the most promising directions to enable the next generation of agents to learn even more from less.
Gokul Swamy is a final-year PhD student in at the Carnegie Mellon University Robotics Institute. He works on efficient interactive learning algorithms for training agents like robots and language models. More fundamentally, he is interested in techniques for learning to make good decisions efficiently, even when “good” is hard to specify. Swamy was named a Rising Star in Data Science and Robotics and received an Outstanding Teaching Award for his student mentorship and creation of a new reinforcement learning course. He has also spent summers at Microsoft Research and Google Research.
