Neural Software Abstractions: Michael Chang Dissertation Talk @rail7462
Neural Software Abstractions: Michael Chang Dissertation Talk  @rail7462
Uploaded December 2022 | Updated November 2026, 3 days ago
Title: Neural Software Abstractions: Learning Abstractions for Automatically Modeling and Manipulating Systems
Speaker: Michael Chang (mbchang.github.io/)
Advisors: Sergey Levine, Thomas L. Griffiths

Abstract:
The way neural networks are studied and built today bears a striking resemblance to how electronic circuits were studied and built 100 years ago: back then we manually designed electronic circuits for specific tasks while now we train neural circuits for specific tasks. The retrieval-augmented transformer, for example, is the deep-learning analogue to the von Neumann architecture of the 1940s. In this talk, I explore the question: what did it take for us to scale electronic circuits to the modern software stack we have today, and how can we apply a similar approach to scaling our neural circuits to create the future of learning software? I will discuss four examples of abstractions humans have invented for scaling electronic circuits to programmed software -- the digital abstraction, data abstraction, function abstraction, and problem abstraction. I will deconstruct the underlying principles that made these abstractions powerful, and show how we can apply these principles to design neural networks that exhibit many of the same properties and benefits that we get from discreteness, variables, reusable computations, and hierarchical organization, without explicitly defining these abstractions ourselves. Similarly to how programmed software enabled humans to manually model and manipulate systems, this line of work, which I call "neural software abstractions," aims to build learning software for automatically modeling and manipulating systems. I conclude by situating neural software abstractions in the broader context of the relationship between AI and humans, arguing for research on both neural software abstractions and adaptive human computer interfaces as two complementary research directions towards building AI that enables humans to do more with less.
Neural Software Abstractions: Michael Chang Dissertation TalkCS 285: Lecture 21, Transfer Learning, Part 3CS 285: Lecture 22, Part 4: Transfer Learning & Meta-LearningReinforcement Learning with Large Datasets: a Path to Resourceful Autonomous AgentsCS 185/285 (Spring 2026): Lecture 1, Deep Reinforcement LearningCS 182: Lecture 18: Part 4: Latent Variable ModelsCS 182: Lecture 12: Part 3: TransformersCS 182: Lecture 10: Part 3: Recurrent Neural NetworksCS 182: Lecture 15: Part 3: Policy GradientsCS 182: Lecture 1, Part 2: IntroductionCS 185/285 (Spring 2026): Lecture 4, Reinforcement Learning BasicsCS 285: Lecture 23, Open Problems, Part 3
RAIL |

Neural Software Abstractions: Michael Chang Dissertation Talk

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER