MIT 6.S191 (2021): Reinforcement Learning @AAmini

Uploaded March 2021 | Updated September 2026, 2 weeks ago

MIT Introduction to Deep Learning 6.S191: Lecture 5
Deep Reinforcement Learning
Lecturer: Alexander Amini
January 2021

For all lectures, slides, and lab materials: introtodeeplearning.com

Lecture Outline
0:00 - Introduction
3:17 - Classes of learning problems
6:19 - Definitions
12:33 - The Q function
16:14 - Deeper into the Q function
20:49 - Deep Q Networks
26:28 - Atari results and limitations
29:53 - Policy learning algorithms
33:11 - Discrete vs continuous actions
37:22 - Training policy gradients
44:50 - RL in real life
46:02 - VISTA simulator
47:44 - AlphaGo and AlphaZero and MuZero
55:22 - Summary

Subscribe to stay up to date with new deep learning lectures at MIT, or follow us @MITDeepLearning on Twitter and Instagram to stay fully-connected!!

MIT 6.S191 (2021): Reinforcement Learning

MIT 6.S191 (2023): Reinforcement Learning

MIT 6.S191 (2021): Convolutional Neural Networks

MIT 6.S191 (2021): Deep Generative Modeling

GTC 2018: Learning Steering for Parallel Autonomy. Alexander Amini

MIT 6.S191 (2025): A Hipocratic Oath, for *your* AI (Comet ML)

MIT 6.S191 (2018): Sequence Modeling with Neural Networks

MIT 6.S191 (2024): Deep Generative Modeling

MIT Introduction to Deep Learning (2024) | 6.S191

MIT 6.S191 (2023): Deep Learning New Frontiers

MIT 6.S191 (2018): Faster ML Development with TensorFlow