Uploaded May 2021 | Updated September 2026, 18 hours ago
Every "what is proximal policy optimization?", well this is the video for you. Proximal Policy Optimization (PPO) is a reinforcement learning training method. It falls into the category of policy gradient methods, which is where a predictor is trained on a gradient derived directly from a reward function. PPO is sample efficient and very stable which makes it great from RL control problems like robotics and also many other tasks.
RL theory series: youtube.com/playlist?list=PL_49VD9KwQ_OML1Knh-Yb7FUFkhTLS0jL
^ Watch the series above if you were confused
PPO paper: arxiv.org/abs/1707.06347
TRPO paper: arxiv.org/abs/1502.05477
Every "what is proximal policy optimization?", well this is the video for you. Proximal Policy Optimization (PPO) is a reinforcement learning training method. It falls into the category of policy gradient methods, which is where a predictor is trained on a gradient derived directly from a reward function. PPO is sample efficient and very stable which makes it great from RL control problems like robotics and also many other tasks.
RL theory series: youtube.com/playlist?list=PL_49VD9KwQ_OML1Knh-Yb7FUFkhTLS0jL
^ Watch the series above if you were confused
PPO paper: arxiv.org/abs/1707.06347
TRPO paper: arxiv.org/abs/1502.05477
