Uploaded November 2021 | Updated September 2026, 6 minutes ago
This video we cover a research paper about Reinforcement Learning in RTS games and how it works! Recently works like OpenAI Five and Alpha Star by DeepMind have been incredible, but what makes these models work is still a mystery in many ways. The ablation study performed by this paper was very insightful in providing more light on what is important in these ML models.
Full paper title: Gym-μRTS: Toward Affordable Deep Reinforcement Learning Research in Real-Time Strategy Games
Wandb report: wandb.ai/vwxyzjn/gym-microrts-paper/reports/Gym-RTS-Toward-Affordable-Deep-Reinforcement-Learning-Research-in-Real-Time-Strategy-Games--Vmlldzo2MDIzMTg
Arxiv paper: arxiv.org/pdf/2105.13807.pdf
This video we cover a research paper about Reinforcement Learning in RTS games and how it works! Recently works like OpenAI Five and Alpha Star by DeepMind have been incredible, but what makes these models work is still a mystery in many ways. The ablation study performed by this paper was very insightful in providing more light on what is important in these ML models.
Full paper title: Gym-μRTS: Toward Affordable Deep Reinforcement Learning Research in Real-Time Strategy Games
Wandb report: wandb.ai/vwxyzjn/gym-microrts-paper/reports/Gym-RTS-Toward-Affordable-Deep-Reinforcement-Learning-Research-in-Real-Time-Strategy-Games--Vmlldzo2MDIzMTg
Arxiv paper: arxiv.org/pdf/2105.13807.pdf
![ML Research Idea [Zero to Paper]](https://i.ytimg.com/vi/nSEb6w_BBqE/mqdefault.jpg "ML Research Idea [Zero to Paper]
This episode (part 2) of Zero to Paper covers the idea we will be working on: Text to Goal, or TTG for short. TTG aims to translate natural language into a reward function for a Reinforcement Learning problem. This research project aims to leverage recent advancements in NLP and Computer Vision to make reward functions easier and more natural to craft.
I also briefly touch on how I come up with ideas an what is important to me. I hope this will be helpful to anyone wonder how to do ML research!
Zero to Paper playlist: https://www.youtube.com/watch?v=74fKCvr5n5o&list=PL_49VD9KwQ_ONxENRk11jFEI3_pqAwaug
RL Theory series if you want to get into RL: https://www.youtube.com/watch?v=1OI0uuz9jkI&list=PL_49VD9KwQ_OML1Knh-Yb7FUFkhTLS0jL")
