Uploaded March 2022 | Updated September 2026, 2 hours ago
Lots of research in Artificial Intelligence (AI) and Machine Learning (ML) in the past few years has focused on supervised learning, and more recently there has been a trend of constructing massive models and focusing on scaling (e.g. GPT-3, Gopher, AlphaCode). These aren't the only two areas of work, but is it perhaps a mistake to focus on these approaches in ML research? Is something like Reinforcement Learning (RL) more promising? I'm not sure, but these are some opinions I've heard from others.
Physics simulation paper: arxiv.org/abs/2002.09405
Face image generation paper: arxiv.org/pdf/1903.06048.pdf
Source of other AI-gen images used (DALL-E): arxiv.org/abs/2102.12092
Lots of research in Artificial Intelligence (AI) and Machine Learning (ML) in the past few years has focused on supervised learning, and more recently there has been a trend of constructing massive models and focusing on scaling (e.g. GPT-3, Gopher, AlphaCode). These aren't the only two areas of work, but is it perhaps a mistake to focus on these approaches in ML research? Is something like Reinforcement Learning (RL) more promising? I'm not sure, but these are some opinions I've heard from others.
Physics simulation paper: arxiv.org/abs/2002.09405
Face image generation paper: arxiv.org/pdf/1903.06048.pdf
Source of other AI-gen images used (DALL-E): arxiv.org/abs/2102.12092
![ML Research Idea [Zero to Paper]](https://i.ytimg.com/vi/nSEb6w_BBqE/mqdefault.jpg "ML Research Idea [Zero to Paper]
This episode (part 2) of Zero to Paper covers the idea we will be working on: Text to Goal, or TTG for short. TTG aims to translate natural language into a reward function for a Reinforcement Learning problem. This research project aims to leverage recent advancements in NLP and Computer Vision to make reward functions easier and more natural to craft.
I also briefly touch on how I come up with ideas an what is important to me. I hope this will be helpful to anyone wonder how to do ML research!
Zero to Paper playlist: https://www.youtube.com/watch?v=74fKCvr5n5o&list=PL_49VD9KwQ_ONxENRk11jFEI3_pqAwaug
RL Theory series if you want to get into RL: https://www.youtube.com/watch?v=1OI0uuz9jkI&list=PL_49VD9KwQ_OML1Knh-Yb7FUFkhTLS0jL")
