Uploaded March 2023 | Updated September 2026, 2 weeks ago
https://www.ri.cmu.edu/event/ri-seminar-lerrel-pinto-nyu-courant-institute-of-mathematical-sciences-assistant-professor-of-computer-science-2023-03-24/
Lerrel Pinto
Assistant Professor of Computer Science
Robotics and Machine Learning, New York University
Friday, March 24, 2023
A Constructivist’s Guide to Robot Learning
Over the last decade, a variety of paradigms have sought to teach robots complex and dexterous behaviors in real-world environments. On one end of the spectrum we have nativist approaches that bake in fundamental human knowledge through physics models, simulators and knowledge graphs. While on the other end of the spectrum we have tabula-rasa approaches that teach robots from scratch. In this talk I will argue for the need for better constructivist approaches to robotics, i.e. techniques that take guidance from humans while allowing robots to continuously adapt in changing scenarios. The constructivist guide I propose will focus on three elements. First, creating physical interfaces to allow humans to provide robots with rich and dexterous data. Second, developing adaptive learning mechanisms to allow robots to continually fine-tune in their environments. Third, architecting models that allow robots to learn from un-curated play. Applications of such a learning paradigm will be demonstrated on mobile manipulators in home environments, industrial robots on precision tasks, and multi-fingered hands on dexterous manipulation.
Bio:
Lerrel Pinto is an Assistant Professor of Computer Science at NYU. His research interests focus on machine learning for robots. He received a Ph.D. degree from CMU in 2019 after which he did a Postdoc at UC Berkeley. His work on large-scale robot learning received the Best Student Paper Award at ICRA 2016, Best Paper Award finalist at IROS 2019, and CoRL 2022. Several of his works have been featured in popular media such as The Wall Street Journal, TechCrunch, MIT Tech Review, Wired, and BuzzFeed among others. His recent work can be found on www.lerrelpinto.com.
https://www.ri.cmu.edu/event/ri-seminar-lerrel-pinto-nyu-courant-institute-of-mathematical-sciences-assistant-professor-of-computer-science-2023-03-24/
Lerrel Pinto
Assistant Professor of Computer Science
Robotics and Machine Learning, New York University
Friday, March 24, 2023
A Constructivist’s Guide to Robot Learning
Over the last decade, a variety of paradigms have sought to teach robots complex and dexterous behaviors in real-world environments. On one end of the spectrum we have nativist approaches that bake in fundamental human knowledge through physics models, simulators and knowledge graphs. While on the other end of the spectrum we have tabula-rasa approaches that teach robots from scratch. In this talk I will argue for the need for better constructivist approaches to robotics, i.e. techniques that take guidance from humans while allowing robots to continuously adapt in changing scenarios. The constructivist guide I propose will focus on three elements. First, creating physical interfaces to allow humans to provide robots with rich and dexterous data. Second, developing adaptive learning mechanisms to allow robots to continually fine-tune in their environments. Third, architecting models that allow robots to learn from un-curated play. Applications of such a learning paradigm will be demonstrated on mobile manipulators in home environments, industrial robots on precision tasks, and multi-fingered hands on dexterous manipulation.
Bio:
Lerrel Pinto is an Assistant Professor of Computer Science at NYU. His research interests focus on machine learning for robots. He received a Ph.D. degree from CMU in 2019 after which he did a Postdoc at UC Berkeley. His work on large-scale robot learning received the Best Student Paper Award at ICRA 2016, Best Paper Award finalist at IROS 2019, and CoRL 2022. Several of his works have been featured in popular media such as The Wall Street Journal, TechCrunch, MIT Tech Review, Wired, and BuzzFeed among others. His recent work can be found on www.lerrelpinto.com.
