Uploaded November 2024 | Updated September 2026, 1 week ago
In a society that is confronting the new age of AI in which LLMs begin to display aspects of human intelligence, understanding the fundamental theory of deep learning and applying it to real systems is a compelling and urgent need.
This panel will introduce some new simple foundational results in the theory of supervised learning. It will also discuss open problems in the theory of learning, including problems specific to neuroscience.
Moderator: Tomaso Poggio - Professor of Brain and Cognitive Sciences, MIT
Panelists:
Ila Fiete - Professor of Brain and Cognitive Sciences, MIT
Haim Sompilinski - Professor of Molecular and Cellular Biology and of Physics, Harvard University
Eran Malach - Research fellow, Kempner Institute at Harvard University
Philip Isola - Associate Professor, EECS at MIT
In a society that is confronting the new age of AI in which LLMs begin to display aspects of human intelligence, understanding the fundamental theory of deep learning and applying it to real systems is a compelling and urgent need.
This panel will introduce some new simple foundational results in the theory of supervised learning. It will also discuss open problems in the theory of learning, including problems specific to neuroscience.
Moderator: Tomaso Poggio - Professor of Brain and Cognitive Sciences, MIT
Panelists:
Ila Fiete - Professor of Brain and Cognitive Sciences, MIT
Haim Sompilinski - Professor of Molecular and Cellular Biology and of Physics, Harvard University
Eran Malach - Research fellow, Kempner Institute at Harvard University
Philip Isola - Associate Professor, EECS at MIT









![Aligning deep networks with human vision will require novel neural architectures, data diets and ...
Thomas Serre, Brown University
[full title] Aligning deep networks with human vision will require novel neural architectures, data diets and training algorithms
Abstract: Recent advances in artificial intelligence have been mainly driven by the rapid scaling of deep neural networks (DNNs), which now contain unprecedented numbers of learnable parameters and are trained on massive datasets, covering large portions of the internet. This scaling has enabled DNNs to develop visual competencies that approach human levels. However, even the most sophisticated DNNs still exhibit strange, inscrutable failures that diverge markedly from human-like behavior—a misalignment that seems to worsen as models grow in scale.
In this talk, I will discuss recent work from our group addressing this misalignment via the development of DNNs that mimic human perception by incorporating computational, algorithmic, and representational principles fundamental to natural intelligence. First, I will review our ongoing efforts in characterizing human visual strategies in image categorization tasks and contrasting these strategies with modern deep nets. I will present initial results suggesting we must explore novel data regimens and training algorithms for deep nets to learn more human-like visual representations. Second, I will show results suggesting that neural architectures inspired by cortex-like recurrent neural circuits offer a compelling alternative to the prevailing transformers, particularly for tasks requiring visual reasoning beyond simple categorization. Aligning deep networks with human vision will require novel neural architectures, data diets and ...](https://i.ytimg.com/vi/IiYjQdpXtNQ/mqdefault.jpg)
