Introduction to transformer architecture and discussion @MITCBMM
Introduction to transformer architecture and discussion  @MITCBMM
Uploaded October 2022 | Updated September 2026, 1 week ago
Phillip Isola and Brian Cheung, MIT

This is meant to be an informal discussion in which Phillip and Brian will give an overview of transformer networks and then we will open the floor for questions and discussion. It is likely that we will have another meeting at a later time discussing what transformers may contribute to neuroscience.
Introduction to transformer architecture and discussionAttention Approximates Sparse Distributed MemoryRoadmap for the day¿Cómo ven nuestros ojos el cuadro completo?The Platonic Representation HypothesisCan we change someones emotions by showing them a picture?Selective responses to faces, scenes, and bodies in the ventral visual pathway of infantsWhat can computers tell us about biology?Sprouting: BienvenidaLearning to Reason, Insights from Language ModelingScaling Inference MissionQuest Engineering Team presentation
MITCBMM |

Introduction to transformer architecture and discussion

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER