Understanding the Structure of Reasoning in Language Models @SimonsInstitute
Understanding the Structure of Reasoning in Language Models  @SimonsInstitute
Uploaded October 2026 | Updated November 2026, 2 days ago
Soheil Feizi (University of Maryland, College Park)
https://simons.berkeley.edu/talks/soheil-feizi-university-maryland-college-park-2026-10-07
Trustworthy AI: From Hallucinations to Reliable Autonomy

Large language models are becoming increasingly capable reasoners, but reliability requires more than solving individual problems correctly. Models must reason under uncertainty, allocate computation effectively, recognize their limitations, and decide when and how to use external information or tools.

In this talk, I will discuss recent work on the structure and dynamics of reasoning in language models, their ability to reason under uncertainty, and mechanisms for controlling inference-time computation. Across these settings, a recurring theme is that strong underlying capabilities do not always translate into reliable reasoning behavior. Understanding this gap—and the internal signals and mechanisms that govern reasoning—will become central to building more reliable and autonomous AI systems.
Understanding the Structure of Reasoning in Language ModelsFunctional Stochastic LocalizationWhy Pretrained Models HallucinatePeaked quantum advantage using error correctionThe elusive generalization: classical bounds to double descent to grokkingMatrix Concentration and Equivalent Operators on Fock SpacesRandomness Extractors and Related Objects (Part 2)Sampling from spherical spin glasses: diffusions and simulated annealingTalk by Max Hopkins (Institute for Advanced Study)Sequential Statistical Methods for Reliable Machine LearningNodal surplus and the spectral decomposition of the cycle spaceSturmian discrete and metric graphs - appearance and absence of gaps
Simons Institute for the Theory of Computing |

Understanding the Structure of Reasoning in Language Models

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER