Artificial Intelligence & Large Language Models: Steve Hsu Oxford Lecture — #35 @ManifoldPodcast
Artificial Intelligence & Large Language Models: Steve Hsu Oxford Lecture — #35  @ManifoldPodcast
Uploaded May 2023 | Updated November 2026, 2 days ago
This week's episode is based on a lecture Steve gave to an audience of theoretical physicists at Oxford University. The topic is artificial intelligence and large language models.

Lecture slides: docs.google.com/presentation/d/1xiMeeRMVpB-_W66BnyRyUAtrLlUwQNlndqbVcguKK8U/edit?usp=sharing


Chapter markers:

0:00 Introduction
2:31 Deep Learning and Neural Networks; history and mathematical results
21:15 Embedding space, word vectors
31:53 Next word prediction as objective function
34:08 Attention is all you need
37:09 Transformer architecture
44:54 The geometry of thought
52:57 What can LLMs do? Sparks of AGI
1:02:41 Hallucination
1:14:40 SuperFocus testing and examples
1:18:40 AI landscape, AGI, and the future


Music used with permission from Blade Runner Blues Livestream improvisation by State Azure.


–
Steve Hsu is Professor of Theoretical Physics and of Computational Mathematics, Science, and Engineering at Michigan State University. Previously, he was Senior Vice President for Research and Innovation at MSU and Director of the Institute of Theoretical Science at the University of Oregon. Hsu is a startup founder (SuperFocus.ai., SafeWeb, Genomic Prediction) and advisor to venture capital and other investment firms. He was educated at Caltech and Berkeley, was a Harvard Junior Fellow, and has held faculty positions at Yale, the University of Oregon, and MSU.

Please send any questions or suggestions to manifold1podcast@gmail.com or Steve on Twitter @hsu_steve.
Artificial Intelligence & Large Language Models: Steve Hsu Oxford Lecture — #35Ray McGovern: CIA, JFK, Deep State, and Ukraine Crisis — #54Michael Kauffman on Cancer, Drug Development and Market Capitalism - #48Gilles Saint-Paul: The Yellow Vests, French Politics, and Hypergamy — #31Shenzhen is the Technology Capital of the World, with Taylor Ogan – #107Iran War is the First Missile War (crossover with Seeking TruthFrom Facts podcast) – #110Ken Liu: Art in the Age of AI — #79Russell Clark: Japan, China, and USD reserve status — #56Adam Dynes on Noisy Retrospection: The Effect of Party Control on Policy Outcomes - #35Carl Zha: Xinjiang, Ukraine, and U.S.-China relations — #10Omar Shams: AI Founder and Google AI Agent Lead — #89Sebastian Mallaby: Venture capital as an engine of courage — #8
Manifold |

Artificial Intelligence & Large Language Models: Steve Hsu Oxford Lecture — #35

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER