Uploaded April 2025 | Updated September 2026, 1 week ago
Machine Learning Street Talk
|
ChatGPT is overconfident (Anil Ananthaswamy)
🔇 TAP TO UNMUTE
![The Mathematical Foundations of Intelligence [Professor Yi Ma]](https://i.ytimg.com/vi/QWidx8cYVRs/mqdefault.jpg "The Mathematical Foundations of Intelligence [Professor Yi Ma]
What if everything we think we know about AI understanding is wrong? Is compression the key to intelligence? Or is there something more—a leap from memorization to true abstraction?
In this fascinating conversation, we sit down with *Professor Yi Ma*—world-renowned expert in deep learning, IEEE/ACM Fellow, and author of the groundbreaking new book *Learning Deep Representations of Data Distributions*. Professor Ma challenges our assumptions about what large language models actually do, reveals why 3D reconstruction isnt the same as understanding, and presents a unified mathematical theory of intelligence built on just two principles: *parsimony* and *self-consistency*.
**SPONSOR MESSAGES START**
—
Prolific - Quality data. From real people. For faster breakthroughs.
https://www.prolific.com/?utm_source=mlst
—
cyber•Fund https://cyber.fund/?utm_source=mlst is a founder-led investment firm accelerating the cybernetic economy
Hiring a SF VC Principal: https://talent.cyber.fund/companies/cyber-fund-2/jobs/57674170-ai-investment-principal#content?utm_source=mlst
Submit investment deck: https://cyber.fund/contact?utm_source=mlst
—
**END**
NOTE: Based on lower retention we have EDITED out 33:45 of the original interview from near the start - philosophical stuff, an extended analogy comparing DNA evolution to AI development, speculation about where theories come from (Platonism, deductive trees), Norbert Wieners cybernetics history. You can watch the original version on the rescript link or Spotify version.
Key Insights:
*LLMs Dont Understand—They Memorize*
Language models process text (*already* compressed human knowledge) using the same mechanism we use to learn from raw data.
*The Illusion of 3D Vision*
Sora and NeRFs etc that can reconstruct 3D scenes still fail miserably at basic spatial reasoning
*All Roads Lead to Rome*
Why adding noise is *necessary* for discovering structure.
*Why Gradient Descent Actually Works*
Natural optimization landscapes are surprisingly smooth—a blessing of dimensionality
*Transformers from First Principles*
Transformer architectures can be mathematically derived from compression principles
—
INTERACTIVE AI TRANSCRIPT PLAYER w/REFS (ReScript):
https://app.rescript.info/public/share/Z-dMPiUhXaeMEcdeU6Bz84GOVsvdcfxU_8Ptu6CTKMQ
About Professor Yi Ma
Yi Ma is the inaugural director of the School of Computing and Data Science at Hong Kong University and a visiting professor at UC Berkeley.
https://people.eecs.berkeley.edu/~yima/
https://scholar.google.com/citations?user=XqLiBQMAAAAJ&hl=en
https://x.com/YiMaTweets
*Slides from this conversation:*
https://www.dropbox.com/scl/fi/sbhbyievw7idup8j06mlr/slides.pdf?rlkey=7ptovemezo8bj8tkhfi393fh9&dl=0
*Related Talks by Professor Ma:*
- Pursuing the Nature of Intelligence (ICLR): https://www.youtube.com/watch?v=LT-F0xSNSjo
- Earlier talk at Berkeley: https://www.youtube.com/watch?v=TihaCUjyRLM
TIMESTAMPS:
00:00:00 Introduction
00:02:08 The First Principles Book & Research Vision
00:05:21 Two Pillars: Parsimony & Consistency
00:09:50 Evolution vs. Learning: The Compression Mechanism
00:14:37 The Illusion of 3D Understanding: Sora & NeRF
00:20:41 All Roads Lead to Rome: The Role of Noise
00:26:11 All Roads Lead to Rome: The Role of Noise
00:26:29 Benign Non-Convexity: Why Optimization Works
00:32:50 Double Descent & The Myth of Overfitting
00:40:41 Self-Consistency: Closed-Loop Learning
00:47:18 Deriving Transformers from First Principles
00:56:26 Verification & The Kevin Murphy Question
01:00:26 CRATE vs. ViT: White-Box AI & Conclusion
REFERENCES:
Book:
[00:03:04] Learning Deep Representations of Data Distributions
https://ma-lab-berkeley.github.io/deep-representation-learning-book/
Book (Yi Ma):
[00:03:14] An Invitation to 3-D Vision
https://link.springer.com/book/10.1007/978-0-387-21779-6
[00:03:24] Generalized Principal Component Analysis
https://link.springer.com/book/10.1007/978-0-387-87811-9
[00:03:34] High-Dimensional Data Analysis with Low-Dimensional Models
https://book-wright-ma.github.io/
Slide:
[00:44:11] Slide 26: Neuroscience Evidence
https://arxiv.org/abs/2207.04630)
Person:
[00:08:24] Albert Einstein
https://quoteinvestigator.com/2011/05/13/einstein-simple/
[00:56:41] Kevin Murphy
https://probml.github.io/pml-book/book1.html
Paper:
[00:18:09] Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMs
https://arxiv.org/abs/2401.06209
[00:26:13] A Global Geometric Analysis of Maximal Coding Rate Reduction
https://arxiv.org/pdf/2406.01909
[00:47:26] CRATE: White-Box Transformers via Sparse Rate Reduction
https://arxiv.org/abs/2306.01129
[00:55:05] DINOv2: Learning Robust Visual Features without Supervision
https://arxiv.org/abs/2304.07193
[01:00:36] An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (ViT)
https://arxiv.org/abs/2010.11929")
![Why Humans Are Still Powering AI [Sponsored] - Phelim Bradley](https://i.ytimg.com/vi/R11ESdfVX64/mqdefault.jpg "Why Humans Are Still Powering AI [Sponsored] - Phelim Bradley
Ever wonder where AI models actually get their intelligence? We reveal the dirty secret of Silicon Valley: behind every impressive AI system are thousands of real humans providing crucial data, feedback, and expertise.
Guest: Phelim Bradley, CEO and Co-founder of Prolific
Phelim Bradley runs Prolific, a platform that connects AI companies with verified human experts who help train and evaluate their models. Think of it as a sophisticated marketplace matching the right human expertise to the right AI task - whether thats doctors evaluating medical chatbots or coders reviewing AI-generated software.
Prolific: https://prolific.com/?utm_source=mlst
https://uk.linkedin.com/in/phelim-bradley-84300826
INTERACTIVE TRANSCRIPT:
https://app.rescript.info/public/share/8wsXTkYiczP2rZyc2_I2aylvaxJ-6QJQ2VTu_9woJyQ
The discussion dives into:
**The human data pipeline**: How AI companies rely on human intelligence to train, refine, and validate their models - something rarely discussed openly
**Quality over quantity**: Why paying humans well and treating them as partners (not commodities) produces better AI training data
**The matching challenge**: How Prolific solves the complex problem of finding the right expert for each specific task, similar to matching Uber drivers to riders but with deep expertise requirements
**Future of work**: What it means when human expertise becomes an on-demand service, and why this might actually create more opportunities rather than fewer
**Geopolitical implications**: Why the centralization of AI development in US tech companies should concern Europe and the UK")
![Your Brain Doesnt Command Your Body. It Predicts It. [Max Bennett]](https://i.ytimg.com/vi/RvYSsi6rd4g/mqdefault.jpg "Your Brain Doesnt Command Your Body. It Predicts It. [Max Bennett]
Tim sits down with Max Bennett to explore how our brains evolved over 600 million years—and what that means for understanding both human intelligence and AI.
Max isnt a neuroscientist by training. Hes a tech entrepreneur who got curious, started reading, and ended up weaving together three fields that rarely talk to each other: comparative psychology (what different animals can actually do), evolutionary neuroscience (how brains changed over time), and AI (what actually works in practice).
*Your Brain Is a Guessing Machine*
You dont actually see the world. Your brain builds a simulation of what it *thinks* is out there and just uses your eyes to check if its right. Thats why optical illusions work—your brain is filling in a triangle that isnt there, or cant decide if its looking at a duck or a rabbit.
*Rats Have Regrets*
In a fascinating experiment called Restaurant Row, rats make choices about waiting for food. When they skip a short wait for something they like and end up stuck with a long wait for something they dont—you can literally watch their brain imagine eating the food they passed up. They regret their choice and make different decisions next time.
*Chimps Are Machiavellian*
The most gripping story is about two chimps, Rock and Belle. Belle learns where food is hidden. Rock figures out he can just follow her and steal it. So Belle starts hiding the food when she finds it. Then Rock starts *pretending* not to watch her, then sprinting to grab the food once she moves. This escalates into an arms race of deception and counter-deception—proof that apes can think about what others are thinking.
*Language Is the Human Superpower*
Other animals learn by watching each others actions. Humans can share whats happening *inside our minds*. You can describe a dream, plan a hunt with five other people, or warn someone about a snake you saw yesterday. This ability to share mental simulations is what lets knowledge accumulate across generations—and its arguably the singularity that already happened.
*Does ChatGPT Think?*
ChatGPT clearly has *a model* (it wouldnt work otherwise), but it doesnt have a *world model* in the way brains do. A real world model means you can form a hypothesis, test it, and update your beliefs based on what happens. GPT learns only from its training data—it cant run experiments or reject information it knows to be false.
Understanding how the brain evolved isnt just about the past. It gives us clues about:
- Whats actually different between human intelligence and AI
- Why were so easily fooled by status games and tribal thinking
- What features we might want to build into—or leave out of—future AI systems
Get Maxs book:
https://www.amazon.com/Brief-History-Intelligence-Humans-Breakthroughs/dp/0063286343
Rescript: https://app.rescript.info/public/share/R234b7AXyDXZusqQ_43KMGsUSvJ2TpSz2I3emnI6j9A
TIMESTAMPS:
00:00:00 Introduction: Outsiders Advantage & Neocortex Theories
00:11:34 Perception as Inference: The Filling-In Machine
00:19:11 Understanding, Recognition & Generative Models
00:36:39 How Mice Plan: Vicarious Trial & Error
00:46:15 Evolution of Self: The Layer 4 Mystery
00:58:31 Ancient Minds & The Social Brain: Machiavellian Apes
01:19:36 AI Alignment, Instrumental Convergence & Status Games
01:33:07 Metacognition & The IQ Paradox
01:48:40 Does GPT Have Theory of Mind?
02:00:40 Memes, Language Singularity & Brain Size Myths
02:16:44 Communication, Language & The Cyborg Future
02:44:25 Shared Fictions, World Models & The Reality Gap
REFERENCES:Person:
[00:00:05] Karl Friston (UCL)
https://www.youtube.com/watch?v=PNYWi996Beg
[00:00:06] Jeff Hawkins
https://www.youtube.com/watch?v=6VQILbDqaI4
[00:12:19] Hermann von Helmholtz
https://plato.stanford.edu/entries/hermann-helmholtz/
[00:38:34] David Redish (U. Minnesota)
https://redishlab.umn.edu/
[01:10:19] Robin Dunbar
https://www.psy.ox.ac.uk/people/robin-dunbar
[01:15:04] Emil Menzel
https://www.sciencedirect.com/bookseries/behavior-of-nonhuman-primates/vol/5/suppl/C
[01:19:49] Nick Bostrom
https://nickbostrom.com/
[02:28:25] Noam Chomsky
https://linguistics.mit.edu/user/chomsky/
[03:01:22] Judea Pearl
https://samueli.ucla.edu/people/judea-pearl/
Concept/Framework:
[00:05:04] Active Inference
https://www.youtube.com/watch?v=KkR24ieh5Ow
Paper:
[00:35:59] Predictions not commands [Rick A Adams]
https://pubmed.ncbi.nlm.nih.gov/23129312/
Book:
[01:25:42] The Elephant in the Brain
https://www.amazon.com/Elephant-Brain-Hidden-Motives-Everyday/dp/0190495995
[01:28:27] The Status Game
https://www.goodreads.com/book/show/58642436-the-status-game
[02:00:40] The Selfish Gene
https://amazon.com/dp/0198788606
[02:14:25] The Language Game
https://www.amazon.com/Language-Game-Improvisation-Created-Changed/dp/1541674987
[02:54:40] The Evolution of Language
https://www.amazon.com/Evolution-Language-Approaches/dp/052167736X
[03:09:37] The Three-Body Problem
https://amazon.com/dp/0765377063")
