Uploaded October 2026 | Updated November 2026, 4 days ago
Shawn Wen of PolyAI on why voice agents should not sound generic. A regional flavour reads as human, and the most natural early voice agent was a French voice speaking English.
Taken from our full interview with Shawn Wen (PolyAI) on Machine Learning Street Talk.
Subscribe for more conversations with the people building AI: youtube.com/@MachineLearningStreetTalk
#Shorts #VoiceAI #AI #PolyAI
Shawn Wen of PolyAI on why voice agents should not sound generic. A regional flavour reads as human, and the most natural early voice agent was a French voice speaking English.
Taken from our full interview with Shawn Wen (PolyAI) on Machine Learning Street Talk.
Subscribe for more conversations with the people building AI: youtube.com/@MachineLearningStreetTalk
#Shorts #VoiceAI #AI #PolyAI


![You dont fine-tune your way to AGI - Heres why. [Eiso Kant]
Eiso Kant is the co-founder and CTO of Poolside AI, one of roughly seven companies worldwide with the technical muscle to build frontier foundation models from scratch. He sat down with Tim to explain why Poolside deliberately rejected the prevailing wisdom of just scale up the next GPT and instead bet the company on a thesis most labs were ignoring: that reinforcement learning from code execution feedback is the missing scaling axis.
The argument is straightforward and, once you hear it, hard to unsee. Next-token prediction is imitation learning. Reinforcement learning is trial-and-error learning. Poolside maintains close to a million fully containerized code repositories each with its own test suite as a massive, diverse RL environment. The model writes code, executes it, gets deterministic feedback, and learns. This is why software turns out to be the ideal domain for RL scaling: it is deterministic enough to provide clear reward signals, but diverse enough to avoid model collapse.
Along the way, Eiso and Tim get into the weeds on frontier lab operations (over 4000 experimental runs per month), why Chinchilla optimality breaks down once you account for inference cost, what DeepSeek V3 tells us about the second-generation AI company playbook, and why the R1 zero-shot reasoning result should have been the real headline rather than the dollar figure. There is a candid exchange on whether the software development lifecycle itself will progressively collapse into the model, what Chris Olah interpretability work means for alignment, and whether Karpathy was right about Software 2.0 with some important caveats Eiso has developed after a decade of building AI for code.
SPONSOR MESSAGES:
***
Tufa AI Labs is a brand new research lab in Zurich started by Benjamin Crouzier focussed on o-series style reasoning and AGI. They are hiring a Chief Engineer and ML engineers. Events in Zurich.
TIMESTAMPS:
00:00:00 Introduction and Guest Background
00:02:50 Poolside AIs Vision and Three-Step Plan
00:06:50 Foundation Models vs. Enterprise Customization
00:10:25 The Missing Scaling Axis: Reinforcement Learning
00:15:40 Reinforcement Learning from Code Execution Feedback
00:22:20 Model Economics and Experimental Optimization
00:26:00 Enterprise Deployment Strategy and Market Focus
00:30:30 DeepSeek, Distributed Training, and Hardware Architecture
00:36:40 Emergent Reasoning and Chain-of-Thought Scaling
00:45:00 AI-Assisted Software Development Today
00:58:20 Architecture Innovation and Model Interpretability
01:15:00 Karpathys Software 2.0 and the Future of Code
01:25:00 AWS Partnership, Enterprise Security, and Closing
REFERENCES:
website:
[00:01:40] Tufa AI Labs
https://tufalabs.ai/
[00:02:50] Poolside AI
https://poolside.ai/
social:
[00:02:50] Eiso Kant on X
https://x.com/eisokant
paper:
[00:15:40] The Curse of Recursion: Training on Generated Data Makes Models Forget
https://arxiv.org/abs/2305.17493
[00:20:00] Efficient Estimation of Word Representations in Vector Space (Word2Vec)
https://arxiv.org/abs/1301.3781
[00:22:40] On the Measure of Intelligence
https://arxiv.org/abs/1911.01547
[00:30:30] DeepSeek-V3 Technical Report
https://arxiv.org/abs/2412.19437
[00:34:30] Training Compute-Optimal Large Language Models (Chinchilla)
https://arxiv.org/abs/2203.15556
[00:45:45] The Bitter Lesson
http://www.incompleteideas.net/IncIdeas/BitterLesson.html
[00:49:55] Mastering the Game of Go with Deep Neural Networks and Tree Search
https://www.nature.com/articles/nature16961
[01:10:15] Mamba: Linear-Time Sequence Modeling with Selective State Spaces
https://arxiv.org/abs/2312.00752
[01:14:25] Zoom In: An Introduction to Circuits
https://distill.pub/2020/circuits/zoom-in/
benchmark:
[00:46:10] ARC Prize Challenge
https://arcprize.org/
blog:
[01:19:10] Software 2.0
https://karpathy.medium.com/software-2-0-a64152b37c35
LINKS:
Full Transcript: https://app.rescript.info/share/a8144052b0a5fc7210ab37f9651a3557
Download PDF transcript: https://app.rescript.info/api/public/sessions/2f5beb6d70f79973/pdf
Eiso Kant:
https://x.com/eisokant
https://poolside.ai/ You dont fine-tune your way to AGI - Heres why. [Eiso Kant]](https://i.ytimg.com/vi/NDrosuKhXeo/mqdefault.jpg)
![What Building an AI Scientist Actually Requires Beyond Intelligence — Edward Hughes
Can a machine learn the judgement that separates a plausible-looking result from a faithful experiment? Edward Hughes, Chief Scientist and co-founder of Inherent, joins Tim Scarfe to argue that creativity is not optimisation, and that the missing capability in AI is choosing which questions are worth asking.
SPONSOR:
Cyber Fund built the Monastery to help founders ship products that were impossible a year ago.
Apply now: https://cyber.fund
Edward makes the case that Move 37 was innovative rather than creative, and that the field, not the individual, decides what counts as a discovery. That reframing runs through Csikszentmihalyi, Deutsch and exaptation into open-endedness, where deceptive goals and imperfect world models turn out to be the point rather than the problem. The second half turns to the paper: Replica, a task space built by redacting figures from real papers, and Faraday, a 27-billion-parameter model trained to steer a frontier coding agent that then beats the frontier on held-out replications.
TIMESTAMPS:
00:00:00 Cold open: Move 37, Faraday and collective intelligence
00:01:08 Sponsor: CyberFund
00:01:46 Inherents $50M raise and the road from string theory
00:09:14 Three timescales of learning: weights, context, culture
00:13:47 Move 37 was innovative, not creative: the field decides
00:20:39 Creativity as satisficing: the urinal and evolution
00:25:06 Exaptation and the Tristan chord: creativity in context
00:30:56 Coherence for whom? Deutschs hard-to-vary explanations
00:35:53 Why copying is creative: Deutsch and the constraint engineer
00:42:27 Societies of agents and the strong Moravec paradox
00:45:51 Evaluate in hindsight: from Lean proofs to climate change
00:51:56 Picbreeder, local goals and why discovery needs deception
00:57:21 Spaghetti proofs, translation layers and superhuman Go
01:00:37 Does nature compress? Naturalness and real patterns
01:07:36 Why replicate? Replicas redacted figures and Faraday
01:12:31 Faraday beats Codex, Claude and GLM 5.2 on held-out tasks
01:15:31 Replication to innovation: how the Transformer happened
01:18:26 Deep replication: what Faraday learns from Voyager and GNoME
01:23:37 Can the AI scientist cheat? Goodharting the judge
01:29:09 Inside Replica: scale-down, 8xB300 runs, per-task rubrics
01:34:11 The RL crisis: getting GRPO to work with per-turn credit
01:39:43 Weights vs harnesses: AlphaEvolve, DGM and EvoTune
01:45:45 The recursive company: agents cross a phase transition
01:50:35 Collective intelligence and the electric dynamo
01:55:46 What replaces OKRs? Incumbents and the burden of knowledge
REFERENCES:
MLST creativity article:
https://archive.mlst.ai/read/why-creativity-cannot-be-interpolated
organization:
[00:01:47] Inherent
https://inherentlabs.ai/
other:
[00:20:51] Marcel Duchamp, Fountain (1917)
https://www.tate.org.uk/art/artworks/duchamp-fountain-t07573
[00:28:25] The Tristan chord
https://imslp.org/wiki/Tristan_und_Isolde%2C_WWV_90_(Wagner%2C_Richard)
https://arxiv.org/abs/2301.07608
[00:05:41] Genie
https://arxiv.org/abs/2402.15391
[00:06:05] The AI Scientist
https://arxiv.org/abs/2408.06292
[00:12:13] Training AI Scientists to Replicate Research (Replica and Faraday)
https://arxiv.org/abs/2608.13331
[00:25:42] Open-Endedness is Essential for ASI
https://arxiv.org/abs/2406.04268
[00:50:30] MAP-Elites
https://arxiv.org/abs/1504.04909
[00:50:59] OMNI: Open-endedness via Models of human Notions of Interestingness
https://arxiv.org/abs/2306.01711
[00:51:01] OMNI-EPIC
https://arxiv.org/abs/2405.15568
[00:53:42] Picbreeder
https://pubmed.ncbi.nlm.nih.gov/20964537/
[01:17:26] Neural Machine Translation by Jointly Learning to Align and Translate
https://arxiv.org/abs/1409.0473
[01:20:44] Voyager
https://arxiv.org/abs/2305.16291
[01:21:57] GNoME
https://www.nature.com/articles/s41586-023-06735-9
[01:34:11] DeepSeekMath
https://arxiv.org/abs/2402.03300
[01:41:29] AlphaEvolve
https://arxiv.org/abs/2506.13131
[01:41:53] Darwin Gödel Machine
https://arxiv.org/abs/2505.22954
[01:41:56] Hyperagents
https://arxiv.org/abs/2603.19461
[01:42:33] EvoTune
https://arxiv.org/abs/2504.05108
[01:44:46] Evolutionary Principles in Self-Referential Learning
https://people.idsia.ch/~juergen/diploma.html
[01:59:33] Are Ideas Getting Harder to Find?
https://www.nber.org/papers/w23782
book:
[00:16:04] Creativity: Flow and the Psychology of Discovery and Invention
https://search.worldcat.org/title/254487436
[00:26:22] Why Greatness Cannot Be Planned
https://link.springer.com/book/10.1007/978-3-319-15524-1
[00:33:03] The Beginning of Infinity
https://www.penguinrandomhouse.com/books/293575/the-beginning-of-infinity-by-david-deutsch/
[01:55:47] Laws of Knowledge
https://www.penguin.co.nz/books/the-infinite-alphabet-9780241655672
RESCRIPT:
https://app.rescript.info/session/670296ba913761d0?share=6281911cac9bdbff637f10819d4d1e5c What Building an AI Scientist Actually Requires Beyond Intelligence — Edward Hughes](https://i.ytimg.com/vi/P4bYjTJvD28/mqdefault.jpg)
![Can Latent Program Networks Solve Abstract Reasoning? [Clement Bonnet]
SPONSOR MESSAGES:
***
CentML offers competitive pricing for GenAI model deployment, with flexible options to suit a wide range of models, from small to large-scale deployments. Check out their super fast DeepSeek R1 hosting!
https://centml.ai/pricing/
Clement Bonnet presents Latent Program Networks (LPNs), a fundamentally different approach to the ARC-AGI benchmark that embeds programs into a continuous latent space rather than generating code or fine-tuning language models. The architecture uses a VAE-style encoder to map input-output pairs into distributional program representations, performs gradient-based search during both training and inference to refine these representations, and decodes solutions directly without an explicit program intermediary.
The conversation explores why ARC remains impervious to standard neural networks Chollet designed it to resist memorization, with test tasks far enough from any training distribution that zero-shot generalization fails. Bonnet and Tim Scarfe dig into the induction vs. transduction distinction, the role of the kernel trick in blurring that boundary, and why parameter-space search (test-time training) may be less efficient than searching a compressed program manifold.
A key architectural insight: training the search procedure end-to-end forces the latent space to become smooth and searchable, similar to MAML-style meta-learning. The system achieves ~10% on ARC evaluation sets using only small transformers (40M parameters total) trained from scratch on Michael Hodels re-ARC dataset no pre-trained LLMs, no internet priors.
The discussion also probes the limits of continuous latent spaces for compositional reasoning. Bonnet acknowledges that single-thread search through a fixed latent space cannot achieve true program composition, but suggests multi-threaded search with external composition could bridge the gap. The episode closes with reflections on creativity, the efficiency gap between human hypothesis-testing (a handful of guesses) and LLM program sampling (millions of samples), and what scaling LPNs might reveal about the structure of program spaces.
REFERENCES:
paper:
[00:00:05] ARC-AGI Benchmark
https://arxiv.org/abs/2412.04604
[00:02:10] Latent Program Networks
https://arxiv.org/abs/2411.08706
[00:08:45] Induction vs Transduction in Abstract Reasoning
https://arxiv.org/abs/2411.02272
[00:17:40] Variational Autoencoders
https://arxiv.org/abs/1312.6114
[00:33:00] Critique of Deep Learning
https://arxiv.org/abs/2002.06177
person:
[00:07:45] Kevin Ellis - Program Synthesis
https://www.cs.cornell.edu/~ellisk/
tool:
[00:27:50] re-ARC Framework
https://github.com/michaelhodel/re-arc
LINKS:
Full Transcript: https://app.rescript.info/share/55768bb71fbcc62c0522136650ccf960
Download PDF transcript: https://app.rescript.info/api/public/sessions/54ec5e9b3152760b/pdf
Clem and Matthew-
https://www.linkedin.com/in/clement-bonnet16/
https://github.com/clement-bonnet
https://mvmacfarlane.github.io/
[00:27:50] re-ARC, Hodel
https://github.com/michaelhodel/re-arc
[00:29:40] Grid size in ARC tasks, Chollet
https://github.com/fchollet/ARC-AGI Can Latent Program Networks Solve Abstract Reasoning? [Clement Bonnet]](https://i.ytimg.com/vi/PHBItVuudbU/mqdefault.jpg)
![Mutually Assured AI Malfunction [Dan Hendrycks]
Deep dive with Dan Hendrycks, a leading AI safety researcher and co-author of the Superintelligence Strategy paper with former Google CEO Eric Schmidt and Scale AI CEO Alexandr Wang.
*** SPONSOR MESSAGES
Gemini CLI is an open-source AI agent that brings the power of Gemini directly into your terminal - https://github.com/google-gemini/gemini-cli
Prolific: Quality data. From real people. For faster breakthroughs.
https://prolific.com/mlst?utm_campaign=98404559-MLST&utm_source=youtube&utm_medium=podcast&utm_content=script-gen
***
Hendrycks argues that society is making a fundamental mistake in how it views artificial intelligence. We often compare AI to transformative but ultimately manageable technologies like electricity or the internet. He contends a far better and more realistic analogy is nuclear technology. Like nuclear power, AI has the potential for immense good, but it is also a dual-use technology that carries the risk of unprecedented catastrophe.
The Problem with an AI Manhattan Project:
A popular idea is for the U.S. to launch a Manhattan Project for AI—a secret, all-out government race to build a superintelligence before rivals like China. Hendrycks argues this strategy is deeply flawed and dangerous for several reasons:
- It wouldn’t be secret. You cannot hide a massive, heat-generating data center from satellite surveillance.
- It would be destabilizing. A public race would alarm rivals, causing them to start their own desperate, corner-cutting projects, dramatically increasing global risk.
- It’s vulnerable to sabotage. An AI project can be crippled in many ways, from cyberattacks that poison its training data to physical attacks on its power plants. This is what the paper refers to as a maiming attack.
This vulnerability leads to the papers central concept: Mutual Assured AI Malfunction (MAIM). This is the AI-era version of the nuclear-eras Mutual Assured Destruction (MAD). In this dynamic, any nation that makes an aggressive, destabilizing bid for a world-dominating AI must expect its rivals to sabotage the project to ensure their own survival.
This deterrence, Hendrycks argues, is already the default reality we live in.
A Better Strategy: The Three Pillars
Instead of a reckless race, the paper proposes a more stable, three-part strategy modeled on Cold War principles:
- Deterrence: Acknowledge the reality of MAIM. The goal should not be to win the race to superintelligence, but to deter anyone from starting such a race in the first place through the credible threat of sabotage.
- Nonproliferation: Just as we work to keep fissile materials for nuclear bombs out of the hands of terrorists and rogue states, we must control the key inputs for catastrophic AI. The most critical input is advanced AI chips (GPUs). Hendrycks makes the powerful claim that building cutting-edge GPUs is now more difficult than enriching uranium, making this strategy viable.
- Competitiveness: The race between nations like the U.S. and China should not be about who builds superintelligence first. Instead, it should be about who can best use existing AI to build a stronger economy, a more effective military, and more resilient supply chains (for example, by manufacturing more chips domestically).
Dan says the stakes are high if we fail to manage this transition:
- Erosion of Control: Society becomes so dependent on AI systems for its economy and military that we can no longer turn them off without risking total collapse. We become passengers in an autonomous economy where humans are no longer in the drivers seat.
- Intelligence Recursion: This is the scenario where AI becomes capable of improving itself, kicking off a rapid intelligence explosion that could race ahead of any human attempts at control.
- Worthless Labor: When AI can perform most human cognitive tasks, the economic value of human labor could plummet, leading to massive societal instability and stripping people of their bargaining power.
Hendrycks maintains that while the risks are existential, the future is not set.
TOC:
1 Measuring the Beast [00:00:00]
2 Defining the Beast [00:11:34]
3 The Core Strategy [00:38:20]
4 Ideological Battlegrounds [00:53:12]
5 Mechanisms of Control [01:34:45]
TRANSCRIPT:
https://app.rescript.info/public/share/cOKcz4pWRPjh7BTIgybd7PUr_vChUaY6VQW64No8XMs
REFS:
Superintelligence Strategy
https://arxiv.org/abs/2503.05628
Humanitys Last Exam
https://arxiv.org/abs/2501.14249
Enigma Eval
https://arxiv.org/abs/2502.08859
Natural Selection Favors AIs Over Humans
https://arxiv.org/abs/2303.16200
Utility Engineering
https://arxiv.org/abs/2502.08640
Unsolved Problems in ML Safety [Emergence ref]
https://arxiv.org/abs/2109.13916
Situational Awareness by Leopold Aschenbrenner
https://situational-awareness.ai/
Large Language Models and Emergence [Krakauer]
https://arxiv.org/abs/2506.11135
Fractured Entangled Representations [Stanley/Kumar]
https://arxiv.org/pdf/2505.11581 Mutually Assured AI Malfunction [Dan Hendrycks]](https://i.ytimg.com/vi/PM1waDBNDhw/mqdefault.jpg)
![Your Brain Is a Prediction Machine, Not a Processor — Karl Friston
To truly understand natural intelligence and address complex issues like mental well-being, we must first be able to build it ourselves.
We met our hero, the brilliant neuroscientist Professor Karl Friston. We explore Professor Fristons lifes work, the Free Energy Principle, and what it reveals about life, intelligence, and consciousness itself.
**SPONSORS**
Gemini CLI is an open-source AI agent that brings the power of Gemini directly into your terminal - https://github.com/google-gemini/gemini-cli
Take the Prolific human data survey - https://www.prolific.com/humandatasurvey?utm_source=mlst and be the first to see the results and benchmark their practices against the wider community!
cyber•Fund https://cyber.fund/?utm_source=mlst is a founder-led investment firm accelerating the cybernetic economy
Oct SF conference - https://dagihouse.com/?utm_source=mlst - Joscha Bach keynoting(!) + OAI, Anthropic, NVDA,++
Hiring a SF VC Principal: https://talent.cyber.fund/companies/cyber-fund-2/jobs/57674170-ai-investment-principal#content?utm_source=mlst
Submit investment deck: https://cyber.fund/contact?utm_source=mlst
***
They kick things off by looking back on the 20-year journey of the Free Energy Principle. Professor Friston explains it as a fundamental rule for survival: all living things, from a single cell to a human being, are constantly trying to make sense of the world and reduce unpredictability. It’s this drive to minimize surprise that allows things to exist and maintain their structure.
This leads to a bigger question: What does it truly mean to be intelligent? The group debates whether intelligence is everywhere, even in a virus or a plant, or if it requires a certain level of complexity.
Professor Friston introduces the idea of different kinds of things, suggesting that creatures like us, who can model themselves and think about the future, possess a unique and strange kind of agency that sets us apart.
From intelligence, the discussion naturally flows to the even trickier concept of consciousness. Is it the same as intelligence? Professor Friston argues they are different. He explains that consciousness might emerge from deep, layered self-awareness—not just acting, but understanding that you are the one causing your actions and thinking about your place in the world.
They also explore intelligence at different sizes. Is a corporation intelligent? What about the entire planet? Professor Friston suggests there might be a Goldilocks zone for intelligence. It doesnt seem to exist at the super-tiny atomic level or at the massive scale of planets and solar systems, but thrives in the complex middle-ground where we live.
Finally, they tackle one of the most pressing topics of our time: Can we build a truly conscious AI? Professor Friston shares his doubts about whether our current computers are capable of a feat like that. He suggests that genuine consciousness might require a different kind of mortal computation, where the machines physical body and its mind are inseparable, much like in biological creatures.
TRANSCRIPT:
https://app.rescript.info/public/share/FZkF8BO7HMt9aFfu2_q69WGT_ZbYZ1VVkC6RtU3eeOI
TOC:
[00:00:00] Introduction & Retrospective on the Free Energy Principle
[00:09:34] Strange Particles, Agency, and Consciousness
[00:37:45] The Scale of Intelligence: From Viruses to the Biosphere
[01:01:35] Modelling, Boundaries, and Practical Application
[01:21:12] Conclusion
REFS:
Inner Screen [Fields]
https://arxiv.org/abs/2305.02205
Genius [Gleick]
https://www.amazon.com/Genius-Life-Science-Richard-Feynman/dp/0679747044
Epistemic foraging [Bengio]
https://youtu.be/G1ARvwQntAU?feature=shared
Being You [Seth]
https://www.penguin.co.uk/books/111089/being-you-by-seth-anil/9780571337729
Predictive Mind [Hohwy]
https://global.oup.com/academic/product/the-predictive-mind-9780199682737
Hidden Spring [Solms]
https://www.amazon.com/Hidden-Spring-Journey-Source-Consciousness/dp/0393542017
M-Autonomy [Metzinger]
https://www.ingentaconnect.com/content/imp/jcs/2015/00000022/f0020011/art00013
Chinese Room [Searle]
https://plato.stanford.edu/entries/chinese-room/
Mortal computation [Hinton]
https://www.cs.toronto.edu/~hinton/
Intelligence [Krakauer]
https://www.santafe.edu/people/profile/david-krakauer
Plant predictive processing [Calvo/Friston]
https://royalsocietypublishing.org/doi/10.1098/rsif.2017.0096
Basal cognition [Levin]
https://scholar.google.com/citations?user=luouyakAAAAJ&hl=en
Computational boundedness [Wolfram]
https://writings.stephenwolfram.com/2023/12/observer-theory
Extended mind [Clark/Chalmers]
https://tinyurl.com/yy8xbwnm
FEP synchrony [Ramstead]
https://www.youtube.com/watch?v=jsIt2sTB_vo
Markov blankets [Beck]
https://arxiv.org/abs/2502.21217
Object-centric priors [Tenenbaum]
https://arxiv.org/abs/1612.00341
Free-energy principle [Friston]
https://www.nature.com/articles/nrn2787
Path Integrals [Friston et al.]
https://arxiv.org/abs/2210.12761 Your Brain Is a Prediction Machine, Not a Processor — Karl Friston](https://i.ytimg.com/vi/PNYWi996Beg/mqdefault.jpg)


![The Mathematical Foundations of Intelligence [Professor Yi Ma]
What if everything we think we know about AI understanding is wrong? Is compression the key to intelligence? Or is there something more—a leap from memorization to true abstraction?
In this fascinating conversation, we sit down with *Professor Yi Ma*—world-renowned expert in deep learning, IEEE/ACM Fellow, and author of the groundbreaking new book *Learning Deep Representations of Data Distributions*. Professor Ma challenges our assumptions about what large language models actually do, reveals why 3D reconstruction isnt the same as understanding, and presents a unified mathematical theory of intelligence built on just two principles: *parsimony* and *self-consistency*.
**SPONSOR MESSAGES START**
—
Prolific - Quality data. From real people. For faster breakthroughs.
https://www.prolific.com/?utm_source=mlst
—
cyber•Fund https://cyber.fund/?utm_source=mlst is a founder-led investment firm accelerating the cybernetic economy
Hiring a SF VC Principal: https://talent.cyber.fund/companies/cyber-fund-2/jobs/57674170-ai-investment-principal#content?utm_source=mlst
Submit investment deck: https://cyber.fund/contact?utm_source=mlst
—
**END**
NOTE: Based on lower retention we have EDITED out 33:45 of the original interview from near the start - philosophical stuff, an extended analogy comparing DNA evolution to AI development, speculation about where theories come from (Platonism, deductive trees), Norbert Wieners cybernetics history. You can watch the original version on the rescript link or Spotify version.
Key Insights:
*LLMs Dont Understand—They Memorize*
Language models process text (*already* compressed human knowledge) using the same mechanism we use to learn from raw data.
*The Illusion of 3D Vision*
Sora and NeRFs etc that can reconstruct 3D scenes still fail miserably at basic spatial reasoning
*All Roads Lead to Rome*
Why adding noise is *necessary* for discovering structure.
*Why Gradient Descent Actually Works*
Natural optimization landscapes are surprisingly smooth—a blessing of dimensionality
*Transformers from First Principles*
Transformer architectures can be mathematically derived from compression principles
—
INTERACTIVE AI TRANSCRIPT PLAYER w/REFS (ReScript):
https://app.rescript.info/public/share/Z-dMPiUhXaeMEcdeU6Bz84GOVsvdcfxU_8Ptu6CTKMQ
About Professor Yi Ma
Yi Ma is the inaugural director of the School of Computing and Data Science at Hong Kong University and a visiting professor at UC Berkeley.
https://people.eecs.berkeley.edu/~yima/
https://scholar.google.com/citations?user=XqLiBQMAAAAJ&hl=en
https://x.com/YiMaTweets
*Slides from this conversation:*
https://www.dropbox.com/scl/fi/sbhbyievw7idup8j06mlr/slides.pdf?rlkey=7ptovemezo8bj8tkhfi393fh9&dl=0
*Related Talks by Professor Ma:*
- Pursuing the Nature of Intelligence (ICLR): https://www.youtube.com/watch?v=LT-F0xSNSjo
- Earlier talk at Berkeley: https://www.youtube.com/watch?v=TihaCUjyRLM
TIMESTAMPS:
00:00:00 Introduction
00:02:08 The First Principles Book & Research Vision
00:05:21 Two Pillars: Parsimony & Consistency
00:09:50 Evolution vs. Learning: The Compression Mechanism
00:14:37 The Illusion of 3D Understanding: Sora & NeRF
00:20:41 All Roads Lead to Rome: The Role of Noise
00:26:11 All Roads Lead to Rome: The Role of Noise
00:26:29 Benign Non-Convexity: Why Optimization Works
00:32:50 Double Descent & The Myth of Overfitting
00:40:41 Self-Consistency: Closed-Loop Learning
00:47:18 Deriving Transformers from First Principles
00:56:26 Verification & The Kevin Murphy Question
01:00:26 CRATE vs. ViT: White-Box AI & Conclusion
REFERENCES:
Book:
[00:03:04] Learning Deep Representations of Data Distributions
https://ma-lab-berkeley.github.io/deep-representation-learning-book/
Book (Yi Ma):
[00:03:14] An Invitation to 3-D Vision
https://link.springer.com/book/10.1007/978-0-387-21779-6
[00:03:24] Generalized Principal Component Analysis
https://link.springer.com/book/10.1007/978-0-387-87811-9
[00:03:34] High-Dimensional Data Analysis with Low-Dimensional Models
https://book-wright-ma.github.io/
Slide:
[00:44:11] Slide 26: Neuroscience Evidence
https://arxiv.org/abs/2207.04630)
Person:
[00:08:24] Albert Einstein
https://quoteinvestigator.com/2011/05/13/einstein-simple/
[00:56:41] Kevin Murphy
https://probml.github.io/pml-book/book1.html
Paper:
[00:18:09] Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMs
https://arxiv.org/abs/2401.06209
[00:26:13] A Global Geometric Analysis of Maximal Coding Rate Reduction
https://arxiv.org/pdf/2406.01909
[00:47:26] CRATE: White-Box Transformers via Sparse Rate Reduction
https://arxiv.org/abs/2306.01129
[00:55:05] DINOv2: Learning Robust Visual Features without Supervision
https://arxiv.org/abs/2304.07193
[01:00:36] An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (ViT)
https://arxiv.org/abs/2010.11929 The Mathematical Foundations of Intelligence [Professor Yi Ma]](https://i.ytimg.com/vi/QWidx8cYVRs/mqdefault.jpg)
![Why Humans Are Still Powering AI [Sponsored] - Phelim Bradley
Ever wonder where AI models actually get their intelligence? We reveal the dirty secret of Silicon Valley: behind every impressive AI system are thousands of real humans providing crucial data, feedback, and expertise.
Guest: Phelim Bradley, CEO and Co-founder of Prolific
Phelim Bradley runs Prolific, a platform that connects AI companies with verified human experts who help train and evaluate their models. Think of it as a sophisticated marketplace matching the right human expertise to the right AI task - whether thats doctors evaluating medical chatbots or coders reviewing AI-generated software.
Prolific: https://prolific.com/?utm_source=mlst
https://uk.linkedin.com/in/phelim-bradley-84300826
INTERACTIVE TRANSCRIPT:
https://app.rescript.info/public/share/8wsXTkYiczP2rZyc2_I2aylvaxJ-6QJQ2VTu_9woJyQ
The discussion dives into:
**The human data pipeline**: How AI companies rely on human intelligence to train, refine, and validate their models - something rarely discussed openly
**Quality over quantity**: Why paying humans well and treating them as partners (not commodities) produces better AI training data
**The matching challenge**: How Prolific solves the complex problem of finding the right expert for each specific task, similar to matching Uber drivers to riders but with deep expertise requirements
**Future of work**: What it means when human expertise becomes an on-demand service, and why this might actually create more opportunities rather than fewer
**Geopolitical implications**: Why the centralization of AI development in US tech companies should concern Europe and the UK Why Humans Are Still Powering AI [Sponsored] - Phelim Bradley](https://i.ytimg.com/vi/R11ESdfVX64/mqdefault.jpg)