Uploaded November 2024 | Updated September 2026, 1 week ago
Francois Chollet, a prominent AI expert and creator of ARC-AGI, discusses intelligence, consciousness, and artificial intelligence.
Chollet explains that real intelligence isn't about memorizing information or having lots of knowledge - it's about being able to handle new situations effectively. This is why he believes current large language models (LLMs) have "near-zero intelligence" despite their impressive abilities. They're more like sophisticated memory and pattern-matching systems than truly intelligent beings.
***
MLST IS SPONSORED BY TUFA AI LABS!
The current winners of the ARC challenge, MindsAI are part of Tufa AI Labs. They are hiring ML engineers. Are you interested?! Please goto tufalabs.ai
***
He introduced his "Kaleidoscope Hypothesis," which suggests that while the world seems infinitely complex, it's actually made up of simpler patterns that repeat and combine in different ways. True intelligence, he argues, involves identifying these basic patterns and using them to understand new situations.
Chollet also talked about consciousness, suggesting it develops gradually in children rather than appearing all at once. He believes consciousness exists in degrees - animals have it to some extent, and even human consciousness varies with age and circumstances (like being more conscious when learning something new versus doing routine tasks).
On AI safety, Chollet takes a notably different stance from many in Silicon Valley. He views AGI development as a scientific challenge rather than a religious quest, and doesn't share the apocalyptic concerns of some AI researchers. He argues that intelligence itself isn't dangerous - it's just a tool for turning information into useful models. What matters is how we choose to use it.
ARC-AGI Prize:
arcprize.org
Francois Chollet:
https://x.com/fchollet
Shownotes:
dropbox.com/scl/fi/j2068j3hlj8br96pfa7bi/CHOLLET_FINAL.pdf?rlkey=xkbr7tbnrjdl66m246w26uc8k&st=0a4ec4na&dl=0
TOC:
1. Intelligence and Model Building
[00:00:00] 1.1 Intelligence Definition and ARC Benchmark
[00:05:40] 1.2 LLMs as Program Memorization Systems
[00:09:36] 1.3 Kaleidoscope Hypothesis and Abstract Building Blocks
[00:13:39] 1.4 Deep Learning Limitations and System 2 Reasoning
[00:29:38] 1.5 Intelligence vs. Skill in LLMs and Model Building
2. ARC Benchmark and Program Synthesis
[00:37:36] 2.1 Intelligence Definition and LLM Limitations
[00:41:33] 2.2 Meta-Learning System Architecture
[00:56:21] 2.3 Program Search and Occam's Razor
[00:59:42] 2.4 Developer-Aware Generalization
[01:06:49] 2.5 Task Generation and Benchmark Design
3. Cognitive Systems and Program Generation
[01:14:38] 3.1 System 1/2 Thinking Fundamentals
[01:22:17] 3.2 Program Synthesis and Combinatorial Challenges
[01:31:18] 3.3 Test-Time Fine-Tuning Strategies
[01:36:10] 3.4 Evaluation and Leakage Problems
[01:43:22] 3.5 ARC Implementation Approaches
4. Intelligence and Language Systems
[01:50:06] 4.1 Intelligence as Tool vs Agent
[01:53:53] 4.2 Cultural Knowledge Integration
[01:58:42] 4.3 Language and Abstraction Generation
[02:02:41] 4.4 Embodiment in Cognitive Systems
[02:09:02] 4.5 Language as Cognitive Operating System
5. Consciousness and AI Safety
[02:14:05] 5.1 Consciousness and Intelligence Relationship
[02:20:25] 5.2 Development of Machine Consciousness
[02:28:40] 5.3 Consciousness Prerequisites and Indicators
[02:36:36] 5.4 AGI Safety Considerations
[02:40:29] 5.5 AI Regulation Framework
Francois Chollet, a prominent AI expert and creator of ARC-AGI, discusses intelligence, consciousness, and artificial intelligence.
Chollet explains that real intelligence isn't about memorizing information or having lots of knowledge - it's about being able to handle new situations effectively. This is why he believes current large language models (LLMs) have "near-zero intelligence" despite their impressive abilities. They're more like sophisticated memory and pattern-matching systems than truly intelligent beings.
***
MLST IS SPONSORED BY TUFA AI LABS!
The current winners of the ARC challenge, MindsAI are part of Tufa AI Labs. They are hiring ML engineers. Are you interested?! Please goto tufalabs.ai
***
He introduced his "Kaleidoscope Hypothesis," which suggests that while the world seems infinitely complex, it's actually made up of simpler patterns that repeat and combine in different ways. True intelligence, he argues, involves identifying these basic patterns and using them to understand new situations.
Chollet also talked about consciousness, suggesting it develops gradually in children rather than appearing all at once. He believes consciousness exists in degrees - animals have it to some extent, and even human consciousness varies with age and circumstances (like being more conscious when learning something new versus doing routine tasks).
On AI safety, Chollet takes a notably different stance from many in Silicon Valley. He views AGI development as a scientific challenge rather than a religious quest, and doesn't share the apocalyptic concerns of some AI researchers. He argues that intelligence itself isn't dangerous - it's just a tool for turning information into useful models. What matters is how we choose to use it.
ARC-AGI Prize:
arcprize.org
Francois Chollet:
https://x.com/fchollet
Shownotes:
dropbox.com/scl/fi/j2068j3hlj8br96pfa7bi/CHOLLET_FINAL.pdf?rlkey=xkbr7tbnrjdl66m246w26uc8k&st=0a4ec4na&dl=0
TOC:
1. Intelligence and Model Building
[00:00:00] 1.1 Intelligence Definition and ARC Benchmark
[00:05:40] 1.2 LLMs as Program Memorization Systems
[00:09:36] 1.3 Kaleidoscope Hypothesis and Abstract Building Blocks
[00:13:39] 1.4 Deep Learning Limitations and System 2 Reasoning
[00:29:38] 1.5 Intelligence vs. Skill in LLMs and Model Building
2. ARC Benchmark and Program Synthesis
[00:37:36] 2.1 Intelligence Definition and LLM Limitations
[00:41:33] 2.2 Meta-Learning System Architecture
[00:56:21] 2.3 Program Search and Occam's Razor
[00:59:42] 2.4 Developer-Aware Generalization
[01:06:49] 2.5 Task Generation and Benchmark Design
3. Cognitive Systems and Program Generation
[01:14:38] 3.1 System 1/2 Thinking Fundamentals
[01:22:17] 3.2 Program Synthesis and Combinatorial Challenges
[01:31:18] 3.3 Test-Time Fine-Tuning Strategies
[01:36:10] 3.4 Evaluation and Leakage Problems
[01:43:22] 3.5 ARC Implementation Approaches
4. Intelligence and Language Systems
[01:50:06] 4.1 Intelligence as Tool vs Agent
[01:53:53] 4.2 Cultural Knowledge Integration
[01:58:42] 4.3 Language and Abstraction Generation
[02:02:41] 4.4 Embodiment in Cognitive Systems
[02:09:02] 4.5 Language as Cognitive Operating System
5. Consciousness and AI Safety
[02:14:05] 5.1 Consciousness and Intelligence Relationship
[02:20:25] 5.2 Development of Machine Consciousness
[02:28:40] 5.3 Consciousness Prerequisites and Indicators
[02:36:36] 5.4 AGI Safety Considerations
[02:40:29] 5.5 AI Regulation Framework
![Tau Language: The Software Synthesis Future [Sponsored] - Ohad Asor
This sponsored episode features mathematician Ohad Asor discussing logical approaches to AI, focusing on the limitations of machine learning and introducing the Tau language for software development and blockchain tech.
SPONSOR MESSAGES:
***
Tufa AI Labs is a brand new research lab in Zurich started by Benjamin Crouzier focussed on o-series style reasoning and AGI. They are hiring a Chief Engineer and ML engineers. Events in Zurich.
Mathematician Ohad Asor makes the case that machine learning has fundamental theoretical ceilings PAC learning guarantees only probabilistic approximate correctness, and beyond a certain problem complexity, neural nets perform no better than coin tosses. His…
TIMESTAMPS:
00:00:00 Fundamental Limitations of Machine Learning and PAC Learning Theory
00:04:50 Transductive Learning and the Three Curses of Machine Learning
00:08:57 Language, Reality, and AI System Design
00:12:58 Program Synthesis and Formal Verification Approaches
00:21:00 Definability, Computability, and the Halting Problem
00:31:55 Self-Referential Language and Tarskis Influence
00:34:00 Boolean Algebra and Logical Foundations of Tau
00:40:00 SAT Solvers, DPLL/CDCL, and the Revival of Logical AI
00:47:50 Program Synthesis and Specification in the Tau Language
01:00:00 Pointwise Revision and Belief Revision Theory
01:06:00 Quantifier Elimination and Normalization
01:10:30 User Control and Software Governance via Blockchain
01:24:00 Automation, Finance, and the Future of Blockchain Economics
REFERENCES:
Company:
[00:00:47] Tau Language
https://tau.ai/tau-language/
[00:00:47] Tau Language GitHub
https://github.com/IDNI/tau-lang
[01:11:40] Tau Net Blockchain Platform
https://tau.net/
Paper:
[00:03:03] PAC Learning Framework
https://en.wikipedia.org/wiki/Probably_approximately_correct_learning
[00:05:42] Boolean Satisfiability Problem
https://en.wikipedia.org/wiki/Boolean_satisfiability_problem
[00:13:51] Knowledge as Justified True Belief
https://plato.stanford.edu/entries/epistemology/
[00:21:25] Theories and Applications of Boolean Algebras
https://tau.net/Theories-and-Applications-of-Boolean-Algebras-0.29.pdf
[00:26:00] The Halting Problem
https://plato.stanford.edu/entries/turing-machine/#HaltProb
[00:41:40] DPLL and CDCL SAT Solving Algorithms
https://www.cs.princeton.edu/~zkincaid/courses/fall18/readings/SATHandbook-CDCL.pdf
[00:49:20] Tarski Undefinability Theorem
https://plato.stanford.edu/entries/tarski-truth/
[00:50:50] Boolean Algebra Foundations
https://plato.stanford.edu/entries/boolalg-math/
[01:02:27] Belief Revision Theory
https://plato.stanford.edu/entries/logic-belief-revision/
[01:05:30] Quantifier Elimination in Boolean Algebra
https://people.math.wisc.edu/~hkeisler/random.pdf
[01:19:10] Tau Whitepaper
https://tau.net/Whitepaper.pdf
Person:
[00:17:20] Wittgenstein on Limits of Language
https://plato.stanford.edu/entries/wittgenstein/
[00:30:00] Alfred Tarski
https://plato.stanford.edu/entries/tarski/
LINKS:
Full Transcript: https://app.rescript.info/share/dbb6e25a5cde17f66e6847ffdc4ac728
Download PDF transcript: https://app.rescript.info/api/public/sessions/9403107f522d646c/pdf
REFERENCES:
Company:
[00:00:47] Tau Language
https://tau.ai/tau-language/
[00:00:47] Tau Language GitHub
https://github.com/IDNI/tau-lang
[01:11:40] Tau Net Blockchain Platform
https://tau.net/
Paper:
[00:03:03] PAC Learning Framework
https://en.wikipedia.org/wiki/Probably_approximately_correct_learning
[00:05:42] Boolean Satisfiability Problem
https://en.wikipedia.org/wiki/Boolean_satisfiability_problem
[00:13:51] Knowledge as Justified True Belief
https://plato.stanford.edu/entries/epistemology/
[00:21:25] Theories and Applications of Boolean Algebras
https://tau.net/Theories-and-Applications-of-Boolean-Algebras-0.29.pdf
[00:26:00] The Halting Problem
https://plato.stanford.edu/entries/turing-machine/#HaltProb
[00:41:40] DPLL and CDCL SAT Solving Algorithms
https://www.cs.princeton.edu/~zkincaid/courses/fall18/readings/SATHandbook-CDCL.pdf
[00:49:20] Tarski Undefinability Theorem
https://plato.stanford.edu/entries/tarski-truth/
[00:50:50] Boolean Algebra Foundations
https://plato.stanford.edu/entries/boolalg-math/
[01:02:27] Belief Revision Theory
https://plato.stanford.edu/entries/logic-belief-revision/
[01:05:30] Quantifier Elimination in Boolean Algebra
https://people.math.wisc.edu/~hkeisler/random.pdf
[01:19:10] Tau Whitepaper
https://tau.net/Whitepaper.pdf
Person:
[00:17:20] Wittgenstein on Limits of Language
https://plato.stanford.edu/entries/wittgenstein/
[00:30:00] Alfred Tarski
https://plato.stanford.edu/entries/tarski/
GitHub:
https://github.com/IDNI/tau-lang Tau Language: The Software Synthesis Future [Sponsored] - Ohad Asor](https://i.ytimg.com/vi/JVLpxm5jT2s/mqdefault.jpg)
![ImageNet Moment for Reinforcement Learning? [Prof. Jakob Foerster]
SPONSOR MESSAGES:
***
CentML offers competitive pricing for GenAI model deployment, with flexible options to suit a wide range of models, from small to large-scale deployments. Check out their super fast DeepSeek R1 hosting!
https://centml.ai/pricing/
Prof. Jakob Foerster (FLAIR lab, Oxford / Meta AI) and his PhD student Chris Lu make the case that deep reinforcement learning is finally winning the hardware lottery. The core thesis: RL has underperformed not because the ideas are wrong, but because running environments on CPUs while training agents on GPUs created a computational bottleneck that made experimentation slow, expensive, and brittle. JAX-based GPU-native environments now deliver ~4000x speedups, enabling the kind of rapid iteration that made supervised deep learning successful.
Chris Lu explains the technical foundation how JAXs JIT compilation and vmap (vectorized map) allow writing a single environment instance in NumPy-like code and scaling it to millions of parallel copies on GPU. This started from necessity: their lab initially had only Google Colab free-tier compute. The constraint forced them to put environments on GPU for their Model-Free Opponent Shaping paper, and the results were surprisingly effective.
The conversation then shifts to discovered policy optimization. Foersters mirror learning framework provides theoretical grounding for why PPO works, and crucially, lets you parameterize the drift function as a neural network and meta-learn it. Evolution strategies, not gradient-based meta-learning, turned out to be the better optimizer for this a vindication of the bitter lesson. The learned policy optimization function shows intriguing too good to be true behavior: when advantages are very high, it clips more aggressively, as if it has learned skepticism.
The second half covers multi-agent systems, emergent communication, and AI governance. Foerster argues forcefully for open-source AI development and democratic control, drawing analogies to CERN. His position: the biggest alignment challenge is not between AI and humans, but between those who control AI systems and the rest of the population. Concentrated AI development creates fragile single points of failure; distributed development is both safer and more innovative.
REFERENCES:
paper:
[00:03:05] Deep RL Doesnt Work Yet
https://www.alexirpan.com/2018/02/14/rl-hard.html
[00:06:10] JaxMARL
https://arxiv.org/html/2311.10090v5
[00:08:50] M-FOS: Model-Free Opponent Shaping
https://arxiv.org/abs/2205.01447
[00:12:10] Kinetix Physics Simulator
https://arxiv.org/abs/2410.23208
[00:14:42] Mirror Learning Framework
https://arxiv.org/abs/2208.01682
[00:16:30] Discovered Policy Optimisation
https://arxiv.org/abs/2210.05639
[00:28:55] AlphaGo
https://arxiv.org/abs/1712.01815
[00:41:00] Open Source Generative AI
https://arxiv.org/abs/2405.08597
tool:
[00:09:45] JAX Library
https://github.com/jax-ml/jax
[00:49:51] Llama 3
https://ai.meta.com/blog/meta-llama-3/
concept:
[00:24:10] Goodharts Law
https://en.wikipedia.org/wiki/Goodhart%27s_law
LINKS:
Full Transcript: https://app.rescript.info/share/04498ba49b081dbcc254c40ba7b56035
Download PDF transcript: https://app.rescript.info/api/public/sessions/8fe06defb6d2216d/pdf
Prof. Jakob Foerster
https://x.com/j_foerst
https://www.jakobfoerster.com/
University of Oxford Profile:
https://eng.ox.ac.uk/people/jakob-foerster/
REFS
[[00:00:05] ARC Benchmark, Chollet
https://github.com/fchollet/ARC-AGI
[00:09:45] JAX Library, Google Research
https://github.com/jax-ml/jax
[00:25:15] LLM ARChitect, Franzen et al.
https://github.com/da-fr/arc-prize-2024/blob/main/the_architects.pdf ImageNet Moment for Reinforcement Learning? [Prof. Jakob Foerster]](https://i.ytimg.com/vi/Jr_nGkCG3og/mqdefault.jpg)
![Every Definition of Intelligence Is Wrong. Heres Why — Michael Bennett
Dr. Michael Timothy Bennett is a computer scientist whos deeply interested in understanding artificial intelligence, consciousness, and what it means to be alive. Hes known for his provocative paper What the F*** is Artificial Intelligence which challenges conventional thinking about AI and intelligence.
**SPONSOR MESSAGES***
Prolific: Quality data. From real people. For faster breakthroughs.
https://prolific.com/mlst?utm_campaign=98404559-MLST&utm_source=youtube&utm_medium=podcast&utm_content=mb
***
Michael takes us on a journey through some of the biggest questions in AI and consciousness. He starts by exploring what intelligence actually is - settling on the idea that its about adaptation with limited resources (a definition from researcher Pei Wang that he particularly likes).
The discussion ranges from technical AI concepts to philosophical questions about consciousness, with Michael offering fresh perspectives that challenge Silicon Valleys just scale it up approach to AI. He argues that true intelligence isnt just about having more parameters or data - its about being able to adapt efficiently, like biological systems do.
TOC:
1. Introduction & Paper Overview [00:00:00]
2. Definitions of Intelligence [00:02:54]
3. Formal Models (AIXI, Active Inference) [00:07:06]
4. Causality, Abstraction & Embodiment [00:10:45]
5. Computational Dualism & Mortal Computation [00:25:51]
6. Modern AI, AGI Progress & Benchmarks [00:31:30]
7. Hybrid AI Approaches [00:35:00]
8. Consciousness & The Hard Problem [00:39:35]
9. The Diverse Intelligences Summer Institute (DISI) [00:53:20]
10. Living Systems & Self-Organization [00:54:17]
11. Closing Thoughts [01:04:24]
Michaels socials:
https://michaeltimothybennett.com/
https://x.com/MiTiBennett
Transcript:
https://app.rescript.info/public/share/4jSKbcM77Sf6Zn-Ms4hda7C4krRrMcQt0qwYqiqPTPI
References:
Bennett, M.T. What the F*** is Artificial Intelligence
https://arxiv.org/abs/2503.23923
Bennett, M.T. Are Biological Systems More Intelligent Than Artificial Intelligence?
https://arxiv.org/abs/2405.02325
Bennett, M.T. PhD Thesis How To Build Conscious Machines
https://osf.io/preprints/thesiscommons/wehmg_v1
Legg, S. & Hutter, M. (2007). Universal Intelligence: A Definition of Machine Intelligence
Wang, P. Defining Artificial Intelligence - on non-axiomatic reasoning systems (NARS)
Chollet, F. (2019). On the Measure of Intelligence - introduces the ARC benchmark and developer-aware generalization
Hutter, M. (2005). Universal Artificial Intelligence: Sequential Decisions Based on Algorithmic Probability
Chalmers, D. The Hard Problem of Consciousness
Descartes, R. - Cartesian dualism and the pineal gland theory (historical context)
Friston, K. - Free Energy Principle and Active Inference framework
Levin, M. - Work on collective intelligence, cancer as information isolation, and mind blindness
Hinton, G. (2022). The Forward-Forward Algorithm - introduces mortal computation concept
Alexander Ororbia & Friston - Formal treatment of mortal computation
Sutton, R. The Bitter Lesson - on search and learning in AI
Pearl, J. The Book of Why - causal inference and reasoning
Alternative AGI Approaches
Wang, P. - NARS (Non-Axiomatic Reasoning System)
Goertzel, B. - Hyperon system and modular AGI architectures
Benchmarks & Evaluation
Hendrycks, D. - Humanities Last Exam benchmark (mentioned re: saturation)
Filmed at:
Diverse Intelligences Summer Institute (DISI)
https://disi.org/ Every Definition of Intelligence Is Wrong. Heres Why — Michael Bennett](https://i.ytimg.com/vi/K18Gmp2oXIM/mqdefault.jpg)
![AI Isnt Creative [Prof. Kenneth Stanley]
Are the AI models you use today imposters?
Please watch the intro video we did before this: https://www.youtube.com/watch?v=o1q6Hhz0MAg
In this episode, hosts Dr. Tim Scarfe and Dr. Duggar are joined by AI researcher Prof. Kenneth Stanley and MIT PhD student Akash Kumar to discuss their fascinating paper, Questioning Representational Optimism in Deep Learning.
Imagine you ask two people to draw a perfect skull. One is a brilliant artist who understands anatomy, the other is a machine that just traces the image. Both drawings look identical, but the artist understands what a skull is—they know where the mouth is, how the jaw works, and that its symmetrical. The machine just has a tangled mess of lines that happens to form the right picture.
An AI with an elegant representation, has the building blocks to generate truly new ideas.
The Path Is the Goal: As Kenneth Stanley puts it, it matters not just where you get, but how you got there. Two students can ace a math test, but the one who truly understands the concepts—instead of just memorizing formulas—is the one who will go on to make new discoveries.
The show is a mixture of 3 separate recordings we have done, the original Patreon warmup with Tim/Kenneth, the Tim/Keith Steakhouse recorded after the main interview, then the main interview with Kenneth/Akarsh/Keith/Tim. Feel free to skip around. We had to edit this in a rush as we are travelling next week but its reasonably cleaned up.
DUPLICATION NOTE:
There is a little bit of content duplication/overlap in these segments, if you are time-limited and dont want duplication - just watch the main interview from 48 mins
TOC:
00:00:00 Intro: Garbage vs. Amazing Representations
00:05:42 How Good Representations Form
00:11:14 Challenging the Bitter Lesson
00:18:04 AI Creativity & Representation Types
00:22:13 Steakhouse: Critiques & Alternatives
00:28:30 Steakhouse: Key Concepts & Goldilocks Zone
00:39:42 Steakhouse: A Sober View on AI Risk
00:43:46 Steakhouse: The Paradox of Open-Ended Search
00:47:58 Main Interview: Paper Intro & Core Concepts
00:56:44 Main Interview: Deception and Evolvability
01:36:30 Main Interview: Reinterpreting Evolution
01:56:16 Main Interview: Impostor Intelligence
02:11:15 Main Interview: Recommendations for AI Research
REFS:
Questioning Representational Optimism in Deep Learning:
The Fractured Entangled Representation Hypothesis
Akarsh Kumar, Jeff Clune, Joel Lehman, Kenneth O. Stanley
https://arxiv.org/pdf/2505.11581
Kenneth O. Stanley, Joel Lehman
Why Greatness Cannot Be Planned: The Myth of the Objective
https://amzn.to/44xLaXK
Original show with Kenneth from 4 years ago:
https://www.youtube.com/watch?v=lhYGXYeMq_E
Kenneth Stanley is SVP Open Endedness at Lila Sciences
https://x.com/kenneth0stanley
Akarsh Kumar (MIT)
https://akarshkumar.com/
AND... Kenneth is HIRING (this is an OPPORTUNITY OF A LIFETIME!)
Research Engineer: https://job-boards.greenhouse.io/lila/jobs/7890007002
Research Scientist: https://job-boards.greenhouse.io/lila/jobs/8012245002
TRANSCRIPT:
https://app.rescript.info/public/share/yVOfAlH9dwWoRozJGYrDiYSUlMFtRkzFPMW2S-9OQlI AI Isnt Creative [Prof. Kenneth Stanley]](https://i.ytimg.com/vi/KKUKikuV58o/mqdefault.jpg)


![David Hansons Vision for Sentient Robots
MLST is sponsored by Brave:
The Brave Search API covers over 20 billion webpages, built from scratch without Big Tech biases or the recent extortionate price hikes on search API access. Perfect for AI model training and retrieval augmentated generation. Try it now - get 2,000 free queries monthly at http://brave.com/api.
David Hanson, CEO of Hanson Robotics and creator of the humanoid robot Sophia, sits down with Tim Scarfe at AGI-24 to talk about building AI systems that dont just process information but actually care about the world around them.
Hansons background is unusual for a roboticist. He trained across neuroscience, AI, the arts, sculpture, and material science all of which fed into making Sophias facial expressions more lifelike than anything else on the market. His PhD combined aesthetics, cognitive science, and mechanical engineering. The result: robots that people instinctively want to talk to.
The conversation gets philosophically dense quickly. Hanson argues that current LLMs, while useful as cortical prostheses that democratize expertise, fundamentally lack what makes biological intelligence work: drives. Not high-level goal-setting, but the deep, low-level motivation to exist and persist that cells have had since life began. He calls this appreciation the thing that makes an organism actually struggle to survive rather than sit dormant.
This leads to his central thesis: if you want AI with genuine agency, you need to wire in drives analogous to biological ones, not at the high level where they become brittle, but at a low, flexible level where emergence can do the heavy lifting. Hes not talking about copying brains. Hes talking about identifying the core evolutionary principles the desire to live, curiosity, the appreciation of patterns and encoding them in computational systems.
The ethical implications occupy much of the back half. Hanson introduces what he calls existential pattern ethics the idea that moral behavior might be grounded in the fundamental bioinformatics of physics and math, in the tendency of certain patterns to come into existence and persist. This isnt standard AI safety talk. Hes proposing that ethics isnt just about restrictions (dont do this) but about growth, play, and creative exploration. His goal isnt artificial super intelligence alone its super wisdom.
The interview touches on human-AI integration, the risks of technological augmentation widening inequality, democratizing AI globally, and the potential for AI-enhanced mental health tools. Hanson filmed this at AGI-24 and throughout, he walks a line between visionary and pragmatic, acknowledging were still in the tinkering phase while making the case that the tinkering needs to be guided by something deeper than performance benchmarks.
TIMESTAMPS:
00:00:00 Introduction and Sizzle Reel
00:01:48 David Hansons Interdisciplinary Background
00:03:27 Sophia and Human-Robot Social Interaction
00:05:55 Compassion as the Distinguishing Factor
00:09:54 AI as Cortical Prosthesis
00:13:17 Biological Drives as the Foundation for AGI
00:20:34 Creating AI with Genuine Agency
00:23:23 Flexible Low-Level Desires vs Brittle High-Level Goals
00:27:53 Enhancing Humanity Through AI
00:30:14 Existential Pattern Ethics
00:35:35 Morality Beyond Restrictions
00:38:07 Democratizing AI Technologies Globally
00:43:37 Human-AI Integration and Identity
00:50:03 Technological Augmentation, Inequality, and Corporate Ethics
REFERENCES:
reference:
[00:00:00] AGI-24 Conference
https://agi-conference.org/
[00:01:48] Bina48 Robot
https://en.wikipedia.org/wiki/Bina48
[00:03:27] Sophia the Robot
https://www.youtube.com/watch?v=9u1O954cMmE
[00:03:27] Eusociality in Human Cognition
https://en.wikipedia.org/wiki/Eusociality
[00:43:37] Integrated Information Theory (IIT)
https://en.wikipedia.org/wiki/Integrated_information_theory
person:
[00:01:48] David Hanson - Hanson Robotics
https://www.hansonrobotics.com/david-hanson/
[00:43:37] Susan Schneider - Artificial You
https://en.wikipedia.org/wiki/Susan_Schneider
book:
[00:05:55] Philip K. Dick - Do Androids Dream of Electric Sheep?
https://en.wikipedia.org/wiki/Do_Androids_Dream_of_Electric_Sheep%3F
LINKS:
Full Transcript: https://app.rescript.info/share/16daa6558770b8fbf3cd9b871a181ba2
Download PDF transcript: https://app.rescript.info/api/public/sessions/ec445a79d5f896dd/pdf David Hansons Vision for Sentient Robots](https://i.ytimg.com/vi/LFCIEhlsozU/mqdefault.jpg)

![The Real Reason Huge AI Models Actually Work [Prof. Andrew Wilson]
Why can billion-parameter models perform so well without catastrophically overfitting? The answer lies in the mysterious simplicity bias that emerges at scale, a core concept of the double descent phenomenon.
Professor Andrew Wilson from NYU explains why many common-sense ideas in artificial intelligence might be wrong. For decades, the rule of thumb in machine learning has been to fear complexity. The thinking goes: if your model has too many parameters (is too complex) for the amount of data you have, it will overfit by essentially memorizing the data instead of learning the underlying patterns. This leads to poor performance on new, unseen data. This is known as the classic bias-variance trade-off i.e. a balancing act between a model thats too simple and one thats too complex.
**SPONSOR MESSAGES**
—
Tufa AI Labs is an AI research lab based in Zurich. **They are hiring ML research engineers!**
This is a once in a lifetime opportunity to work with one of the best labs in Europe
Contact Benjamin Crouzier - https://tufalabs.ai/
—
Take the Prolific human data survey - https://www.prolific.com/humandatasurvey?utm_source=mlst and be the first to see the results and benchmark their practices against the wider community!
—
cyber•Fund https://cyber.fund/?utm_source=mlst is a founder-led investment firm accelerating the cybernetic economy
Oct SF conference - https://dagihouse.com/?utm_source=mlst - Joscha Bach keynoting(!) + OAI, Anthropic, NVDA,++
Hiring a SF VC Principal: https://talent.cyber.fund/companies/cyber-fund-2/jobs/57674170-ai-investment-principal#content?utm_source=mlst
Submit investment deck: https://cyber.fund/contact?utm_source=mlst
—
Description Continued:
Professor Wilson challenges this fundamental belief (fearing complexity). He makes a few surprising points:
**Bigger Can Be Better**: massive models dont just get more flexible; they also develop a stronger simplicity bias. So, if your model is overfitting, the solution might paradoxically be to make it even bigger.
**The Bias-Variance Trade-off is a Misnomer**: Wilson claims you dont actually have to trade one for the other. You can have a model that is incredibly expressive and flexible while also being strongly biased toward simple solutions. He points to the double descent phenomenon, where performance first gets worse as models get more complex, but then surprisingly starts getting better again.
**Honest Beliefs and Bayesian Thinking**: His core philosophy is that we should build models that honestly represent our beliefs about the world. We believe the world is complex, so our models should be expressive. But we also believe in Occams razor—that the simplest explanation is often the best. He champions Bayesian methods, which naturally balance these two ideas through a process called marginalization, which he describes as an automatic Occams razor.
TOC:
[00:00:00] Introduction and Thesis
[00:04:19] Challenging Conventional Wisdom
[00:11:17] The Philosophy of a Scientist-Engineer
[00:16:47] Expressiveness, Overfitting, and Bias
[00:28:15] Understanding, Compression, and Kolmogorov Complexity
[01:05:06] The Surprising Power of Generalization
[01:13:21] The Elegance of Bayesian Inference
[01:33:02] The Geometry of Learning
[01:46:28] Practical Advice and The Future of AI
Prof. Andrew Gordon Wilson:
https://x.com/andrewgwils
https://cims.nyu.edu/~andrewgw/
https://scholar.google.com/citations?user=twWX2LIAAAAJ&hl=en
https://www.youtube.com/watch?v=Aja0kZeWRy4
https://www.youtube.com/watch?v=HEp4TOrkwV4
TRANSCRIPT:
https://app.rescript.info/public/share/H4Io1Y7Rr54MM05FuZgAv4yphoukCfkqokyzSYJwCK8
REFS:
Deep Learning is Not So Mysterious or Different [Andrew Gordon Wilson]
https://arxiv.org/abs/2503.02113
Bayesian Deep Learning and a Probabilistic Perspective of Generalization [Andrew Gordon Wilson, Pavel Izmailov]
https://arxiv.org/abs/2002.08791
Compute-Optimal LLMs Provably Generalize Better With Scale [Marc Finzi, Sanyam Kapoor, Diego Granziol, Anming Gu, Christopher De Sa, J. Zico Kolter, Andrew Gordon Wilson]
https://arxiv.org/abs/2504.15208 The Real Reason Huge AI Models Actually Work [Prof. Andrew Wilson]](https://i.ytimg.com/vi/M-jTeBCEGHc/mqdefault.jpg)
![What If Intelligence Didnt Evolve? It Was There From the Start! - Blaise Agüera y Arcas
Blaise Agüera y Arcas presenting at ALife 2025 — the most technically detailed public walkthrough of the ideas in his *What is Life?* and *What is Intelligence?* books that weve come across.
He covers the BFF experiments (self-replicating programs emerging spontaneously from random noise), the mathematical framework connecting Lotka-Volterra population dynamics with Smoluchowski coagulation, eigenvalue analysis of cooperation matrices, and his central claim that symbiogenesis — not mutation — is the primary engine of evolutionary novelty.
The experimental results are genuinely striking: complex self-replicating code arising from random byte strings with zero mutation, a sharp phase transition that looks like gelation, and a proof that blocking deep symbiogenetic ancestry trees prevents the transition entirely.
A few things worth flagging for critical viewers:
— The substrate is more carefully engineered than the framing sometimes suggests. The choice of language, tape length, interaction protocol, and step limits all shape what emerges. Their own SUBLEQ counterexample (where self-replicators *dont* arise despite being theoretically possible) highlights that these design choices matter substantially — and a general theory of which substrates support this transition is still missing.
— The leap from self-replicating programs on fixed-length tapes to life was computational and intelligent from the start involves significant philosophical extrapolation beyond what the experiments directly demonstrate.
— The Bedau et al. (2000) open problems paper he references at the start actually sets a higher bar for Challenge 3.2 than BFF currently meets: it asks that the internal organization of these organisms and the boundaries separating them from their environment arise and be sustained through the activities of lower-level primitives — whereas BFFs tape boundaries are fixed by design, not emergent.
TIMESTAMPS:
00:00:00 Introduction: From Noise to Programs & ALife History
00:03:15 Defining Life: Function as the Spirit
00:05:45 Von Neumanns Insight: Life is Embodied Computation
00:09:15 Physics of Computation: Irreversibility & Fallacies
00:15:00 The BFF Experiment: Spontaneous Generation of Code
00:23:45 The Mystery: Complexity Growth Without Mutation
00:27:00 Symbiogenesis: The Engine of Novelty
00:33:15 Mathematical Proof: Blocking Symbiosis Stops Life
00:40:15 Evolutionary Implications: Its Symbiogenesis All The Way Down
00:44:30 Intelligence as Modeling Others
00:46:49 Q&A: Levels of Abstraction & Definitions
REFERENCES:
Paper:
[00:01:16] Open Problems in Artificial Life
https://direct.mit.edu/artl/article/6/4/363/2354/Open-Problems-in-Artificial-Life
[00:09:30] When does a physical system compute?
https://arxiv.org/abs/1309.7979
[00:15:00] Computational Life
https://arxiv.org/abs/2406.19108
[00:27:30] On the Origin of Mitosing Cells
https://pubmed.ncbi.nlm.nih.gov/11541392/
[00:42:00] The Major Evolutionary Transitions
https://www.nature.com/articles/374227a0
[00:44:00] The ARC gene
https://www.nih.gov/news-events/news-releases/memory-gene-goes-viral
Person:
[00:05:45] Alan Turing
https://plato.stanford.edu/entries/turing/
[00:07:30] John von Neumann
https://en.wikipedia.org/wiki/John_von_Neumann
[00:11:15] Hector Zenil
https://hectorzenil.net/
[00:12:00] Robert Sapolsky
https://profiles.stanford.edu/robert-sapolsky
[00:29:30] Marian Smoluchowski
https://en.wikipedia.org/wiki/Marian_Smoluchowski
Book:
[00:06:15] What is Life?
https://mitpress.mit.edu/9780262554091/what-is-life/
[00:19:45] What is Life? How Chemistry Becomes Biology
https://amazon.com/dp/0199641013
Technical Concept:
[00:15:45] Brainfuck
https://esolangs.org/wiki/Brainfuck
LINKS:
RESCRIPT: https://app.rescript.info/public/share/ff7gb6HpezOR3DF-gr9-rCoMFzzEgUjLQK6voV5XVWY What If Intelligence Didnt Evolve? It Was There From the Start! - Blaise Agüera y Arcas](https://i.ytimg.com/vi/M2iX6HQOoLg/mqdefault.jpg)
![ARC Prize Version 2 Launch Video! [Francois Chollet, Mike Knoop]
Francois Chollet and Mike Knoop join Tim Scarfe to announce ARC-AGI 2 and the ARC Prize 2025 contest. The new benchmark has been human-calibrated with 400 participants and adversarially designed so that frontier reasoning models score in the single digits, while every task remains solvable by at least two humans. The conversation covers the story behind testing OpenAI o3 on ARC v1 (where it scored 75-85%), what those results reveal about fluid intelligence versus brute-force capability, and why Chollet considers o3 the first model with genuine if limited fluid intelligence. Technical discussion ranges from chain-of-thought reasoning as natural language program synthesis, to the exponential failure modes of current reasoning systems on spatially complex tasks, to the deeper question of whether intelligence is best understood as a binary category or a spectrum of recombination depth. Chollet argues that intelligence is fundamentally about efficiency of knowledge acquisition and adaptation, not raw capability, and that ARC-AGI 2 is designed to measure exactly this distinction.
SPONSOR MESSAGES:
***
Tufa AI Labs is a brand new research lab in Zurich started by Benjamin Crouzier focussed on o-series style reasoning and AGI. They are hiring a Chief Engineer and ML engineers. Events in Zurich.
REFERENCES:
Paper:
[00:00:15] On the Measure of Intelligence
https://arxiv.org/abs/1911.01547
[00:12:50] OpenAI o3 Performance on ARC v1
https://arcprize.org/blog/oai-o3-pub-breakthrough
[00:18:30] Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
https://arxiv.org/abs/2201.11903
[00:26:05] ARC Prize 2024: Technical Report
https://arxiv.org/abs/2412.04604
[00:48:57] The Bitter Lesson
http://www.incompleteideas.net/IncIdeas/BitterLesson.html
[00:53:30] Decoding Strategies in Neural Text Generation
https://www.mdpi.com/2078-2489/12/9/355/pdf
Organization:
[00:06:45] ARC Prize Foundation
https://arcprize.org/
LINKS:
Full Transcript: https://app.rescript.info/share/19ed0e8921636ce804d8780e6b03f67d
Download PDF transcript: https://app.rescript.info/api/public/sessions/302bc045019e056a/pdf ARC Prize Version 2 Launch Video! [Francois Chollet, Mike Knoop]](https://i.ytimg.com/vi/M3b59lZYBW8/mqdefault.jpg)