Uploaded April 2025 | Updated September 2026, 1 week ago
Jeff is CEO of Noumenal Labs, Inc.
noumenal.ai
Machine Learning Street Talk
|
Separating Beliefs from Rewards (Dr. Jeff Beck)
🔇 TAP TO UNMUTE
![The Universal Hierarchy of Life - Prof. Chris Kempes [SFI]](https://i.ytimg.com/vi/iwClZ-7OweY/mqdefault.jpg "The Universal Hierarchy of Life - Prof. Chris Kempes [SFI]
What is life? - asks Chris Kempes, a professor at the Santa Fe Institute.
Chris explains that scientists are moving beyond a purely Earth-based, biological view and are searching for a universal theory of life that could apply to anything, anywhere in the universe. He proposes that things we dont normally consider alive—like human culture, language, or even artificial intelligence; could be seen as life forms existing on different substrates.
To understand this, Chris presents a fascinating three-level framework:
- Materials: The physical stuff life is made of. He argues this could be incredibly diverse across the universe, and we shouldnt expect alien life to share our biochemistry.
- Constraints: The universal laws of physics (like gravity or diffusion) that all life must obey, regardless of what its made of. This is where different life forms start to look more similar.
- Principles: At the highest level are abstract principles like evolution and learning. Chris suggests these computational or optimization rules are what truly define a living system.
A key idea is convergence – using the example of the eye. Its such a complex organ that youd think it evolved only once. However, eyes evolved many separate times across different species. This is because the physics of light provides a clear target, and evolution found similar solutions to the problem of seeing, even with different starting materials.
**SPONSOR MESSAGES**
—
Prolific - Quality data. From real people. For faster breakthroughs.
https://www.prolific.com/?utm_source=mlst
—
Check out NotebookLM from Google here - https://notebooklm.google.com/ - it’s really good for doing research directly from authoritative source material, minimising hallucinations.
—
cyber•Fund https://cyber.fund/?utm_source=mlst is a founder-led investment firm accelerating the cybernetic economy
Hiring a SF VC Principal: https://talent.cyber.fund/companies/cyber-fund-2/jobs/57674170-ai-investment-principal#content?utm_source=mlst
Submit investment deck: https://cyber.fund/contact?utm_source=mlst
—
Prof. Chris Kempes:
https://www.santafe.edu/people/profile/chris-kempes
TRANSCRIPT:
https://app.rescript.info/public/share/Y2cI1i0nX iuZitvlguHvaVLQTwPX1Y_E1EHxV0i9I
TOC:
00:00:00 - Introduction to Chris Kempes and the Santa Fe Institute
00:02:28 - The Three Cultures of Science
00:05:08 - What Makes a Good Scientific Theory?
00:06:50 - The Universal Theory of Life
00:09:40 - The Role of Material in Life
00:12:50 - A Hierarchy for Understanding Life
00:13:55 - How Life Diversifies and Converges
00:17:53 - Adaptive Processes and Defining Life
00:19:28 - Functionalism, Memes, and Phylogenies
00:22:58 - Convergence at Multiple Levels
00:25:45 - The Possibility of Simulating Life
00:28:16 - Intelligence, Parasitism, and Spectrums of Life
00:32:39 - Phase Changes in Evolution
00:36:16 - The Separation of Matter and Logic
00:37:21 - Assembly Theory and Quantifying Complexity
REFS:
Developing a predictive science of the biosphere requires the integration of scientific cultures [Kempes et al]
https://www.pnas.org/doi/10.1073/pnas.2209196121
Seeing with an extra sense (“Dangerous prediction”) [Rob Phillips]
https://www.sciencedirect.com/science/article/pii/S0960982224009035
The Multiple Paths to Multiple Life [Christopher P. Kempes & David C. Krakauer]
https://link.springer.com/article/10.1007/s00239-021-10016-2
The Information Theory of Individuality [David Krakauer et al]
https://arxiv.org/abs/1412.2447
Minds, Brains and Programs [Searle]
https://home.csulb.edu/~cwallis/382/readings/482/searle.minds.brains.programs.bbs.1980.pdf
The error threshold
https://www.sciencedirect.com/science/article/abs/pii/S0168170204003843
Assembly theory and its relationship with computational complexity [Kempes et al]
https://arxiv.org/abs/2406.12176")
![Explosive AI Timeline Predictions [Gary Marcus, Daniel Kokotajlo, Dan Hendrycks]](https://i.ytimg.com/vi/j13ySJLvdOc/mqdefault.jpg "Explosive AI Timeline Predictions [Gary Marcus, Daniel Kokotajlo, Dan Hendrycks]
What if the most powerful technology in human history is being built by people who openly admit they dont trust each other? In this explosive 2-hour debate, three AI experts pull back the curtain on the shocking psychology driving the race to Artificial General Intelligence—and why the people building it might be the biggest threat of all. Kokotajlo predicts AGI by 2028 based on compute scaling trends. Marcus argues we havent solved basic cognitive problems from his 2001 research. The stakes? If Kokotajlo is right and Marcus is wrong about safety progress, humanity may have already lost control.
Sponsor messages:
Google Gemini: Google Gemini features Veo3, a state-of-the-art AI video generation model in the Gemini app. Sign up at https://gemini.google.com
Tufa AI Labs are hiring for ML Engineers and a Chief Scientist in Zurich/SF. They are top of the ARCv2 leaderboard!
https://tufalabs.ai/
Guest Powerhouse
Gary Marcus - Cognitive scientist, author of Taming Silicon Valley, and AIs most prominent skeptic whos been warning about the same fundamental problems for 25 years (https://garymarcus.substack.com/)
Daniel Kokotajlo - Former OpenAI insider turned whistleblower who reveals the disturbing rationalizations of AI lab leaders in his viral AI 2027 scenario (https://ai-2027.com/)
Dan Hendrycks - Director of the Center for AI Safety who created the benchmarks used to measure AI progress and argues we have only years, not decades, to prevent catastrophe (https://danhendrycks.com/)
Transcript: http://app.rescript.info/public/share/tEcx4UkToi-2jwS1cN51CW70A4Eh6QulBRxDILoXOno
TOC:
Introduction: The AI Arms Race
00:00:04 - The Danger of Automated AI R&D
00:00:43 - The Rationalization: If we dont, someone else will
00:01:56 - Sponsor Reads (Tufa AI Labs & Google Gemini)
00:02:55 - Guest Introductions
The Philosophical Stakes
00:04:13 - What is the Positive Vision for AGI?
00:07:00 - The Abundance Scenario: Superintelligent Economy
00:09:06 - Differentiating AGI and Superintelligence (ASI)
00:11:41 - Sam Altman: A Decade in a Month
00:14:47 - Economic Inequality & The UBI Problem
Policy and Red Lines
00:17:13 - The Pause Letter: Stopping vs. Delaying AI
00:20:03 - Defining Three Concrete Red Lines for AI Development
00:25:24 - Racing Towards Red Lines & The Myth of Durable Advantage
00:31:15 - Transparency and Public Perception
00:35:16 - The Rationalization Cascade: Why AI Labs Race to Win
Forecasting AGI: Timelines and Methodologies
00:42:29 - The Case for Short Timelines (Median 2028)
00:47:00 - Scaling Limits: Compute, Data, and Money
00:49:36 - Forecasting Models: Bio-Anchors and Agentic Coding
00:53:15 - The 10^45 FLOP Thought Experiment
The Great Debate: Cognitive Gaps vs. Scaling
00:58:41 - Gary Marcuss Counterpoint: The Unsolved Problems of Cognition
01:00:46 - Current AI Cant Play Chess Reliably
01:08:23 - Can Tools and Neurosymbolic AI Fill the Gaps?
01:16:13 - The Multi-Dimensional Nature of Intelligence
01:24:26 - The Benchmark Debate: Data Contamination and Reliability
01:31:15 - The Superhuman Coder Milestone Debate
01:37:45 - The Driverless Car Analogy
The Alignment Problem
01:39:45 - Has Any Progress Been Made on Alignment?
01:42:43 - Fairly Reasonably Scares the Sh*t Out of Me
01:46:30 - Distinguishing Model vs. Process Alignment
Scenarios and Conclusions
01:49:26 - Garys Alternative Scenario: The Neurosymbolic Shift
01:53:35 - Will AI Become Jeff Dean?
01:58:41 - Takeoff Speeds and Exceeding Human Intelligence
02:03:19 - Final Disagreements and Closing Remarks
REFS:
Gary Marcus (2001) - The Algebraic Mind
https://mitpress.mit.edu/9780262632683/the-algebraic-mind/
00:59:00
Gary Marcus & Ernest Davis (2019) - Rebooting AI
https://www.amazon.co.uk/Rebooting-AI-Building-Artificial-Intelligence-ebook/dp/B07MYLGQLB
01:31:59
Gary Marcus (2024) - Taming Silicon Valley
https://www.amazon.co.uk/Taming-Silicon-Valley-Ensure-Works-ebook/dp/B0CQWWM94N
00:03:01
Ajeya Cotra (2020) - Forecasting TAI with Biological Anchors
https://www.alignmentforum.org/posts/KrJfoZzpSDpnrv9va/draft-report-on-ai-timelines
00:53:15
Daniel Kokotajlo (2021) - What 2026 looks like
https://www.lesswrong.com/posts/6Xgy6CAf2jqHhynHL/what-2026-looks-like
00:55:00
Dan Hendrycks et al. (2021) - Measuring Massive Multitask Language Understanding (MMLU)
https://arxiv.org/abs/2009.03300
00:03:48
Dan Hendrycks et al. (2021) - Measuring Mathematical Problem Solving With the MATH Dataset
https://arxiv.org/abs/2103.03874
00:03:48
Aitor Lewkowycz, Anders Andreassen et al. (2022) - Solving Quantitative Reasoning Problems with Language Models (Minerva)
https://arxiv.org/abs/2206.14858
01:21:45
Apple Research (2024) - GSM-Symbolic/The Illusion of Thinking
https://arxiv.org/abs/2410.05229
https://machinelearning.apple.com/research/illusion-of-thinking
00:59:15")
