Uploaded February 2024 | Updated September 2026, 1 week ago
Professor Kenneth Stanley has just launched a brand new type of social network without any popularity contest of likes, which he calls a "Serendipity network".
MLST public Discord: discord.gg/machine-learning-street-talk-mlst-937356144060530778
Please support our work on Patreon - get access to interviews months early, private Patreon, networking, exclusive content and regular calls with Tim and Keith.
patreon.com/mlst
Get Maven here:
heymaven.com
Kenneth:
twitter.com/kenneth0stanley
kenstanley.net/home
Host - Tim Scarfe:
linkedin.com/in/ecsquizor
mlst.ai
Original MLST show with Kenneth:
youtube.com/watch?v=lhYGXYeMq_E
TOC:
00:00 - Introduction
02:14 - Sam Altman Story
04:43 - What is Maven?
16:08 - Cofounders
16:59 - WGCNBP
23:00 - Link to RL
27:45 - Natural Plausibility / How Far Can We Go?
33:59 - Jim Fan
36:47 - Picbreeder
43:54 - Language Game
49:40 - Creativity
58:15 - Why did Kenneth do Maven?
1:10:15 - Agency + Politics Lens
1:12:06 - Agency Deprivation on Left and Right
1:17:47 - The Ultimate Divergent System Is the World
1:22:04 - Why is high agency social good?
1:25:27 - Agency or Deceptive Objective (FB)
1:31:20 - YouTube Debasement
1:38:21 - The Space of Creativity, Measuring It
1:40:32 - Market System / Profit
1:43:14 - Agency to Power Seeking
1:48:01 - Is Serendipity == Power Seeking?
1:55:19 - Morality
1:59:24 - Accounting for Our Intrinsic Drive to Explore (+Friston)
2:05:27 - Pure Exploration? Any Planning?
2:07:55 - Most Social Media Users Consumer
2:11:24 - Echo Chambers
2:13:47 - Is Social Media Broken? Maybe Edit, A Bit Like WHY Question
2:18:02 - AI X-risk
2:25:03 - Agency Interpretation of Kenneth's work
2:35:23 - Status Game
2:47:16 - Facebook
2:54:26 - Cold Start Problem
3:03:44 - Convergence from Other Platforms (Maven)
3:06:29 - Objectives Creeping in Later
3:08:15 - Will Zuck Copy?
3:09:51 - Panopticon / Social Identity
Professor Kenneth Stanley has just launched a brand new type of social network without any popularity contest of likes, which he calls a "Serendipity network".
MLST public Discord: discord.gg/machine-learning-street-talk-mlst-937356144060530778
Please support our work on Patreon - get access to interviews months early, private Patreon, networking, exclusive content and regular calls with Tim and Keith.
patreon.com/mlst
Get Maven here:
heymaven.com
Kenneth:
twitter.com/kenneth0stanley
kenstanley.net/home
Host - Tim Scarfe:
linkedin.com/in/ecsquizor
mlst.ai
Original MLST show with Kenneth:
youtube.com/watch?v=lhYGXYeMq_E
TOC:
00:00 - Introduction
02:14 - Sam Altman Story
04:43 - What is Maven?
16:08 - Cofounders
16:59 - WGCNBP
23:00 - Link to RL
27:45 - Natural Plausibility / How Far Can We Go?
33:59 - Jim Fan
36:47 - Picbreeder
43:54 - Language Game
49:40 - Creativity
58:15 - Why did Kenneth do Maven?
1:10:15 - Agency + Politics Lens
1:12:06 - Agency Deprivation on Left and Right
1:17:47 - The Ultimate Divergent System Is the World
1:22:04 - Why is high agency social good?
1:25:27 - Agency or Deceptive Objective (FB)
1:31:20 - YouTube Debasement
1:38:21 - The Space of Creativity, Measuring It
1:40:32 - Market System / Profit
1:43:14 - Agency to Power Seeking
1:48:01 - Is Serendipity == Power Seeking?
1:55:19 - Morality
1:59:24 - Accounting for Our Intrinsic Drive to Explore (+Friston)
2:05:27 - Pure Exploration? Any Planning?
2:07:55 - Most Social Media Users Consumer
2:11:24 - Echo Chambers
2:13:47 - Is Social Media Broken? Maybe Edit, A Bit Like WHY Question
2:18:02 - AI X-risk
2:25:03 - Agency Interpretation of Kenneth's work
2:35:23 - Status Game
2:47:16 - Facebook
2:54:26 - Cold Start Problem
3:03:44 - Convergence from Other Platforms (Maven)
3:06:29 - Objectives Creeping in Later
3:08:15 - Will Zuck Copy?
3:09:51 - Panopticon / Social Identity
![Google Researcher Shows Life Emerges From Code [Blaise Agüera y Arcas]](https://i.ytimg.com/vi/rMSEqJ_4EBk/mqdefault.jpg "Google Researcher Shows Life Emerges From Code [Blaise Agüera y Arcas]
Blaise Agüera y Arcas explores some mind-bending ideas about what intelligence and life really are—and why they might be more similar than we think (filmed at ALIFE conference, 2025 - https://2025.alife.org/ ).
Life and intelligence are both fundamentally computational (he says). From the very beginning, living things have been running programs. Your DNA? Its literally a computer program, and the ribosomes in your cells are tiny universal computers building you according to those instructions.
**SPONSOR MESSAGES**
—
Prolific - Quality data. From real people. For faster breakthroughs.
https://www.prolific.com/?utm_source=mlst
—
cyber•Fund https://cyber.fund/?utm_source=mlst is a founder-led investment firm accelerating the cybernetic economy
Oct SF conference - https://dagihouse.com/?utm_source=mlst - Joscha Bach keynoting(!) + OAI, Anthropic, NVDA,++
Hiring a SF VC Principal: https://talent.cyber.fund/companies/cyber-fund-2/jobs/57674170-ai-investment-principal#content?utm_source=mlst
Submit investment deck: https://cyber.fund/contact?utm_source=mlst
—
Blaise argues that there is more to evolution than random mutations (like most people think). The secret to increasing complexity is *merging* i.e. when different organisms or systems come together and combine their histories and capabilities.
Blaise describes his BFF experiment where random computer code spontaneously evolved into self-replicating programs, showing how purpose and complexity can emerge from pure randomness through computational processes.
https://en.wikipedia.org/wiki/Blaise_Ag%C3%BCera_y_Arcas
https://x.com/blaiseaguera?lang=en
TRANSCRIPT:
https://app.rescript.info/public/share/VX7Gktfr3_wIn4Bj7cl9StPBO1MN4R5lcJ11NE99hLg
TOC:
00:00:00 Introduction - New book What is Intelligence?
00:01:45 Life as computation - Von Neumanns insights
00:12:00 BFF experiment - How purpose emerges
00:26:00 Symbiogenesis and evolutionary complexity
00:40:00 Functionalism and consciousness
00:49:45 AI as part of collective human intelligence
00:57:00 Comparing AI and human cognition
REFS:
What is intelligence [Blaise Agüera y Arcas]
https://whatisintelligence.antikythera.org/ [Read free online, interactive rich media]
https://mitpress.mit.edu/9780262049955/what-is-intelligence/ [MIT Press]
Large Language Models and Emergence: A Complex Systems Perspective
https://arxiv.org/abs/2506.11135
Our first Noam Chomsky MLST interview
https://www.youtube.com/watch?v=axuGfh4UR9Q
Chance and Necessity [Jacques Monod]
https://monoskop.org/images/9/99/Monod_Jacques_Chance_and_Necessity.pdf
Wonderful Life: The Burgess Shale and the History of Nature [Stephen Jay Gould]
https://www.amazon.co.uk/Wonderful-Life-Burgess-Nature-History/dp/0099273454
The major evolutionary transitions [E Szathmáry, J M Smith]
https://wiki.santafe.edu/images/0/0e/Szathmary.MaynardSmith_1995_Nature.pdf
Dont Sleep, There Are Snakes: Life and Language in the Amazonian Jungle [Dan Everett]
https://www.amazon.com/Dont-Sleep-There-Are-Snakes/dp/0307386120
The Nature of Technology: What It Is and How It Evolves [W. Brian Arthur]
https://www.amazon.com/Nature-Technology-What-How-Evolves-ebook/dp/B002RI9W16/
The MANIAC [Benjamin Labatut]
https://www.amazon.com/MANIAC-Benjam%C3%ADn-Labatut/dp/1782279814
When We Cease to Understand the World [Benjamin Labatut]
https://www.amazon.com/When-We-Cease-Understand-World/dp/1681375664/
The Boys in the Boat [Dan Brown]
https://www.amazon.com/Boys-Boat-Americans-Berlin-Olympics/dp/0143125478
How something can be said about Telling More Than We Can Know [Petter Johansson] (Split brain)
https://www.lucs.lu.se/fileadmin/user_upload/lucs/2011/01/Johansson-et-al.-2006-How-Something-Can-Be-Said-About-Telling-More-Than-We-Can-Know.pdf
If Anyone Builds It, Everyone Dies [Eliezer Yudkowsky, Nate Soares]
https://www.amazon.com/Anyone-Builds-Everyone-Dies-Superhuman/dp/0316595640
The science of cycology: Failures to understand how everyday objects work [Rebeca Lawson]
https://link.springer.com/content/pdf/10.3758/bf03195929.pdf
SEVA: Leveraging sketches to evaluate alignment between human and machine visual abstraction [Kushin Mukherjee, Judith Fan et al]
https://arxiv.org/pdf/2312.03035
Brain-Score [Martin Schrimpf]
https://www.biorxiv.org/content/10.1101/407007v1.full.pdf
Feature Visualization [Chris Olah]
https://distill.pub/2017/feature-visualization/
THE REVERSAL CURSE [Lukas Berglund]
https://arxiv.org/pdf/2309.12288")
![Why High Benchmark Scores Don’t Mean Better AI [SPONSORED]](https://i.ytimg.com/vi/rqiC9a2z8Io/mqdefault.jpg "Why High Benchmark Scores Don’t Mean Better AI [SPONSORED]
Is a car that wins a Formula 1 race the best choice for your morning commute? Probably not. In this sponsored deep dive with Prolific, we explore why the same logic applies to Artificial Intelligence. While models are currently shattering records on technical exams, they often fail the most important test of all: *the human experience.*
Why High Benchmark Scores Don’t Mean Better AI
Joining us are *Andrew Gordon* (Staff Researcher in Behavioral Science) and *Nora Petrova* (AI Researcher) from *Prolific* . They reveal the hidden flaws in how we currently rank AI and introduce a more rigorous, humane way to measure whether these models are actually helpful, safe, and relatable for real people.
Key Insights in This Episode:
* *The F1 Car Analogy:* Andrew explains why a model that excels at the Humanities Last Exam might be a nightmare for daily use. Technical benchmarks often ignore the nuances of human communication and adaptability.
* *The Wild West of AI Safety:* As users turn to AI for sensitive topics like mental health, Nora highlights the alarming lack of oversight and the thin veneer of safety training—citing recent controversial incidents like Grok-3’s Mecha Hitler.
* *Fixing the Leaderboard Illusion:* The team critiques current popular rankings like Chatbot Arena, discussing how anonymous, unstratified voting can lead to biased results and how companies can game the system.
* *The Xbox Secret to AI Ranking:* Discover how Prolific uses *TrueSkill* —the same algorithm Microsoft developed for Xbox Live matchmaking—to create a fairer, more statistically sound leaderboard for LLMs.
* *The Personality Gap:* Early data from the *Humane Leaderboard* suggests that while AI is getting smarter, it is actually performing *worse* on metrics like personality, culture, and sycophancy (the tendency for models to become annoying people-pleasers).
About the HUMAINE Leaderboard
Moving beyond simple A vs. B testing, the researchers discuss their new framework that samples participants based on *census data* (Age, Ethnicity, Political Alignment). By using a representative sample of the general public rather than just tech enthusiasts, they are building a standard that reflects the values of the real world.
*Are we building models for benchmarks, or are we building them for humans? It’s time to change the scoreboard.*
Rescript link:
https://app.rescript.info/public/share/IDqwjY9Q43S22qSgL5EkWGFymJwZ3SVxvrfpgHZLXQc
TIMESTAMPS:
00:00:00 Introduction & The Benchmarking Problem
00:01:58 The Fractured State of AI Evaluation
00:03:54 AI Safety & Interpretability
00:05:45 Bias in Chatbot Arena
00:06:45 Prolifics Three Pillars Approach
00:09:01 TrueSkill Ranking & Efficient Sampling
00:12:04 Census-Based Representative Sampling
00:13:00 Key Findings: Culture, Personality & Sycophancy
REFERENCES:
Paper:
[00:00:15] MMLU
https://arxiv.org/abs/2009.03300
[00:05:10] Constitutional AI
https://arxiv.org/abs/2212.08073
[00:06:45] The Leaderboard Illusion
https://arxiv.org/abs/2504.20879
[00:09:41] HUMAINE Framework Paper
https://huggingface.co/blog/ProlificAI/humaine-framework
Company:
[00:00:30] Prolific
https://www.prolific.com
[00:01:45] Chatbot Arena
https://lmarena.ai/
Person:
[00:00:35] Andrew Gordon
https://www.linkedin.com/in/andrew-gordon-03879919a/
[00:00:45] Nora Petrova
https://www.linkedin.com/in/nora-petrova/
Event:
Algorithm:
[00:09:01] Microsoft TrueSkill
https://www.microsoft.com/en-us/research/project/trueskill-ranking-system/
Leaderboard:
[00:09:21] Prolific HUMAINE Leaderboard
https://www.prolific.com/humaine
[00:09:31] HUMAINE HuggingFace Space
https://huggingface.co/spaces/ProlificAI/humaine-leaderboard
[00:10:21] Prolific AI Leaderboard Portal
https://www.prolific.com/leaderboard
Dataset:
[00:09:51] Prolific Social Reasoning RLHF Dataset
https://huggingface.co/datasets/ProlificAI/social-reasoning-rlhf
Organization:
[00:10:31] MLCommons
https://mlcommons.org/")
