Uploaded February 2025 | Updated November 2026, 14 hours ago
Discussion between Anders Sandberg & Kristian Rönn on the AI Arms Race & the Darwinian Trap.
Kristian Rönn is the CEO and co-founder of Normative, and author of the book 'The Darwinian Trap'. He has a background in mathematics, philosophy, computer science and artificial intelligence.
Anders Sandberg is a researcher at the Mimir Center for Long Term Futures Research at the Institute for Futures Studies.
Chapters:
00:00 - Introduction and Guest Background
00:35 - What is "The Darwinian Trap"?
01:06 - Evolution as a Metaphor and a Reality
02:12 - The Iterated Prisoner’s Dilemma & Evolutionary Dynamics
05:02 - How Evolution Favors Short-term Optimization
08:29 - Evolution and Workplace Competitiveness
11:32 - Predators, Prey, and Evolutionary Arms Races
13:53 - The 2008 Financial Crisis as an Evolutionary Trap
15:44 - The AI Arms Race & Safety Concerns
17:45 - Economic Incentives Driving AI Risk
20:00 - AI Moratorium vs. Continued Development
22:01 - Is Cooperation Possible Among AI Companies?
25:01 - Open-Source AI: Risks and Benefits
27:45 - Should AI Be Open-Source? Ethical Considerations
30:10 - The Dangers of Self-Improving AI
32:56 - The Problem of Short-term Gains vs. Long-term Risks
35:50 - AI, Governments, and Regulation Challenges
38:30 - Multi-Polar Traps & Competition
42:10 - Solving Competitive Traps Through Better Governance
46:15 - The Future of AI and Global Cooperation
49:50 - Can We Prevent Existential AI Risks?
52:40 - Fragility of Life & Evolutionary Challenges
55:30 - What Evolution Can Teach Us About AI Alignment
59:20 - The Role of Institutions in Managing AI Risks
01:03:05 - The Great Bootstrap: Can We Rewire Incentives?
01:07:30 - Reputation Markets & Better AI Decision Making
01:12:10 - How Markets Can Help Regulate AI Safely
01:16:30 - The Future of AI: Can We Escape the Trap?
01:21:00 - Final Thoughts & Optimistic Outlook
#AGI #AiArmsRace #GameTheory #AiSafety #Evolution
Many thanks for tuning in!
Please support SciFuture by subscribing and sharing!
Buy me a coffee? buymeacoffee.com/tech101z
Have any ideas about people to interview? Want to be notified about future events? Any comments about the STF series?
Please fill out this form: docs.google.com/forms/d/1mr9PIfq2ZYlQsXRIn5BcLH2onbiSI7g79mOH_AFCdIk
Kind regards,
Adam Ford
- Science, Technology & the Future - #SciFuture - scifuture.org
Discussion between Anders Sandberg & Kristian Rönn on the AI Arms Race & the Darwinian Trap.
Kristian Rönn is the CEO and co-founder of Normative, and author of the book 'The Darwinian Trap'. He has a background in mathematics, philosophy, computer science and artificial intelligence.
Anders Sandberg is a researcher at the Mimir Center for Long Term Futures Research at the Institute for Futures Studies.
Chapters:
00:00 - Introduction and Guest Background
00:35 - What is "The Darwinian Trap"?
01:06 - Evolution as a Metaphor and a Reality
02:12 - The Iterated Prisoner’s Dilemma & Evolutionary Dynamics
05:02 - How Evolution Favors Short-term Optimization
08:29 - Evolution and Workplace Competitiveness
11:32 - Predators, Prey, and Evolutionary Arms Races
13:53 - The 2008 Financial Crisis as an Evolutionary Trap
15:44 - The AI Arms Race & Safety Concerns
17:45 - Economic Incentives Driving AI Risk
20:00 - AI Moratorium vs. Continued Development
22:01 - Is Cooperation Possible Among AI Companies?
25:01 - Open-Source AI: Risks and Benefits
27:45 - Should AI Be Open-Source? Ethical Considerations
30:10 - The Dangers of Self-Improving AI
32:56 - The Problem of Short-term Gains vs. Long-term Risks
35:50 - AI, Governments, and Regulation Challenges
38:30 - Multi-Polar Traps & Competition
42:10 - Solving Competitive Traps Through Better Governance
46:15 - The Future of AI and Global Cooperation
49:50 - Can We Prevent Existential AI Risks?
52:40 - Fragility of Life & Evolutionary Challenges
55:30 - What Evolution Can Teach Us About AI Alignment
59:20 - The Role of Institutions in Managing AI Risks
01:03:05 - The Great Bootstrap: Can We Rewire Incentives?
01:07:30 - Reputation Markets & Better AI Decision Making
01:12:10 - How Markets Can Help Regulate AI Safely
01:16:30 - The Future of AI: Can We Escape the Trap?
01:21:00 - Final Thoughts & Optimistic Outlook
#AGI #AiArmsRace #GameTheory #AiSafety #Evolution
Many thanks for tuning in!
Please support SciFuture by subscribing and sharing!
Buy me a coffee? buymeacoffee.com/tech101z
Have any ideas about people to interview? Want to be notified about future events? Any comments about the STF series?
Please fill out this form: docs.google.com/forms/d/1mr9PIfq2ZYlQsXRIn5BcLH2onbiSI7g79mOH_AFCdIk
Kind regards,
Adam Ford
- Science, Technology & the Future - #SciFuture - scifuture.org


![Wendell Wallach - AI and the Silent Ethic #AI #Ethics #aiethics
In this video, Wendell Wallach discusses the relationship between AI governance, silent ethics, and trade-off ethics. He explores whether institutional systems and artificial intelligence can approximate a moral sense through data and analysis.
Key Takeaways:
- AI as an Analytical Equivalent to Silent Ethics: Wallach suggests that if an AI has access to complete information and performs a thorough analysis, the most ethical course of action often becomes apparent [00:41]. This analytical clarity serves as a functional equivalent to the silent ethic—a concept usually rooted in human moral intuition [01:22].
- The Intersection of Moral Psychology and Analysis: He emphasises that silent ethics and trade-off ethics are complementary. In his view, true moral intelligence requires both internal moral psychology (self-understanding) and rigorous moral analysis (calculating benefits and harms) [01:48].
- The Role of Human Actors in Institutions: When asked if institutions can possess self-understanding, Wallach points out that organisations are ultimately collections of individuals. An institution’s ethical standing is only as strong as the human actors within it and their ability to embody and pass down its core values to the next generation [02:48].
Wendell Wallach (born 21 April 1946) is a world-renowned bioethicist and expert on the ethics and governance of emerging technologies, particularly artificial intelligence (AI) and neuroscience. Often referred to as a godfather of AI ethics, his work focuses on the challenges of aligning rapidly advancing systems with human values.
# Current Roles & Affiliations:
Wallach remains active in several prestigious academic and policy institutions:
- Yale University: Emeritus Scholar at the Interdisciplinary Center for Bioethics, where he chaired the Technology and Ethics study group for 11 years.
- Carnegie Council for Ethics in International Affairs: Carnegie-Uehiro Senior Fellow and co-director of the AI & Equality Initiative (AIEI), which addresses structural inequalities driven by AI.
- The Hastings Center: Senior Advisor for this nonpartisan research institute focused on the social and ethical issues of science and health.
- Other Fellows: Fellow at the Sandra Day O’Connor School of Law (Arizona State University) and the Institute for Ethics & Emerging Technology.Key Publications
# He has authored several foundational works that helped define the field of machine ethics:
- Moral Machines: Teaching Robots Right from Wrong (2008): Co-authored with Colin Allen, this is widely considered the first book to examine the challenge of building artificial moral agents.
- A Dangerous Master: How to Keep Technology from Slipping Beyond Our Control (2015): Explores the risks of unchecked technological development and proposes governance solutions. A revised edition with a new preface was released in 2024.
- Library of Essays on Ethics and Emerging Technologies: Series editor for this comprehensive eight-volume collection published by Routledge.
# Global Policy & Influence
Wallach has a significant presence in international policy forums:United Nations: Has provided testimony to the UN on lethal autonomous weapons systems and advised on digital cooperation.
World Economic Forum (WEF): Formerly co-chaired the Global Future Council on Technology, Values, and Policy and served on the AI Council.
# Awards: Recipient of the World Technology Network awards for Ethics (2014) and Journalism & Media (2015).
#moralmachines #MachineEthics #AI
Many thanks for tuning in!
Please support SciFuture by subscribing and sharing!
Buy me a coffee? https://buymeacoffee.com/tech101z
Have any ideas about people to interview? Want to be notified about future events? Any comments about the STF series?
Please fill out this form: https://docs.google.com/forms/d/1mr9PIfq2ZYlQsXRIn5BcLH2onbiSI7g79mOH_AFCdIk/
Kind regards,
Adam Ford
- Science, Technology & the Future - #SciFuture - http://scifuture.org Wendell Wallach - AI and the Silent Ethic #AI #Ethics #aiethics](https://i.ytimg.com/vi/hReugvhIGsE/mqdefault.jpg)







