Is Superintelligence Necessarily Moral? @scfu
Is Superintelligence Necessarily Moral?  @scfu
Uploaded July 2026 | Updated November 2026, 1 day ago
Dr. Leonard Dung is a Postdoctoral Researcher at the Institute of Philosophy II, Ruhr-University Bochum

See paper: philarchive.org/rec/DUNISN

Abstract : Numerous authors have expressed concern that advanced artificial intelligence (AI) poses an existential risk to humanity. These authors argue that we might build AI which is vastly intellectually superior to humans (a ‘superintelligence’), and which optimizes for goals that strike us as morally bad, or even irrational. Thus this argument assumes that a superintelligence might have morally bad goals. However, according to some views, a superintelligence necessarily has morally adequate goals. This might be the case either because abilities for moral reasoning and intelligence mutually depend on each other, or because moral realism and moral internalism are true. I argue that the former argument misconstrues the view that intelligence and goals are independent, and that the latter argument misunderstands the implications of moral internalism. Moreover, the current state of AI research provides additional reasons to think that a superintelligence could have bad goals.

- What is the core argument of "Is Superintelligence Necessarily Moral?"
- Can moral knowledge motivate artificial agents?
- How does this argument relate to Bostrom’s orthogonality thesis?
- Does moral realism change the alignment problem?
- What do current AI systems suggest about the relationship between learning, goals, and motivation?
Is Superintelligence Necessarily Moral?Are Machines Capable of Morality? Join Professor Colin Allen!Soenke Ziesche - IkigAI & AI, Ikigai Risk (IRisk)Wendell Wallach: AI Ethics in China - a Governance Mirror #aigovernance #aiethics  #aialignmentAngela Livingstone - AI Won’t Replace Psychiatrists - But May Expose UsRobin Hanson - Futarchy: Competent Governance Soon?!Andrés Gómez-Emilsson - Path Dependence in Consciousness ScienceKen Mogi - Philosophical Zombies #consciousness #philosophy #qualiaJonathan Leighton & David Veldran - The Moral Blind Spot in AI GovernanceTerence Cuneo: Moral Intuitions - Trustworthy in Complex Cases #ethics #metaethicsAndrés Gómez Emilsson - Awesome Futures Tier ListJames Hughes - The Future Digital You
Science, Technology & the Future |

Is Superintelligence Necessarily Moral?

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER