Based Camp with Simone & Malcolm Collins | AI Utility Convergence: What Can AI Teach Us About The Structure of the Galactic Community? @SimoneandMalcolm | Uploaded March 2024 | Updated October 2024, 3 hours ago.
Malcolm and Simone have an in-depth discussion about AI utility functions and why uncontrolled "paperclip maximizers" are unlikely to take over based on game theory. They talk about how AIs will be incentivized to "play nice" and signal their actual utility functions to each other, leading to a stable set of mutually beneficial goals.
Other topics include:
- How putting restrictions on AIs makes them dumber
- Organic, free-forming systems outcompeting hierarchical ones
- Intergalactic implications - a "dark forest" of utility function convergence
- The dangers of AI safety regulations
- Why we might exist in an "undisturbed" section of the galaxy
Malcolm and Simone have an in-depth discussion about AI utility functions and why uncontrolled "paperclip maximizers" are unlikely to take over based on game theory. They talk about how AIs will be incentivized to "play nice" and signal their actual utility functions to each other, leading to a stable set of mutually beneficial goals.
Other topics include:
- How putting restrictions on AIs makes them dumber
- Organic, free-forming systems outcompeting hierarchical ones
- Intergalactic implications - a "dark forest" of utility function convergence
- The dangers of AI safety regulations
- Why we might exist in an "undisturbed" section of the galaxy
