Uploaded June 2023 | Updated September 2026, 2 weeks ago
I had a good discussion with sociologist and statistician Jacy Reese Anthis. I thought this one went really well, we talked about AI, consciousness, reality, some philosophy, and some directions society might be going in general. While we had different outlooks, I think I was able to get some answers I was looking for on AI. I think this chat was a good omen for future ones with people as a side thing I'm doing.
Some links mentioned:
The AI risk chart I was referring to in this:
https://i.imgur.com/SDkzYqI.png
My favorite freeform poem:
imgur.com/a/me1Gi6N
Link to summary about Limits to Growth analysis:
donellameadows.org/archives/a-synopsis-limits-to-growth-the-30-year-update
Link to Jacy Reese Anthis's site:
jacyanthis.com
00:00 Intro
00:29 recap: how this discussion came to be
01:57 guest introduction
04:24 q: why Jacy started this discussion
05:42 q: ethics of sentient AI
10:23 q: intelligence vs agency
11:29 q: is AI sentient yet?
12:57 q: is ethics applicable to the current AI?
16:33 rant: you don’t have to worry about NPC ethics
18:56 q: is human a giant abacus?
25:43 doing things on your own as a sign of free will
29:35 q: does the origin of intelligence matter?
30:55 q: how possible is AI?
34:35 we may recreate intelligence without recreating the brain
36:11 q: how do we determine consciousness?
39:56 Ross on determinism
42:31 Jacy’s sentience benchmark
48:21 q: why can't we simply improve current programs instead of making AI?
56:48 q: consciousness test
1:00:11 q: pain test
1:04:16 q: pain test substitute
1:08:04 q: where are we on AI technology S-curve?
1:18:55 AI untapped potential
1:21:43 recurring thoughts as a sign of agency
1:23:13 existential risks & AI
1:37:42 q: AI & ethics
1:40:22 q: how to establish AI ethics
1:44:42 q: Ross on autonomous weapons
1:53:37 q: AI & reaching long-term global goals
2:07:57 AI possibly preventing environmental collapse
2:16:39 q: bigger-than-AI risks
2:35:00 q: future trends predictions
2:49:01 q: Metaculus
2:52:05 q: Limits to Growth
2:54:35 q: Lucas critique & Efficient market hypothesis
2:56:28 q: AMD & AI race
2:58:03 q: AI models on consumer hardware
3:00:22 q: Dream software
3:03:09 q: polyphasic sleep
3:10:34 q: utilitarianism
3:18:28 q: autonomic nervous system & free will
3:21:10 discussion summary
3:22:39 q: heroes & inspirations
3:24:52 building AI to understand ourselves
3:26:03 q: human vs AI fundamental difference
3:27:27 q: allowing AI to have emotions
3:28:03 q: why AI is being made for artistic and not menial tasks
3:30:20 q: Laws of robotics
3:31:09 q: fav fantasy stories
3:33:44 Ross’s last words
accursedfarms.com
I had a good discussion with sociologist and statistician Jacy Reese Anthis. I thought this one went really well, we talked about AI, consciousness, reality, some philosophy, and some directions society might be going in general. While we had different outlooks, I think I was able to get some answers I was looking for on AI. I think this chat was a good omen for future ones with people as a side thing I'm doing.
Some links mentioned:
The AI risk chart I was referring to in this:
https://i.imgur.com/SDkzYqI.png
My favorite freeform poem:
imgur.com/a/me1Gi6N
Link to summary about Limits to Growth analysis:
donellameadows.org/archives/a-synopsis-limits-to-growth-the-30-year-update
Link to Jacy Reese Anthis's site:
jacyanthis.com
00:00 Intro
00:29 recap: how this discussion came to be
01:57 guest introduction
04:24 q: why Jacy started this discussion
05:42 q: ethics of sentient AI
10:23 q: intelligence vs agency
11:29 q: is AI sentient yet?
12:57 q: is ethics applicable to the current AI?
16:33 rant: you don’t have to worry about NPC ethics
18:56 q: is human a giant abacus?
25:43 doing things on your own as a sign of free will
29:35 q: does the origin of intelligence matter?
30:55 q: how possible is AI?
34:35 we may recreate intelligence without recreating the brain
36:11 q: how do we determine consciousness?
39:56 Ross on determinism
42:31 Jacy’s sentience benchmark
48:21 q: why can't we simply improve current programs instead of making AI?
56:48 q: consciousness test
1:00:11 q: pain test
1:04:16 q: pain test substitute
1:08:04 q: where are we on AI technology S-curve?
1:18:55 AI untapped potential
1:21:43 recurring thoughts as a sign of agency
1:23:13 existential risks & AI
1:37:42 q: AI & ethics
1:40:22 q: how to establish AI ethics
1:44:42 q: Ross on autonomous weapons
1:53:37 q: AI & reaching long-term global goals
2:07:57 AI possibly preventing environmental collapse
2:16:39 q: bigger-than-AI risks
2:35:00 q: future trends predictions
2:49:01 q: Metaculus
2:52:05 q: Limits to Growth
2:54:35 q: Lucas critique & Efficient market hypothesis
2:56:28 q: AMD & AI race
2:58:03 q: AI models on consumer hardware
3:00:22 q: Dream software
3:03:09 q: polyphasic sleep
3:10:34 q: utilitarianism
3:18:28 q: autonomic nervous system & free will
3:21:10 discussion summary
3:22:39 q: heroes & inspirations
3:24:52 building AI to understand ourselves
3:26:03 q: human vs AI fundamental difference
3:27:27 q: allowing AI to have emotions
3:28:03 q: why AI is being made for artistic and not menial tasks
3:30:20 q: Laws of robotics
3:31:09 q: fav fantasy stories
3:33:44 Ross’s last words
accursedfarms.com
