Uploaded August 2022 | Updated November 2026, 1 day ago
Support AI and Games on Patreon:
patreon.com/ai_and_games
--
'GT Sophy' made a splash in early 2022 as it was declared to be a new type of AI racer for Gran Turismo that could leave many a professional player in the dust. It's time to find out how it works, and the story of where it comes from.
--
A written version of this episode is available at:
aiandgames.com/2022/08/01/gran-turismo-sophy
If you're keen to find out more, here are all the research materials used for this episode:
"Neural Networks Overtake Humans in Gran Turismo Racing Game"
nature.com/articles/d41586-022-00304-2
"Outracing Champion Gran Turismo Drivers with Deep Reinforcement Learning"
nature.com/articles/s41586-021-04357-7
"Superhuman Performance in Gran Turismo Sport using Deep Reinforcement Learning"
https://rpg.ifi.uzh.ch/docs/RAL21_Fuchs.pdf
"Autonomous Overtaking in Gran Turismo Sport Using Curriculum Reinforcement Learning"
https://rpg.ifi.uzh.ch/docs/ICRA21_Yunlong.pdf
The Sony AI YouTube Channel
youtube.com/channel/UC-eJUbUU5AVi_tp75XFnDIQ
The Gran Turismo TV YouTube Channel
youtube.com/c/GRANTURISMOTV
The Gran Turismo Sophy Website
gran-turismo.com/us/gran-turismo-sophy
Footage of Tesla AI Driving by 'Whole Mars Catalog'
youtube.com/watch?v=_ZYEjYnmPlA
--
Video Chapters:
[00:00] Intro
[01:23] Sony AI
[05:02] The Goal of Sophy
[09:30] Sophy's 'Brain'
[15:59] Learning to Race
[19:23] Rewarding Good Racing
[23:44] Training a Champion
[30:34] Open Challenges
[31:38] Credits
Music in this episode is by TeknoAxe:
teknoaxe.com
--
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games. It's supported through and wouldn't be possible without the wonderful people who support it via Patreon and YouTube memberships.
patreon.com/ai_and_games
youtube.com/channel/UCov_51F0betb6hJ6Gumxg3Q/join
--
You can follow AI and Games on Twitter:
twitter.com/AIandGames
Join me for live streams over on Twitch:
twitch.tv/aiandgames
Join our Discord Community:
bit.ly/AIandGamesDiscord
Support AI and Games on Patreon:
patreon.com/ai_and_games
--
'GT Sophy' made a splash in early 2022 as it was declared to be a new type of AI racer for Gran Turismo that could leave many a professional player in the dust. It's time to find out how it works, and the story of where it comes from.
--
A written version of this episode is available at:
aiandgames.com/2022/08/01/gran-turismo-sophy
If you're keen to find out more, here are all the research materials used for this episode:
"Neural Networks Overtake Humans in Gran Turismo Racing Game"
nature.com/articles/d41586-022-00304-2
"Outracing Champion Gran Turismo Drivers with Deep Reinforcement Learning"
nature.com/articles/s41586-021-04357-7
"Superhuman Performance in Gran Turismo Sport using Deep Reinforcement Learning"
https://rpg.ifi.uzh.ch/docs/RAL21_Fuchs.pdf
"Autonomous Overtaking in Gran Turismo Sport Using Curriculum Reinforcement Learning"
https://rpg.ifi.uzh.ch/docs/ICRA21_Yunlong.pdf
The Sony AI YouTube Channel
youtube.com/channel/UC-eJUbUU5AVi_tp75XFnDIQ
The Gran Turismo TV YouTube Channel
youtube.com/c/GRANTURISMOTV
The Gran Turismo Sophy Website
gran-turismo.com/us/gran-turismo-sophy
Footage of Tesla AI Driving by 'Whole Mars Catalog'
youtube.com/watch?v=_ZYEjYnmPlA
--
Video Chapters:
[00:00] Intro
[01:23] Sony AI
[05:02] The Goal of Sophy
[09:30] Sophy's 'Brain'
[15:59] Learning to Race
[19:23] Rewarding Good Racing
[23:44] Training a Champion
[30:34] Open Challenges
[31:38] Credits
Music in this episode is by TeknoAxe:
teknoaxe.com
--
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games. It's supported through and wouldn't be possible without the wonderful people who support it via Patreon and YouTube memberships.
patreon.com/ai_and_games
youtube.com/channel/UCov_51F0betb6hJ6Gumxg3Q/join
--
You can follow AI and Games on Twitter:
twitter.com/AIandGames
Join me for live streams over on Twitch:
twitch.tv/aiandgames
Join our Discord Community:
bit.ly/AIandGamesDiscord
![How Machine Learning is Transforming the Video Games Industry | AI 101
Artificial intelligence has been adopted in many ways in the games industry over the past 30 years, but machine learning has never been considered practical until now. In this episode of AI 101 we discuss the fundamentals of what ML does, how it differs from traditional AI, what deep learning actually means, and the ways in which it is being put to good use in the industry.
[00:00] Intro
[01:54] What is Machine Learning?
[04:13] Different Approaches
[07:42] Why ML Wasnt Used in Games
[11:47] Modern Applications
[17:05] Closing
[17:45] Credits
All of my earlier videos mentioned in this one can be found in the new dedicated playlist on machine learning for video games:
https://www.youtube.com/watch?v=hwk37ID4qdE&list=PLokhY9fbx05cMPgT0h3HPzv5yeB8wrRCF
Some resources to check out as well if youre keen to dive deeper:
Artificial Intelligence: A Modern Approach by Russell and Norvig (quoted from in this video)
https://aima.cs.berkeley.edu/
The DeepMind x UCL Deep Learning lecture series
https://www.youtube.com/playlist?list=PLqYmG7hTraZCDxZ44o4p3N5Anz3lLRVZF
Artificial Intelligence and Games by Togelius and Yannakakis
http://gameaibook.org/
Deep Learning with Python by Chollet
https://www.manning.com/books/deep-learning-with-python-second-edition
Music in this episode is by TeknoAxe:
http://www.teknoaxe.com
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games.
Follow AI and Games for educational videos and essays:
http://www.youtube.com/@AIandGames
My second channel AI and Games Plus is dedicated to bonus content, deep-dive analysis, revisiting old topics and more:
http://www.youtube.com/@AIandGamesPlus
Listen to my podcast Branching Factor, as I discuss game development and research with my co-hosts and guests:
https://shows.acast.com/branchingfactor
Watch Livestreams: http://www.twitch.tv/aiandgames
Join our Community: https://aiandgames.com/discord
Buy some merch at: https://aiandgames.com
You can support AI and Games via Patreon and YouTube memberships, and in return, you get bonus rewards!
http://www.patreon.com/aiandgames
https://www.youtube.com/@AIandGames/join
Follow AI and Games on social media.
Twitter: http://www.twitter.com/AIandGames
Mastodon: https://mastodon.gamedev.place/@AIandGames
TikTok: https://www.tiktok.com/@aiandgames
If youre interested in working with us, check out the following:
Business Enquiries: contact@aiandgames.com
Arrange Meeting: https://calendly.com/aiandgames How Machine Learning is Transforming the Video Games Industry | AI 101](https://i.ytimg.com/vi/dm_yY-hddvE/mqdefault.jpg)



![The Secret of Into the Breachs AI: Power in Simplicity | AI and Games #72
Sometimes you just dont need super flashy AI in your game. You just need something that is good enough for what your game is trying to do. With that in mind, we dive behind the scenes of Subset Games 2018 release Into the Breach, and find out that keeping it simple can not only result in something smart and scalable but also make players think its much smarter than it really is.
[00:00] Introduction
[01:27] About the Game
[03:03] How it Actually Works
[07:41] Misconceptions and Balancing
[10:52] Keep it Simple Stupid
[12:35] Closing
[14:07] Credits
You can read this episode on our dedicated @substackinc site:
https://aiandgames.com/p/into-the-breach
This episode is sourced from Matthew Davis own blog post on the AI of Into the Breach. Special thanks to @AlanZucconi for sending us the link earlier this year!
https://docs.google.com/document/d/1OPRNzAVQNgPtP35HzhV2ZzEqE1eCdXbWA7lEZXDdMHQ/mobilebasic
Music in this episode is lifted from the Into the Breach soundtrack by Ben Prunty
https://benprunty.bandcamp.com/album/into-the-breach-soundtrack
Credit music is by our own wonderful @BenRidgeMusic
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games.
Follow AI and Games for educational videos and essays:
http://www.youtube.com/@AIandGames
My second channel AI and Games Plus is dedicated to bonus content, deep-dive analysis, revisiting old topics and more:
http://www.youtube.com/@AIandGamesPlus
Listen to my podcast Branching Factor, as I discuss game development and research with my co-hosts and guests:
https://shows.acast.com/branchingfactor
Watch Livestreams: http://www.twitch.tv/aiandgames
Join our Community: https://discord.aiandgames.com
Buy our Merch: https://store.aiandgames.com
You can support AI and Games via Patreon and YouTube memberships, and in return, you get bonus rewards!
http://www.patreon.com/aiandgames
https://www.youtube.com/@AIandGames/join
Follow AI and Games on social media.
Twitter: http://www.twitter.com/AIandGames
Mastodon: https://mastodon.gamedev.place/@AIandGames
TikTok: https://www.tiktok.com/@aiandgames
If youre interested in working with us, check out the following:
Business Enquiries: contact@aiandgames.com
Arrange Meeting: https://calendly.com/aiandgames The Secret of Into the Breachs AI: Power in Simplicity | AI and Games #72](https://i.ytimg.com/vi/fkEG55gFqrA/mqdefault.jpg)


![How Resident Evil 4 Transformed Horror Games | Design Dive
Support AI and Games on Patreon:
http://www.patreon.com/ai_and_games
In part 2 of the Revisiting Evil series on Design Dive, we continue our analysis of the Resident Evil series. In this episode, we look at 2005s Resident Evil 4, and the seismic impact it had not just on the franchise, but the videogames industry as a whole. How the Resident Evil series evolved as a result and the concessions and revamps that powered an entire trilogy of survival terror.
If youve missed it, dont forget the first episode of Revisiting Evil:
https://www.youtube.com/watch?v=CBbNVBiHWV8
Plus check out the @Game Makers Toolkit episode on RE4s dynamic difficulty mentioned in this video:
https://www.youtube.com/watch?v=zFv6KAdQ5SE
Chapters
[00:00] Intro
[01:29] From Horror to Terror
[02:54] Revamping Mechanics
[08:58] Introducing The Ganados
[12:21] Revisiting Evil
[16:14] Balancing Difficulty
[19:48] Resident Evil 5
[24:51] Resident Evil 6
[28:53] Horror Endures
[33:46] Closing
The following games appear in this episode, with details on where they were recorded from:
- Resident Evil Zero [Xbox One X]
- Resident Evil [Duckstation PSX Emulator]
- Resident Evil [Remake] [Xbox One X]
- Resident Evil 2 [Duckstation PSX Emulator]
- Resident Evil 3 [Duckstation PSX Emulator]
- Resident Evil: Code Veronica X [Xbox One X]
- Resident Evil 4 [PC with HD texture pack, Xbox One X]
- Resident Evil 4 VR [Oculus Quest 2]
- Resident Evil 5 [Xbox One X]
- Resident Evil 6 [Xbox One X]
- Resident Evil: Revelations [PC]
- Resident Evil: Revelations 2 [Xbox One X]
- Vanquish [PC]
- The Evil Within [Xbox One X]
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games. Its supported through and wouldnt be possible without the wonderful people who support it via Patreon and YouTube memberships.
http://www.patreon.com/ai_and_games
https://www.youtube.com/channel/UCov_51F0betb6hJ6Gumxg3Q/join
You can follow AI and Games on Twitter:
http://www.twitter.com/AIandGames
Join me for live streams over on Twitch:
http://www.twitch.tv/aiandgames
Join our Discord Community:
bit.ly/AIandGamesDiscord
#ResidentEvil #ResidentEvil4 #HorrorGaming How Resident Evil 4 Transformed Horror Games | Design Dive](https://i.ytimg.com/vi/gaEEsZNa4MY/mqdefault.jpg)

![The 10-Year Journey of Ultima Ratio Regum: The Culture Generating Roguelike | AI and Games #58
How do you design culture? How would you get a procedural generator to design it in a video game? And do you think you could dedicate 10 years of your life to making it happen? Tommy explores the inner workings of the roguelike Ultima Ratio Regum and how it builds everything from religious and political ideologies all the way down to the carvings on the chairs in peoples homes. We explore not just how the games systems work, but go into more detail on the origins and ongoing development of the project with help from URRs creator Dr. Mark Johnson.
For those keen to find out more about URR, download the game or check out Marks research in eSports and live streaming, be sure to visit his website:
https://www.markrjohnsongames.com
[00:00] Intro
[01:39] What is Ultima Ratio Regum?
[07:12] Early Beginnings
[12:45] How Does URR Work?
[18:21] Maintaining Diversity
[23:24] Connections
[26:27] Scaling-Up
[29:40] Reflections
[38:08] Lessons Learned
[42:36] Closing
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games. Its supported through and wouldnt be possible without the wonderful people who support it via Patreon and YouTube memberships.
http://www.patreon.com/ai_and_games
https://www.youtube.com/channel/UCov_51F0betb6hJ6Gumxg3Q/join
You can follow AI and Games on Twitter:
http://www.twitter.com/AIandGames
Join me for livestreams over on Twitch:
http://www.twitch.tv/aiandgames
Join our Discord Community:
bit.ly/AIandGamesDiscord
Get yourself an AI and Games t-shirt over on Teespring!
https://teespring.com/stores/aiandgames The 10-Year Journey of Ultima Ratio Regum: The Culture Generating Roguelike | AI and Games #58](https://i.ytimg.com/vi/giIIoIKntnw/mqdefault.jpg)
![My Favourite Games from the AI and Games Jam 2022
Support AI and Games on Patreon:
http://www.patreon.com/ai_and_games
This year was our second run of the AI and Games Jam and the submissions did not disappoint! So here we go, my review of the years event, and some of my favourites having played the top 50% of submissions.
Congratulations to everyone who participated. Some fantastic games again this year, and I hope you all enjoyed the experience. Hopefully, we can be back with more in 2023?
You can check out all of the games over at:
https://itch.io/jam/aiandgames-2022/entries
Plus catch my long-play videos of my time playing the jam games over on my second channel:
Part 1: https://youtu.be/rK2dvYi5u9A
Part 2: https://youtu.be/O_hUUhUAYl4
Episode Chapters
[00:00] Intro
[00:27] The 2022 Theme
[01:53] Solitaire (the #1 Ranked Game)
[02:38] Ambidextro
[03:06] The Horror Museum
[03:27] Isolating Waters
[03:56] Roguelike
[04:14] Compicactus
[05:03] Rokos Basilisk
[05:26] Dead by Roguelight
[06:00] Dark Isolation
[06:31] Untitled Dinosaur Game
[06:48] Alone in the Dark
[07:13] Reflecting on the Year
[08:54] Closing
[09:30] Credits
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games. Its supported through and wouldnt be possible without the wonderful people who support it via Patreon and YouTube memberships.
http://www.patreon.com/ai_and_games
https://www.youtube.com/channel/UCov_51F0betb6hJ6Gumxg3Q/join
Join me for live streams over on Twitch:
http://www.twitch.tv/aiandgames
Join our Discord Community:
bit.ly/AIandGamesDiscord
#AIandGamesJam22 #GameJam #GameDev My Favourite Games from the AI and Games Jam 2022](https://i.ytimg.com/vi/gmg_C0JWNxo/mqdefault.jpg)