Uploaded February 2020 | Updated November 2026, 2 hours ago
Support AI and Games and help the show grow by joining my Patreon:
patreon.com/ai_and_games
--
For the first episode of 2020, I return to arguably the biggest AI story of 2019: the success of AlphaStar. An exerpiment in deep reinforcement learning by Google DeepMind, AlphaStar is the first StarCraft AI player to not only defeat professional players but also to achieve Grandmaster rank in online play. In this video I walk you through the story of how it all works.
Chapters
[00:00] Introduction
[00:42] Why StarCraft?
[04:47] How AlphaStar Works
[10:28] Defeating Pro Players
[13:52] Grandmaster
[17:00] Closing
Some extra resources:
The StarCraft Survey Research Paper that estimates 10^1685 states
cs.mun.ca/~dchurchill/pdf/starcraft_survey.pdf
Google DeepMind AlphaStar Blogs:
deepmind.com/blog/article/alphastar-mastering-real-time-strategy-game-starcraft-ii
deepmind.com/blog/article/AlphaStar-Grandmaster-level-in-StarCraft-II-using-multi-agent-reinforcement-learning
Nature October 2019 Paper on AlphaStar
nature.com/articles/s41586-019-1724-z.epdf?author_access_token=lZH3nqPYtWJXfDA10W0CNNRgN0jAjWel9jnR3ZoTv0PSZcPzJFGNAZhOlk4deBCKzKm70KfinloafEF1bCCXL6IIHHgKaDkaTkBcTEv7aT-wqDoG1VeO9-wO3GEoAMF9bAOt7mJ0RWQnRVMbyfgH9A%3D%3D
AlphaStar Replays (can be played in StarCraft 2):
deepmind.com/research/open-source/alphastar-resources
--
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games. It's supported through and wouldn't be possible without the wonderful people who support it on Patreon, plus YouTube members and Paypal donations.
patreon.com/ai_and_games
youtube.com/channel/UCov_51F0betb6hJ6Gumxg3Q/join
paypal.me/AIandGames
--
Get yourself an AI and Games t-shirt over on Teespring!
teespring.com/stores/aiandgames
You can follow AI and Games (and me) on Facebook and Twitter:
facebook.com/AIandGames
twitter.com/AIandGames
twitter.com/GET_TUDA_CHOPPA
Support AI and Games and help the show grow by joining my Patreon:
patreon.com/ai_and_games
--
For the first episode of 2020, I return to arguably the biggest AI story of 2019: the success of AlphaStar. An exerpiment in deep reinforcement learning by Google DeepMind, AlphaStar is the first StarCraft AI player to not only defeat professional players but also to achieve Grandmaster rank in online play. In this video I walk you through the story of how it all works.
Chapters
[00:00] Introduction
[00:42] Why StarCraft?
[04:47] How AlphaStar Works
[10:28] Defeating Pro Players
[13:52] Grandmaster
[17:00] Closing
Some extra resources:
The StarCraft Survey Research Paper that estimates 10^1685 states
cs.mun.ca/~dchurchill/pdf/starcraft_survey.pdf
Google DeepMind AlphaStar Blogs:
deepmind.com/blog/article/alphastar-mastering-real-time-strategy-game-starcraft-ii
deepmind.com/blog/article/AlphaStar-Grandmaster-level-in-StarCraft-II-using-multi-agent-reinforcement-learning
Nature October 2019 Paper on AlphaStar
nature.com/articles/s41586-019-1724-z.epdf?author_access_token=lZH3nqPYtWJXfDA10W0CNNRgN0jAjWel9jnR3ZoTv0PSZcPzJFGNAZhOlk4deBCKzKm70KfinloafEF1bCCXL6IIHHgKaDkaTkBcTEv7aT-wqDoG1VeO9-wO3GEoAMF9bAOt7mJ0RWQnRVMbyfgH9A%3D%3D
AlphaStar Replays (can be played in StarCraft 2):
deepmind.com/research/open-source/alphastar-resources
--
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games. It's supported through and wouldn't be possible without the wonderful people who support it on Patreon, plus YouTube members and Paypal donations.
patreon.com/ai_and_games
youtube.com/channel/UCov_51F0betb6hJ6Gumxg3Q/join
paypal.me/AIandGames
--
Get yourself an AI and Games t-shirt over on Teespring!
teespring.com/stores/aiandgames
You can follow AI and Games (and me) on Facebook and Twitter:
facebook.com/AIandGames
twitter.com/AIandGames
twitter.com/GET_TUDA_CHOPPA



![Game AIs Existential Crisis (Part 1) | AI and Games
Game AI, the practice of implementing artificial intelligence to craft the experience of players in video games, is facing an existential crisis.
- A crisis of confidence in technology.
- A crisis that, at its heart, is at about perils of scale and complexity.
- A crisis of handling risk in a land of the risk-averse.
- A crisis of lost knowledge, and of forgotten values.
- A crisis born of a niche that exists for a single purpose, in a world that seldom acknowledges its existence.
Having spent a decade in this space, I fear for its survival. But in order to combat the issue, it needs to be brought into the light.
Read the full Game AI Existential Crisis series at AIandGames.com (and support our work too):
- Part 1 - Challenges of Modern Game AI:
https://www.aiandgames.com/p/game-ais-existential-crisis-part
- Part 2 - Game AI Education:
https://www.aiandgames.com/p/game-ais-existential-crisis-2
- Part 3 - Game AI Community:
https://www.aiandgames.com/p/game-ais-existential-crisis-part-eef
Chapters
[00:00] An Existential Crisis
[03:22] A Vision of the Future
[06:51] Game AI Explained
[14:58] The Game AI Problem
[16:52] The Modern Landscape
[23:09] The Need for Experimentation
[25:02] When Experiments Meets Budgets
[27:16] When Bare Minimum Meets Budgets
[30:26] Designing to Systems
[32:26] Generative AI is NOT the Answer
[33:56] The Reframing of Game AI
[36:50] When Structure Meets Chaos
[42:09] Gen AI Needs Game AI to Work
[46:07] Conclusions
Games that appear in this video (by order of appearance)
Resident Evil 8: Village
Marvels Spider-Man
Left 4 Dead 2
Monster Hunter World
Middle-Earth: Shadow of Mordor
Suicide Squad: Kill the Justice League
Death Stranding
A Plague Tale: Innocence
DOOM 2016
Avatar Frontiers of Pandora
Alien: Isolation
Warhammer 40,000: Space Marine 2
Tom Clancys The Division 2
BioShock Infinite
Cities: Skylines
Sea of Thieves
Total War: Warhammer
Gears Tactics
Marvels Spider-Man: Miles Morales
Far Cry 5
Cyberpunk 2077
Age of Empires 4
Halo 2
F.E.A.R.
Forza Horizon 4
Call of Duty: Warzone
Mass Effect: Legendary Edition
Splinter Cell: Blacklist
Bloodborne
Half-Life 2
Hitman: World of Assassination
Resident Evil 7: BioHazard
Halo 2
DOOM
Command and Conquer: Remastered
Black & White
The Sims
Horizon Zero Dawn
Resident Evil 2 (remake)
The Witcher 3
Batman: Arkham Asylum
DOOM: Eternal
Assassins Creed: Shadows
Kingdom Come: Deliverance 2
Final Fantasy XV
WatchDogs Legion
Monster Hunter Rise
S.T.A.L.K.E.R.: Shadow of Chernobyl
Origins Demo
Facade
Convai Demo
The Sims 4
Gran Turismo 7
Star Wars Outlaws
Little Learning Machines
EA Sports FC 26
InZoi
Tom Clancys Ghost Recon Wildlands
Dead Meat
Dark Souls Remastered
Writer and Voice: Tommy Thompson
Editing and Production Support: Shraddha Gupta
AI and Games Logos: Andy Carolan
Theme Music: Ben Ridge
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games.
Check out all of our content:
Website and Newsletter: http://www.aiandgames.com
AI and Games: http://www.youtube.com/@AIandGames
AI and Games Plus: http://www.youtube.com/@AIandGamesPlus
AI and Games Conference: http://www.youtube.com/@AIandGamesConference
Goal State: http://www.youtube.com/@GoalStateAI
Livestreams on Twitch: http://www.twitch.tv/aiandgames
Join our Discord Community: https://discord.aiandgames.com
Follow AI and Games on social media.
BlueSky: https://bsky.app/profile/tommy.aiandgames.com
TikTok: https://www.tiktok.com/@aiandgames
If youre interested in working with us, check out the following:
Sponsorship Enquiries: https://www.passionfroot.me/aiandgames
Business Enquiries: https://www.aiandgames.com/p/professional-services Game AIs Existential Crisis (Part 1) | AI and Games](https://i.ytimg.com/vi/mixkOgBs32s/mqdefault.jpg)




![Create NPCs with LLM-powered Convai!
@convai recently made headlines because of their conversational AI tools that use large language models (LLMs) like GPT to create intelligent non-player characters (NPCs) in games. In this sponsored video I chat with Convais CEO Purnendu Mukherjee about the progress theyre making in building these tools and even tried making my own NPC to see how well it works in practice.
This episode was sponsored by Convai and I received compensation for my time producing this video.
If youre interested in finding out more about Convais work, some links are provided below:
Website: http://Convai.com
Youtube Channel: https://www.youtube.com/@convai
Discord: https://discord.gg/de6SmWG7e2
Twitter: https://twitter.com/convaitech
LinkedIn: https://www.linkedin.com/company/convaitech/
Convai Demo with NVIDIA (https://www.youtube.com/watch?v=0Zm2IIIWK6I)
Download and play with the Convai demos:
https://drive.google.com/drive/folders/1iD2nvkAr3Hcz-cRTN7Z9NKja7yueFFSZ?usp=sharing
[00:00] Intro
[02:29] Who Are Convai?
[05:41] Building NPCs for Conversation
[09:59] Testing Out the Tech
[19:24] Building for the Future
[26:56] Closing
[27:51] Credits
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games.
Follow AI and Games for educational videos and essays:
http://www.youtube.com/@AIandGames
My second channel AI and Games Plus is dedicated to bonus content, deep-dive analysis, revisiting old topics and more:
http://www.youtube.com/@AIandGamesPlus
Listen to my podcast Branching Factor, as I discuss game development and research with my co-hosts and guests:
https://shows.acast.com/branchingfactor
Watch Livestreams: http://www.twitch.tv/aiandgames
Join our Community: https://discord.aiandgames.com
Buy our Merch: https://store.aiandgames.com
You can support AI and Games via Patreon and YouTube memberships, and in return, you get bonus rewards!
http://www.patreon.com/aiandgames
https://www.youtube.com/@AIandGames/join
Follow AI and Games on social media.
Twitter: http://www.twitter.com/AIandGames
Mastodon: https://mastodon.gamedev.place/@AIandGames
TikTok: https://www.tiktok.com/@aiandgames
Instagram: https://www.instagram.com/aiandgames/
Threads: https://www.threads.net/@aiandgames
If youre interested in working with us, check out the following:
Business Enquiries: contact@aiandgames.com
Arrange Meeting: https://calendly.com/aiandgames Create NPCs with LLM-powered Convai!](https://i.ytimg.com/vi/nZE0gkFKMt8/mqdefault.jpg)
![Death Strandings Biggest Problem? Teaching the AI to Walk | AI and Games #67
Support AI and Games on Patreon:
http://www.patreon.com/ai_and_games
Death Stranding is all about walking. The AAA walking simulator tasks players with delivering packages to isolated corners of a post-apocalyptic United States. It presents a rich and challenging environment for players to navigate, and this leads to the biggest problem developers at Kojima Productions had to tackle. How do you teach the AI to walk in a game that breaks so many conventions of how you move around the world? Lets find out!
This episode is inspired by Eric Johnsons fantastic 2021 GDC post-mortem on Death Stranding.
https://www.gdcvault.com/play/1027144/AI-Summit-Death-Stranding-An
[00:00] Introduction
[01:42] Exploring the Fundamentals
[04:26] Understanding the Challenge
[08:54] Achieving Traversal Parity
[12:34] Finding the Path
[14:23] Rebuilding the World
[16:05] Refining the Path
[21:05] Closing
[21:50] Credits
Music in this episode is by @teknoaxe
http://www.teknoaxe.com
Footage for this episode is recorded from the Directors Cut version on Playstation 5.
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games. Its supported through and wouldnt be possible without the wonderful people who support it via Patreon and YouTube memberships.
http://www.patreon.com/ai_and_games
https://www.youtube.com/channel/UCov_51F0betb6hJ6Gumxg3Q/join
You can follow AI and Games on Twitter:
http://www.twitter.com/AIandGames
Join me for live streams over on Twitch:
http://www.twitch.tv/aiandgames
Join our Discord Community:
bit.ly/AIandGamesDiscord Death Strandings Biggest Problem? Teaching the AI to Walk | AI and Games #67](https://i.ytimg.com/vi/oOdaUUHRcJI/mqdefault.jpg)
![The AI of DOOM (1993) | AI and Games #66
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games. Its supported through and wouldnt be possible without the wonderful people who support it via Patreon and YouTube memberships.
http://www.patreon.com/ai_and_games
https://www.youtube.com/channel/UCov_51F0betb6hJ6Gumxg3Q/join
DOOM is one of the most important games of all time, and the AI behind it is just as impressive now as it was almost 30 years ago. In this 66(6)th episode, lets go and find out how it all works.
[00:00] Intro
[00:37] The AI of DOOM
[02:57] Core AI Logic
[08:18] Defining AI Actions
[14:29] The See State
[18:52] Reactions
[21:17] Designing Encounters
[25:46] Closing
Check out all of my #DOOM videos in this specially prepared DOOM playlist:
https://youtube.com/playlist?list=PLokhY9fbx05ffAx5FYVSNyY3207iInGK5
If you want to learn more about DOOM, check out the original source code repo on GitHub:
https://github.com/id-Software/DOOM
If youre not a fan of reading code, I highly recommend @fcxss fantastic Game Engine Black Book:
https://fabiensanglard.net/gebbdoom/
Plus check out the wonderful IDKFA album by @AndrewHulshultOfficial. Listen to it on its own or add it to your DOOM experience (if you havent already).
https://www.moddb.com/addons/idkfa-doom-soundtrack
You can follow AI and Games on Twitter:
http://www.twitter.com/AIandGames
Join me for live streams over on Twitch:
http://www.twitch.tv/aiandgames
Join our Discord Community:
bit.ly/AIandGamesDiscord
Get yourself an AI and Games t-shirt over on Teespring!
https://teespring.com/stores/aiandgames The AI of DOOM (1993) | AI and Games #66](https://i.ytimg.com/vi/owAxZPE9a0E/mqdefault.jpg)