Uploaded September 2021 | Updated November 2026, 2 days ago
Support AI and Games on Patreon to get your name in the credits, early-access and more:
patreon.com/ai_and_games
--
Sometimes the AI in a videogame has lots of perfectly valid actions it can take, but deciding which one can be quite difficult. Utility AI is one approach to help solve it, by calculating how useful that action is based on the current context. We look at how it works, some simple calculations and how games ranging from @electronicarts's 'The Sims', all the way to @CreativeAssembly's 'Total War' series, adopt Utility AI in their games.
[00:00] Intro
[01:02] Why do we need Utility AI?
[04:21] Calculating Utility
[06:39] Utility AI in AAA Games
[14:46] Closing
If you're interested in learning more about Utility AI, check out these reading materials and related links:
"An Introduction to Utility AI Theory" - Game AI Pro v2
gameaipro.com/GameAIPro/GameAIPro_Chapter09_An_Introduction_to_Utility_Theory.pdf
"Behavior Decision System: Dragon Age Inquisition’s Utility Scoring Architecture" - Game AI Pro v3
gameaipro.com/GameAIPro3/GameAIPro3_Chapter31_Behavior_Decision_System_Dragon_Age_Inquisition%E2%80%99s_Utility_Scoring_Architecture.pdf
"Intrigue & Betrayal: Diplomacy AI in Total War Three Kingdoms", Csaba Toth and Duygu Cakmak, GDC 2021
"Analysing AI Behaviour in Total War | Creative Assembly and BAFTA Games", Csaba Toth and Duygu Cakmak
youtube.com/watch?v=2NM78eM_yME&ab_channel=CreativeAssembly
All music in this video is from TeknoAxe
teknoaxe.com
--
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games. It's supported through and wouldn't be possible without the wonderful people who support it via Patreon and YouTube memberships.
patreon.com/ai_and_games
youtube.com/channel/UCov_51F0betb6hJ6Gumxg3Q/join
--
You can follow AI and Games on Twitter:
twitter.com/AIandGames
Join me for live streams over on Twitch:
twitch.tv/aiandgames
Join our Discord Community:
bit.ly/AIandGamesDiscord
Get yourself an AI and Games t-shirt over on Teespring!
teespring.com/stores/aiandgames
Support AI and Games on Patreon to get your name in the credits, early-access and more:
patreon.com/ai_and_games
--
Sometimes the AI in a videogame has lots of perfectly valid actions it can take, but deciding which one can be quite difficult. Utility AI is one approach to help solve it, by calculating how useful that action is based on the current context. We look at how it works, some simple calculations and how games ranging from @electronicarts's 'The Sims', all the way to @CreativeAssembly's 'Total War' series, adopt Utility AI in their games.
[00:00] Intro
[01:02] Why do we need Utility AI?
[04:21] Calculating Utility
[06:39] Utility AI in AAA Games
[14:46] Closing
If you're interested in learning more about Utility AI, check out these reading materials and related links:
"An Introduction to Utility AI Theory" - Game AI Pro v2
gameaipro.com/GameAIPro/GameAIPro_Chapter09_An_Introduction_to_Utility_Theory.pdf
"Behavior Decision System: Dragon Age Inquisition’s Utility Scoring Architecture" - Game AI Pro v3
gameaipro.com/GameAIPro3/GameAIPro3_Chapter31_Behavior_Decision_System_Dragon_Age_Inquisition%E2%80%99s_Utility_Scoring_Architecture.pdf
"Intrigue & Betrayal: Diplomacy AI in Total War Three Kingdoms", Csaba Toth and Duygu Cakmak, GDC 2021
"Analysing AI Behaviour in Total War | Creative Assembly and BAFTA Games", Csaba Toth and Duygu Cakmak
youtube.com/watch?v=2NM78eM_yME&ab_channel=CreativeAssembly
All music in this video is from TeknoAxe
teknoaxe.com
--
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games. It's supported through and wouldn't be possible without the wonderful people who support it via Patreon and YouTube memberships.
patreon.com/ai_and_games
youtube.com/channel/UCov_51F0betb6hJ6Gumxg3Q/join
--
You can follow AI and Games on Twitter:
twitter.com/AIandGames
Join me for live streams over on Twitch:
twitch.tv/aiandgames
Join our Discord Community:
bit.ly/AIandGamesDiscord
Get yourself an AI and Games t-shirt over on Teespring!
teespring.com/stores/aiandgames
![Why is It Difficult to Make Good AI for Games? | AI 101
Having made over 100 videos digging into how AI works in video games, Ive never really explained why this is such a big problem. Lets discuss some core AI fundamentals.
[00:00] Intro
[00:34] Playing the Game Vs Being the Game
[03:21] Understanding State Spaces
[06:51] The Challenge of Good AI for Games
[10:55] Why Not Use Machine Learning?
[12:58] Closing
[14:32] Credits
Be sure to catch the rest of the AI 101 series to learn the foundations of AI for games.
https://www.youtube.com/playlist?list=PLokhY9fbx05eeUZCNUbelL-b0TyVizPjt
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games.
Follow AI and Games for educational videos and essays:
http://www.youtube.com/@AIandGames
http://www.aiandgames.com
My second channel AI and Games Plus is dedicated to bonus content, deep-dive analysis, revisiting old topics and more:
http://www.youtube.com/@AIandGamesPlus
Listen to my podcast Branching Factor, as I discuss game development and research with my co-hosts and guests:
https://shows.acast.com/branchingfactor
Watch Livestreams: http://www.twitch.tv/aiandgames
Join our Community: https://discord.aiandgames.com
Buy our Merch: https://store.aiandgames.com
You can support AI and Games via Patreon, YouTube memberships, and Substack In return, you get bonus rewards!
http://www.patreon.com/aiandgames
https://www.youtube.com/@AIandGames/join
http://aiandgames.substack.com
Follow AI and Games on social media.
Twitter: http://www.twitter.com/AIandGames
Mastodon: https://mastodon.gamedev.place/@AIandGames
TikTok: https://www.tiktok.com/@aiandgames
Instagram: https://www.instagram.com/aiandgames/
Threads: https://www.threads.net/@aiandgames
BlueSky: https://bsky.app/profile/aiandgames.bsky.social
Substack: http://www.aiandgames.com
If youre interested in working with us, check out the following:
Business Enquiries: contact@aiandgames.com
Arrange Meeting: https://calendly.com/aiandgames Why is It Difficult to Make Good AI for Games? | AI 101](https://i.ytimg.com/vi/qCkqpRnk1oU/mqdefault.jpg)



![Why Earth Defense Force is the Perfect Videogame - with guest Rami Ismail | Design Dive
Support AI and Games on Patreon and listen to my full conversation with Rami:
https://www.patreon.com/posts/discussing-earth-60041279
Earth Defense Force is a series with a storied and complicated history and one that has an ardent and dedicated fanbase both in its homeland of Japan, but also in western territories. EDF is, in many respects, a game that continues to delight, but what is it about this series that makes it so appealing?
In this closing episode of Design Dive for 2021, I sit down with beloved indie game developer Rami Ismail to discuss our mutual appreciation of the series. How we come to discover the joy of Earth Defense Force, the quirks that continue to make us laugh and what is it about this series that means we hold it in such high esteem.
Be sure to check out all the great stuff Rami is involved in:
Follow Rami on Twitter: https://twitter.com/tha_rami
GameDev.World: https://gamedev.world/en/
The Habibis Podcast: https://thehabibis.transistor.fm/
Games Appearing in This Episode
The following games were captured using the PCSX2 Emulator:
- Gigantic Drive (Robot Alchemic Drive)
- Chikyū Bōeigun (Earth Defense Force)
- Chikyū Bōeigun 2 (Global Defense Force)
The following games were captured on an Xbox One X console:
- Earth Defense Force 2017
- Earth Defense Force: Insect Armageddon
- Earth Defense Force 2025
The following games were captured on PC
- Earth Defense Force 5
- Earth Defense Force: Iron Rain
- Earth Defense Force: World Brothers
Chapters
[00:00] Intro
[02:45] The Earth Defense Force Series
[08:55] Discussing Design
[14:36] Imperfections
[25:46] Dramatic Storytelling
[33:07] Closing
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games. Its supported through and wouldnt be possible without the wonderful people who support it via Patreon and YouTube memberships.
http://www.patreon.com/ai_and_games
https://www.youtube.com/channel/UCov_51F0betb6hJ6Gumxg3Q/join
You can follow AI and Games on Twitter:
http://www.twitter.com/AIandGames
Join me for live streams over on Twitch:
http://www.twitch.tv/aiandgames
Join our Discord Community:
bit.ly/AIandGamesDiscord
Get yourself an AI and Games t-shirt over on Teespring!
https://teespring.com/stores/aiandgames Why Earth Defense Force is the Perfect Videogame - with guest Rami Ismail | Design Dive](https://i.ytimg.com/vi/s74kpmk8qHM/mqdefault.jpg)
![MLMove: The LLM Trained to Play Counter-Strike | AI and Games #81
For this episode of @AIandGames, Tommy sits down with David Durst: a Stanford PhD graduate to discuss his research: the language model of movement. A transformer (like those used in LLMs) that has learned to move teams of bots like humans in Counter-Strike. By training against a dataset of retakes on Dust 2, MLMove hugs walls for cover, covers sightlines and coordinates strategy like a regular human player.
Read this episode at:
https://www.aiandgames.com/p/mlmove-the-llm-trained-to-play-counter
To find out more visit the dedicated MLMove website:
https://davidbdurst.com/mlmove/
Check out Davids recording of his PhD defence which goes into a lot more detail at:
youtube.com/watch?v=AACqZ1zMnOg&feature=youtu.be
The work on the transformer is inspired by prior work on a Scene Transformer by Ngiam et al found at this link:
https://arxiv.org/pdf/2106.08417v3
Chapters
[00:00] Intro
[01:49] What is MLMove?
[06:13] The Language Model of Movement
[12:10] The CSKnow Dataset
[16:51] Designing the MLMove Bot
[18:08] Evaluating Bot Behaviour
[25:47] Future Work
[30:30] Credits
Writer and Voice: Tommy Thompson
Editing and Production Support: Shraddha Gupta
AI and Games Logos: Andy Carolan
Theme Music: Ben Ridge
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games.
Check out all of our content:
Website and Newsletter: http://www.aiandgames.com
AI and Games: http://www.youtube.com/@AIandGames
AI and Games Plus: http://www.youtube.com/@AIandGamesPlus
AI and Games Conference: http://www.youtube.com/@AIandGamesConference
Goal State: http://www.youtube.com/@GoalStateAI
Livestreams on Twitch: http://www.twitch.tv/aiandgames
Join our Discord Community: https://discord.aiandgames.com
Follow AI and Games on social media.
BlueSky: https://bsky.app/profile/tommy.aiandgames.com
TikTok: https://www.tiktok.com/@aiandgames
If youre interested in working with us, check out the following:
Sponsorship Enquiries: https://www.passionfroot.me/aiandgames
Business Enquiries: https://www.aiandgames.com/p/professional-services
AI Bots That Move Like Pros: The MLMove Counter-Strike Project Explained
In this episode, we explore MLMove, a groundbreaking AI system that teaches Counter-Strike bots to move and coordinate like professional players. Built using the same transformer technology behind ChatGPT, MLMove learns realistic movement, teamwork, and positioning by studying thousands of hours of real gameplay. Developed by Dr. David Durst at Stanford, this research shows how generative AI can improve player experience—not replace developers. Discover how this 21-MB model achieves lifelike tactical behaviour, why it’s different from traditional game AI, and what it means for the future of AI in gaming. MLMove: The LLM Trained to Play Counter-Strike | AI and Games #81](https://i.ytimg.com/vi/sOgfvb8y9j8/mqdefault.jpg)
![Is Generative AI the Future of Game Development? | Artifacts #02
Throughout 2022 and 2023 the buzz surrounding #generativeai has exploded, and the big question often coming my way is: How does this impact the games industry? So lets dig into it. In this episode of Artifacts, we explain what Generative AI is, and how it can (and will) influence the industry in a positive way. But we also highlight the issues, the criticisms and the whether the hype is truly justified.
Fill in the Generative AI survey, tell us your thoughts, and help influence a future episode of Artifacts!
https://forms.gle/YwyGgM1cNYY2SmUd9
[00:00] Intro
[02:08] What is Generative AI?
[06:29] The Ever-Changing Market
[09:19] Generative AI for Games
[12:24] The Technology Issues
[15:01] The Legal Issues
[19:03] The Source of Creativity
[22:51] Wrapping Up
[23:55] Survey!
[24:55] Credits
Music in this episode is by @teknoaxe.
Opening sting and outro music by @BenRidgeMusic
Links for You
Variational Auto Encoders - https://arxiv.org/abs/1312.6114
Generative Adversarial Networks - https://arxiv.org/abs/1406.2661
How researchers found you can reproduce image data from training sets:
https://techcrunch.com/2022/12/13/image-generating-ai-can-copy-and-paste-from-training-data-raising-ip-concerns
Learn more about AI and copyright:
https://builtin.com/artificial-intelligence/ai-copyright
The @promethean_ai Keynote
https://www.youtube.com/watch?v=hA0MsGWvmzs
The Inworld / Skyrim Mod by @Bloctheworker
https://www.youtube.com/watch?v=d6sVWEu9HWU
@playhiddendoor Trailer
https://www.youtube.com/watch?v=KVyU3UsE47E
The @inworldai Origins Demo Trailer
https://www.youtube.com/watch?v=sQEDJ5Q5yEk
The Nvidia ACE Demo, using AI tools by @convai
https://www.youtube.com/watch?v=X_2X2uLZyL4
@BenBonk Makes a Unity Game With GPT
https://www.youtube.com/watch?v=L6vW0um5XTg&ab_channel=BenBonk
@samyam Makes a Horror Game in One Hour
https://www.youtube.com/watch?v=xXaw5-U9Syo
@SpeedTreeMiddleware Games Reel 2020
https://www.youtube.com/watch?v=vXFQPixRQOI
@Ubisofts new Ghostwriter tool, developed by @ubisoftlaforge7026
https://www.youtube.com/watch?v=XxQoN3PFiKA
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games.
Follow AI and Games for educational videos and essays:
http://www.youtube.com/@AIandGames
My second channel AI and Games Plus is dedicated to bonus content, deep-dive analysis, revisiting old topics and more:
http://www.youtube.com/@AIandGamesPlus
Listen to my podcast Branching Factor, as I discuss game development and research with my co-hosts and guests:
https://shows.acast.com/branchingfactor
Watch Livestreams: http://www.twitch.tv/aiandgames
Join our Community: https://discord.aiandgames.com
Buy our Merch: https://store.aiandgames.com
You can support AI and Games via Patreon and YouTube memberships, and in return, you get bonus rewards!
http://www.patreon.com/aiandgames
https://www.youtube.com/@AIandGames/join
Follow AI and Games on social media.
Twitter: http://www.twitter.com/AIandGames
Mastodon: https://mastodon.gamedev.place/@AIandGames
TikTok: https://www.tiktok.com/@aiandgames
If youre interested in working with us, check out the following:
Business Enquiries: contact@aiandgames.com
Arrange Meeting: https://calendly.com/aiandgames
#AINews #AITools #generativeart #generativeai Is Generative AI the Future of Game Development? | Artifacts #02](https://i.ytimg.com/vi/t3tm0dawMgo/mqdefault.jpg)

![Our Favourite Games from AI and Games Jam 2021
With over 100 games submitted and close to 1000 participants, the inaugural AI and Games game jam has vastly exceeded my expectations. To celebrate the occasion and thank everyone for participating, here is my summary. Including my favourite games submitted to the jam.
Thanks to everyone who signed up, submitted a game, rated, or just joined in the fun! You can check out the full list of submissions over at:
https://itch.io/jam/aiandgames-2021
[00:00] Intro
[02:29] Public Vote Winner: Breaking the Rule - https://ximmersion.itch.io/break-the-rule
[03:06] Hamlet - https://qwertyuiop888.itch.io/hamlet
[03:45] Dummy Fight - https://ahmetahaydemir.itch.io/dummy-fight
[04:24] Aquatic Deceptions - https://rodellison.itch.io/aquatic-deceptions
[05:12] A.N.G.E.R. - https://hellman.itch.io/anger
[05:52] Grid Wars - https://cavemanlabs.itch.io/grid-wars
[06:26] Sand Flag - https://peacefield.itch.io/sand-flag
[07:22] Eye of the Big Brother - https://celmer89.itch.io/eye-of-the-big-brother
[08:02] Wendell Tank - https://chase-of-bass.itch.io/wendell-tank
[08:52] Inhabitants of the Fir Forest - https://stefanocagnani90.itch.io/inhabitants-of-the-fir-forest
[09:37] Crime Bots - https://cashgarman.itch.io/crimebots
[10:39] Break the Sky - https://sambigos.itch.io/break-the-sky
[11:48] Wave Function Cat Labs - https://qu0d0.itch.io/wave-function-cat-labs
[12:46] Tic Tac Robot - https://jean-marc-studio-jms.itch.io/tic-tac-robot
[13:53] Closing
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games. Its supported through and wouldnt be possible without the wonderful people who support it via Patreon and YouTube memberships.
http://www.patreon.com/ai_and_games
https://www.youtube.com/channel/UCov_51F0betb6hJ6Gumxg3Q/join
You can follow AI and Games on Twitter:
http://www.twitter.com/AIandGames
Join me for livestreams over on Twitch:
http://www.twitch.tv/aiandgames
Join our Discord Community:
bit.ly/AIandGamesDiscord
Get yourself an AI and Games t-shirt over on Teespring!
https://teespring.com/stores/aiandgames
#AIandGamesJam21 #IndieDev #GameJam Our Favourite Games from AI and Games Jam 2021](https://i.ytimg.com/vi/tbEhLSI8QnM/mqdefault.jpg)
![The Thrill of Monster Hunter | Design Dive
Support AI and Games on Patreon:
http://www.patreon.com/ai_and_games
Design Dive returns to take a look at the recent releases in the Monster Hunter franchise. What is it about this series that makes it so appealing? Smashing big weapons into even bigger monsters of course!
[00:00] Intro
[01:52] The Core Loop
[04:14] Monster Design
[10:00] How Monster Hunter: World Builds Immersion
[15:28] The Combat Focus of Monster Hunter Rise
[19:11] Closing
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games. Its supported through and wouldnt be possible without the wonderful people who support it via Patreon and YouTube memberships.
http://www.patreon.com/ai_and_games
https://www.youtube.com/channel/UCov_51F0betb6hJ6Gumxg3Q/join
You can follow AI and Games on Twitter:
http://www.twitter.com/AIandGames
Join me for live streams over on Twitch:
http://www.twitch.tv/aiandgames
Join our Discord Community:
bit.ly/AIandGamesDiscord
Get yourself an AI and Games t-shirt over on Teespring!
https://teespring.com/stores/aiandgames The Thrill of Monster Hunter | Design Dive](https://i.ytimg.com/vi/u2F1npoOAnA/mqdefault.jpg)
![How Barks Make Videogame NPCs Look Smarter | AI 101
Support AI and Games on Patreon:
http://www.patreon.com/ai_and_games
It doesnt matter how intelligent your videogame AI is if the player doesnt understand it. One of the simplest and most effective ways of communicating intelligence is simply to have it say what it thinks aloud - a concept known in game development as a bark.
That might sound pretty dumb, but youd be surprised how effective it is in practice.
For additional viewing, check out these videos from other creators:
- @PeopleMakeGames interview with Supergiant on the dialogue of Hades:
https://www.youtube.com/watch?v=bwdYL0KFA_U
Plus check out these @GDCFestivalofGaming talks:
- Elan Ruskin on Fuzzy Pattern Matching for Dialogue:
https://www.youtube.com/watch?v=tAbBID3N64A
- Darren Korb and Greg Kasavin on the dialogue systems of Hades:
https://www.youtube.com/watch?v=m5KJSAj4afg
- Jason Gregory on context-aware dialogue in The Last of Us:
https://www.gdcvault.com/play/1020386/A-Context-Aware-Character-Dialog
Video Chapters
[00:00] Intro
[00:53] Bark Basics
[05:16] Designing for Immersion
[06:50] Barks for NPCs
[10:14] Communicating Game State
[14:38] Simple Dialogue Systems
[18:15] Closing
Music in this episode is by Teknoaxe:
http://www.teknoaxe.com
AI and Games is a YouTube series on research and applications of Artificial Intelligence in video games. Its supported through and wouldnt be possible without the wonderful people who support it via Patreon and YouTube memberships.
http://www.patreon.com/ai_and_games
https://www.youtube.com/channel/UCov_51F0betb6hJ6Gumxg3Q/join
You can follow AI and Games on Twitter:
http://www.twitter.com/AIandGames
Join me for live streams over on Twitch:
http://www.twitch.tv/aiandgames
Join our Discord Community:
bit.ly/AIandGamesDiscord How Barks Make Videogame NPCs Look Smarter | AI 101](https://i.ytimg.com/vi/u9VkW18IMzc/mqdefault.jpg)