Uploaded June 2023 | Updated September 2026, 7 hours ago

---

!IMPORTANT NOTE!! Runtime audio importer and speech recognizer are not free anymore on marketplace. However I think you can till download the plugins from Github:
github.com/gtreshchev/RuntimeSpeechRecognizer
github.com/gtreshchev/RuntimeAudioImporter

Because there has been excessive demand for a tutorial, there it is now.
Explaining how to use a microphone for communication with an NPC/AI and get an voice response using ChatGPT and Elevenlabs TTS from scratch!

Project Files downloadable for Patrons:
https://9sj9.short.gy/UE5AI

Plugins need to be installed for UE5.1
____________________________________
unrealengine.com/marketplace/en-US/product/varest-plugin
unrealengine.com/marketplace/en-US/product/runtime-audio-importer
unrealengine.com/marketplace/en-US/product/runtime-speech-recognizer

Websites:
openai.com
API: platform.openai.com/docs/api-reference/chat/create
beta.elevenlabs.io
API: docs.elevenlabs.io/api-reference/text-to-speech-stream

Voice IDs:
Name Voice ID
Rachel 21m00Tcm4TlvDq8ikWAM
Domi AZnzlk1XvdvUeBnXmlld
Bella EXAVITQu4vr4xnSDxMaL
Antoni ErXwobaYiN019PkySvjV
Elli MF3mGyEYCl7XYWbV9V6O
Josh TxGEqnHWrfWFTfGW9XjX
Arnold VR6AewLTigWG4xSOukaG
Adam pNInz6obpgDQGcFmaJgB
Sam yoZ06aMxZJJ28mfd3POQ


Don't forget to like, comment, and subscribe for more exciting showcases.

discord.gg/94tfRKDG9w

_______________________________________
Want to support me?

patreon.com/marvelmaster
or
paypal.me/marvelmasteryt

All donation money flows into better software, equipement, assest and cloud space.
_______________________________________

Time stamps:
0:00 Introduction
1:39 Requirements and limitations
4:51 Setting up the project
6:21 Speech recognition
16:07 ChatGPT communication
34:46 Fixing ChatGPT bugs
37:47 Make ChatGPT remember
44:36 Elevenlabs TTS
1:04:44 TTS Bug fixing
1:12:00 Outro