Uploaded May 2025 | Updated September 2026, 2 hours ago

---

Believe it or not but you can download this demo and try on your own...
This showcases that you can run a local ai in Unreal Engine 5 and use it ingame as an generic NPC. The conversation here is not scripted...I am just reacting to what the AI says.
The Demo uses Ollama as AI Server and LLama3.2-vision as model.
I use as c++ and libcurl to commuicate with the Ollama server.
All code was written by chatgpt and Deepseek AI ... lol

Download link:
drive.google.com/drive/folders/1n362U-2zCpiaTR45RRP2flA166SdKCet?usp=sharing

Project download over at my patreon:
patreon.com/posts/ue5-ollama-ai-133275160?utm_medium=clipboard_copy&utm_source=copyLink&utm_campaign=postshare_creator&utm_content=join_link

For the metahuman interaction i used some plugins by Georgy Dev:
Runtime Speech Recognizer
fab.com/listings/00ffc308-d7f9-4142-ac4c-4aeaa75ab54b
Runtimer Text to speech
fab.com/listings/0dab646f-73b4-46d9-bb7e-8e6c12bdd808
Runtime Metahuman Lip Sync
fab.com/listings/b514294e-e78b-4b8b-ad21-78ce51dc7e8c

PC Specs:
RTX3090 Founders Edition
AMD 7950x3D
64GB Ram

Frame Model by
toya_mimura (sketchfab.com/toya_mimura)