Uploaded October 2021 | Updated September 2026, 1 week ago
*NVIDIA interview: blogs.nvidia.com/blog/2021/12/16/omniverse-creator-anderson-rohr
I just created this scene to test the @NVIDIAOmniverse Audio2Face to @UnrealEngine Metahuman.
I recorded my voice singing this music, cleaned the audio a little bit and opened that in Audio2Face.
AI generates lip sync from a voice over to a 3d face, then I manually animated the eyes, brows and neck in Unreal Engine to add more realism for the scene. I also did the lighting.
Rendered in Unreal Engine 4.27.1 with the new RTX Global Illumination by NVIDIA.
Color grading in @Adobe Premiere Pro
Powered by @NVIDIA-Studio
Music: Bad Moon Rising by Mourning Ritual (feat. Peter Dreimanis)
Follow my work:
artstation.com/artwork/eaGOn6
instagram.com/anderson_rohr
#unrealengine #audio2face #metahuman #ai #rtxon #rtxgi #nvidia #nvidiaomniverse #ue4 #ue5 #realtime #rendering #lipsync #animation
*NVIDIA interview: blogs.nvidia.com/blog/2021/12/16/omniverse-creator-anderson-rohr
I just created this scene to test the @NVIDIAOmniverse Audio2Face to @UnrealEngine Metahuman.
I recorded my voice singing this music, cleaned the audio a little bit and opened that in Audio2Face.
AI generates lip sync from a voice over to a 3d face, then I manually animated the eyes, brows and neck in Unreal Engine to add more realism for the scene. I also did the lighting.
Rendered in Unreal Engine 4.27.1 with the new RTX Global Illumination by NVIDIA.
Color grading in @Adobe Premiere Pro
Powered by @NVIDIA-Studio
Music: Bad Moon Rising by Mourning Ritual (feat. Peter Dreimanis)
Follow my work:
artstation.com/artwork/eaGOn6
instagram.com/anderson_rohr
#unrealengine #audio2face #metahuman #ai #rtxon #rtxgi #nvidia #nvidiaomniverse #ue4 #ue5 #realtime #rendering #lipsync #animation
