GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians @MatthiasNiessner
GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians  @MatthiasNiessner
Uploaded December 2023 | Updated November 2026, 12 hours ago
Project: shenhanqian.github.io/gaussian-avatars

We introduce GaussianAvatars, a new method to create photorealistic head avatars that are fully controllable in terms of expression, pose, and viewpoint. The core idea is a dynamic 3D representation based on 3D Gaussian splats that are rigged to a parametric morphable face model. This combination facilitates photorealistic rendering while allowing for precise animation control via the underlying parametric model, e.g., through expression transfer from a driving sequence or by manually changing the morphable model parameters. We parameterize each splat by a local coordinate frame of a triangle and optimize for explicit displacement offset to obtain a more accurate geometric representation. During avatar reconstruction, we jointly optimize for the morphable model parameters and Gaussian splat parameters in an end-to-end fashion. We demonstrate the animation capabilities of our photorealistic avatar in several challenging scenarios. For instance, we show reenactments from a driving video, where our method outperforms existing works by a significant margin.
GaussianAvatars: Photorealistic Head Avatars with Rigged 3D GaussiansVideo Diffusion Avatars: Taming Video Diffusion Models into Controllable 3D AvatarsIntrinsic Image Diffusion for Single-view Material EstimationDeleted videoDeleted videoMonoNPHM: Dynamic Head Reconstruction from Monocular VideosInverse Path Tracing for Joint Material and Lighting Estimation (CVPR 2019 Oral)TUM AI Lecture Series - Neural Fields Beyond Novel View Synthesis (Andrea Tagliasacchi)DiffusionAvatars: Deferred Diffusion for High-fidelity 3D Head AvatarsDeleted videoNeural Non-Rigid Tracking (NeurIPS 2020)TUM AI Lecture Series - FLUX: Flow Matching for Content Creation at Scale (Robin Rombach)
Matthias Niessner |

GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER