GenRecon: Bridging Generative Priors for Multi-View 3D Scene Reconstruction @MatthiasNiessner
GenRecon: Bridging Generative Priors for Multi-View 3D Scene Reconstruction  @MatthiasNiessner
Uploaded May 2026 | Updated November 2026, 2 days ago
kasothaphie.github.io/GenRecon

We introduce a new approach to high-fidelity 3D scene reconstruction from multi-view RGB images that tightly couples reconstruction with a strong generative 3D prior. We cast scene reconstruction as conditional 3D generation over a set of spatially-localized, overlapping chunks that together tile the scene, scaling generation to large scene extents. Crucially, we inherit the fidelity and completeness of state-of-the-art generative shape models -- we use Trellis.2 as an example -- which we generalize to the scene level. To this end, we propose a projection-based conditioning mechanism that lifts posed multi-view image features into a coherent 3D representation aligned with the generative model, independent of view ordering and spatially anchored to the scene, yielding high-fidelity, multi-view consistent generated geometry. This enables lifting the strong object-level prior of Trellis.2 to multi-view, scene-scale generation, producing faithful, editable PBR mesh reconstructions of indoor environments. As a result, we obtain high-fidelity results that outperform cutting-edge reconstruction methods by 16%.
GenRecon: Bridging Generative Priors for Multi-View 3D Scene ReconstructionPrEditor3D: Fast and Precise 3D Shape EditingIntroduction to Deep Learning - 5.Scaling Optimization and Stochastic Gradient Descent (Summer 2020)Matthias Niessner Live StreamL3DG: Latent 3D Gaussian Diffusion (SIGGRAPH Asia24)MeshGPT: Generating Triangle Meshes with Decoder-Only TransformersIMU2Face: Real-time Gesture-driven Facial ReenactmentDeleted videoMotion2VecSets: 4D Latent Vector Set Diffusion for Non-rigid Shape Reconstruction and TrackingDeleted videoTUM AI Lecture Series - Perceiving Humans in the 3D World (Angjoo Kanazawa)3D Scanning & Motion Capture: 7. Non-Rigid Tracking & Reconstruction
Matthias Niessner |

GenRecon: Bridging Generative Priors for Multi-View 3D Scene Reconstruction

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER