IGNOR: Image-guided Neural Object Rendering (ICLR 2020) @MatthiasNiessner
IGNOR: Image-guided Neural Object Rendering (ICLR 2020)  @MatthiasNiessner
Uploaded November 2018 | Updated November 2026, 3 hours ago
ICLR 2020 Paper Video
Project Page: niessnerlab.org/projects/thies2020ignor.html

We propose a new learning-based novel view synthesis approach for scanned objects that is trained based on a set of multi-view images. Instead of using texture mapping or hand-designed image-based rendering, we directly train a deep neural network to synthesize a view-dependent image of an object. First, we employ a coverage-based nearest neighbor look-up to retrieve a set of reference frames that are explicitly warped to a given target view using cross-projection. Our network then learns to best composite the warped images. This enables us to generate photo-realistic results, while not having to allocate capacity on ``remembering'' object appearance. Instead, the multi-view images can be reused. While this works well for diffuse objects, cross-projection does not generalize to view-dependent effects. Therefore, we propose a decomposition network that extracts view-dependent effects and that is trained in a self-supervised manner. After decomposition, the diffuse shading is cross-projected, while the view-dependent layer of the target view is regressed. We show the effectiveness of our approach both qualitatively and quantitatively on real as well as synthetic data.
IGNOR: Image-guided Neural Object Rendering (ICLR 2020)NPGA: Neural Parametric Gaussian Avatars (SIGGRAPH Asia24)ViewAL: Active Learning with Viewpoint Entropy for Semantic Segmentation (CVPR 2020)3DGS-LM: Faster Gaussian-Splatting Optimization with Levenberg-MarquardtClipFace: Text-guided Editing of Textured 3D Morphable Models (SIGGRAPH23)ICCV 2023 Paper Compilation - TUM Visual Computing Lab & CollaboratorsEnd2End Multi-View Feature Matching with Differentiable Pose Optimization (ICCV2023)SHeaP: Self-Supervised Head Geometry Predictor Learned via 2D GaussiansSIGGRAPH 2023 Paper Compilation - TUM Visual Computing Lab & CollaboratorsDeleted videoModeling 3D Shapes by Reinforcement Learning (ECCV 2020)TUM AI Lecture Series - Explainability and Compositionality for Visual Recognition (Zeynep Akata)
Matthias Niessner |

IGNOR: Image-guided Neural Object Rendering (ICLR 2020)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER