TUM AI Lecture Series - Deep Surface Meshes (Pascal Fua) @MatthiasNiessner
TUM AI Lecture Series - Deep Surface Meshes (Pascal Fua)  @MatthiasNiessner
Uploaded January 2022 | Updated November 2026, 4 days ago
Abstract:
Geometric Deep Learning has recently made striking progress with the advent of Deep Implicit Fields (SDFs). They allow for detailed modeling of watertight surfaces of arbitrary topology while not relying on a 3D Euclidean grid, resulting in a learnable 3D surface parameterization that is not limited in resolution. Unfortunately, they have not yet reached their full potential for applications that require an explicit surface representation in terms of vertices and facets because converting the SDF to such a 3D mesh representation requires a marching-cube algorithm, whose output cannot be easily differentiated with respect to the SDF parameters.

In this talk, I will our approach to overcoming this limitation and implementing convolutional neural nets that output complex 3D surface meshes while remaining fully-differentiable and end-to-end trainable. I will also present applications to single view reconstruction, physically-driven Shape optimization, and bio-medical image segmentation.
TUM AI Lecture Series - Deep Surface Meshes (Pascal Fua)SG-NN: Sparse Generative Neural Networks for Self-Supervised Scene Completion of RGB-D Scans (CVPR)Deleted videoNeural Voice Puppetry: Audio-driven Facial Reenactment (ECCV 2020)IGNOR: Image-guided Neural Object Rendering (ICLR 2020)NPGA: Neural Parametric Gaussian Avatars (SIGGRAPH Asia24)ViewAL: Active Learning with Viewpoint Entropy for Semantic Segmentation (CVPR 2020)3DGS-LM: Faster Gaussian-Splatting Optimization with Levenberg-MarquardtClipFace: Text-guided Editing of Textured 3D Morphable Models (SIGGRAPH23)ICCV 2023 Paper Compilation - TUM Visual Computing Lab & CollaboratorsEnd2End Multi-View Feature Matching with Differentiable Pose Optimization (ICCV2023)SHeaP: Self-Supervised Head Geometry Predictor Learned via 2D Gaussians
Matthias Niessner |

TUM AI Lecture Series - Deep Surface Meshes (Pascal Fua)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER