End2End Multi-View Feature Matching with Differentiable Pose Optimization (ICCV2023) @MatthiasNiessner
End2End Multi-View Feature Matching with Differentiable Pose Optimization (ICCV2023)  @MatthiasNiessner
Uploaded September 2023 | Updated November 2026, 1 hour ago
Project: barbararoessle.github.io/e2e_multi_view_matching

Erroneous feature matches have severe impact on subsequent camera pose estimation and often require additional, time-costly measures, like RANSAC, for outlier rejection. Our method tackles this challenge by addressing feature matching and pose optimization jointly. To this end, we propose a graph attention network to predict image correspondences along with confidence weights. The resulting matches serve as weighted constraints in a differentiable pose estimation. Training feature matching with gradients from pose optimization naturally learns to down-weight outliers and boosts pose estimation on image pairs compared to SuperGlue by 6.7% on ScanNet. At the same time, it reduces the pose estimation time by over 50% and renders RANSAC iterations unnecessary. Moreover, we integrate information from multiple views by spanning the graph across multiple frames to predict the matches all at once. Multi-view matching combined with end-to-end training improves the pose estimation metrics on Matterport3D by 18.5% compared to SuperGlue.
End2End Multi-View Feature Matching with Differentiable Pose Optimization (ICCV2023)SHeaP: Self-Supervised Head Geometry Predictor Learned via 2D GaussiansSIGGRAPH 2023 Paper Compilation - TUM Visual Computing Lab & CollaboratorsDeleted videoModeling 3D Shapes by Reinforcement Learning (ECCV 2020)TUM AI Lecture Series - Explainability and Compositionality for Visual Recognition (Zeynep Akata)Face Anything: 4D Face Reconstruction from Any Image SequenceDPHMs: Diffusion Parametric Head Models for Depth-based TrackingHyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusion (ICCV2023)FaceForensics++: Learning to Detect Manipulated Facial Images (ICCV 2019)Introduction to Deep Learning (I2DL 2023) - 6. Training Neural NetworksBecomingLit: Relightable Gaussian Avatars with Hybrid Neural Shading
Matthias Niessner |

End2End Multi-View Feature Matching with Differentiable Pose Optimization (ICCV'2023)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER