SceneCAD: Predicting Object Alignmentsand Layouts in RGB-D Scans (ECCV 2020) @MatthiasNiessner
SceneCAD: Predicting Object Alignmentsand Layouts in RGB-D Scans (ECCV 2020)  @MatthiasNiessner
Uploaded April 2020 | Updated November 2026, 3 hours ago
Paper: arxiv.org/pdf/2003.12622.pdf

Project:
We present a novel approach to reconstructing lightweight, CAD-based representations of scanned 3D environments from commodity RGB-D sensors. Our key idea is to jointly optimize for both CAD model alignments as well as layout estimations of the scanned scene, explicitly modeling inter-relationships between objects-to-objects and objects-to-layout. Since object arrangement and scene layout are intrinsically coupled, we show that treating the problem jointly significantly helps to produce globally-consistent representations of a scene. Object CAD models are aligned to the scene by establishing dense correspondences between geometry, and we introduce a hierarchical layout prediction approach to estimate layout planes from corners and edges of the scene. To this end, we propose a message-passing graph neural network to model the inter-relationships between objects and layout, guiding generation ofa globally object alignment in a scene. By considering the global scene layout, we achieve significantly improved CAD alignments compared to state-of-the-art methods, improving from 41.83% to 58.41% alignment accuracy on SUNCG and from 50.05% to 61.24% on ScanNet, respectively. The resulting CAD-based representations makes our method well-suited for applications in content creation such as augmented- or virtual reality.
SceneCAD: Predicting Object Alignmentsand Layouts in RGB-D Scans (ECCV 2020)Deleted videoDeleted videoDeleted videoIntroduction to Deep Learning - 4. Optimization (Summer 2020)Deleted video3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans (CVPR 2019 Oral)Introduction to Deep Learning (I2DL 2023) - 10. ArchitecturesRC-MVSNet: Unsupervised Multi-View Stereo with Neural Rendering (ECCV22)Deleted videoDeleted videoDeleted video
Matthias Niessner |

SceneCAD: Predicting Object Alignmentsand Layouts in RGB-D Scans (ECCV 2020)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER