Pose2Room: Understanding 3D Scenes from Human Activities (ECCV2022) @MatthiasNiessner
Pose2Room: Understanding 3D Scenes from Human Activities (ECCV2022)  @MatthiasNiessner
Uploaded July 2022 | Updated November 2026, 7 hours ago
Project: yinyunie.github.io/pose2room-page

With wearable IMU sensors, one can estimate human poses from wearable devices without requiring visual input. In this work, we pose the question: Can we reason about object structure in real-world environments solely from human trajectory information? Crucially, we observe that human motion and interactions tend to give strong information about the objects in a scene – for instance, a per-son sitting indicates the likely presence of a chair or sofa. To this end, we propose P2R-Net to learn a probabilistic 3D model of the objects in a scene characterized by their class categories and oriented 3D bounding boxes, based on an input observed human trajectory in the environment. P2R-Net models the probability distribution of object class as well as a deep Gaussian mixture model for object boxes, enabling sampling of multiple, diverse, likely modes of object configurations from an observed human trajectory. In our experiments, we demonstrate that P2R-Net can effectively learn multi-modal distributions of likely objects for human motions, and produce a variety of plausible object structures of the environment, even without any visual information.
Pose2Room: Understanding 3D Scenes from Human Activities (ECCV2022)CVPR 2023 Paper Compilation - TUM Visual Computing Lab & CollaboratorsPix2NPHM: Learning to Regress NPHM Reconstructions From a Single ImageWorldAgents: Can Foundation Image Models be Agents for 3D World Models?WorldExplorer: Towards Generating Fully Navigable 3D Scenes (SIGGRAPH Asia25)OneCanvas: 3D Scene Understanding via Panoramic ReprojectionLinPrim: Linear Primitives for Differentiable Volumetric RenderingTriFlow: Generating Artist-Like 3D Mesh Topology via Nearest-Vertex Vector FieldsTriPlaneNet: An Encoder for EG3D Inversion (WACV24)DeepDeform: Learning Non-rigid RGB-D Reconstruction with Semi-supervised Data (CVPR 2020)Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head AvatarsCVPR 2024 Paper Compilation - TUM Visual Computing Lab & Collaborators
Matthias Niessner |

Pose2Room: Understanding 3D Scenes from Human Activities (ECCV'2022)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER