Uploaded November 2019 | Updated September 2026, 1 day ago
In order to make augmented reality (AR) more realistic, we need to be able to apply AR effects both in front and behind objects in a scene. Most AR systems, however, are based on SLAM, which only tracks a few sparse point features. This allows for overlays in front of objects, but not behind them. We developed a method that increases the density of the depth from the sparse point track locations to all other pixels, creating dense depth maps for every frame. This method enables AR effects to fully interact with a scene geometry, for example, to recognize occlusions by real objects in the scene.
Read the full paper: Fast Depth Densification for Occlusion-aware Augmented Reality research.fb.com/publications/fast-depth-densification-for-occlusion-aware-augmented-reality
In order to make augmented reality (AR) more realistic, we need to be able to apply AR effects both in front and behind objects in a scene. Most AR systems, however, are based on SLAM, which only tracks a few sparse point features. This allows for overlays in front of objects, but not behind them. We developed a method that increases the density of the depth from the sparse point track locations to all other pixels, creating dense depth maps for every frame. This method enables AR effects to fully interact with a scene geometry, for example, to recognize occlusions by real objects in the scene.
Read the full paper: Fast Depth Densification for Occlusion-aware Augmented Reality research.fb.com/publications/fast-depth-densification-for-occlusion-aware-augmented-reality
