Open Source with Project Aria: How to get High-Fidelity 3D Depth from Stereo Cameras @FacebookOpenSource
Open Source with Project Aria: How to get High-Fidelity 3D Depth from Stereo Cameras  @FacebookOpenSource
Uploaded June 2026 | Updated November 2026, 2 hours ago
The Project Aria team is officially releasing code for Aria Gen 2 Stereo Depth Estimation with NVIDIA’s FoundationStereo. This includes a tutorial of the full steps to perform stereo rectification and depth-from-stereo, as well as a tool to export dense metric depth from any Aria Gen 2 recording.

Our depth-from-stereo pipeline is built on top of two critical components: a highly accurate and generalizable stereo foundation model, FoundationStereo, and pixel-accurate online calibration of the stereo cameras on Aria Gen 2 devices with Visual Inertial Odometry (VIO). FoundationStereo is trained on over 1 million photorealistic synthetic pairs and delivers accurate stereo disparity estimates on Aria Gen 2 data without any fine-tuning needed. To convert these disparity estimates into metric depth estimates we leverage our state-of-the-art VIO system running on-device to provide continuously refined stereo calibration parameters as the glasses move and change over time.

Why this matters:

🤖 Zero-Shot Generalization: Works in diverse environments without retraining.
⚡️ High Performance: Real-time ready, capable of 20 FPS (with TensorRT).
🛠️ Full Pipeline: Covers stereo image rectification and disparity estimation.
🔓 100% Open Source: Built for the research and developer community.
Whether you are building for Robotics, AR/VR, or SLAM, Project Aria Gen 2’s depth-from stereo capability provides the robust depth foundation you've been waiting for.

👉 GitHub Tutorial & Tools: github.com/facebookresearch/projectaria_gen2_depth_from_stereo

#ProjectAria #ComputerVision #OpenSource #Robotics #MachineLearning #AITools #StereoVision
Open Source with Project Aria: How to get High-Fidelity 3D Depth from Stereo CamerasTECH(K)NOW Day: Gen Ashley, Jessica Lin, and Jesslyn Tannady chat about Facebook Open SourceELI5: SlowfastProject Aria Case Study: Introducing EgoMimic by the Georgia Institute of TechnologyMLH Fellowship x Facebook Open Source Q&AProject Aria CVPR 2022 Tutorial: Introducing open source file format VRS (4 of 11)The Diff Episode 14 : Hand Tracking in VRELI5: ProphetHow the New Pyrefly Tensor Shape Checking Feature WorksELI5: CrypTenProject Aria CVPR 2023 Tutorial: Live Demo (Section 6 of 10)Project Aria CVPR 2022 Tutorial: Egocentric Multi-View 3D Object Detection (7 of 11)
Meta Open Source |

Open Source with Project Aria: How to get High-Fidelity 3D Depth from Stereo Cameras

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER