Drift-free Visual SLAM using Digital Twins (RAL 2025) @ailabRPG
Drift-free Visual SLAM using Digital Twins (RAL 2025)  @ailabRPG
Uploaded January 2025 | Updated November 2026, 1 hour ago
Globally-consistent localization in urban environments is crucial for autonomous systems such as self-driving vehicles and drones, as well as assistive technologies for visually impaired people. Traditional Visual-Inertial Odometry (VIO) and Visual Simultaneous Localization and Mapping (VSLAM) methods, though adequate for local pose estimation, suffer from drift in the long term due to reliance on local sensor data. While GPS counteracts this drift, it is unavailable indoors and often unreliable in urban areas. An alternative is to localize the camera to an existing 3D map using visual-feature matching. This can provide centimeter-level accurate localization but is limited by the visual similarities between the current view and the map. This work introduces a novel approach that achieves accurate and globally-consistent localization by aligning the sparse 3D point cloud generated by the VIO/VSLAM system to a digital twin using point-to-plane matching; no visual data association is needed. The proposed method provides a 6-DoF global measurement tightly integrated into the VIO/VSLAM system. Experiments run on a high-fidelity GPS simulator and real-world data collected from a drone demonstrate that our approach outperforms state-of-the-art VIO-GPS systems and offers superior robustness against viewpoint changes compared to the state-of-the-art Visual SLAM systems.

Reference
Roxane Merat, Giovanni Cioffi, Leonard Bauersfeld , and Davide Scaramuzza
"Drift-free Visual SLAM using Digital Twins", Robotics and Automation Letters (RAL), 2025
PDF: arxiv.org/pdf/2412.08496
Code: github.com/uzh-rpg/rpg_svo_pro_with_digital_twins

For more info on our research on:
Our publications: https://rpg.ifi.uzh.ch/publications.html
Our publications on Visual and Inertial Odometry and SLAM: http://rpg.ifi.uzh.ch/research_vo.html

Affiliation: R. Merat, G. Cioffi, L. Bauersfeld, and D. Scaramuzza are with the Robotics and Perception Group, Dept. of Informatics, University of Zurich, Switzerland https://rpg.ifi.uzh.ch/
Drift-free Visual SLAM using Digital Twins (RAL 2025)E-RAFT: Dense Optical Flow from Event Cameras (3DV 2021)Motion-aware Event Suppression for Event Cameras (RSS 2026)Tightly-coupled Fusion of Global Positional Measurements in Optimization-based VIO (IROS 2020)Ultimate SLAM? Combining Events, Images, and IMU for Visual SLAM in HDR and High-Speed ScenariosData-Driven Methods for Event Cameras (Ph.D. defense of Mathias Gehrig)The Foldable Drone: A Morphing Quadrotor that can Squeeze and FlyHuman-Piloted Drone Racing: Visual Processing and Control (ICRA 2021 Video Pitch)Student-Informed Teacher Training (ICLR 2025)Swiss Drone Days - Zurich, June 11-12, 2022 - Teaser #2Structure-Invariant Range-Visual-Inertial Odometry for the Mars Science Helicopter (with NASA-JPL)AutoTune: Controller Tuning for High-Speed Flight
UZH Robotics and Perception Group |

Drift-free Visual SLAM using Digital Twins (RAL 2025)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER