VIMO: Simultaneous Visual Inertial Model-based Odometry and Force Estimation (RSS 2019) @ailabRPG
VIMO: Simultaneous Visual Inertial Model-based Odometry and Force Estimation (RSS 2019)  @ailabRPG
Uploaded July 2020 | Updated November 2026, 48 minutes ago
In recent years, many approaches to Visual Inertial Odometry (VIO) have become available. However, they neither exploit the robot’s dynamics and known actuation inputs, nor differentiate between desired motion due to actuation and unwanted perturbation due to external force. For many robotic applications, it is often essential to sense the external force acting on the system due to, for example, interactions, contacts, and disturbances. Adding a motion constraint to an estimator leads to a discrepancy between the model-predicted motion and the actual motion. Our approach exploits this discrepancy and resolves it by simultaneously estimating the motion and the external force. We propose a relative motion constraint combining the robot’s dynamics and the external force in a preintegrated residual, resulting in a tightly-coupled, sliding-window estimator exploiting all correlations among all variables. We implement our Visual Inertial Model-based Odometry (VIMO) system into a state-ofthe-art VIO approach and evaluate it against the original pipeline without motion constraints on both simulated and real-world data. The results show that our approach increases the accuracy of the estimator up to 29% compared to the original VIO, and provides external force estimates at no extra computational cost. To the best of our knowledge, this is the first approach exploiting model dynamics by jointly estimating motion and external force. Our implementation will be made available open-source.

Reference:
B. Nisar, P. Foehn, D. Falanga, D. Scaramuzza
"VIMO: Simultaneous Visual Inertial Model-based Odometry and Force Estimation"
Robotics: Science and Systems (RSS), Freiburg, 2019
PDF: http://rpg.ifi.uzh.ch/docs/RSS19_Nisar.pdf
Code: github.com/uzh-rpg/vimo

Our research on visual (-inertial) odometry and SLAM: http://rpg.ifi.uzh.ch/research_vo.html
More about our research: http://rpg.ifi.uzh.ch/publications.html

Affiliations: The authors are with the Robotics and Perception Group, Dep. of informatics, University of Zurich, and Dep. of Neuroinformatics, University of Zurich and ETH Zurich, Switzerland http://rpg.ifi.uzh.ch/
VIMO: Simultaneous Visual Inertial Model-based Odometry and Force Estimation (RSS 2019)LA1 (Swiss italian TV): High-Speed Drones for the GoodFast Event-based Corner DetectionLearning Vision-based Agile Drone Flight: from Simulation to RealityEvent-driven Vision and Control for UAVs on a Neuromorphic Chip (Intel Loihi) - ICRA 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarios (ICRA 2021 Video Pitch)Video to Events: Recycling Video Datasets for Event CamerasLow-Latency Event-Based Velocimetry for Quadrotor Control in a Narrow Pipe (T-RO, 2026)Human-Level Performance with Autonomous Vision-based Drones - Davide ScaramuzzaDeep Drone Racing: From Simulation to Reality with Domain RandomizationLearning Minimum-Time Flight in Cluttered Environments (RAL 2022)Video to Events: Recycling Video Datasets for Event Cameras (CVPR20 1-min Video Pitch)
UZH Robotics and Perception Group |

VIMO: Simultaneous Visual Inertial Model-based Odometry and Force Estimation (RSS 2019)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER