CNN-based Ego-Motion Estimation for Fast MAV Maneuvers @microuav
CNN-based Ego-Motion Estimation for Fast MAV Maneuvers  @microuav
Uploaded April 2021 | Updated November 2026, 3 hours ago
Video demonstrating the performance of the pose estimation network and network-in-loop autonomous flights. A part of this work (shown during the first 1 minute and 35 seconds of this video) has been accepted by ICRA 2021.

Abstract: In the field of visual ego-motion estimation for Micro Air Vehicles (MAVs), fast maneuvers stay challenging mainly because of the big visual disparity and motion blur. In the pursuit of higher robustness, we study convolutional neural networks (CNNs) that predict the relative pose between subsequent images from a fast-moving monocular camera facing a planar scene. Aided by the Inertial Measurement Unit (IMU), we mainly focus on the translational motion. The networks we study have similar small model sizes (around 1.35MB) and high inference speeds (around 100Hz on a mobile GPU). Images for training and testing have realistic motion blur. Departing from a network framework that iteratively warps the first image to match the second with cascaded network blocks, we study different network architectures and training strategies. Simulated datasets and MAV flight datasets are used for evaluation. The proposed setup shows better accuracy over existing networks and traditional feature-point-based methods during fast maneuvers. Moreover, self-supervised learning outperforms supervised learning. In the Appendix, we further demonstrate the network's performance by testing on a public high-speed flight dataset and running it in real-time onboard for the feedback control of an autonomous MAV that reaches speeds up to 4m/s.

Article (with Appendix): arxiv.org/abs/2101.01841
Open-Sourced Code: github.com/tudelft/PoseNet_Planar

Authors: Yingfu Xu, Prof. Dr. Guido C. H. E. de Croon
Technical Support: Ir. Nilay Y. Sheth

The narrator of this video is generated using Google Cloud Text-to-Speech API.
CNN-based Ego-Motion Estimation for Fast MAV ManeuversIMAV 2014 Presentations - Qi WangEvolved controller makes 20-gram drone fly through window with onboard visionDelFly Nimble - an agile insect-inspired robotControl of Unknown Quadrotors from a Single ThrowIMAV 2014 Presentations - Mario Gäbel[Additional Demo] Stability-based Scale Estimation for Monocular SLAMMonoRace: Robust monocular AI for champion-level drone racingRigid Airborne Docking between an Overactuated Multicopter and a Fixed-wing UAVsonar testIMAV2014 CompetitionLisa/S Nano Quadcopter Getting Started
MAVLab TU Delft |

CNN-based Ego-Motion Estimation for Fast MAV Maneuvers

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER