Rapid, Dynamic Obstacle Avoidance with an Event-based Camera @ailabRPG
Rapid, Dynamic Obstacle Avoidance with an Event-based Camera  @ailabRPG
Uploaded May 2019 | Updated November 2026, 32 minutes ago
In this work, we study the effects that perception latency has on the maximum speed a robot can reach to safely navigate through an unknown cluttered environment. We provide a general analysis that can serve as a baseline for future quantitative reasoning for design trade-offs in autonomous robot navigation. We consider the case where the robot is modeled as a linear second-order system with bounded input and navigates through static obstacles. Also, we focus on a scenario where the robot wants to reach a target destination in as little time as possible, and therefore cannot change its longitudinal velocity to avoid obstacles. We show how the maximum latency that the robot can tolerate to guarantee safety is related to the desired speed, the range of its sensing pipeline, and the actuation limitations of the platform (i.e., the maximum acceleration it can produce). As a particular case study, we compare monocular and stereo frame-based cameras against novel, low-latency sensors, such as event cameras, in the case of quadrotor flight. To validate our analysis, we conduct experiments on a quadrotor platform equipped with an event camera to detect and avoid obstacles thrown towards the robot. To the best of our knowledge, this is the first theoretical work in which perception and actuation limitations are jointly considered to study the performance of a robotic platform in high-speed navigation.

Reference:
D. Falanga, S. Kim, D. Scaramuzza, "How Fast is Too Fast? The Role of Perception Latency in High-Speed Sense and Avoid", IEEE Robotics and Automation Letters (RA-L), 2019.
PDF: http://rpg.ifi.uzh.ch/docs/RAL19_Falanga.pdf

Our research pages:
Vision-based quadrotor navigation: http://rpg.ifi.uzh.ch/research_mav.html
Aggressive quadrotor flight: http://rpg.ifi.uzh.ch/aggressive_flight.html
Event-based vision: http://rpg.ifi.uzh.ch/research_dvs.html

Affiliations: D. Falanga, S. Kim and D. Scaramuzza are with the Robotics and Perception Group, Dept. of Informatics, University of Zurich, and Dept. of Neuroinformatics, University of Zurich and ETH Zurich, Switzerland http://rpg.ifi.uzh.ch/
Rapid, Dynamic Obstacle Avoidance with an Event-based CameraMPCC++: Model Predictive Contouring Control for Time-Optimal Flight with Safety Constraints (RSS24)VIMO: Simultaneous Visual Inertial Model-based Odometry and Force Estimation (RSS 2019)LA1 (Swiss italian TV): High-Speed Drones for the GoodFast Event-based Corner DetectionLearning Vision-based Agile Drone Flight: from Simulation to RealityEvent-driven Vision and Control for UAVs on a Neuromorphic Chip (Intel Loihi) - ICRA 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarios (ICRA 2021 Video Pitch)Video to Events: Recycling Video Datasets for Event CamerasLow-Latency Event-Based Velocimetry for Quadrotor Control in a Narrow Pipe (T-RO, 2026)Human-Level Performance with Autonomous Vision-based Drones - Davide ScaramuzzaDeep Drone Racing: From Simulation to Reality with Domain Randomization
UZH Robotics and Perception Group |

Rapid, Dynamic Obstacle Avoidance with an Event-based Camera

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER