Learning High-Speed Flight in the Wild (Science Robotics, 2021) @ailabRPG
Learning High-Speed Flight in the Wild (Science Robotics, 2021)  @ailabRPG
Uploaded October 2021 | Updated November 2026, 1 hour ago
Quadrotors are agile. Unlike most other machines, they can traverse extremely complex environments at high speeds. To date, only expert human pilots have been able to fully exploit their capabilities. Autonomous operation with onboard sensing and computation has been limited to low speeds. State-of-the-art methods generally separate the navigation problem into subtasks: sensing, mapping, and planning. While this approach has proven successful at low speeds, the separation it builds upon can be problematic for high-speed navigation in cluttered environments. Indeed, the subtasks are executed sequentially, leading to increased processing latency and compounding of errors through the pipeline. Here we propose an end-to-end approach that can autonomously fly quadrotors through complex natural and man-made environments at high speeds, with purely onboard sensing and computation. The key principle is to directly map noisy sensory observations to collision-free trajectories in a receding-horizon fashion. This direct mapping drastically reduces processing latency and increases robustness to noisy and incomplete perception. The sensorimotor mapping is performed by a convolutional network that is trained exclusively in simulation via privileged learning: imitating an expert with access to privileged information. By simulating realistic sensor noise, our approach achieves zero-shot transfer from simulation to challenging real-world environments that were never experienced during training: dense forests, snow-covered terrain, derailed trains and collapsed buildings. Our work demonstrates that end-to-end policies trained in simulation enable high-speed autonomous flight through challenging environments, outperforming traditional obstacle avoidance pipelines.

Reference:
A. Loquercio, E. Kaufmann, R. Ranftl, M. Müller, V. Koltun, D. Scaramuzza,
"Learning High-Speed Flight in the Wild",
Science Robotics, October 6, 2021
PDF: http://rpg.ifi.uzh.ch/docs/Loquercio21_Science.pdf
Code & Datasets: github.com/uzh-rpg/agile_autonomy

For more info about our research on:
Agile Drone Flight: http://rpg.ifi.uzh.ch/aggressive_flight.html
Drone Racing: http://rpg.ifi.uzh.ch/research_drone_racing.html
Machine Learning: http://rpg.ifi.uzh.ch/research_learning.html

Affiliations:
E. Kaufmann, A. Loquercio and D. Scaramuzza are with the Robotics and Perception Group, Dep. of Informatics, University of Zurich, and Dep. of Neuroinformatics, University of Zurich and ETH Zurich, Switzerland
http://rpg.ifi.uzh.ch/
R. Ranftl, M. Müller and V. Koltun are with Intel Labs
vladlen.info

Voiceover: Pete Edmunds | British Voiceover british-voiceover.co.uk
Music Credits: scottholmesmusic.com under Free Creative Commons License
Learning High-Speed Flight in the Wild (Science Robotics, 2021)Flightmare: A Flexible Quadrotor SimulatorModel Predictive Contouring Control for Time-Optimal Quadrotor Flight (TRO 2022)Actor-Critic Model Predictive Control (ICRA 2024)RPG TV Documentary: Drones for Search and Rescue - 3Sat Nano - 20.03.2020Deep Visual Odometry with Events and Frames (IROS 2024)Efficient, Data-Driven Perception with Event Cameras (Ph.D. Defense of Daniel Gehrig)Dream to Fly: Model-Based Reinforcement Learning for Vision-Based Drone Flight (ICRA 2026)Feature Detection and Tracking with the Dynamic and Active pixel Vision Sensor DAVISUZH Deep Learning Symposium: Learning Agile FilghtAEGNN: Asynchronous Event-based Graph Neural Networks (CVPR 2022)Dronet: Learning to Fly by Driving
UZH Robotics and Perception Group |

Learning High-Speed Flight in the Wild (Science Robotics, 2021)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER