User-Conditioned Neural Control Policies for Mobile Robotics (ICRA 2023) @ailabRPG
User-Conditioned Neural Control Policies for Mobile Robotics (ICRA 2023)  @ailabRPG
Uploaded December 2022 | Updated November 2026, 58 minutes ago
Recently, learning-based controllers have been shown to push mobile robotic systems to their limits and provide the robustness needed for many real-world applications. However, only classical optimization-based control frameworks offer the inherent flexibility to be dynamically adjusted during execution by, for example, setting target speeds or actuator limits. We present a framework to overcome this shortcoming of neural controllers by conditioning them on an auxiliary input. This advance is enabled by including a feature-wise linear modulation layer (FiLM). We use model-free reinforcement-learning to train quadrotor control policies for the task of navigating through a sequence of waypoints in minimum time. By conditioning the policy on the maximum available thrust or the viewing direction relative to the next waypoint, a user can regulate the aggressiveness of the quadrotor’s flight during deployment. We demonstrate in simulation and in real-world experiments that a single control policy can achieve close to time-optimal flight performance across the entire performance envelope of the robot, reaching up to 60 km/h and 4.5 g in acceleration. The ability to guide a learned controller during task execution has implications beyond agile quadrotor flight, as conditioning the control policy on human intent helps safely bringing learning based systems out of the well-defined laboratory environment into the wild.


Reference:
L. Bauersfeld, E. Kaufmann, D. Scaramuzza
User-Conditioned Neural Control Policies for Mobile Robotics, arXiv, 2022
PDF: https://rpg.ifi.uzh.ch/docs/ICRA23_Bauersfeld.pdf

To see more of our work on drone flight and machine learning, check out our webpage:
- Drone racing: https://rpg.ifi.uzh.ch/research_drone_racing.html
- Deep learning: https://rpg.ifi.uzh.ch/research_learning.html
- Agile flight: https://rpg.ifi.uzh.ch/aggressive_flight.html
- Lab's publications: https://rpg.ifi.uzh.ch/publications.html

Affiliations:
The authors are with the Robotics and Perception Group, Dep. of Informatics, University of Zurich, and Dep. of Neuroinformatics, University of Zurich Switzerland (https://rpg.ifi.uzh.ch)
User-Conditioned Neural Control Policies for Mobile Robotics (ICRA 2023)Voxel Map for Visual SLAM (ICRA20 Video Pitch)Active Autonomous Aerial Exploration for Ground Robot Path PlanningExploration Without Global Consistency Using Local Volume ConsolidationFast Trajectory Optimization for Agile Quadrotor Maneuvers with a Cable-Suspended PayloadEvent-based Shape from Polarization (CVPR 2023)Rapid, Dynamic Obstacle Avoidance with an Event-based CameraMPCC++: Model Predictive Contouring Control for Time-Optimal Flight with Safety Constraints (RSS24)VIMO: Simultaneous Visual Inertial Model-based Odometry and Force Estimation (RSS 2019)LA1 (Swiss italian TV): High-Speed Drones for the GoodFast Event-based Corner DetectionLearning Vision-based Agile Drone Flight: from Simulation to Reality
UZH Robotics and Perception Group |

User-Conditioned Neural Control Policies for Mobile Robotics (ICRA 2023)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER