Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Cars (CVPR18) @ailabRPG
Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Cars (CVPR18)  @ailabRPG
Uploaded August 2018 | Updated November 2026, 8 hours ago
Event cameras are bio-inspired vision sensors that naturally capture the dynamics of a scene, filtering out redundant information. This paper presents a deep neural network approach that unlocks the potential of event cameras on a challenging motion-estimation task: prediction of a vehicle’s steering angle. To make the best out of this sensor–algorithm combination, we adapt state-of-the-art convolutional architectures to the output of event sensors and extensively evaluate the performance of our approach on a publicly available large scale event-camera dataset (≈1000 km). We present qualitative and quantitative explanations of why event cameras allow robust steering estimation even in cases where traditional cameras fail, e.g. challenging illumination conditions and fast motion. Finally, we demonstrate the advantages of leveraging transfer learning from traditional to event based vision, and show that our approach outperforms state-of-the-art algorithms based on standard cameras.

Reference: A.I. Maqueda, A. Loquercio, G. Gallego, N. Garcia, D. Scaramuzza. Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Cars.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, June 2018.
PDF: http://rpg.ifi.uzh.ch/docs/CVPR18_Maqueda.pdf
Code: github.com/uzh-rpg/cvpr18_event_steering_angle

Our research page on event based vision: http://rpg.ifi.uzh.ch/research_dvs.html

Our research page on deep learning: http://rpg.ifi.uzh.ch/research_learning.html

For event-camera datasets and event camera simulator, see here: http://rpg.ifi.uzh.ch/davis_data.html

Other resources on event cameras (publications, software, drivers, where to buy, etc.): github.com/uzh-rpg/event-based_vision_resources

Affiliations:
A.I. Maqueda and Narciso García are with the Grupo de Tratamiento de Imágenes, Universidad Politécnica de Madrid gti.ssr.upm.es
A. Loquercio, G. Gallego and D. Scaramuzza are with the Robotics and Perception Group, Dep. of Informatics, University of Zurich, and Dep. of Neuroinformatics, University of Zurich and ETH Zurich, Switzerland http://rpg.ifi.uzh.ch/
Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Cars (CVPR18)Continuous-Time vs. Discrete-Time Vision-based SLAM: A Comparative Study (RA-L 2022)Agile Autonomy: Learning High-Speed Flight (Ph.D. Thesis Defense Antonio Loquercio)Learning Depth with Very Sparse Supervision (IROS 2020 Pitch Video)Demonstrating Agile Flight from Pixels without State Estimation (RSS 2024)ICRA 2026 Keynote Tutorial - Learning Agile Vision-based Quadrotor FlightParabolic Flight Experiments | How Gravity affects Self-Motion estimation in Drone PilotsFisher Information Field: an Efficient and Differentiable Map for Perception-aware PlanningPowerline Tracking with Event Cameras (IROS 2021 Video Pitch)10-Year Anniversary of the UZH Robotics and Perception GroupEnd-to-End Learning of Representations for Asynchronous Event-Based Data (ICCV19)Time Lens++: Event-based Frame Interpolation with Parametric Flow and Multi-scale Fusion (CVPR 2022)
UZH Robotics and Perception Group |

Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Cars (CVPR'18)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER