Video to Events: Recycling Video Datasets for Event Cameras (CVPR20 1-min Video Pitch) @ailabRPG
Video to Events: Recycling Video Datasets for Event Cameras (CVPR20 1-min Video Pitch)  @ailabRPG
Uploaded May 2020 | Updated November 2026, 38 minutes ago
Event cameras are novel sensors that output brightness changes in the form of a stream of asynchronous "events" instead of intensity frames. They offer significant advantages with respect to conventional cameras: High Dynamic Range (HDR), high temporal resolution, and no motion blur.
Recently, novel learning approaches operating on event data have achieved impressive results. Yet, these methods require a large amount of event data for training, which is hardly available due the novelty of event sensors in computer vision research. In this work, we present a method that addresses these needs by converting any existing video dataset recorded with conventional cameras to synthetic event data. This unlocks the use of a virtually unlimited number of existing video datasets for training networks designed for real event data. We evaluate our method on two relevant vision tasks, i.e., object recognition and semantic segmentation, and show that models trained on synthetic events have several benefits:
(i) they generalize well to real event data, even in scenarios where standard-camera images are blurry or overexposed, by inheriting the outstanding properties of event cameras;
(ii) they can be used for fine-tuning on real data to improve over state-of-the-art for both classification and semantic segmentation.

Reference:
Daniel Gehrig, Mathias Gehrig, Javier Hidalgo-Carrió, Davide Scaramuzza.
Video to Events: Bringing Modern Computer Vision Closer to Event Cameras
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, 2020
PDF: http://rpg.ifi.uzh.ch/docs/CVPR20_Gehrig.pdf
Code: github.com/uzh-rpg/rpg_vid2e

Our research page on event based vision: http://rpg.ifi.uzh.ch/research_dvs.html

For event-camera datasets, see here:
http://rpg.ifi.uzh.ch/davis_data.html
and here: github.com/uzh-rpg/event-based_vision_resources#datasets

For an event camera simulator: http://rpg.ifi.uzh.ch/esim/index.html

For a survey paper on event cameras, see here:
http://rpg.ifi.uzh.ch/docs/EventVisionSurvey.pdf

Other resources on event cameras (publications, software, drivers, where to buy, etc.):
github.com/uzh-rpg/event-based_vision_resources

Affiliation:
D. Gehrig, M. Gehrig, J. Hidalgo-Carrió and D. Scaramuzza are with the Robotics and Perception Group, Dept. of Informatics, University of Zurich, and Dept. of Neuroinformatics, University of Zurich and ETH Zurich, Switzerland http://rpg.ifi.uzh.ch/
Video to Events: Recycling Video Datasets for Event Cameras (CVPR20 1-min Video Pitch)HDVIO2.0: Wind and Disturbance Estimation with Hybrid Dynamics VIO (T-RO 2025)Learning Quadruped Locomotion Using Differentiable Simulation (CORL 2024, Oral)Recurrent Vision Transformers for Object Detection with Event Cameras (CVPR 2023)Swiss Drone Days - Zurich, June 11-12, 2022 - Teaser #1Approximate Imitation Learning for Event-based Flight in Cluttered Environments (CoRL 2026)A Benchmark Comparison of Monocular Visual-Inertial Odometry Algorithms for Flying RobotsESIM: an Open Event Camera SimulatorLearning Agile Quadrotor Flight in the Real World (RSS 2026)Learning Visuomotor Flight Through Dynamic Narrow Gap via Differentiable Simulation (CoRL 2026)Time-Optimal Online Replanning for Agile Quadrotor Flight (RAL 2022)Data-Efficient Decentralized Visual SLAM (ICRA18 Video Teaser)
UZH Robotics and Perception Group |

Video to Events: Recycling Video Datasets for Event Cameras (CVPR20 1-min Video Pitch)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER