Event-based Asynchronous Sparse Convolutional Networks @ailabRPG
Event-based Asynchronous Sparse Convolutional Networks  @ailabRPG
Uploaded March 2020 | Updated November 2026, 1 hour ago
Event cameras are bio-inspired sensors that respond to per-pixel brightness changes in the form of asynchronous and sparse "events". Recently, pattern recognition algorithms, such as learning-based methods, have made significant progress with event cameras by converting events into synchronous dense, image-like representations and applying traditional machine learning methods developed for standard cameras. However, these approaches discard the spatial and temporal sparsity inherent in event data at the cost of higher computational complexity and latency. In this work, we present a general framework for converting models trained on synchronous image-like event representations into asynchronous models with identical output, thus directly leveraging the intrinsic asynchronous and sparse nature of the event data. We show both theoretically and experimentally that this drastically reduces the computational complexity and latency of high-capacity, synchronous neural networks without sacrificing accuracy. In addition, our framework has several desirable characteristics: (i) it exploits spatio-temporal sparsity of events explicitly, (ii) it is agnostic to the event representation, network architecture, and task, and (iii) it does not require any train-time change, since it is compatible with the standard neural networks' training process. We thoroughly validate the proposed framework on two computer vision tasks: object detection and object recognition. In these tasks, we reduce the computational complexity up to 20 times with respect to high-latency neural networks. At the same time, we outperform state-of-the-art asynchronous approaches up to 24% in prediction accuracy.

Reference:
Nico Messikommer*, Daniel Gehrig*, Antonio Loquercio, and Davide Scaramuzza
European Conference on Computer Vision (ECCV), 2020.
PDF: http://rpg.ifi.uzh.ch/docs/ECCV20_Messikommer.pdf
Code: github.com/uzh-rpg/rpg_asynet

Our research page on event based vision: http://rpg.ifi.uzh.ch/research_dvs.html
Our research page on machine learning: http://rpg.ifi.uzh.ch/research_learning.html

For event-camera datasets, see here:
http://rpg.ifi.uzh.ch/davis_data.html
and here: github.com/uzh-rpg/event-based_vision_resources#datasets

For an event camera simulator: http://rpg.ifi.uzh.ch/esim/index.html

For a survey paper on event cameras, see here:
http://rpg.ifi.uzh.ch/docs/EventVisionSurvey.pdf

Other resources on event cameras (publications, software, drivers, where to buy, etc.):
github.com/uzh-rpg/event-based_vision_resources

Affiliations:
The authors are with the Robotics and Perception Group, Dep. of Informatics, University of Zurich, and Dep. of Neuroinformatics, University of Zurich and ETH Zurich, Switzerland
http://rpg.ifi.uzh.ch/
Event-based Asynchronous Sparse Convolutional NetworksDrift-free Visual SLAM using Digital Twins (RAL 2025)E-RAFT: Dense Optical Flow from Event Cameras (3DV 2021)Motion-aware Event Suppression for Event Cameras (RSS 2026)Tightly-coupled Fusion of Global Positional Measurements in Optimization-based VIO (IROS 2020)Ultimate SLAM? Combining Events, Images, and IMU for Visual SLAM in HDR and High-Speed ScenariosData-Driven Methods for Event Cameras (Ph.D. defense of Mathias Gehrig)The Foldable Drone: A Morphing Quadrotor that can Squeeze and FlyHuman-Piloted Drone Racing: Visual Processing and Control (ICRA 2021 Video Pitch)Student-Informed Teacher Training (ICLR 2025)Swiss Drone Days - Zurich, June 11-12, 2022 - Teaser #2Structure-Invariant Range-Visual-Inertial Odometry for the Mars Science Helicopter (with NASA-JPL)
UZH Robotics and Perception Group |

Event-based Asynchronous Sparse Convolutional Networks

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER