AEGNN: Asynchronous Event-based Graph Neural Networks (CVPR 2022) @ailabRPG
AEGNN: Asynchronous Event-based Graph Neural Networks (CVPR 2022)  @ailabRPG
Uploaded April 2022 | Updated November 2026, 1 hour ago
The best performing learning algorithms devised for event cameras work by first converting events into dense representations that are then processed using standard CNNs. However, these steps discard both the sparsity and high temporal resolution of events, leading to high computational burden and latency. For this reason, recent works have adopted Graph Neural Networks (GNNs), which process events as "static" spatio-temporal graphs, which are inherently "sparse". We take this trend one step further by introducing Asynchronous, Event-based Graph Neural Networks (AEGNNs), a novel event-processing paradigm that generalizes standard GNNs to process events as ``evolving" spatio-temporal graphs. AEGNNs follow efficient update rules that restrict recomputation of network activations only to the nodes affected by each new event, thereby significantly reducing both computation and latency for event-by-event processing. AEGNNs are easily trained on synchronous inputs and can be converted to efficient, "asynchronous" networks at test time. We thoroughly validate our method on object classification and detection tasks, where we show an up to a 200-fold reduction in computational complexity (FLOPs), with similar or even better performance than state-of-the-art asynchronous methods. This reduction in computation directly translates to an 8-fold reduction in computational latency when compared to standard GNNs, which opens the door to low-latency event-based processing.

Reference:
Simon Schaefer*, Daniel Gehrig*, Davide Scaramuzza.
AEGNN: Asynchronous Event-based Graph Neural Networks
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022, New Orleans
PDF: http://rpg.ifi.uzh.ch/docs/CVPR22_Schaefer.pdf
Code: github.com/uzh-rpg/aegnn

Our research page on event-based vision: http://rpg.ifi.uzh.ch/research_dvs.html

For event-camera datasets, see here: http://rpg.ifi.uzh.ch/davis_data.html
here: https://dsec.ifi.uzh.ch/
and here: github.com/uzh-rpg/event-based_vision_resources#datasets

For an event camera simulator: http://rpg.ifi.uzh.ch/esim

For a survey paper on event cameras, see here:
https://rpg.ifi.uzh.ch/docs/EventVisionSurvey.pdf

Other resources on event cameras (publications, software, drivers, where to buy, etc.):
github.com/uzh-rpg/event-based_vision_resources

Affiliation:
D. Gehrig, and D. Scaramuzza are with the Robotics and Perception Group, Dept. of Informatics, University of Zurich, and Dept. of Neuroinformatics, University of Zurich and ETH Zurich, Switzerland http://rpg.ifi.uzh.ch/, and Simon Schaefer is with the Smart Robotics Lab, Dept. of Informatics, Technical University of Munich.
AEGNN: Asynchronous Event-based Graph Neural Networks (CVPR 2022)Dronet: Learning to Fly by DrivingRedesigning SLAM for Arbitrary Multi-Camera SystemsReinforcement Learning Meets Visual Odometry  (ECCV 2024)Low-Latency Event-Based Object Detection with Spatially-Sparse Linear Attention (ECCV 2026)Deep Drone Acrobatics (RSS 2020 Video Pitch)User-Conditioned Neural Control Policies for Mobile Robotics (ICRA 2023)Voxel Map for Visual SLAM (ICRA20 Video Pitch)Active Autonomous Aerial Exploration for Ground Robot Path PlanningExploration Without Global Consistency Using Local Volume ConsolidationFast Trajectory Optimization for Agile Quadrotor Maneuvers with a Cable-Suspended PayloadEvent-based Shape from Polarization (CVPR 2023)
UZH Robotics and Perception Group |

AEGNN: Asynchronous Event-based Graph Neural Networks (CVPR 2022)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER