Unsupervised Learning of a Hierarchical Spiking Neural Network for Optical Flow Estimation @microuav
Unsupervised Learning of a Hierarchical Spiking Neural Network for Optical Flow Estimation  @microuav
Uploaded April 2019 | Updated November 2026, 3 hours ago
Paper: ieeexplore.ieee.org/abstract/document/8660483
arxiv.org/abs/1807.10936
cuSNN library: github.com/tudelft/cuSNN

We present the first SNN in which selectivity to the local and global motion of the visual scene emerges through STDP from event-based stimuli. The success of this emergence depends on three contributions. First, an adaptive spiking neuron model is necessary to handle the rapidly varying input statistics of event-based sensors, and we present a novel suitable formulation for this purpose. Second, we introduce a novel STDP implementation that, contrary to the current state-of-the-art of this learning protocol, is inherently stable. Third, we propose an SNN architecture that learns to perform hierarchical feature extraction, effectively capturing geometric features, identifying the local motion of these features, and integrating this information into a global ego-motion estimate. We hope that this work, and the framework published alongside it, will provide the first step of many towards highly efficient artificial motion perception.
Unsupervised Learning of a Hierarchical Spiking Neural Network for Optical Flow EstimationSwarm pocket drones demonstration @ dig-it eventDelfly FreeflightSeeing distances with one eyeDelFly flight caught on high speed cameraSLAMdunk onboard Joe detectionIMAV 2014 Presentations - Bart RemesA2RL January 2026 - Season 2 - SKYDREAMER - Micro Aerial Vehicle Lab (Delft, the Netherlands)A Tailless Flapping Wing MAV Performing Monocular Visual Servoing TasksTudelft bebop paparazziSwarm of 4 tiny flying robots performs a search-and-rescue missionIMAV 2011 Summer Edition Talks
MAVLab TU Delft |

Unsupervised Learning of a Hierarchical Spiking Neural Network for Optical Flow Estimation

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER