Leveraging Asynchronous Spiking Neural Networks for Ultra Efficient Event-Based Visual Processing

Event cameras encode visual information by generating asynchronous and sparse event streams, which hold great potential for low latency and low power consumption. Despite many successful implementations of event camera-based applications, most of them accumulate the events into frames and then utilize conventional frame-based computer vision algorithms. These frame-based methods, though typically effective, diminish the inherent advantages of the event camera's low latency and low power consumption. To solve the above problems, we propose ASGCN, which efficiently processes data on an event-by-event basis and dynamically evolves into a corresponding dynamic representation, enabling low latency and high sparsity of data representation. The sparsity computation is further improved by introducing brain-inspired spiking neural networks, resulting in low power consumption for ASGCN. Extensive and diverse experiments demonstrate the energy efficiency and low latency advantages of our processing pipeline. Especially on real-world event camera datasets, our pipeline consumes more than 10,000 times less energy and achieves similar performance compared to current frame-based methods.

Authors

• DingYi Zeng University of Electronic Science and Technology of China
• Yuchen Wang University of Electronic Science and Technology of China
• Honglin Cao University of Electronic Science and Technology of China
• Wanlong Liu University of Electronic Science and Technology of China
• Yichen Xiao University of Electronic Science and Technology of China
• ChengzhuoLu University of Electronic Science and Technology of China
• Wenyu Chen University of Electronic Science and Technology of China
• Malu Zhang University of Electronic Science and Technology of China
• Guoqing Wang School of Computer Science and Technology, East China Normal University, Shanghai, China
• Yang Yang

Keywords

No keywords are indexed for this paper.