Rapid Dynamic Obstacle Avoidance for UAVs Enhanced by DVS and Neuromorphic Computing

Achieving rapid and accurate dynamic obstacle avoidance is crucial for enhancing the survivability of unmanned aerial vehicles (UAVs) in hazardous conditions. To accomplish dynamic obstacle avoidance, sensors with high temporal resolution and efficient processing models are required. Dynamic vision sensors (DVS) fulfill the sensing requirements, while spiking neural networks (SNNs) address the processing demands. In this paper, we develop an end-to-end obstacle avoidance algorithm for UAVs using only a single monocular DVS as the sensor and further enhance accuracy and speed through our proposed mechanisms. The algorithm consists of three components: ego-motion compensation, an SNN model for movement analysis, and a force filter inspired by spiking neurons. In movement analysis, we propose the temporal potential pooling (TPP) and incremental event (EI) mechanisms to accelerate our SNN model. The real-flight experiments confirm that our algorithm achieves approximately 90% accuracy with a processing latency as low as 4ms on a GPU, surpassing state-of-the-art methods. Ablation studies show that the proposed method maintains high accuracy in movement detection while significantly reducing computational time. Our method operates in real-time, achieves high accuracy, and is feasible across a wide range of environments. Our code is available at https://github.com/AmperiaWang/oanet_s1 for reproducibility.

Authors

• Siyang Wang
• Sheng Yu
• Tingbang Liang
• Yilin Shi
• Yongqiang Ma
• Pengju Ren

Keywords

• Accuracy
• Heuristic algorithms
• Force
• Clustering algorithms
• Filtering algorithms
• Autonomous aerial vehicles
• Approximation algorithms
• Collision avoidance
• Vehicle dynamics
• Voltage control
• Unmanned Aerial Vehicles
• Obstacle Avoidance
• Neuromorphic Computing
• Dynamic Obstacles
• Dynamic Vision Sensor
• Dynamic Obstacle Avoidance
• Monocular
• Movement Analysis
• Spiking Neural Networks
• Wide Range Of Environments
• Time Step
• High Speed
• Convolutional Layers
• Temporal Dimension
• Spatial Dimensions
• Angular Velocity
• Temporal Information
• Real-world Scenarios
• Neuron Model
• Previous Stage
• Leaky Integrate-and-fire
• CNN Model
• Inertial Measurement Unit
• Force Vector
• Processing Events
• Changes In Light Intensity
• Heaviside Function
• Unmanned Aerial Vehicle Flight
• Force Output