EAAI Journal 2026 Journal Article
Electro-optical and infrared multi-sensor fusion based airborne target perception: A unified framework
- Zhouyu Zhang
- Chenyuan He
- Yingfeng Cai
- Long Chen
- Hai Wang
- Can Zhong
- Yiqun Zhang
This paper presents a unified framework for airborne target perception, designed for unmanned aerial vehicles (UAVs) operating in non-cooperative airspace environments. The core contribution to artificial intelligence lies in the integration of electro-optical and infrared (EO/IR) sensors using a convolutional sparse representation-based image fusion algorithm, along with a novel spatiotemporal detection method that combines conditional random fields and motion history analysis. The engineering application focuses on real-time airborne Sense and Avoid (SAA) capabilities for small UAVs, where a local-angle-based collision avoidance path planning method is proposed to address the limitations of monocular vision-based perception. To validate the proposed framework, a distributed digital simulation and verification system is developed based on virtual camera feeds and local network communication. This system supports closed-loop testing of visual perception, target detection, and path planning in realistic airspace environments. Experiments conducted in three representative airport scenarios — Illinois State Hospital, Shanghai Pudong International Airport, and New York John F. Kennedy International Airport — demonstrate the framework’s effectiveness in enhancing visual quality under low illumination conditions, improving detection accuracy, and enabling robust and safe autonomous navigation. Specifically, the proposed system achieves a target detection accuracy of 94. 6% and reduces false alarm rate to 2. 1%, while successfully generating collision-free paths in 97. 8% of dynamic encounters. Compared to existing state-of-the-art EO/IR fusion-based perception systems, our framework improves detection precision by 4. 3% on average and increases planning robustness by 5. 6% in complex airspace environments. These results validate both the effectiveness and the generalizability of the unified framework for real-world UAVs SAA tasks.