EAAI Journal 2026 Journal Article
Semantic-geometric dual knowledge guided instance segmentation for vehicle components
- Zhenqi Zhang
- Xunqi Zhou
- Yongjie Zhai
- Nianhao Chen
- Qianming Wang
- Xinying Wang
The detection and segmentation of vehicle components are crucial steps in intelligent vehicle damage assessment. However, due to the wide variety of vehicle components with diverse shapes and the high similarity between mirror-symmetric components, missed detections and false positives remain common challenges in vehicle component detection and segmentation. To address these challenges, this paper proposes a deep learning-based dual-knowledge guided vehicle component instance segmentation network. The proposed method fuses implicit multi-scale semantic knowledge by the enhanced semantic knowledge network, thereby improving the model’s capability to filter and capture critical component information. This design enhances focus on key foreground features while suppressing interference from background features. Furthermore, the proposed embedded geometric knowledge module synergizes geometric constraint knowledge of vehicle components with the model’s intrinsic learning capability. By reasoning about positions among three types of landmark components, it explicitly supplements the model with spatial relationship information of components that are inherently challenging to learn from data alone. We evaluate the detection and segmentation performance of the proposed method on a dataset comprising 59 classes of vehicle components. Compared with the baseline model, our method achieves significant improvements of 19. 3% and 19. 1% in detection mean average precision and segmentation mean average precision, respectively. Additionally, we evaluate the generalization capability of the proposed method on an independent public dataset. Compared with state-of-the-art instance segmentation methods, the proposed method demonstrates superior performance in both detection and segmentation tasks for vehicle components.