EAAI Journal 2026 Journal Article
Multi-modal semantic interaction fusion with dual-consistency contrastive learning for rotating machinery fault diagnosis
- Ying Li
- Xiaoping Liu
- Xutong Zhang
- Pengfei Liang
- Xuetao Xu
- Xiaoming Yuan
- Lijie Zhang
Intelligent fault diagnosis of rotating machinery relies on the ability to extract discriminative and robust representations from multi-modal sensor data. However, in realistic industrial environments, multi-modal signals are often weakly labeled, and many existing data-driven methods suffer from insufficient semantic interaction across modalities and scales, leading to unstable diagnostic decisions. To address these issues, this paper develops a novel artificial intelligence framework for fault diagnosis based on multiscale semantic interaction and dual-consistency contrastive representation learning. Heterogeneous sensor signals are first transformed into unified multi-channel time-frequency representations through continuous wavelet analysis and tensor fusion. A hierarchical representation learning architecture is then constructed to progressively capture global dependencies, intermediate semantic patterns, and fine-grained local fault features. A feedback-driven interaction mechanism is further introduced to propagate discriminative local information to higher-level representations, thereby enhancing global-local semantic consistency. To overcome the scarcity of labeled data and improve generalization, a dual-consistency contrastive learning strategy is designed, which enforces both intra-channel stability and inter-channel semantic alignment across different sensor modalities. This consistency-driven formulation constrains the representation space such that fault-related features remain separable, and robust under limited supervision and heterogeneous sensing conditions. Comprehensive evaluations using multiple performance metrics on two rotating machinery benchmark datasets demonstrate that the proposed method outperforms existing state-of-the-art approaches. Further ablation, sensitivity, and efficiency analyses confirm a favorable balance between diagnostic performance and model complexity. These results indicate that the proposed artificial intelligence-based framework provides an effective solution for intelligent condition monitoring and predictive maintenance in complex industrial systems.