EAAI Journal 2025 Journal Article
A novel local enhanced channel self-attention based on Transformer for industrial remaining useful life prediction
- Zhizheng Zhang
- Wen Song
- Qiong Wu
- Wenxu Sun
- Qiqiang Li
- Lei Jia
Remaining useful life (RUL) prediction is a foundational technique for predictive maintenance (PdM) and is critical to ensuring the reliability and safety of complex industrial machines. Recently, while advanced deep learning architectures like recurrent neural network (RNN), convolutional neural network (CNN) and self-attention (SA) have been widely used for RUL prediction, existing methods still face difficulties in simultaneously processing global long-term dependencies and local contextual information of sequence units as well as the spatial correlations of industrial multi-sensors. In this article, we propose local enhanced channel self-attention based on Transformer (LECformer), a novel deep RUL prediction method to overcome these issues. LECformer can more effectively capture the long-term dependencies by Transformer architecture compared with RNN/CNN-based methods. Moreover, LECformer proposes a novel local enhanced channel self-attention (LECSA) mechanism to replace the traditional SA of vanilla Transformer, which can adaptively extract both long-term dependencies and local contextual information, while dynamically weighting the importance of different channels to improve predictive performance. Two widely used turbofan engine datasets and a bearing dataset are applied to validate the effectiveness of the proposed method. Experimental results show that the LECformer significantly outperforms the state-of-the-art RUL prediction methods.