EAAI Journal 2026 Journal Article
An emotion recognition approach using peripheral physiological signals based on hierarchical gated residuals and receptive field attention
- Yonghui Yu
- Hongji Xu
- Zhikai Xu
- Yupeng Duan
- Renzhuo Wang
- Hao Zheng
- Yiran Li
- Yipeng Xu
The field of emotion recognition (ER) based on peripheral physiological signals (PPSs) has gained significant attention due to the analytical capabilities of artificial intelligence (AI) and its extensive applications. However, a common challenge in many existing ER networks lies in effectively extracting and integrating features from the PPSs. Some networks rely solely on single-channel features, while others struggle with efficient multi-channel fusion, often resulting in suboptimal accuracy. Moreover, the lack of PPS-based public ER datasets, with most existing datasets focusing on the electroencephalogram signal, continues to pose an obstacle. The hierarchical gated residual and receptive field attention fusion (HGR-RFAF) network is proposed to address the above challenges. The HGR-RFAF network improves feature extraction and fusion through multiple multi-branch hierarchical residual fusion convolution (MB-HRFC) layers and a multi-scale dilated convolution (MS-DC) layer. Additionally, the I + Lab Emotion (ILEmo) dataset is constructed to address the scarcity of public ER datasets based on PPSs. To evaluate the performance of the HGR-RFAF network, experiments are conducted on the public K-EmoCon, DEAP, and self-constructed ILEmo datasets. By applying the valence-arousal (V-A) model for validation, the HGR-RFAF network achieves accuracies of 91. 15 % (A)/93. 03 % (V) for the K-EmoCon dataset and 81. 44 % (A)/82. 07 % (V) for the DEAP dataset, respectively. On the ILEmo dataset, HGR-RFAF achieves an accuracy of 91. 25 % with the discrete emotion model. Moreover, various PPSs and their combinations are evaluated, highlighting the benefits of fusing multi-channel PPSs along with their complementarities and contributions to ER.