Attention-Induced Embedding Imputation for Incomplete Multi-View Partial Multi-Label Classification

As a combination of emerging multi-view learning methods and traditional multi-label classification tasks, multi-view multi-label classification has shown broad application prospects. The diverse semantic information contained in heterogeneous data effectively enables the further development of multi-label classification. However, the widespread incompleteness problem on multi-view features and labels greatly hinders the practical application of multi-view multi-label classification. Therefore, in this paper, we propose an attention-induced missing instances imputation technique to enhance the generalization ability of the model. Different from existing incomplete multi-view completion methods, we attempt to approximate the latent features of missing instances in embedding space according to cross-view joint attention, instead of recovering missing views in kernel space or original feature space. Accordingly, multi-view completed features are dynamically weighted by the confidence derived from joint attention in the late fusion phase. In addition, we propose a multi-view multi-label classification framework based on label-semantic feature learning, utilizing the statistical weak label correlation matrix and graph attention network to guide the learning process of label-specific features. Finally, our model is compatible with missing multi-view and partial multi-label data simultaneously and extensive experiments on five datasets confirm the advancement and effectiveness of our embedding imputation method and multi-view multi-label classification model.

Authors

• Chengliang Liu Computer Science and Engineering, Hong Kong University of Science and Technology
• Jinlong Jia Harbin Institute of Technology, Shenzhen
• Jie Wen
• Yabo Liu Harbin Institute of Technology
• Xiaoling Luo Shenzhen University
• Chao Huang Tongji University
• Yong Xu

Keywords

• ML: Multi-class/Multi-label Learning & Extreme Classification
• ML: Multi-instance/Multi-view Learning
• ML: Multimodal Learning