Learning Invariant Deep Representation for NIR-VIS Face Recognition

Visual versus near infrared (VIS-NIR) face recognition is still a challenging heterogeneous task due to large appearance difference between VIS and NIR modalities. This paper presents a deep convolutional network approach that uses only one network to map both NIR and VIS images to a compact Euclidean space. The low-level layers of this network are trained only on large-scale VIS data. Each convolutional layer is implemented by the simplest case of maxout operator. The highlevel layer is divided into two orthogonal subspaces that contain modality-invariant identity information and modalityvariant spectrum information respectively. Our joint formulation leads to an alternating minimization approach for deep representation at the training time and an efficient computation for heterogeneous data at the testing time. Experimental evaluations show that our method achieves 94% verification rate at FAR=0. 1% on the challenging CASIA NIR-VIS 2. 0 face recognition dataset. Compared with state-of-the-art methods, it reduces the error rate by 58% only with a compact 64-D representation.

Authors

• Ran He NLPR & MAIS, Institute of Automation, Chinese Academy of Sciences University of Chinese Academy of Sciences
• Xiang Wu
• Zhenan Sun School of Artificial Intelligence, University of Chinese Academy of Sciences State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences
• Tieniu Tan Nanjing University NLPR & MAIS, Institute of Automation, Chinese Academy of Sciences University of Chinese Academy of Sciences

Keywords

No keywords are indexed for this paper.