Pairwise Relationship Guided Deep Hashing for Cross-Modal Retrieval

With benefits of low storage cost and fast query speed, crossmodal hashing has received considerable attention recently. However, almost all existing methods on cross-modal hashing cannot obtain powerful hash codes due to directly utilizing hand-crafted features or ignoring heterogeneous correlations across different modalities, which will greatly degrade the retrieval performance. In this paper, we propose a novel deep cross-modal hashing method to generate compact hash codes through an end-to-end deep learning architecture, which can effectively capture the intrinsic relationships between various modalities. Our architecture integrates different types of pairwise constraints to encourage the similarities of the hash codes from an intra-modal view and an inter-modal view, respectively. Moreover, additional decorrelation constraints are introduced to this architecture, thus enhancing the discriminative ability of each hash bit. Extensive experiments show that our proposed method yields state-of-the-art results on two cross-modal retrieval datasets.

Authors

• Erkun Yang
• Cheng Deng Xidian University
• Wei Liu Amazon AGI
• Xianglong Liu Beihang University
• Dacheng Tao College of Computing and Data Science, Nanyang Technological University
• Xinbo Gao School of Electronic Engineering, Xidian University, Xi’an, China Chongqing University of Posts and Telecommunications, Chongqing, China

Keywords

No keywords are indexed for this paper.