Probability-Polarized Optimal Transport for Unsupervised Domain Adaptation

Optimal transport (OT) is an important methodology to measure distribution discrepancy, which has achieved promising performance in artificial intelligence applications, e.g., unsupervised domain adaptation. However, from the view of transportation, there are still limitations: 1) the local discriminative structures for downstream tasks, e.g., cluster structure for classification, cannot be explicitly admitted by the learned OT plan; 2) the entropy regularization induces a dense OT plan with increasing uncertainty. To tackle these issues, we propose a novel Probability-Polarized OT (PPOT) framework, which can characterize the structure of OT plan explicitly. Specifically, the probability polarization mechanism is proposed to guide the optimization direction of OT plan, which generates a clear margin between similar and dissimilar transport pairs and reduces the uncertainty. Further, a dynamic mechanism for margin is developed by incorporating task-related information into the polarization, which directly captures the intra/inter class correspondence for knowledge transportation. A mathematical understanding for PPOT is provided from the view of gradient, which ensures interpretability. Extensive experiments on several datasets validate the effectiveness and empirical efficiency of PPOT.

Authors

• Yan Wang
• Chuan-Xian Ren School of Mathematics, Sun Yat-Sen University, China
• Yi-Ming Zhai School of Mathematics, Sun Yat-Sen University, China
• You-Wei Luo School of Mathematics, Sun Yat-Sen University, China
• Hong Yan Department of Electrical Engineering, City University of Hong Kong, Hong Kong

Keywords

• ML: Classification and Regression
• ML: Transfer, Domain Adaptation, Multi-Task Learning