Variational Adversarial Kernel Learned Imitation Learning

Imitation learning refers to the problem where an agent learns to perform a task through observing and mimicking expert demonstrations, without knowledge of the cost function. Stateof-the-art imitation learning algorithms reduce imitation learning to distribution-matching problems by minimizing some distance measures. However, the distance measure may not always provide informative signals for a policy update. To this end, we propose the variational adversarial kernel learned imitation learning (VAKLIL), which measures the distance using the maximum mean discrepancy with variational kernel learning. Our method optimizes over a large cost-function space and is sample efficient and robust to overfitting. We demonstrate the performance of our algorithm through benchmarking with four state-of-the-art imitation learning algorithms over five high-dimensional control tasks, and a complex transportation control task. Experimental results indicate that our algorithm significantly outperforms related algorithms in all scenarios.

Authors

• Fan Yang Nanyang Technological University
• Alina Vereshchaka
• Yufan Zhou Adobe Research
• Changyou Chen University at Buffalo
• Wen Dong Key Laboratory of Social Computing and Cognitive Intelligence, Dalian University of Technology

Keywords

No keywords are indexed for this paper.