Cramer-Wold Auto-Encoder

The computation of the distance to the true distribution is a key component of most state-of-the-art generative models. Inspired by prior works on the Sliced-Wasserstein Auto-Encoders (SWAE) and the Wasserstein Auto-Encoders with MMD-based penalty (WAE-MMD), we propose a new generative model - a Cramer-Wold Auto-Encoder (CWAE). A fundamental component of CWAE is the characteristic kernel, the construction of which is one of the goals of this paper, from here on referred to as the Cramer-Wold kernel. Its main distinguishing feature is that it has a closed-form of the kernel product of radial Gaussians. Consequently, CWAE model has a~closed-form for the distance between the posterior and the normal prior, which simplifies the optimization procedure by removing the need to sample in order to compute the loss function. At the same time, CWAE performance often improves upon WAE-MMD and SWAE on standard benchmarks. [abs] [ pdf ][ bib ] [ code ] &copy JMLR 2020. ( edit, beta )

Authors

• Szymon Knop
• Przemysław Spurek Jagiellonian University
• Jacek Tabor Jagiellonian University
• Igor Podolak
• Marcin Mazur Jagiellonian University in Kraków, Faculty of Mathematics and Computer Science
• Stanisław Jastrzębski

Keywords

No keywords are indexed for this paper.