Kernel Maximum Entropy Data Transformation and an Enhanced Spectral Clustering Algorithm

We propose a new kernel-based data transformation technique. It is founded on the principle of maximum entropy (MaxEnt) preservation, hence named kernel MaxEnt. The key measure is Renyi's entropy estimated via Parzen windowing. We show that kernel MaxEnt is based on eigenvectors, and is in that sense similar to kernel PCA, but may produce strikingly different transformed data sets. An enhanced spectral clustering algorithm is proposed, by replacing kernel PCA by kernel MaxEnt as an intermediate step. This has a major impact on performance.

Authors

• Robert Jenssen Department of Physics and Technology, UiT The Arctic University of Norway Norwegian Computing Center, Oslo, Norway Pioneer Centre for AI, University of Copenhagen, Denmark
• Torbjørn Eltoft
• Mark Girolami
• Deniz Erdogmus Northeastern University

Keywords

No keywords are indexed for this paper.