Clustering ensemble based on sample's stability

The objective of clustering ensemble is to find the underlying structure of data based on a set of clustering results. It has been observed that the samples can change between clusters in different clustering results. This change shows that samples may have different contributions to the detection of the underlying structure. However, the existing clustering ensemble methods treat all sample equally. To tackle this deficiency, we introduce the stability of a sample to quantify its contribution and present a methodology to determine this stability. We propose two formulas accord with this methodology to calculate sample's stability. Then, we develop a clustering ensemble algorithm based on the sample's stability. With either formula, this algorithm divides a data set into two classes: cluster core and cluster halo. With the core and halo, the proposed algorithm then discovers a clear structure using the samples in the cluster core and assigns samples in the cluster halo to the clear structure gradually. The experiments on eight synthetic data sets illustrate how the proposed algorithm works. This algorithm statistically outperforms twelve state-of-the-art clustering ensemble algorithms on ten real data sets from UCI and six document data sets. The experimental analysis on the case of image segmentation shows that cluster cores discovered by the stability are rational.

Authors

• Feijiang Li Shanxi University Key Laboratory of Evolutionary Science Intelligence ofShanxi Province
• Yuhua Qian Shanxi University Key Laboratory of Evolutionary Science Intelligence ofShanxi Province
• Jieting Wang Shanxi University Key Laboratory of Evolutionary Science Intelligence ofShanxi Province
• Chuangyin Dang
• Liping Jing Beijing Key Laboratory of Traffic Data Mining and Embodied Intelligence, Beijing Jiaotong University

Keywords

• Clustering ensemble
• Clustering analysis
• Sample's stability
• Ensemble learning