Cluster-based under-sampling approaches for imbalanced data distributions

• Published in: Expert systems with applications Vol. 36; no. 3; pp. 5718 - 5727
• Main Authors: Yen, Show-Jane, Lee, Yue-Shi
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01-04-2009
• Subjects: Classification; Data mining; Imbalanced data distribution; Under-sampling; Under-sampling; Data mining; Classification; Imbalanced data distribution
• ISSN: 0957-4174; 1873-6793
• DOI: 10.1016/j.eswa.2008.06.108

For classification problem, the training data will significantly influence the classification accuracy. However, the data in real-world applications often are imbalanced class distribution, that is, most of the data are in majority class and little data are in minority class. In this case, if all the data are used to be the training data, the classifier tends to predict that most of the incoming data belongs to the majority class. Hence, it is important to select the suitable training data for classification in the imbalanced class distribution problem.
In this paper, we propose cluster-based under-sampling approaches for selecting the representative data as training data to improve the classification accuracy for minority class and investigate the effect of under-sampling methods in the imbalanced class distribution environment. The experimental results show that our cluster-based under-sampling approaches outperform the other under-sampling techniques in the previous studies.