EDSUCh: A robust ensemble data summarization method for effective medical diagnosis

• Published in: Digital communications and networks Vol. 10; no. 1; pp. 182 - 189
• Main Authors: Ahmed, Mohiuddin, Rashid, A.N.M. Bazlur
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01-02-2024; KeAi Communications Co., Ltd
• Subjects: Data summarization; Ensemble; Medical diagnosis; Sampling; Data summarization; Medical diagnosis; Sampling; Ensemble
• ISSN: 2352-8648; 2352-8648
• DOI: 10.1016/j.dcan.2022.07.007

Identifying rare patterns for medical diagnosis is a challenging task due to heterogeneity and the volume of data. Data summarization can create a concise version of the original data that can be used for effective diagnosis. In this paper, we propose an ensemble summarization method that combines clustering and sampling to create a summary of the original data to ensure the inclusion of rare patterns. To the best of our knowledge, there has been no such technique available to augment the performance of anomaly detection techniques and simultaneously increase the efficiency of medical diagnosis. The performance of popular anomaly detection algorithms increases significantly in terms of accuracy and computational complexity when the summaries are used. Therefore, the medical diagnosis becomes more effective, and our experimental results reflect that the combination of the proposed summarization scheme and all underlying algorithms used in this paper outperforms the most popular anomaly detection techniques.