Fuzzy entropy based Max-Relevancy and Min-Redundancy feature selection

• Published in: 2008 IEEE International Conference on Granular Computing pp. 101 - 106
• Main Authors: Shuang An, Qinghua Hu, Daren Yu
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01-08-2008
• Subjects: Accuracy; Algorithm design and analysis; Classification algorithms; Entropy; Feature selection; fuzzy entropy; Horses; Indexes; Max-Relevancy; Min-Redundancy; mRMR; Mutual information
• ISBN: 1424425123; 9781424425129
• DOI: 10.1109/GRC.2008.4664740

Feature selection is an important problem for pattern classification systems. Mutual information is a good indicator of relevance between variables, and has been used as a measure in several feature selection algorithms. Because the mutual information could not be calculated directly for continuous data sets in max-relevance and min-redundancy (mRMR) algorithm, here we combine the mRMR algorithm with fuzzy entropy, which avoids estimating probability density. We test our new algorithm using several different data sets and two different classifiers. According to the comparison between the new algorithm and max-dependency, max-dependency and min-redundancy (mDMR) algorithms, it is proven the new algorithm is feasible and valid.