Estimating the Bayes error rate through classifier combining

• Published in: Proceedings of 13th International Conference on Pattern Recognition Vol. 2; pp. 695 - 699 vol.2
• Main Authors: Tumer, K., Ghosh, J.
• Format: Conference Proceeding
• Language: English; Japanese
• Published: IEEE 1996
• Subjects: Computer errors; Creep; Electronic mail; Error analysis; Integral equations; Pattern classification; Pattern recognition; Probability density function; Training data
• ISBN: 9780818672828; 081867282X
• ISSN: 1051-4651; 2831-7475
• DOI: 10.1109/ICPR.1996.546912

The Bayes error provides the lowest achievable error rate for a given pattern classification problem. There are several classical approaches for estimating or finding bounds for the Bayes error. One type of approach focuses on obtaining analytical bounds, which are both difficult to calculate and dependent on distribution parameters that may not be known. Another strategy is to estimate the class densities through non-parametric methods, and use these estimates to obtain bounds on the Bayes error. This article presents a novel approach to estimating the Bayes error based on classifier combining techniques. For an artificial data set where the Bayes error is known, the combiner-based estimate outperforms the classical methods.