Classification Error for a Very Large Number of Classes

• Published in: IEEE transactions on pattern analysis and machine intelligence Vol. PAMI-6; no. 6; pp. 779 - 788
• Main Authors: Fukunaga, Keinosuke, Flick, Thomas E.
• Format: Journal Article
• Language: English
• Published: Los Alamitos, CA IEEE 01-11-1984; IEEE Computer Society
• Subjects: Airplanes; Applied sciences; Artificial intelligence; Bayes error; blurring; classification error; Computer science; control theory; systems; effective dimensionality; Error analysis; Error correction; Exact sciences and technology; group classification; Laboratories; Marine vehicles; nearest neighbor; Nearest neighbor searches; Noise level; Pattern recognition; Pattern recognition. Digital image processing. Computational geometry; single class classification; Statistical distributions; Bayes estimation; Nearest neighbour; Error; Pattern recognition; Classification
• ISSN: 0162-8828; 1939-3539
• DOI: 10.1109/TPAMI.1984.4767601

Classification error is analyzed for a situation where the number of possible classes may be on the order of a hundred or more. The error associated with classifying to a single class is shown to depend mainly on average nearest-neighbor distance between class means, noise level, and effective dimensionality of the class mean distribution and not much on other aspects of the distribution, noise correlation, or number of classes. Since single class error is large, separation of classes into groups is also explored. Group classification error has the same properties as single class error but the size of the error is moderated by the Bayes overlap between groups. Standard curves are provided to predict single class and group error. Also discussed are the effect of pattern blurring on classification error and the nearest-neighbor distance statistics throughout a distribution.