Data sampling based ensemble acoustic modelling

• Published in: 2009 IEEE International Conference on Acoustics, Speech and Signal Processing pp. 3805 - 3808
• Main Authors: Xin Chen, Yunxin Zhao
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01-04-2009
• Subjects: Acoustic measurements; acoustic modeling; Computer science; Context modeling; cross validation; data sampling; Decision trees; Decoding; ensemble classifier; Hidden Markov models; hierarchical mixture ensemble; Sampling methods; Speech recognition; Telemedicine; Training data
• ISBN: 9781424423538; 1424423538
• ISSN: 1520-6149; 2379-190X
• DOI: 10.1109/ICASSP.2009.4960456

In this paper, we propose a novel technique of using cross validation (CV) data sampling to construct an ensemble of acoustic models for conversational speech recognition. We further propose using hierarchical Gaussian mixture model (HGMM) and repartition training data to increase the ensemble size and diversity. The proposed methods are found to work well together for ensemble acoustic modeling. We also evaluated the quality of the ensemble acoustic models by using the measures of classification margin, average correct score and variance of correct score. We have found that the ensemble of acoustic models increases the margin and the average correct score, and reduces the variance. We compared the performance of our proposed method with a recently reported method of CV expectation maximization (CVEM) for single acoustic models. Our experimental results on a telemedicine automatic captioning task showed that the proposed ensemble acoustic modeling has led to significant improvements in word recognition accuracy.