A Hybrid Machine-Learning-Based Method for Analytic Representation of the Vocal Fold Edges during Connected Speech

• Published in: Applied sciences Vol. 11; no. 3; p. 1179
• Main Authors: Yousef, Ahmed M, Deliyski, Dimitar D, Zacharias, Stephanie R C, de Alarcon, Alessandro, Orlikoff, Robert F, Naghibolhosseini, Maryam
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 01-02-2021
• Subjects: Algorithms; automated machine-learning-based edge detection; Automation; Cameras; Clustering; Computer applications; connected speech; Contours; Data analysis; high-speed videoendoscopy; Learning algorithms; Machine learning; Methods; Noise; Speech; Vibration; Vocal organs; United States > US; automated machine-learning-based edge detection; high-speed videoendoscopy; connected speech
• ISSN: 2076-3417; 2076-3417
• DOI: 10.3390/app11031179

Investigating the phonatory processes in connected speech from high-speed videoendoscopy (HSV) demands the accurate detection of the vocal fold edges during vibration. The present paper proposes a new spatio-temporal technique to automatically segment vocal fold edges in HSV data during running speech. The HSV data were recorded from a vocally normal adult during a reading of the "Rainbow Passage." The introduced technique was based on an unsupervised machine-learning (ML) approach combined with an active contour modeling (ACM) technique (also known as a hybrid approach). The hybrid method was implemented to capture the edges of vocal folds on different HSV kymograms, extracted at various cross-sections of vocal folds during vibration. The k-means clustering method, an ML approach, was first applied to cluster the kymograms to identify the clustered glottal area and consequently provided an initialized contour for the ACM. The ACM algorithm was then used to precisely detect the glottal edges of the vibrating vocal folds. The developed algorithm was able to accurately track the vocal fold edges across frames with low computational cost and high robustness against image noise. This algorithm offers a fully automated tool for analyzing the vibratory features of vocal folds in connected speech.