Preliminary evaluation of the multimodal interactive system for NAO robot

• Published in: 2017 15th International Conference on Emerging eLearning Technologies and Applications (ICETA) pp. 1 - 6
• Main Authors: Ondas, S., Pleva, M., Juhar, J., Husovsky, R.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01-10-2017
• Subjects: Grammar; Humanoid robots; Production; Speech; Switches; Text processing
• DOI: 10.1109/ICETA.2017.8102515

The proposed paper brings a description of the pilot version of the multimodal dialogue system for NAO humanoid robot. Designed system enables multimodal interaction with the user in such manner that it takes a speech input from the user and it answers by a combination of synthetic speech and gestures. The core of the system is an external dialogue manager, which interprets VoiceXML language. A pilot speech communication application was designed and a preliminary evaluation was performed using subjective methods. Results of the preliminary evaluation highlights importance of involving gestures into communication exchange. Moreover the paper brings a discussion of usage scenarios, where designed system can be used for educational purposes.