Conversational Subjective Tests Based on Video-telephony Platform

• Published in: 2023 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB) pp. 1 - 5
• Main Authors: Joskowicz, Jose, Liu, Mengying, Sotelo, Rafael, Armendariz, Alejandra, Yang, Lei
• Format: Conference Proceeding
• Language: English
• Published: IEEE 14-06-2023
• Subjects: Distortion; Focusing; Laboratories; Medical services; Multimedia databases; Packet loss; Streaming media
• ISSN: 2155-5052
• DOI: 10.1109/BMSB58369.2023.10211186

Video-telephony applications are widely used in offices, education, medical care, social and other fields. This paper introduces a method designed for conversational subjective tests, based on an open-source video-telephony platform, focusing on multimedia quality and interaction experience perceived by users under various network states. The research is carried out as part of the 'Computational model used as a QoE/QoS monitor to assess video-telephony services' (G.CMVTQS) project, which is under study in ITU-T SG12 Q.15. Six different laboratories, from four countries, are collaboratively working on the conversational subjective tests. The designed test bed is described, along with the lab deployment, the simulation of network distortions and the method used for subjective evaluation.