Convolutional Neural Networks for Continuous QoE Prediction in Video Streaming Services

• Published in: IEEE access Vol. 8; pp. 116268 - 116278
• Main Authors: Duc, Tho Nguyen, Minh, Chanh Tran, Xuan, Tan Phan, Kamioka, Eiji
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2020; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Accuracy; Artificial neural networks; Complexity; Computational modeling; Computer architecture; Convolutional neural networks; Electronic devices; Mobile computing; Neural networks; Performance evaluation; Performance prediction; Personal computers; Predictive models; Quality of experience; Speech processing; Streaming media; Task analysis; temporal convolutional network; User satisfaction; video streaming; Video transmission
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2020.3004125

In video streaming services, predicting the continuous user's quality of experience (QoE) plays a crucial role in delivering high quality streaming contents to the user. However, the complexity caused by the temporal dependencies in QoE data and the non-linear relationships among QoE influence factors has introduced challenges to continuous QoE prediction. To deal with that, existing studies have utilized the Long Short-Term Memory model (LSTM) to effectively capture such complex dependencies, resulting in excellent QoE prediction accuracy. However, the high computational complexity of LSTM, caused by the sequential processing characteristic in its architecture, raises a serious question about its performance on devices with limited computational power. Meanwhile, Temporal Convolutional Network (TCN), a variation of convolutional neural networks, has recently been proposed for sequence modeling tasks (e.g., speech enhancement), providing a superior prediction performance over baseline methods including LSTM in terms of prediction accuracy and computational complexity. Being inspired of that, in this paper, an improved TCN-based model, namely CNN-QoE, is proposed for continuously predicting the QoE, which poses characteristics of sequential data. The proposed model leverages the advantages of TCN to overcome the computational complexity drawbacks of LSTM-based QoE models, while at the same time introducing the improvements to its architecture to improve QoE prediction accuracy. Based on a comprehensive evaluation, we demonstrate that the proposed CNN-QoE model can provide a high QoE prediction performance on both personal computers and mobile devices, outperforming the existing approaches.