Learning based no-reference metric for assessing quality of experience of stereoscopic images

• Published in: Journal of visual communication and image representation Vol. 61; pp. 272 - 283
• Main Authors: Liu, Tsung-Jung, Liu, Kuan-Hsien, Shen, Kuan-Hung
• Format: Journal Article
• Language: English
• Published: Elsevier Inc 01-05-2019
• Subjects: Disparity-depth map; No reference; Quality of experience; Stereoscopic image; Visual discomfort; Disparity-depth map; Quality of experience; Visual discomfort; Stereoscopic image; No reference
• ISSN: 1047-3203; 1095-9076
• DOI: 10.1016/j.jvcir.2019.04.004

•Propose a no-reference assessment metric for stereoscopic image quality of experience.•Segment one disparity map to become five disparity-depth maps.•Extract four types of statistical features from the disparity-depth map.•Test proposed method on EPFL 3D image and IEEE-SA stereoscopic image databases.•Cross-database evaluation suggests the good generalization capability of our model.
Human’s perception plays a very important role on image assessment, especially for stereoscopic images. In general, viewing stereoscopic 3D images will cause visual fatigue, eyestrain, dizziness or headache. Therefore, how to evaluate human’s perception of visual quality on 3D images becomes an emerging topic. In this paper, we propose a no-reference assessment metric for stereoscopic image quality of experience (QoE). First, the stereoscopic image pairs are used to calculate the disparity maps by optical flow estimation. Then the depth information are extracted from the disparity map, called as disparity-depth map. Next, we extract four types of features based on pixel value and distribution of disparity-depth map. Two regression models are used to predict visual discomfort scores. Also, we test the proposed method on EPFL 3D image database and IEEE-SA stereoscopic image database, respectively. The experiment results show that our proposed QoE assessment metric achieves excellent performance compared with state-of-the-art methods.