Backward Registration-Based Aspect Ratio Similarity for Image Retargeting Quality Assessment

• Published in: IEEE transactions on image processing Vol. 25; no. 9; pp. 4286 - 4297
• Main Authors: Zhang, Yabin, Fang, Yuming, Lin, Weisi, Zhang, Xinfeng, Li, Leida
• Format: Journal Article
• Language: English
• Published: United States IEEE 01-09-2016; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Aspect ratio; backward registration; Degradation; Distortion; Distortion measurement; Estimation; geometric change; Image quality; Image retargeting quality assessment; Loss measurement; Quality; Quality assessment; Resampling; Similarity; Visual; Visualization
• ISSN: 1057-7149; 1941-0042
• DOI: 10.1109/TIP.2016.2585884

During the past few years, there have been various kinds of content-aware image retargeting operators proposed for image resizing. However, the lack of effective objective retargeting quality assessment metrics limits the further development of image retargeting techniques. Different from traditional image quality assessment (IQA) metrics, the quality degradation during image retargeting is caused by artificial retargeting modifications, and the difficulty for image retargeting quality assessment (IRQA) lies in the alternation of the image resolution and content, which makes it impossible to directly evaluate the quality degradation like traditional IQA. In this paper, we interpret the image retargeting in a unified framework of resampling grid generation and forward resampling. We show that the geometric change estimation is an efficient way to clarify the relationship between the images. We formulate the geometric change estimation as a backward registration problem with Markov random field and provide an effective solution. The geometric change aims to provide the evidence about how the original image is resized into the target image. Under the guidance of the geometric change, we develop a novel aspect ratio similarity (ARS) metric to evaluate the visual quality of retargeted images by exploiting the local block changes with a visual importance pooling strategy. Experimental results on the publicly available MIT RetargetMe and CUHK data sets demonstrate that the proposed ARS can predict more accurate visual quality of retargeted images compared with the state-of-the-art IRQA metrics.