Fast Image Super-Resolution Based on In-Place Example Regression

• Published in: 2013 IEEE Conference on Computer Vision and Pattern Recognition pp. 1059 - 1066
• Main Authors: Jianchao Yang, Zhe Lin, Cohen, Scott
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01-06-2013
• Subjects: Approximation algorithms; Image edge detection; image restoration; image upscaling; in-place matching; Least squares approximations; self-example; self-similarity; Spatial resolution; super-resolution; Visualization
• ISSN: 1063-6919
• DOI: 10.1109/CVPR.2013.141

We propose a fast regression model for practical single image super-resolution based on in-place examples, by leveraging two fundamental super-resolution approaches- learning from an external database and learning from self-examples. Our in-place self-similarity refines the recently proposed local self-similarity by proving that a patch in the upper scale image have good matches around its origin location in the lower scale image. Based on the in-place examples, a first-order approximation of the nonlinear mapping function from low-to high-resolution image patches is learned. Extensive experiments on benchmark and real-world images demonstrate that our algorithm can produce natural-looking results with sharp edges and preserved fine details, while the current state-of-the-art algorithms are prone to visual artifacts. Furthermore, our model can easily extend to deal with noise by combining the regression results on multiple in-place examples for robust estimation. The algorithm runs fast and is particularly useful for practical applications, where the input images typically contain diverse textures and they are potentially contaminated by noise or compression artifacts.