Rolling shutter correction for video with large depth of field

• Published in: 2013 IEEE International Conference on Image Processing pp. 900 - 904
• Main Authors: Yen-Hao Chiao, Tung-Ying Lee, Shang-Hong Lai
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01-09-2013
• Subjects: Adaptive optics; Camera motion estimation; Cameras; Depth estimation; Estimation; Motion estimation; Nonlinear distortion; Optical distortion; Rolling shutter correction; Vectors
• ISSN: 1522-4880; 2381-8549
• DOI: 10.1109/ICIP.2013.6738186

Rolling shutter correction has attracted considerable attention in recent years. Several algorithms have been proposed to correct the distortion. Previous methods on rolling shutter correction did not consider depth variations in the scene. In this work, we overcome the limitation of the previous works that the depth of field in the scene is small. We present a correction model for rectifying the rolling shutter video based on the depth maps estimated from the rolling shutter video. In addition, we propose a two-stage optimization algorithm to estimate the temporal camera motion and the associated depth maps. Experimental results show the improvement of the proposed rolling shutter correction algorithm that takes the depth information into account.