Affine Motion Based CMOS Distortion Analysis and CMOS Digital Image Stabilization

• Published in: IEEE transactions on consumer electronics Vol. 53; no. 3; pp. 833 - 841
• Main Authors: Cho, Won-ho, Hong, Ki-sang
• Format: Journal Article
• Language: English
• Published: New York IEEE 01-08-2007; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Cameras; CMOS; CMOS image sensors; Computational Intelligence Society; Digital; Digital cameras; Digital images; Distortion; Image analysis; Image motion analysis; Image sequences; Mathematical models; Motion analysis; Motion estimation; Semiconductor device modeling; Stabilization; Translational motion; Visual
• ISSN: 0098-3063; 1558-4127
• DOI: 10.1109/TCE.2007.4341553

The CMOS image distortion is due to the rolling shutter in CMOS image sensors (CISs) and it can be more exaggerated when a CIS camera moves rapidly. Several methods have been proposed to remove CMOS distortions made by the translational motion. But, in this paper, we propose the affine motion based CMOS distortion correction method combined with digital image stabilization. To remove CMOS distortions due to the affine global image motion, CMOS distortion model is proposed to explain the effect of the affine global image motion on the CMOS distortion in CISs. To improve CMOS video's visuals, we propose CMOS digital image stabilization to remove the jittering motions in the new image sequence obtained by our correction method. In addition, to reduce the computational time and the outlier effect, a reliable feature selection method is proposed to be used in the affine global image motion estimation. In the experiment results, we show that the proposed CMOS distortion correction method is more general than previous ones. Also, we show that our stabilization method can improve CMOS video's visuals running in real-time.