Joint Image Registration and Fusion for Panchromatic and Multispectral Images

• Published in: IEEE geoscience and remote sensing letters Vol. 12; no. 3; pp. 467 - 471
• Main Authors: Qian Zhang, Zhiguo Cao, Zhongwen Hu, Yonghong Jia, Xiaoliang Wu
• Format: Journal Article
• Language: English
• Published: IEEE 01-03-2015
• Subjects: Accuracy; Image fusion; image fusion quality; Image registration; Indexes; iterative optimization; Joints; Linear programming; Optimization; registration accuracy; Remote sensing; iterative optimization; registration accuracy; image registration; Image fusion; image fusion quality
• ISSN: 1545-598X; 1558-0571
• DOI: 10.1109/LGRS.2014.2346398

Both image registration and fusion are essential steps to produce high-resolution multispectral images in remote sensing. Traditionally, they are viewed as two independent processes. As a result, the registration errors ignored in the fusion process can significantly affect the fusion quality. In this context, an iterative optimization approach, which jointly considers the registration and fusion processes, is proposed for panchromatic (PAN) and multispectral (MS) images. Given a registration method and a fusion method, the joint optimization process is described as finding the optimal registration parameters to gain the optimal fusion performance. In our approach, the downhill simplex algorithm is adopted to refine the registration parameters iteratively. Experiments on a set of PAN and MS images of ZY-3 and GeoEye-1 show that the proposed approach outperforms several competing ones in terms of registration accuracy and fusion quality.