Efficiently registering video into panoramic mosaics

• Published in: Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 Vol. 2; pp. 1300 - 1307 Vol. 2
• Main Authors: Steedly, D., Pal, C., Szeliski, R.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 2005
• Subjects: Computational efficiency; Computer vision; Costs; Digital cameras; Dynamic range; Image coding; Robustness; Software quality; Video compression; Video sequences
• ISBN: 076952334X; 9780769523347
• ISSN: 1550-5499; 2380-7504
• DOI: 10.1109/ICCV.2005.86

We present an automatic and efficient method to register and stitch thousands of video frames into a large panoramic mosaic. Our method preserves the robustness and accuracy of image stitchers that match all pairs of images while utilizing the ordering information provided by video. We reduce the cost of searching for matches between video frames by adaptively identifying key frames based on the amount of image-to-image overlap. Key frames are matched to all other key frames, but intermediate video frames are only matched to temporally neighboring key frames and intermediate frames. Image orientations can be estimated from this sparse set of matches in time quadratic to cubic in the number of key frames but only linear in the number of intermediate frames. Additionally, the matches between pairs of images are compressed by replacing measurements within small windows in the image with a single representative measurement. We show that this approach substantially reduces the time required to estimate the image orientations with minimal loss of accuracy. Finally, we demonstrate both the efficiency and quality of our results by registering several long video sequences