Multitemporal Very High Resolution From Space: Outcome of the 2016 IEEE GRSS Data Fusion Contest

• Published in: IEEE journal of selected topics in applied earth observations and remote sensing Vol. 10; no. 8; pp. 3435 - 3447
• Main Authors: Mou, L., Zhu, X., Vakalopoulou, M., Karantzalos, K., Paragios, N., Le Saux, B., Moser, G., Tuia, D.
• Format: Journal Article
• Language: English
• Published: IEEE 01-08-2017
• Subjects: Cameras; Change detection; convolutional neural networks (CNN); Data integration; deep learning; Earth; image analysis and data fusion; Image resolution; Iris; multimodal; multiresolution; multisource; random fields; Remote sensing; Sensors; tracking; video from space
• ISSN: 1939-1404; 2151-1535
• DOI: 10.1109/JSTARS.2017.2696823

In this paper, the scientific outcomes of the 2016 Data Fusion Contest organized by the Image Analysis and Data Fusion Technical Committee of the IEEE Geoscience and Remote Sensing Society are discussed. The 2016 Contest was an open topic competition based on a multitemporal and multimodal dataset, which included a temporal pair of very high resolution panchromatic and multispectral Deimos-2 images and a video captured by the Iris camera on-board the International Space Station. The problems addressed and the techniques proposed by the participants to the Contest spanned across a rather broad range of topics, and mixed ideas and methodologies from the remote sensing, video processing, and computer vision. In particular, the winning team developed a deep learning method to jointly address spatial scene labeling and temporal activity modeling using the available image and video data. The second place team proposed a random field model to simultaneously perform coregistration of multitemporal data, semantic segmentation, and change detection. The methodological key ideas of both these approaches and the main results of the corresponding experimental validation are discussed in this paper.