Small Manhole Cover Detection in Remote Sensing Imagery with Deep Convolutional Neural Networks

• Published in: ISPRS international journal of geo-information Vol. 8; no. 1; p. 49
• Main Authors: Liu, Wei, Cheng, Dayu, Yin, Pengcheng, Yang, Mengyuan, Li, Erzhu, Xie, Meng, Zhang, Lianpeng
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01-01-2019
• Subjects: Algorithms; Artificial neural networks; Convolution; deep convolutional neural networks; Deep learning; Detection; Feature extraction; Feature maps; Image acquisition; Image resolution; Imagery; Localization; manhole cover; Manhole covers; Manholes; Neural networks; object detection; Object recognition; Proposals; Receptive field; Redesign; Remote sensing; remote sensing images; Surveying; Unmanned aerial vehicles
• ISSN: 2220-9964; 2220-9964
• DOI: 10.3390/ijgi8010049

With the development of remote sensing technology and the advent of high-resolution images, obtaining data has become increasingly convenient. However, the acquisition of small manhole cover information still has shortcomings including low efficiency of manual surveying and high leakage rate. Recently, deep learning models, especially deep convolutional neural networks (DCNNs), have proven to be effective at object detection. However, several challenges limit the applications of DCNN in manhole cover object detection using remote sensing imagery: (1) Manhole cover objects often appear at different scales in remotely sensed images and DCNNs’ fixed receptive field cannot match the scale variability of such objects; (2) Manhole cover objects in large-scale remotely-sensed images are relatively small in size and densely packed, while DCNNs have poor localization performance when applied to such objects. To address these problems, we propose an effective method for detecting manhole cover objects in remotely-sensed images. First, we redesign the feature extractor by adopting the visual geometry group (VGG), which can increase the variety of receptive field size. Then, detection is performed using two sub-networks: a multi-scale output network (MON) for manhole cover object-like edge generation from several intermediate layers whose receptive fields match different object scales and a multi-level convolution matching network (M-CMN) for object detection based on fused feature maps, which combines several feature maps that enable small and densely packed manhole cover objects to produce a stronger response. The results show that our method is more accurate than existing methods at detecting manhole covers in remotely-sensed images.