Detection of Key Organs in Tomato Based on Deep Migration Learning in a Complex Background

• Published in: Agriculture (Basel) Vol. 8; no. 12; p. 196
• Main Authors: Sun, Jun, He, Xiaofei, Ge, Xiao, Wu, Xiaohong, Shen, Jifeng, Song, Yingying
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01-12-2018
• Subjects: Accuracy; Algorithms; Artificial neural networks; Cluster analysis; Clustering; Complexity; convolutional neural network; Datasets; Deep learning; Feature extraction; Fruits; K-means clustering; migration learning; Natural environment; Neural networks; object detection; Occlusion; Organs; Pesticide application; Pesticides; Robots; Soft-NMS; tomato organ; Tomatoes; Vector quantization
• ISSN: 2077-0472; 2077-0472
• DOI: 10.3390/agriculture8120196

In the current natural environment, due to the complexity of the background and the high similarity of the color between immature green tomatoes and the plant, the occlusion of the key organs (flower and fruit) by the leaves and stems will lead to low recognition rates and poor generalizations of the detection model. Therefore, an improved tomato organ detection method based on convolutional neural network (CNN) has been proposed in this paper. Based on the original Faster R-CNN algorithm, Resnet-50 with residual blocks was used to replace the traditional vgg16 feature extraction network, and a K-means clustering method was used to adjust more appropriate anchor sizes than manual setting, to improve detection accuracy. The test results showed that the mean average precision (mAP) was significantly improved compared with the traditional Faster R-CNN model. The training model can be transplanted to the embedded system, which lays a theoretical foundation for the development of a precise targeting pesticide application system and an automatic picking device.