Melon ripeness detection by an improved object detection algorithm for resource constrained environments

• Published in: Plant methods Vol. 20; no. 1; pp. 127 - 17
• Main Authors: Jing, Xuebin, Wang, Yuanhao, Li, Dongxi, Pan, Weihua
• Format: Journal Article
• Language: English
• Published: England BioMed Central Ltd 16-08-2024; BMC
• Subjects: Algorithms; Crops; Deep learning; Fruit; Machine vision; Melon; Melons; Object detection; Physiological aspects; Ripeness detection; Ripening; Telecommunication systems; China; Deep learning; Ripeness detection; Object detection; Melon
• ISSN: 1746-4811; 1746-4811
• DOI: 10.1186/s13007-024-01259-3

Ripeness is a phenotype that significantly impacts the quality of fruits, constituting a crucial factor in the cultivation and harvesting processes. Manual detection methods and experimental analysis, however, are inefficient and costly.
In this study, we propose a lightweight and efficient melon ripeness detection method, MRD-YOLO, based on an improved object detection algorithm. The method combines a lightweight backbone network, MobileNetV3, a design paradigm Slim-neck, and a Coordinate Attention mechanism. Additionally, we have created a large-scale melon dataset sourced from a greenhouse based on ripeness. This dataset contains common complexities encountered in the field environment, such as occlusions, overlapping, and varying light intensities. MRD-YOLO achieves a mean Average Precision of 97.4% on this dataset, achieving accurate and reliable melon ripeness detection. Moreover, the method demands only 4.8 G FLOPs and 2.06 M parameters, representing 58.5% and 68.4% of the baseline YOLOv8n model, respectively. It comprehensively outperforms existing methods in terms of balanced accuracy and computational efficiency. Furthermore, it maintains real-time inference capability in GPU environments and demonstrates exceptional inference speed in CPU environments. The lightweight design of MRD-YOLO is anticipated to be deployed in various resource constrained mobile and edge devices, such as picking robots. Particularly noteworthy is its performance when tested on two melon datasets obtained from the Roboflow platform, achieving a mean Average Precision of 85.9%. This underscores its excellent generalization ability on untrained data.
This study presents an efficient method for melon ripeness detection, and the dataset utilized in this study, alongside the detection method, will provide a valuable reference for ripeness detection across various types of fruits.