Improved RefineDNet algorithm for precise environmental perception of autonomous earthmoving machinery under haze and fugitive dust conditions

• Published in: Advanced engineering informatics Vol. 59; p. 102326
• Main Authors: Guan, Shiwei, Wang, Jiajun, Wang, Xiaoling, Zhang, Biao, Liang, Hongyang
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01-01-2024
• Subjects: Attention mechanism; Dehazing and fugitive-dust removal; Earth-rock dam; Environmental perception; RefineDNet; Robotic roller; Attention mechanism; Environmental perception; Earth-rock dam; Dehazing and fugitive-dust removal; RefineDNet; Robotic roller
• ISSN: 1474-0346; 1873-5320
• DOI: 10.1016/j.aei.2023.102326

[Display omitted]
•Dehazing and fugitive-dust removal algorithm is integrated into autonomous machinery.•Visibility and realness of degraded images can be restored by improved RefineDNet.•Feature attention and attention gates can address uneven distribution of haze.•Res2Net module can extract multi-scale features and restore multi-scale objects.•The robotic roller was applied to an earth-rock dam and yield great benefits.
Non-homogeneous haze and fugitive dust are frequently encountered at earthwork construction sites, which can lead to errors and omissions in vision-based perception modules of autonomous earthmoving machinery. This study proposes an improved RefineDNet dehazing and fugitive dust removal algorithm to solve this problem. Compared with the original RefineDNet, the improved algorithm integrates feature attention and attention gate modules to address the non-homogeneous distribution of haze and fugitive dust, and integrates a Res2Net module to process multiscale objects. The proposed algorithm effectively enhances the visibility and realness of hazy or dusty images, thereby improving the object detection accuracy significantly. The peak signal-to-noise ratio and structure similarity index measure achieved by the proposed method were on average 2.42 and 0.0699 higher, respectively, than those achieved by state-of-the-art algorithms on a dataset of haze and fugitive dust at a construction site. The object detection accuracy of the restored images was 0.7160, which is an improvement of 45.6% compared to that of the original photographs in the on-site tests.