Automatic Roadside Feature Detection Based on Lidar Road Cross Section Images

• Published in: Sensors (Basel, Switzerland) Vol. 22; no. 15; p. 5510
• Main Authors: Brkić, Ivan, Miler, Mario, Ševrović, Marko, Medak, Damir
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 23-07-2022; MDPI
• Subjects: Accuracy; Automation; Classification; Cross-sections; Data collection; Deep learning; Fatalities; Infrastructure; Lidar; Neural networks; road assessment; road safety; Roads & highways; roadside features; Safety barriers; Segments; Sensors; Traffic accidents & safety; Traffic flow; Travel time; Unmanned aerial vehicles
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s22155510

The United Nations (UN) stated that all new roads and 75% of travel time on roads must be 3+ star standard by 2030. The number of stars is determined by the International Road Assessment Program (iRAP) star rating module. It is based on 64 attributes for each road. In this paper, a framework for highly accurate and fully automatic determination of two attributes is proposed: roadside severity-object and roadside severity-distance. The framework integrates mobile Lidar point clouds with deep learning-based object detection on road cross-section images. The You Only Look Once (YOLO) network was used for object detection. Lidar data were collected by vehicle-mounted mobile Lidar for all Croatian highways. Point clouds were collected in .las format and cropped to 10 m-long segments align vehicle path. To determine both attributes, it was necessary to detect the road with high accuracy, then roadside severity-distance was determined with respect to the edge of the detected road. Each segment is finally classified into one of 13 roadside severity object classes and one of four roadside severity-distance classes. The overall accuracy of the roadside severity-object classification is 85.1%, while for the distance attribute it is 85.6%. The best average precision is achieved for safety barrier concrete class (0.98), while the worst AP is achieved for rockface class (0.72).