Development and Experimental Validation of an Intelligent Camera Model for Automated Driving

• Published in: Sensors (Basel, Switzerland) Vol. 21; no. 22; p. 7583
• Main Authors: Genser, Simon, Muckenhuber, Stefan, Solmaz, Selim, Reckenzaun, Jakob
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 15-11-2021; MDPI
• Subjects: ADAS/AD function; Automation; Automobile Driving; Automobiles; automotive camera; automotive perception sensors; Autonomous Vehicles; Cameras; Datasets; Driving; Light; Model testing; Modelling; Neural networks; Perception; Position errors; Position measurement; Position sensing; sensor model; Sensors; Simulation; Traffic congestion; Vehicles; virtual testing; automotive perception sensors; ADAS/AD function; automotive camera; virtual testing; sensor model
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s21227583

The virtual testing and validation of advanced driver assistance system and automated driving (ADAS/AD) functions require efficient and realistic perception sensor models. In particular, the limitations and measurement errors of real perception sensors need to be simulated realistically in order to generate useful sensor data for the ADAS/AD function under test. In this paper, a novel sensor modeling approach for automotive perception sensors is introduced. The novel approach combines kernel density estimation with regression modeling and puts the main focus on the position measurement errors. The modeling approach is designed for any automotive perception sensor that provides position estimations at the object level. To demonstrate and evaluate the new approach, a common state-of-the-art automotive camera (Mobileye 630) was considered. Both sensor measurements (Mobileye position estimations) and ground-truth data (DGPS positions of all attending vehicles) were collected during a large measurement campaign on a Hungarian highway to support the development and experimental validation of the new approach. The quality of the model was tested and compared to reference measurements, leading to a pointwise position error of 9.60% in the lateral and 1.57% in the longitudinal direction. Additionally, the modeling of the natural scattering of the sensor model output was satisfying. In particular, the deviations of the position measurements were well modeled with this approach.