Ensuring Safety for Artificial-Intelligence-Based Automatic Speech Recognition in Air Traffic Control Environment

• Published in: Aerospace Vol. 10; no. 11; p. 941
• Main Authors: Pinska-Chauvin, Ella, Helmke, Hartmut, Dokic, Jelena, Hartikainen, Petri, Ohneiser, Oliver, Lasheras, Raquel García
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01-11-2023
• Subjects: Air traffic control; Aircraft; Airports; Analysis; Artificial intelligence; Automatic speech recognition; Aviation; Callsigns; Controllers; Design analysis; en-route sector; Hazard assessment; Hazard identification; Hazard mitigation; Human error; Industrial research; Ontology; Pilots; Prototypes; R&D; Radio communications; Research & development; Safety; safety assessment; Safety regulations; Situational awareness; Speech; Systems design; User services; Voice communication; Voice recognition; workload; Workloads; Germany
• ISSN: 2226-4310; 2226-4310
• DOI: 10.3390/aerospace10110941

This paper describes the safety assessment conducted in SESAR2020 project PJ.10-W2-96 ASR on automatic speech recognition (ASR) technology implemented for air traffic control (ATC) centers. ASR already now enables the automatic recognition of aircraft callsigns and various ATC commands including command types based on controller–pilot voice communications for presentation at the controller working position. The presented safety assessment process consists of defining design requirements for ASR technology application in normal, abnormal, and degraded modes of ATC operations. A total of eight functional hazards were identified based on the analysis of four use cases. The safety assessment was supported by top-down and bottom-up modelling and analysis of the causes of hazards to derive system design requirements for the purposes of mitigating the hazards. Assessment of achieving the specified design requirements was supported by evidence generated from two real-time simulations with pre-industrial ASR prototypes in approach and en-route operational environments. The simulations, focusing especially on the safety aspects of ASR application, also validated the hypotheses that ASR reduces controllers’ workload and increases situational awareness. The missing validation element, i.e., an analysis of the safety effects of ASR in ATC, is the focus of this paper. As a result of the safety assessment activities, mitigations were derived for each hazard, demonstrating that the use of ASR does not increase safety risks and is, therefore, ready for industrialization.