Cognitive Radar Target Tracking Using Intelligent Waveforms Based on Reinforcement Learning

• Published in: IEEE transactions on geoscience and remote sensing Vol. 61; p. 1
• Main Authors: Zhu, Peikun, Liang, Jing, Luo, Zihan, Shen, Xiaofeng
• Format: Journal Article
• Language: English
• Published: New York IEEE 01-01-2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Adaptation models; Algorithms; CBO; Closed loops; Cognitive ability; cognitive radar; Complexity; Entropy; ERQL; Field tests; Learning; Libraries; Maneuvering targets; Object detection; Optimization; Parameters; Radar; Radar targets; Radar tracking; Real-time systems; Target tracking; waveform selection; Waveforms
• ISSN: 0196-2892; 1558-0644
• DOI: 10.1109/TGRS.2023.3298355

Cognitive radar (CR) automatically improves itself via ceaseless interaction with the environment and learning from the experience. It continuously adjusts its waveform, parameters, and illuminates strategies based on obtained knowledge to achieve robust target tracking despite complex and changing scenarios. Waveform development for CR has attracted sustaining attention in promoting tracking performance. In this paper, we propose a novel framework of CR waveform selection for the tracking of high maneuvering targets in a cluttered environment with an interactive multi-model (IMM) probabilistic data association (PDA) algorithm. Based on this framework, criterion-based optimization (CBO) and entropy-rewarded Q-learning (ERQL) methods are designed to perform waveform selection, which is divided into pure parameters selection and joint selection of waveforms and parameters. This method integrates the radar target into a closed loop and realizes the real-time update of the transmitted waveform with the change of the target state, to achieve the best tracking performance of the target. The simulations performed on radar target tracking have demonstrated that the proposed ERQL method outperforms the existing method in both time complexity and tracking accuracy. Furthermore, field experiments have confirmed that the ERQL method is more effective in target tracking than the existing method.