Semi-Data-Aided Channel Estimation for MIMO Systems via Reinforcement Learning

• Published in: IEEE transactions on wireless communications Vol. 22; no. 7; pp. 4565 - 4579
• Main Authors: Kim, Tae-Kyoung, Jeon, Yo-Seb, Li, Jun, Tavangaran, Nima, Poor, H. Vincent
• Format: Journal Article
• Language: English
• Published: New York IEEE 01-07-2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Approximation; Channel estimation; Communications systems; Corresponding states; data-aided channel estimation; Error detection; Estimation; Iterative decoding; Iterative methods; Markov processes; MIMO communication; Monte Carlo tree search; Multiple-input multiple-output (MIMO); reinforcement learning; Search algorithms; Symbols; Wireless communication
• DOI: 10.1109/TWC.2022.3227312
• EISSN: 1558-2248
• ISSN: 1536-1276

Data-aided channel estimation is a promising solution to improve channel estimation accuracy by exploiting data symbols as pilot signals for updating an initial channel estimate. In this paper, we propose a semi-data-aided channel estimator for multiple-input multiple-output communication systems. Our strategy is to leverage reinforcement learning (RL) for selecting reliable detected symbols, then update the channel estimate by utilizing only the selected symbols as additional pilot signals. Towards this end, we first define a Markov decision process (MDP) which sequentially decides whether to use each detected symbol as an additional pilot signal. We then develop an RL algorithm to find an effective policy of the MDP based on a Monte Carlo tree search approach. In this algorithm, we exploit the a-posteriori probability for approximating both the optimal future actions and the corresponding state transitions of the MDP and derive a closed-form expression for the optimal policy under the approximations. A key advantage of the proposed channel estimator is that it requires less computational complexity than conventional iterative data-aided channel estimators. Simulation results demonstrate that the proposed channel estimator effectively mitigates both channel estimation error and detection performance loss caused by insufficient pilot signals.