Optimal Filtering of Markov Jump Processes. III. Identification of System Parameters

• Published in: Automation and remote control Vol. 83; no. 11; pp. 1773 - 1791
• Main Author: Borisov, A. V.
• Format: Journal Article
• Language: English
• Published: Moscow Pleiades Publishing 2022; Springer Nature B.V
• Subjects: CAE) and Design; Calculus of Variations and Optimal Control; Optimization; Computer-Aided Engineering (CAD; Control; Estimates; Estimation; Iterative algorithms; Iterative methods; Markov chains; Mathematics; Mathematics and Statistics; Mechanical Engineering; Mechatronics; Parameter identification; Robotics; Stochastic Systems; Systems Theory; optimal estimate; smoothing on fixed observation interval; hidden Markov model; EM algorithm; multiplicative noise in observations
• ISSN: 0005-1179; 1608-3032
• DOI: 10.1134/S00051179220110054

The present paper is a continuation of the series of articles [
1
,
2
] and is devoted to solving the problem of estimating the parameters of hidden Markov models. The hidden state is a homogeneous Markov jump process with a finite set of states. The available observations are indirect and contain Wiener processes whose intensities are different and depend on the hidden state. Both the intensity matrix of Markov state transitions and the drift and diffusion parameters of the observations are subject to estimation. For identification, an iterative algorithm based on smoothing the state of the system based on observations over a fixed time interval is proposed. Then, according to these estimates, the parameters are reconstructed. The paper describes in detail all the numerical schemes for estimating the state and for identifying the parameters. A set of illustrative numerical examples is presented, demonstrating the high quality of the proposed identification estimates.