Admission control scheme for distributed service systems based on model and prediction

• Published in: Proceedings of the 31st Chinese Control Conference pp. 5518 - 5523
• Main Authors: Xiaonong Lu, Baoqun Yin, Haipeng Zhang, Qiang Ling
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01-07-2012
• Subjects: Adaptation models; Admission control; Aerospace electronics; Distributed Service Systems; Hidden Markov models; HMM-based method; Mathematical model; POMDP; Predictive models; Randomized Policy; Resource management
• ISBN: 1467325813; 9781467325813
• ISSN: 1934-1768; 2161-2927

In this paper, we propose an admission control method based on model and prediction for distributed service systems. First, we use partly observable Markov decision process (POMDP) to model the service system. Next, we put the service allocation policy into the model parameters and use randomized policy as admission control policies to optimize system performance. The target of optimization is to maximize the system benefits. Based on the POMDP model, we propose an observation-based policy gradient algorithm to solve the optimal policy. We use HMM-based method to detect and predict change of the system, then updating the system model and admission policy with dynamic adaptive method. Experiment result shows compare with the best effort service policy our optimal policy has a better system performance.