Non-cooperative coupled microgrid-transportation coordination system: A deep deterministic policy gradient-based approach

• Published in: International journal of electrical power & energy systems Vol. 160; p. 110092
• Main Authors: Zhang, Shiyao, Zhu, Xingzheng, Zhang, Shengyu, Yu, James J.Q.
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01-09-2024; Elsevier
• Subjects: Connected electric vehicles; Coupled microgrid-transportation system; Deep deterministic policy gradient; Markov decision process; Microgrid; Non-cooperative system; Coupled microgrid-transportation system; Deep deterministic policy gradient; Markov decision process; Non-cooperative system; Connected electric vehicles; Microgrid
• ISSN: 0142-0615
• DOI: 10.1016/j.ijepes.2024.110092

The cooperation between multiple microgrids (MGs) take a substantial role in enabling the process of information and energy exchange, which can increase the reliability of multi-microgrid (MMG) systems. Since MGs tend to be selfish in real-world operations, it is vital to address the way to motivate MGs to cooperate efficiently in MMG systems. In addition, considering the participated connected electric vehicles (CEVs) in CMT systems, the synergy between the MG-transportation coupled networks shall be accounted. In this paper, we propose a Stackelberg game theoretic approach for the non-cooperative coupled microgrid-transportation (CMT) system by exploiting connected electric vehicles (CEVs). This formulated game can jointly trigger the MG energy trading and vehicle-to-grid coordination schemes in the system. To solve the CMT game with imperfect information, a Markov Decision Process (MDP) and a deep deterministic policy gradient-based methods are developed. The devised algorithm can learn a deterministic optimal response from the opponents. The game’s Nash equilibrium can be approximately converged when the game is with imperfect information. Simulation results show that the proposed model can guarantee the effectiveness of the energy trading process in the CMT system. In addition, through the efficient CEV coordination strategies, the V2G regulation service is provided efficiently while it can further alleviate the grid power fluctuations. Furthermore, large economic benefits can be achieved under the CMT system.
•Tackle multi-microgrid cooperation scheme so as to further enhance system reliability.•Account the synergy between the MG-transportation coupled networks.•Propose a Stackelberg imperfect game for the non-cooperative coupled microgrid-transportation (CMT) system.•Solve the problem by the deep deterministic policy gradient-based method with imperfect information.