Branching Dueling Q-Network-Based Online Scheduling of a Microgrid with Distributed Energy Storage Systems

Hang Shuai, Fangxing Li, Hector Pulgar-Painemal, Yaosuo Xue

Research output: Contribution to journalArticlepeer-review

21 Scopus citations

Abstract

This letter investigates a Branching Dueling Q-Network (BDQ) based online operation strategy for a microgrid with distributed battery energy storage systems (BESSs) operating under uncertainties. The developed deep reinforcement learning (DRL) based microgrid online optimization strategy can achieve a linear increase in the number of neural network outputs with the number of distributed BESSs, which overcomes the curse of dimensionality caused by the charge and discharge decisions of multiple BESSs. Numerical simulations validate the effectiveness of the proposed method.

Original languageEnglish
Pages (from-to)5479-5482
Number of pages4
JournalIEEE Transactions on Smart Grid
Volume12
Issue number6
DOIs
StatePublished - Nov 1 2021

Funding

This work was supported in part by the U.S. National Science Foundation (NSF) ECCS Awards under Grant 1809458 and Grant 2033910; in part by the CURENT which is an Engineering Research Center funded by NSF and U.S. Department of Energy (DOE) through NSF Award under Grant EEC-1041877; and in part by the U.S. DOE, Office of Energy Efficiency and Renewable Energy and Office of Electricity under Contract DE-AC05-00OR22725.

FundersFunder number
National Science Foundation2033910
U.S. Department of EnergyEEC-1041877
Directorate for Engineering1809458
Office of Energy Efficiency and Renewable Energy
Office of ElectricityDE-AC05-00OR22725

    Keywords

    • Deep reinforcement learning (DRL)
    • distributed energy storage
    • microgrid optimization
    • uncertainty

    Fingerprint

    Dive into the research topics of 'Branching Dueling Q-Network-Based Online Scheduling of a Microgrid with Distributed Energy Storage Systems'. Together they form a unique fingerprint.

    Cite this