EAAI Journal 2026 Journal Article
A look-ahead dispatch method via evolution strategies embedded with domain knowledge
- Yuchen Dai
- Weiran Jiao
- Yi Tang
- Minghui Yan
- Feng Xue
- Jianfeng Zhao
Modern power systems require proactive look-ahead dispatch strategies to address various uncertainties. Traditional decision-making methods based on physical models often suffer from slow processing speeds and struggle to handle multiple uncertain scenarios. Meanwhile, reinforcement learning methods face challenges such as hyperparameter sensitivity and a tendency to converge to local optima. To overcome these limitations, a look-ahead dispatch method via evolution strategies embedded with domain knowledge is proposed. First, a knowledge-embedded Markov decision process model of look-ahead dispatch is developed. This model encodes critical physical knowledge into the action space without computational burden. Second, a decision-making approach based on evolution strategies and physical models is introduced. This method enhances parallel exploration efficiency and reduce communication burden by leveraging synchronous random seeds and mirror perturbation techniques. Then, physical models are used to fine-tune agents in new scenarios with limited data. Finally, case studies based on the IEEE 118 system show that the proposed method significantly improves decision-making efficiency without sacrificing accuracy. Compared to deep reinforcement learning, the evolution strategies algorithm offers superior training efficiency and performance, effectively addressing the high-dimensional uncertainties and complexities of modern power systems. This establishes the proposed method as an effective solution for complex decision-making tasks in power system operations.