EAAI Journal 2026 Journal Article
A symbolic node-priority ranker driven by deep reinforcement learning for distributed traffic signal control
- Guoqiang Chen
- Lan Liu
- Jiannan Mao
- Weike Lu
- Guojing Hu
- Hao Huang
In distributed traffic signal control (DTSC) systems, properly prioritizing intersections is crucial for improving network-wide traffic efficiency. However, existing node-priority ranking methods often rely on empirical rules or black-box models, leading to either limited performance or poor interpretability. To address this challenge, we propose SymRanker, a deep reinforcement learning-driven symbolic ranker for node prioritization. From the AI perspective, SymRanker is built on Proximal Policy Optimization (PPO) and consists of two key neural components: an Actor policy network and a Critic network. The Actor is implemented as a Recurrent Neural Network (RNN) and uses a binary-tree representation to efficiently search for interpretable node-ranking formulas. The Critic provides value estimates to stabilize policy optimization, reduce variance, and improve convergence during training. From the engineering perspective, SymRanker is tailored to DTSC by integrating a multi-penetration-rate mechanism into policy updates, ensuring consistent performance across different network penetration rates. Experiments on six benchmark networks show that SymRanker uncovers latent regularities and expresses them as concise symbolic formulas. Ablation studies demonstrate a 90% gain in formula reproduction accuracy when structure learning is decoupled from constant estimation. Further studies on two DTSC systems demonstrate that controlling only critical intersections can achieve performance comparable to full-node control. Across four settings, precision control achieves the same performance as 100% deployment, with distributed controllers installed on only 45% of the nodes. Overall, these results confirm the effectiveness of SymRanker and offer a practical solution to intersection prioritization in DTSC.