EAAI Journal 2026 Journal Article
A curriculum-guided and explainable reinforcement learning framework for fixed-wing unmanned aerial vehicle autopilots
- Yunxiao Lian
- Ni Li
- Pan Zhou
- Ruiguang Hu
- Changyin Dong
Current artificial intelligence methods when used for autopilots often suffer from poor control stability and a lack of explainability. To address these challenges, this paper proposes a curriculum-guided and explainable reinforcement learning framework for fixed-wing unmanned aerial vehicle autopilots. First, a sequential proximal policy optimization algorithm is developed for autopilots’ decision-making; the designed coupled reward function refines the guidance strategy for action selection, significantly improving the control performance of autopilots. Second, to tackle sparse rewards' impact on algorithm convergence, a curriculum learning method based on difficulty coefficient matrices is introduced to effectively guide agents' training process. Third, instead of treating the policy as a “black box”, semantic-grouped Shapley additive explanations are proposed to explain the policy. Finally, the efficacy of the designed autopilot is rigorously tested by a high-fidelity simulator JSBSim. The results indicate that the autopilot can adapt to various waypoint tracking tasks while exhibiting strong policy explainability.