EAAI Journal 2026 Journal Article
A gated recurrent unit-based soft actor–critic approach with social force model crowd simulation for improved mobile robot path planning
- Dezhen Zhang
- Guoxu Wang
- Gerald Schaefer
- Hui Fang
- Junming Su
Mobile robot path planning is an essential function for many current and emerging applications of service robots. Despite consistent progress, learning a generalisable path planning model in a dynamic multiple-pedestrian environment is still a challenging task. In this paper, we construct a dynamic simulation environment based on a social force model to narrow the gap between simulation and reality so as to yield better generalisability for a path planning model. Using this simulation, we design a gated recurrent unit (GRU)-based soft actor–critic (SAC) neural network model which exploits future state predictions to reduce the exploration space in order to improve training convergence. Learning from scenarios driven by the social force model, we include GRU temporal predictions of pedestrian movements as an additional state feature to prevent the model from exploring less frequent or inactive behaviour patterns. Compared to other state-of-the-art offline reinforcement learning approaches, our experimental results show that GRU-SAC achieves faster convergence, yields improved collision avoidance, and obtains planned paths that are shorter and smoother. In addition, results from real-world corridor experiments demonstrate that agents trained with the social force model can better capture the emergent dynamic behaviours of pedestrians in high-density environments. This indicates that the proposed GRU-SAC model exhibits superior adaptability in complex scenarios and confirms its practical applicability in real-world settings.