AAMAS Conference 2026 Conference Paper
GCMRBench: Goal-Conditioned Multi-Robot Environments and Benchmarks for Advancing Offline Multi-Agent Reinforcement Learning
- Chenxing Li
- Chin-jui Chang
- Yinlong Liu
- Zijian Ma
- Jan Seyler
- Shahram Eivazi
Research in multi-agent reinforcement learning (MARL) has focused on developing algorithms to address challenges posed by agents’ diverse goals, collaboration, and competition in complex environments. Extending these algorithms to Offline MARL (OMARL), together with the utilization of large-scale offline datasets, has increasingly been recognized as a promising approach toward safe, efficient, and rapid deployment in real-world scenarios. However, most existing studies train and evaluate OMARL in environments primarily designed for game-based scenarios. As a result, the potential of OMARL in domains such as robotics remains an open question. To bridge this gap, we introduce GCMRBench, a goalconditioned multi-agent simulation environment tailored for dualarm robotic tasks and the evaluation of offline multi-agent algorithms, thereby facilitating their deployment in practical robotic applications.