AAMAS Conference 2026 Conference Paper
Reliable Data Science Analysis with Large Language Models via Multi-Agent Tools Orchestration
- Mingyin Zou
- Guangrong You
- Xiaomin Zhu
- Yanqing Ye
- Ji Wang
WhileLargeLanguageModels(LLMs)showpromiseforautomating the labor-intensive process of data science analysis, their practical application is undermined by the generation of erroneous and unreliable code. We argue that this stems from treating LLMs as open-ended code generators—a task akin to answering an essay question. Weproposeafundamentalparadigmshift: ourframework reframes the task as one of structured tool selection and parameterization, effectively turning the “essay question” into a sequence of “multiple-choice and fill-in-the-blanks” problems. This shift dramatically reduces the potential for error. Our contributions are twofold. First, a multi-agent framework orchestrates the workflow, breaking down complex tasks into verifiable steps. Second, we construct an auto-generated tool library that supports a novel mechanism, empowering LLMs to select tools based on full source code rather than descriptions.