Arrow Research search

Author name cluster

Shuibai Zhang

Possible papers associated with this exact author name in Arrow. This page groups case-insensitive exact name matches and is not a full identity disambiguation profile.

2 papers
1 author row

Possible papers

2

ICML Conference 2025 Conference Paper

VersaPRM: Multi-Domain Process Reward Model via Synthetic Reasoning Data

  • Thomas Zeng 0003
  • Shuibai Zhang
  • Shutong Wu
  • Christian Classen
  • Daewon Chae
  • Ethan Ewer
  • Minjae Lee
  • Heeju Kim

Process Reward Models (PRMs) have proven effective at enhancing mathematical reasoning for Large Language Models (LLMs) by leveraging increased inference-time computation. However, they are predominantly trained on mathematical data and their generalizability to non-mathematical domains has not been rigorously studied. In response, this work first shows that current PRMs have poor performance in other domains. To address this limitation, we introduce VersaPRM, a multi-domain PRM trained on synthetic reasoning data generated using our novel data generation and annotation method. VersaPRM achieves consistent performance gains across diverse domains. For instance, in the MMLU-Pro category of Law, VersaPRM via weighted majority voting, achieves a 7. 9% performance gain over the majority voting baseline–surpassing Qwen2. 5-Math-PRM’s gain of 1. 3%. We further contribute to the community by open-sourcing all data, code and models for VersaPRM.

Details

ICLR Conference 2024 Conference Paper

Supervised Knowledge Makes Large Language Models Better In-context Learners

  • Linyi Yang
  • Shuibai Zhang
  • Zhuohao Yu 0001
  • Guangsheng Bao
  • Yidong Wang 0003
  • Jindong Wang 0001
  • Ruochen Xu
  • Wei Ye 0004

Large Language Models (LLMs) exhibit emerging in-context learning abilities through prompt engineering. The recent progress in large-scale generative models has further expanded their use in real-world language applications. However, the critical challenge of improving the generalizability and factuality of LLMs in natural language understanding and question answering remains under-explored. While previous in-context learning research has focused on enhancing models to adhere to users' specific instructions and quality expectations, and to avoid undesired outputs, little to no work has explored the use of task-specific fine-tuned Language Models (SLMs) to improve LLMs' in-context learning during the inference stage. Our primary contribution is the establishment of a simple yet effective framework that enhances the reliability of LLMs as it: 1) generalizes out-of-distribution data, 2) elucidates how LLMs benefit from discriminative models, and 3) minimizes hallucinations in generative tasks. Using our proposed plug-in method, enhanced versions of Llama 2 and ChatGPT surpass their original versions regarding generalizability and factuality. We offer a comprehensive suite of resources, including 16 curated datasets, prompts, model checkpoints, and LLM outputs across 9 distinct tasks. Our empirical analysis sheds light on the advantages of incorporating discriminative models into LLMs and highlights the potential of our methodology in fostering more reliable LLMs.

Details
v2026.09.13