LLMRG: Improving Recommendations through Large Language Model Reasoning Graphs

Recommendation systems aim to provide users with relevant suggestions, but often lack interpretability and fail to capture higher-level semantic relationships between user behaviors and profiles. In this paper, we propose a novel approach that leverages large language models (LLMs) to construct personalized reasoning graphs. These graphs link a user's profile and behavioral sequences through causal and logical inferences, representing the user's interests in an interpretable way. Our approach, LLM reasoning graphs (LLMRG), has four components: chained graph reasoning, divergent extension, self-verification and scoring, and knowledge base self-improvement. The resulting reasoning graph is encoded using graph neural networks, which serves as additional input to improve conventional recommender systems, without requiring extra user or item information. Our approach demonstrates how LLMs can enable more logical and interpretable recommender systems through personalized reasoning graphs. LLMRG allows recommendations to benefit from both engineered recommendation systems and LLM-derived reasoning graphs. We demonstrate the effectiveness of LLMRG on benchmarks and real-world scenarios in enhancing base recommendation models.

Authors

• Yan Wang
• Zhixuan Chu Zhejiang University
• Xin Ouyang Ant Group
• Simeng Wang Ant Group
• Hongyan Hao Ant Group
• Yue Shen Ant Group
• Jinjie Gu Ant Group
• Siqiao Xue Ant Group
• James Zhang Ant Group
• Qing Cui Ant Group
• Longfei Li Ant Group
• Jun Zhou University of Electronic Science and Technology of China
• Sheng Li

Keywords

• CMS: Conceptual Inference and Reasoning
• DMKM: Recommender Systems
• NLP: (Large) Language Models
• NLP: Applications