Attributive Reasoning for Hallucination Diagnosis of Large Language Models

In recent years, large language models (LLMs) have demonstrated outstanding capabilities in various tasks. However, LLMs also have various drawbacks, especially hallucination. Hallucination refers to the generation of content that does not align with the user input, contradicts previously generated content or world knowledge. Current research on hallucination mainly include knowledge retrieval, prompt engineering, training data improvement, reinforcement learning, etc. However, these methods do not involve different categories of hallucinations which is important on hallucination analysis, and make detailed investigation for the internal state of LLMs which indicates the direction on hallucination occurrence. Therefore, in our research, we introduce an attribution framework to trace the origins of hallucinations based on the internal signals of LLMs. To support this framework, we develop a new benchmark named RelQA-Cate, which includes eight categories of hallucinations for the answers generated by LLMs. After that, we present a novel Differential Penalty Decoding (DPD) strategy for reducing hallucinations through adjusting post-probabilities of each answer. We conduct a series of experiments and the performance on answer reliability has significant improvement, achieving 28.25% at most, which demonstrates the effectiveness of our proposed DPD and its generalization in mitigating hallucination in LLMs.

Authors

• Yuyan Chen Shanghai Key Laboratory of Data Science, School of Computer Science, Fudan University
• Zehao Li School of Data Science and Engineering, East China Normal University
• Shuangjie You Georgia Institute of Technology
• Zhengyu Chen Zhejiang University
• Jingwen Chang Shanghai Key Laboratory of Data Science, School of Computer Science, Fudan University
• Yi Zhang
• Weinan Dai Zhejiang University
• Qingpei Guo Ant Group
• Yanghua Xiao Shanghai Key Laboratory of Data Science, School of Computer Science, Fudan University

Keywords

No keywords are indexed for this paper.