NAI Journal 2025 Journal Article
Benchmarking Neurosymbolic Description Logic Reasoners: Existing Challenges and a Way Forward
- Gunjan Singh
- Riccardo Tommasini
- Sumit Bhatia
- Raghava Mutharaju
Recently, there has been significant progress in the development of robust and highly scalable neurosymbolic description logic reasoners. However, the field faces challenges arising from diverse design strategies and evaluation methods. We address the latter challenge by emphasizing the critical requirement for a comprehensive benchmark framework tailored to the unique evaluation needs of neurosymbolic description logic reasoners. In this paper, we address barriers that must be overcome to facilitate the effective evaluation of these reasoners and outline a potential methodology for designing the benchmark framework. This work contributes toward a more systematic and principled evaluation framework for neurosymbolic reasoning, highlighting the broader role of benchmarks in advancing the field.