Novel Class Discovery for Representation of Real-World Heritage Data as Neural Radiance Fields (Student Abstract)

Neural Radiance Fields (NeRF) have been extensively explored as a leading approach for modeling and representing 3D data across various domains. Their ability to capture arbitrary scale point clouds and generate novel views makes them particularly valuable for digitizing cultural heritage sites. However, despite their impressive rendering capabilities, prior methods have often overlooked a significant real-world challenge: handling open-world scenarios characterized by unstructured data containing multiple classes in a single set of unlabeled images. To address this challenge, we propose a novel method NCD-NeRF that leverages Novel-Class Discovery to effectively tackle the complexities inherent in real-world data with unlabeled classes while excelling in producing high-quality NeRF representation. To validate our approach, we conducted a benchmarking analysis using a custom-collected dataset featuring UNESCO World Heritage sites in India. We observe that our proposed NCD-NeRF can parallely discover novel classes and render high-quality 3D volumes.

Authors

• Shivanand Kundargi Center of Excellence in Visual Intelligence (CEVI), KLE Technological University, Vidyanagar, Hubballi, Karnataka, India
• Tejas Anvekar Center of Excellence in Visual Intelligence (CEVI), KLE Technological University, Vidyanagar, Hubballi, Karnataka, India
• Ramesh Tabib Center of Excellence in Visual Intelligence (CEVI), KLE Technological University, Vidyanagar, Hubballi, Karnataka, India
• Uma Mudenagudi Center of Excellence in Visual Intelligence (CEVI), KLE Technological University, Vidyanagar, Hubballi, Karnataka, India

Keywords

• Computer Vision
• Crowdsourced Real-World Heritage Data
• Neural Radiance Fields
• Novel Class Discovery