Image classification with orchard metadata

Low cost and easy to use monocular vision systems are able to capture large scale, dense data in orchards, to facilitate precision agriculture applications. Accurate image parsing is required for this purpose, however, operating in natural outdoor conditions makes this a complex task due to the undesirable intra-class variations caused by changes in illumination, pose and tree types, etc. Typically these variations are difficult to explicitly model and discriminative classifiers strive to be invariant to them. However, given the presence of structure, in both the orchard and how the data was obtained, a subset of these factors of variations can correlate with readily available metadata, including extrinsic experimental information such as the sun incidence angle, position within farm, etc. This paper presents a method to incorporate such metadata to aid scene parsing based on a multi-scale Multi-Layered Perceptron (MLP) architecture. Experimental results are shown for pixel segmentation over data collected at an apple orchard, leading to fruit detection and yield estimation. The results show a consistent improvement in segmentation accuracy with the inclusion of metadata under different network complexities, training configurations and evaluation metrics.

Authors

• Suchet Bargoti
• James Patrick Underwood

Keywords

• Metadata
• Training
• Lighting
• Sun
• Agriculture
• Image color analysis
• Vegetation
• Image Classification
• Yield Estimation
• Fruit Yield
• Intra-class Variance
• Types Of Trees
• Apple Orchards
• Training Configurations
• Improve Segmentation Accuracy
• Training Set
• Variance In The Data
• Validation Set
• Classification Performance
• Classification Results
• Image Segmentation
• Training Images
• Color Features
• Performance In Cases
• Multiple Iterations
• Individual Scale
• Solar Zenith Angle
• Denoising Autoencoder
• Appearance Variations
• Position Of The Sun
• Training Instances
• True Counts
• Watershed Segmentation
• Default Configuration
• Improvement In Classification
• Imaging Data
• R-squared Values