Semantic-Aware Superpixel for Weakly Supervised Semantic Segmentation

Weakly-supervised semantic segmentation aims to train a semantic segmentation network using weak labels. Among weak labels, image-level label has been the most popular choice due to its simplicity. However, since image-level labels lack accurate object region information, additional modules such as saliency detector have been exploited in weakly supervised semantic segmentation, which requires pixel-level label for training. In this paper, we explore a self-supervised vision transformer to mitigate the heavy efforts on generation of pixel-level annotations. By exploiting the features obtained from self-supervised vision transformer, our superpixel discovery method finds out the semantic-aware superpixels based on the feature similarity in an unsupervised manner. Once we obtain the superpixels, we train the semantic segmentation network using superpixel-guided seeded region growing method. Despite its simplicity, our approach achieves the competitive result with the state-of-the-arts on PASCAL VOC 2012 and MS-COCO 2014 semantic segmentation datasets for weakly supervised semantic segmentation. Our code is available at https://github.com/st17kim/semantic-aware-superpixel.

Authors

• Sangtae Kim Seoul National University
• Daeyoung Park Inha University
• Byonghyo Shim Seoul National University

Keywords

• CV: Segmentation
• ML: Classification and Regression
• ML: Clustering
• ML: Deep Neural Network Algorithms
• ML: Multi-class/Multi-label Learning & Extreme Classification
• ML: Unsupervised & Self-Supervised Learning