Unsupervised semantic segmentation with self-supervised object-centric representations

Zadaianchuk A, Kleindessner M, Zhu Y, Locatello F, Brox T. 2023. Unsupervised semantic segmentation with self-supervised object-centric representations. The 11th International Conference on Learning Representations. ICLR: International Conference on Learning Representations.

Download (ext.)
Conference Paper | Published | English
Author
Zadaianchuk, Andrii; Kleindessner, Matthaeus; Zhu, Yi; Locatello, FrancescoISTA ; Brox, Thomas
Department
Abstract
In this paper, we show that recent advances in self-supervised feature learning enable unsupervised object discovery and semantic segmentation with a performance that matches the state of the field on supervised semantic segmentation 10 years ago. We propose a methodology based on unsupervised saliency masks and self-supervised feature clustering to kickstart object discovery followed by training a semantic segmentation network on pseudo-labels to bootstrap the system on images with multiple objects. We present results on PASCAL VOC that go far beyond the current state of the art (50.0 mIoU), and we report for the first time results on MS COCO for the whole set of 81 classes: our method discovers 34 categories with more than $20\%$ IoU, while obtaining an average IoU of 19.6 for all 81 categories.
Publishing Year
Date Published
2023-05-01
Proceedings Title
The 11th International Conference on Learning Representations
Conference
ICLR: International Conference on Learning Representations
Conference Location
Kigali, Rwanda
Conference Date
2023-05-01 – 2023-05-05
IST-REx-ID

Cite this

Zadaianchuk A, Kleindessner M, Zhu Y, Locatello F, Brox T. Unsupervised semantic segmentation with self-supervised object-centric representations. In: The 11th International Conference on Learning Representations. ; 2023.
Zadaianchuk, A., Kleindessner, M., Zhu, Y., Locatello, F., & Brox, T. (2023). Unsupervised semantic segmentation with self-supervised object-centric representations. In The 11th International Conference on Learning Representations. Kigali, Rwanda.
Zadaianchuk, Andrii, Matthaeus Kleindessner, Yi Zhu, Francesco Locatello, and Thomas Brox. “Unsupervised Semantic Segmentation with Self-Supervised Object-Centric Representations.” In The 11th International Conference on Learning Representations, 2023.
A. Zadaianchuk, M. Kleindessner, Y. Zhu, F. Locatello, and T. Brox, “Unsupervised semantic segmentation with self-supervised object-centric representations,” in The 11th International Conference on Learning Representations, Kigali, Rwanda, 2023.
Zadaianchuk A, Kleindessner M, Zhu Y, Locatello F, Brox T. 2023. Unsupervised semantic segmentation with self-supervised object-centric representations. The 11th International Conference on Learning Representations. ICLR: International Conference on Learning Representations.
Zadaianchuk, Andrii, et al. “Unsupervised Semantic Segmentation with Self-Supervised Object-Centric Representations.” The 11th International Conference on Learning Representations, 2023.
All files available under the following license(s):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]

Link(s) to Main File(s)
Access Level
OA Open Access

Export

Marked Publications

Open Data ISTA Research Explorer

Sources

arXiv 2207.05027

Search this title in

Google Scholar