Grounded object centric learning

Kori A, Locatello F, Ribeiro FDS, Toni F, Glocker B. Grounded object centric learning. arXiv, 2307.09437.

Download (ext.)

Preprint | Submitted | English
Author
Kori, Avinash; Locatello, FrancescoISTA ; Ribeiro, Fabio De Sousa; Toni, Francesca; Glocker, Ben
Department
Abstract
The extraction of modular object-centric representations for downstream tasks is an emerging area of research. Learning grounded representations of objects that are guaranteed to be stable and invariant promises robust performance across different tasks and environments. Slot Attention (SA) learns object-centric representations by assigning objects to \textit{slots}, but presupposes a \textit{single} distribution from which all slots are randomly initialised. This results in an inability to learn \textit{specialized} slots which bind to specific object types and remain invariant to identity-preserving changes in object appearance. To address this, we present \emph{\textsc{Co}nditional \textsc{S}lot \textsc{A}ttention} (\textsc{CoSA}) using a novel concept of \emph{Grounded Slot Dictionary} (GSD) inspired by vector quantization. Our proposed GSD comprises (i) canonical object-level property vectors and (ii) parametric Gaussian distributions, which define a prior over the slots. We demonstrate the benefits of our method in multiple downstream tasks such as scene generation, composition, and task adaptation, whilst remaining competitive with SA in popular object discovery benchmarks.
Publishing Year
Date Published
2023-07-18
Journal Title
arXiv
Acknowledgement
This work was supported by supported by UKRI (grant agreement no. EP/S023356/1), in the UKRI Centre for Doctoral Training in Safe and Trusted AI via A. Kori.
Article Number
2307.09437
IST-REx-ID

Cite this

Kori A, Locatello F, Ribeiro FDS, Toni F, Glocker B. Grounded object centric learning. arXiv. doi:10.48550/arXiv.2307.09437
Kori, A., Locatello, F., Ribeiro, F. D. S., Toni, F., & Glocker, B. (n.d.). Grounded object centric learning. arXiv. https://doi.org/10.48550/arXiv.2307.09437
Kori, Avinash, Francesco Locatello, Fabio De Sousa Ribeiro, Francesca Toni, and Ben Glocker. “Grounded Object Centric Learning.” ArXiv, n.d. https://doi.org/10.48550/arXiv.2307.09437.
A. Kori, F. Locatello, F. D. S. Ribeiro, F. Toni, and B. Glocker, “Grounded object centric learning,” arXiv. .
Kori A, Locatello F, Ribeiro FDS, Toni F, Glocker B. Grounded object centric learning. arXiv, 2307.09437.
Kori, Avinash, et al. “Grounded Object Centric Learning.” ArXiv, 2307.09437, doi:10.48550/arXiv.2307.09437.
All files available under the following license(s):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]

Link(s) to Main File(s)
Access Level
OA Open Access

Export

Marked Publications

Open Data ISTA Research Explorer

Sources

arXiv 2307.09437

Search this title in

Google Scholar