Object-centric learning with slot attention

Weissenborn D, Uszkoreit J, Unterthiner T, Mahendran A, Locatello F, Kipf T, Heigold G, Dosovitskiy A. 2021. Object-centric learning with slot attention.

Download (ext.)
Patent
Inventor
Weissenborn, Dirk; Uszkoreit, Jakob; Unterthiner, Thomas; Mahendran, Aravindh; Locatello, FrancescoISTA ; Kipf, Thomas; Heigold, Georg; Dosovitskiy, Alexey
Department
Abstract
A method involves receiving a perceptual representation including a plurality of feature vectors, and initializing a plurality of slot vectors represented by a neural network memory unit. Each respective slot vector is configured to represent a corresponding entity in the perceptual representation. The method also involves determining an attention matrix based on a product of the plurality of feature vectors transformed by a key function and the plurality of slot vectors transformed by a query function. Each respective value of a plurality of values along each respective dimension of the attention matrix is normalized with respect to the plurality of values. The method additionally involves determining an update matrix based on the plurality of feature vectors transformed by a value function and the attention matrix, and updating the plurality of slot vectors based on the update matrix by way of the neural network memory unit.
Publishing Year
Date Published
2021-12-09
Int. Patent Number
US20210383199A1
Int. Patent Classification
G06N 3/063 ; G06N 3/08 ; G06F 17/16
IST-REx-ID

Cite this

Weissenborn D, Uszkoreit J, Unterthiner T, et al. Object-centric learning with slot attention. 2021.
Weissenborn, D., Uszkoreit, J., Unterthiner, T., Mahendran, A., Locatello, F., Kipf, T., … Dosovitskiy, A. (2021). Object-centric learning with slot attention.
Weissenborn, Dirk, Jakob Uszkoreit, Thomas Unterthiner, Aravindh Mahendran, Francesco Locatello, Thomas Kipf, Georg Heigold, and Alexey Dosovitskiy. “Object-Centric Learning with Slot Attention,” 2021.
D. Weissenborn et al., “Object-centric learning with slot attention.” 2021.
Weissenborn D, Uszkoreit J, Unterthiner T, Mahendran A, Locatello F, Kipf T, Heigold G, Dosovitskiy A. 2021. Object-centric learning with slot attention.
Weissenborn, Dirk, et al. Object-Centric Learning with Slot Attention. 2021.
All files available under the following license(s):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]

Link(s) to Main File(s)
Access Level
OA Open Access

Export

Marked Publications

Open Data ISTA Research Explorer

Sources

arXiv 2006.15055

Search this title in

Google Scholar