Learning Global Object-Centric Representations via Disentangled Slot Attention

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Chen, Tonglin, Huang, Yinxuan, Shen, Zhimeng, Huang, Jinghao, Li, Bin, Xue, Xiangyang
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912102140084224
author Chen, Tonglin
Huang, Yinxuan
Shen, Zhimeng
Huang, Jinghao
Li, Bin
Xue, Xiangyang
author_facet Chen, Tonglin
Huang, Yinxuan
Shen, Zhimeng
Huang, Jinghao
Li, Bin
Xue, Xiangyang
contents Humans can discern scene-independent features of objects across various environments, allowing them to swiftly identify objects amidst changing factors such as lighting, perspective, size, and position and imagine the complete images of the same object in diverse settings. Existing object-centric learning methods only extract scene-dependent object-centric representations, lacking the ability to identify the same object across scenes as humans. Moreover, some existing methods discard the individual object generation capabilities to handle complex scenes. This paper introduces a novel object-centric learning method to empower AI systems with human-like capabilities to identify objects across scenes and generate diverse scenes containing specific objects by learning a set of global object-centric representations. To learn the global object-centric representations that encapsulate globally invariant attributes of objects (i.e., the complete appearance and shape), this paper designs a Disentangled Slot Attention module to convert the scene features into scene-dependent attributes (such as scale, position and orientation) and scene-independent representations (i.e., appearance and shape). Experimental results substantiate the efficacy of the proposed method, demonstrating remarkable proficiency in global object-centric representation learning, object identification, scene generation with specific objects and scene decomposition.
format Preprint
id arxiv_https___arxiv_org_abs_2410_18809
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Learning Global Object-Centric Representations via Disentangled Slot Attention
Chen, Tonglin
Huang, Yinxuan
Shen, Zhimeng
Huang, Jinghao
Li, Bin
Xue, Xiangyang
Computer Vision and Pattern Recognition
Humans can discern scene-independent features of objects across various environments, allowing them to swiftly identify objects amidst changing factors such as lighting, perspective, size, and position and imagine the complete images of the same object in diverse settings. Existing object-centric learning methods only extract scene-dependent object-centric representations, lacking the ability to identify the same object across scenes as humans. Moreover, some existing methods discard the individual object generation capabilities to handle complex scenes. This paper introduces a novel object-centric learning method to empower AI systems with human-like capabilities to identify objects across scenes and generate diverse scenes containing specific objects by learning a set of global object-centric representations. To learn the global object-centric representations that encapsulate globally invariant attributes of objects (i.e., the complete appearance and shape), this paper designs a Disentangled Slot Attention module to convert the scene features into scene-dependent attributes (such as scale, position and orientation) and scene-independent representations (i.e., appearance and shape). Experimental results substantiate the efficacy of the proposed method, demonstrating remarkable proficiency in global object-centric representation learning, object identification, scene generation with specific objects and scene decomposition.
title Learning Global Object-Centric Representations via Disentangled Slot Attention
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2410.18809