InteractEdit: Zero-Shot Editing of Human-Object Interactions in Images
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866929755717107712 |
|---|---|
| author | Hoe, Jiun Tian Hu, Weipeng Zhou, Wei Xie, Chao Wang, Ziwei Chan, Chee Seng Jiang, Xudong Tan, Yap-Peng |
| author_facet | Hoe, Jiun Tian Hu, Weipeng Zhou, Wei Xie, Chao Wang, Ziwei Chan, Chee Seng Jiang, Xudong Tan, Yap-Peng |
| contents | This paper presents InteractEdit, a novel framework for zero-shot Human-Object Interaction (HOI) editing, addressing the challenging task of transforming an existing interaction in an image into a new, desired interaction while preserving the identities of the subject and object. Unlike simpler image editing scenarios such as attribute manipulation, object replacement or style transfer, HOI editing involves complex spatial, contextual, and relational dependencies inherent in humans-objects interactions. Existing methods often overfit to the source image structure, limiting their ability to adapt to the substantial structural modifications demanded by new interactions. To address this, InteractEdit decomposes each scene into subject, object, and background components, then employs Low-Rank Adaptation (LoRA) and selective fine-tuning to preserve pretrained interaction priors while learning the visual identity of the source image. This regularization strategy effectively balances interaction edits with identity consistency. We further introduce IEBench, the most comprehensive benchmark for HOI editing, which evaluates both interaction editing and identity preservation. Our extensive experiments show that InteractEdit significantly outperforms existing methods, establishing a strong baseline for future HOI editing research and unlocking new possibilities for creative and practical applications. Code will be released upon publication. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_09130 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | InteractEdit: Zero-Shot Editing of Human-Object Interactions in Images Hoe, Jiun Tian Hu, Weipeng Zhou, Wei Xie, Chao Wang, Ziwei Chan, Chee Seng Jiang, Xudong Tan, Yap-Peng Graphics Computer Vision and Pattern Recognition Multimedia This paper presents InteractEdit, a novel framework for zero-shot Human-Object Interaction (HOI) editing, addressing the challenging task of transforming an existing interaction in an image into a new, desired interaction while preserving the identities of the subject and object. Unlike simpler image editing scenarios such as attribute manipulation, object replacement or style transfer, HOI editing involves complex spatial, contextual, and relational dependencies inherent in humans-objects interactions. Existing methods often overfit to the source image structure, limiting their ability to adapt to the substantial structural modifications demanded by new interactions. To address this, InteractEdit decomposes each scene into subject, object, and background components, then employs Low-Rank Adaptation (LoRA) and selective fine-tuning to preserve pretrained interaction priors while learning the visual identity of the source image. This regularization strategy effectively balances interaction edits with identity consistency. We further introduce IEBench, the most comprehensive benchmark for HOI editing, which evaluates both interaction editing and identity preservation. Our extensive experiments show that InteractEdit significantly outperforms existing methods, establishing a strong baseline for future HOI editing research and unlocking new possibilities for creative and practical applications. Code will be released upon publication. |
| title | InteractEdit: Zero-Shot Editing of Human-Object Interactions in Images |
| topic | Graphics Computer Vision and Pattern Recognition Multimedia |
| url | https://arxiv.org/abs/2503.09130 |