Discrete Noise Inversion for Next-scale Autoregressive Text-based Image Editing
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866918134838984704 |
|---|---|
| author | Dao, Quan He, Xiaoxiao Han, Ligong Nguyen, Ngan Hoai Nobar, Amin Heyrani Ahmed, Faez Zhang, Han Nguyen, Viet Anh Metaxas, Dimitris |
| author_facet | Dao, Quan He, Xiaoxiao Han, Ligong Nguyen, Ngan Hoai Nobar, Amin Heyrani Ahmed, Faez Zhang, Han Nguyen, Viet Anh Metaxas, Dimitris |
| contents | Visual autoregressive models (VAR) have recently emerged as a promising class of generative models, achieving performance comparable to diffusion models in text-to-image generation tasks. While conditional generation has been widely explored, the ability to perform prompt-guided image editing without additional training is equally critical, as it supports numerous practical real-world applications. This paper investigates the text-to-image editing capabilities of VAR by introducing Visual AutoRegressive Inverse Noise (VARIN), the first noise inversion-based editing technique designed explicitly for VAR models. VARIN leverages a novel pseudo-inverse function for argmax sampling, named Location-aware Argmax Inversion (LAI), to generate inverse Gumbel noises. These inverse noises enable precise reconstruction of the source image and facilitate targeted, controllable edits aligned with textual prompts. Extensive experiments demonstrate that VARIN effectively modifies source images according to specified prompts while significantly preserving the original background and structural details, thus validating its efficacy as a practical editing approach. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_01984 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Discrete Noise Inversion for Next-scale Autoregressive Text-based Image Editing Dao, Quan He, Xiaoxiao Han, Ligong Nguyen, Ngan Hoai Nobar, Amin Heyrani Ahmed, Faez Zhang, Han Nguyen, Viet Anh Metaxas, Dimitris Computer Vision and Pattern Recognition Visual autoregressive models (VAR) have recently emerged as a promising class of generative models, achieving performance comparable to diffusion models in text-to-image generation tasks. While conditional generation has been widely explored, the ability to perform prompt-guided image editing without additional training is equally critical, as it supports numerous practical real-world applications. This paper investigates the text-to-image editing capabilities of VAR by introducing Visual AutoRegressive Inverse Noise (VARIN), the first noise inversion-based editing technique designed explicitly for VAR models. VARIN leverages a novel pseudo-inverse function for argmax sampling, named Location-aware Argmax Inversion (LAI), to generate inverse Gumbel noises. These inverse noises enable precise reconstruction of the source image and facilitate targeted, controllable edits aligned with textual prompts. Extensive experiments demonstrate that VARIN effectively modifies source images according to specified prompts while significantly preserving the original background and structural details, thus validating its efficacy as a practical editing approach. |
| title | Discrete Noise Inversion for Next-scale Autoregressive Text-based Image Editing |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2509.01984 |