Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2511.17074 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909916280651776 |
|---|---|
| author | Wang, Tong Yang, Guanyu Liu, Nian Wang, Kai Wang, Yaxing Shaker, Abdelrahman M Khan, Salman Khan, Fahad Shahbaz Li, Senmao |
| author_facet | Wang, Tong Yang, Guanyu Liu, Nian Wang, Kai Wang, Yaxing Shaker, Abdelrahman M Khan, Salman Khan, Fahad Shahbaz Li, Senmao |
| contents | Visual Autoregressive (VAR) models have recently garnered significant attention for their innovative next-scale prediction paradigm, offering notable advantages in both inference efficiency and image quality compared to traditional multi-step autoregressive (AR) and diffusion models. However, despite their efficiency, VAR models often suffer from the diversity collapse i.e., a reduction in output variability, analogous to that observed in few-step distilled diffusion models. In this paper, we introduce DiverseVAR, a simple yet effective approach that restores the generative diversity of VAR models without requiring any additional training. Our analysis reveals the pivotal component of the feature map as a key factor governing diversity formation at early scales. By suppressing the pivotal component in the model input and amplifying it in the model output, DiverseVAR effectively unlocks the inherent generative potential of VAR models while preserving high-fidelity synthesis. Empirical results demonstrate that our approach substantially enhances generative diversity with only neglectable performance influences. Our code will be publicly released at https://github.com/wangtong627/DiverseVAR. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_17074 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Diversity Has Always Been There in Your Visual Autoregressive Models Wang, Tong Yang, Guanyu Liu, Nian Wang, Kai Wang, Yaxing Shaker, Abdelrahman M Khan, Salman Khan, Fahad Shahbaz Li, Senmao Computer Vision and Pattern Recognition Visual Autoregressive (VAR) models have recently garnered significant attention for their innovative next-scale prediction paradigm, offering notable advantages in both inference efficiency and image quality compared to traditional multi-step autoregressive (AR) and diffusion models. However, despite their efficiency, VAR models often suffer from the diversity collapse i.e., a reduction in output variability, analogous to that observed in few-step distilled diffusion models. In this paper, we introduce DiverseVAR, a simple yet effective approach that restores the generative diversity of VAR models without requiring any additional training. Our analysis reveals the pivotal component of the feature map as a key factor governing diversity formation at early scales. By suppressing the pivotal component in the model input and amplifying it in the model output, DiverseVAR effectively unlocks the inherent generative potential of VAR models while preserving high-fidelity synthesis. Empirical results demonstrate that our approach substantially enhances generative diversity with only neglectable performance influences. Our code will be publicly released at https://github.com/wangtong627/DiverseVAR. |
| title | Diversity Has Always Been There in Your Visual Autoregressive Models |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2511.17074 |