Adaptive Visual Autoregressive Acceleration via Dual-Linkage Entropy Analysis
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866908803085107200 |
|---|---|
| author | Zhang, Yu Liu, Jingyi Liu, Feng Miao, Duoqian Zhang, Qi Fu, Kexue Wang, Changwei Cao, Longbing |
| author_facet | Zhang, Yu Liu, Jingyi Liu, Feng Miao, Duoqian Zhang, Qi Fu, Kexue Wang, Changwei Cao, Longbing |
| contents | Visual AutoRegressive modeling (VAR) suffers from substantial computational cost due to the massive token count involved. Failing to account for the continuous evolution of modeling dynamics, existing VAR token reduction methods face three key limitations: heuristic stage partition, non-adaptive schedules, and limited acceleration scope, thereby leaving significant acceleration potential untapped. Since entropy variation intrinsically reflects the transition of predictive uncertainty, it offers a principled measure to capture modeling dynamics evolution. Therefore, we propose NOVA, a training-free token reduction acceleration framework for VAR models via entropy analysis. NOVA adaptively determines the acceleration activation scale during inference by online identifying the inflection point of scale entropy growth. Through scale-linkage and layer-linkage ratio adjustment, NOVA dynamically computes distinct token reduction ratios for each scale and layer, pruning low-entropy tokens while reusing the cache derived from the residuals at the prior scale to accelerate inference and maintain generation quality. Extensive experiments and analyses validate NOVA as a simple yet effective training-free acceleration framework. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_01345 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Adaptive Visual Autoregressive Acceleration via Dual-Linkage Entropy Analysis Zhang, Yu Liu, Jingyi Liu, Feng Miao, Duoqian Zhang, Qi Fu, Kexue Wang, Changwei Cao, Longbing Computer Vision and Pattern Recognition Visual AutoRegressive modeling (VAR) suffers from substantial computational cost due to the massive token count involved. Failing to account for the continuous evolution of modeling dynamics, existing VAR token reduction methods face three key limitations: heuristic stage partition, non-adaptive schedules, and limited acceleration scope, thereby leaving significant acceleration potential untapped. Since entropy variation intrinsically reflects the transition of predictive uncertainty, it offers a principled measure to capture modeling dynamics evolution. Therefore, we propose NOVA, a training-free token reduction acceleration framework for VAR models via entropy analysis. NOVA adaptively determines the acceleration activation scale during inference by online identifying the inflection point of scale entropy growth. Through scale-linkage and layer-linkage ratio adjustment, NOVA dynamically computes distinct token reduction ratios for each scale and layer, pruning low-entropy tokens while reusing the cache derived from the residuals at the prior scale to accelerate inference and maintain generation quality. Extensive experiments and analyses validate NOVA as a simple yet effective training-free acceleration framework. |
| title | Adaptive Visual Autoregressive Acceleration via Dual-Linkage Entropy Analysis |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2602.01345 |