Learning to Expand Images for Efficient Visual Autoregressive Modeling

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yang, Ruiqing, Zhang, Kaixin, Zhang, Zheng, You, Shan, Huang, Tao
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908665626230784
author Yang, Ruiqing
Zhang, Kaixin
Zhang, Zheng
You, Shan
Huang, Tao
author_facet Yang, Ruiqing
Zhang, Kaixin
Zhang, Zheng
You, Shan
Huang, Tao
contents Autoregressive models have recently shown great promise in visual generation by leveraging discrete token sequences akin to language modeling. However, existing approaches often suffer from inefficiency, either due to token-by-token decoding or the complexity of multi-scale representations. In this work, we introduce Expanding Autoregressive Representation (EAR), a novel generation paradigm that emulates the human visual system's center-outward perception pattern. EAR unfolds image tokens in a spiral order from the center and progressively expands outward, preserving spatial continuity and enabling efficient parallel decoding. To further enhance flexibility and speed, we propose a length-adaptive decoding strategy that dynamically adjusts the number of tokens predicted at each step. This biologically inspired design not only reduces computational cost but also improves generation quality by aligning the generation order with perceptual relevance. Extensive experiments on ImageNet demonstrate that EAR achieves state-of-the-art trade-offs between fidelity and efficiency on single-scale autoregressive models, setting a new direction for scalable and cognitively aligned autoregressive image generation.
format Preprint
id arxiv_https___arxiv_org_abs_2511_15499
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Learning to Expand Images for Efficient Visual Autoregressive Modeling
Yang, Ruiqing
Zhang, Kaixin
Zhang, Zheng
You, Shan
Huang, Tao
Computer Vision and Pattern Recognition
68U10
I.4.9; I.4.10
Autoregressive models have recently shown great promise in visual generation by leveraging discrete token sequences akin to language modeling. However, existing approaches often suffer from inefficiency, either due to token-by-token decoding or the complexity of multi-scale representations. In this work, we introduce Expanding Autoregressive Representation (EAR), a novel generation paradigm that emulates the human visual system's center-outward perception pattern. EAR unfolds image tokens in a spiral order from the center and progressively expands outward, preserving spatial continuity and enabling efficient parallel decoding. To further enhance flexibility and speed, we propose a length-adaptive decoding strategy that dynamically adjusts the number of tokens predicted at each step. This biologically inspired design not only reduces computational cost but also improves generation quality by aligning the generation order with perceptual relevance. Extensive experiments on ImageNet demonstrate that EAR achieves state-of-the-art trade-offs between fidelity and efficiency on single-scale autoregressive models, setting a new direction for scalable and cognitively aligned autoregressive image generation.
title Learning to Expand Images for Efficient Visual Autoregressive Modeling
topic Computer Vision and Pattern Recognition
68U10
I.4.9; I.4.10
url https://arxiv.org/abs/2511.15499