A Glimpse to Compress: Dynamic Visual Token Pruning for Large Vision-Language Models
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866909719168286720 |
|---|---|
| author | Zeng, Quan-Sheng Li, Yunheng Wang, Qilong Jiang, Peng-Tao Wu, Zuxuan Cheng, Ming-Ming Hou, Qibin |
| author_facet | Zeng, Quan-Sheng Li, Yunheng Wang, Qilong Jiang, Peng-Tao Wu, Zuxuan Cheng, Ming-Ming Hou, Qibin |
| contents | Visual token compression is critical for Large Vision-Language Models (LVLMs) to efficiently process high-resolution inputs. Existing methods that typically adopt fixed compression ratios cannot adapt to scenes of varying complexity, often causing imprecise pruning that discards informative visual tokens and results in degraded model performance. To address this issue, we introduce a dynamic pruning framework, GlimpsePrune, inspired by human cognition. It takes a data-driven ''glimpse'' and prunes irrelevant visual tokens in a single forward pass before answer generation. This approach prunes 92.6% of visual tokens while on average fully retaining the baseline performance on free-form VQA tasks. The reduced computational cost also enables more effective fine-tuning: an enhanced GlimpsePrune+ achieves 110% of the baseline performance while maintaining a similarly high pruning rate. Our work paves a new way for building more powerful and efficient LVLMs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_01548 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Glimpse to Compress: Dynamic Visual Token Pruning for Large Vision-Language Models Zeng, Quan-Sheng Li, Yunheng Wang, Qilong Jiang, Peng-Tao Wu, Zuxuan Cheng, Ming-Ming Hou, Qibin Computer Vision and Pattern Recognition Visual token compression is critical for Large Vision-Language Models (LVLMs) to efficiently process high-resolution inputs. Existing methods that typically adopt fixed compression ratios cannot adapt to scenes of varying complexity, often causing imprecise pruning that discards informative visual tokens and results in degraded model performance. To address this issue, we introduce a dynamic pruning framework, GlimpsePrune, inspired by human cognition. It takes a data-driven ''glimpse'' and prunes irrelevant visual tokens in a single forward pass before answer generation. This approach prunes 92.6% of visual tokens while on average fully retaining the baseline performance on free-form VQA tasks. The reduced computational cost also enables more effective fine-tuning: an enhanced GlimpsePrune+ achieves 110% of the baseline performance while maintaining a similarly high pruning rate. Our work paves a new way for building more powerful and efficient LVLMs. |
| title | A Glimpse to Compress: Dynamic Visual Token Pruning for Large Vision-Language Models |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2508.01548 |