Segmentwise Pruning in Audio-Language Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917088716652544 |
|---|---|
| author | Gibier, Marcel Duroselle, Raphaël Serrano, Pierre Boeffard, Olivier Bonastre, Jean-François |
| author_facet | Gibier, Marcel Duroselle, Raphaël Serrano, Pierre Boeffard, Olivier Bonastre, Jean-François |
| contents | Recent audio-language models have shown impressive performance across a wide range of audio tasks and are increasingly capable of handling long audio inputs. However, the computing costs in these models heavily depend on sequence length, which can become very large given the nature of audio data. In the vision-language domain, token pruning methods have proven effective in reducing token counts while preserving strong performance on standard benchmarks. In this work, we investigate the relevance and effectiveness of such token selection strategies in the context of audio-language models. We also improve them by proposing a lightweight strategy that takes the time dimension into account. While retaining only a quarter of the initial tokens, our approach results in a relative maximum decrease of 2% in CIDEr on Clotho v2 and a relative maximum decrease of 4% in accuracy on MMAU. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_14293 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Segmentwise Pruning in Audio-Language Models Gibier, Marcel Duroselle, Raphaël Serrano, Pierre Boeffard, Olivier Bonastre, Jean-François Sound Machine Learning Recent audio-language models have shown impressive performance across a wide range of audio tasks and are increasingly capable of handling long audio inputs. However, the computing costs in these models heavily depend on sequence length, which can become very large given the nature of audio data. In the vision-language domain, token pruning methods have proven effective in reducing token counts while preserving strong performance on standard benchmarks. In this work, we investigate the relevance and effectiveness of such token selection strategies in the context of audio-language models. We also improve them by proposing a lightweight strategy that takes the time dimension into account. While retaining only a quarter of the initial tokens, our approach results in a relative maximum decrease of 2% in CIDEr on Clotho v2 and a relative maximum decrease of 4% in accuracy on MMAU. |
| title | Segmentwise Pruning in Audio-Language Models |
| topic | Sound Machine Learning |
| url | https://arxiv.org/abs/2511.14293 |