Copertina

Do We Need Distinct Representations for Every Speech Token? Unveiling and Exploiting Redundancy in Large Speech Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Xiang, Bajian, Guo, Tingwei, Chen, Xuan, Han, Yang
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Understanding the Modality Gap: An Empirical Study on the Speech-Text Alignment Mechanism of Large Speech Language Models
di: Xiang, Bajian, et al.
Pubblicazione: (2025)

Advancing Speech Language Models by Scaling Supervised Fine-Tuning with Over 60,000 Hours of Synthetic Speech Dialogue Data
di: Zhao, Shuaijiang, et al.
Pubblicazione: (2024)

SpeechR: A Benchmark for Speech Reasoning in Large Audio-Language Models
di: Yang, Wanqi, et al.
Pubblicazione: (2025)

Every Token Counts: Generalizing 16M Ultra-Long Context in Large Language Models
di: Hu, Xiang, et al.
Pubblicazione: (2025)

Measuring the Redundancy of Decoder Layers in SpeechLLMs
di: Moumen, Adel, et al.
Pubblicazione: (2026)

TS-PEFT: Unveiling Token-Level Redundancy in Parameter-Efficient Fine-Tuning
di: Ma, Dabiao, et al.
Pubblicazione: (2025)

VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Model
di: Long, Zuwei, et al.
Pubblicazione: (2025)

LoASR-Bench: Evaluating Large Speech Language Models on Low-Resource Automatic Speech Recognition Across Language Families
di: Chen, Jianan, et al.
Pubblicazione: (2026)

Unveiling Selection Biases: Exploring Order and Token Sensitivity in Large Language Models
di: Wei, Sheng-Lun, et al.
Pubblicazione: (2024)

MOSS-Speech: Towards True Speech-to-Speech Models Without Text Guidance
di: Zhao, Xingjian, et al.
Pubblicazione: (2025)

SpeechMedAssist: Efficiently and Effectively Adapting Speech Language Models for Medical Consultation
di: Chen, Sirry, et al.
Pubblicazione: (2026)

DM-Codec: Distilling Multimodal Representations for Speech Tokenization
di: Ahasan, Md Mubtasim, et al.
Pubblicazione: (2024)

Preservation of Language Understanding Capabilities in Speech-aware Large Language Models
di: Kubis, Marek, et al.
Pubblicazione: (2025)

Cross-Modal Knowledge Distillation for Speech Large Language Models
di: Wang, Enzhi, et al.
Pubblicazione: (2025)

Cross-Lingual Conversational Speech Summarization with Large Language Models
di: Nelson, Max, et al.
Pubblicazione: (2024)

Data Quality Issues in Multilingual Speech Datasets: The Need for Sociolinguistic Awareness and Proactive Language Planning
di: Lau, Mingfei, et al.
Pubblicazione: (2025)

SPBA: Utilizing Speech Large Language Model for Backdoor Attacks on Speech Classification Models
di: Yao, Wenhan, et al.
Pubblicazione: (2025)

Counting Ability of Large Language Models and Impact of Tokenization
di: Zhang, Xiang, et al.
Pubblicazione: (2024)

findsylls: A Language-Agnostic Toolkit for Syllable-Level Speech Tokenization and Embedding
di: Martínez, Héctor Javier Vázquez
Pubblicazione: (2026)

Do Large Language Models Need a Content Delivery Network?
di: Cheng, Yihua, et al.
Pubblicazione: (2024)

InfiniSST: Simultaneous Translation of Unbounded Speech with Large Language Model
di: Ouyang, Siqi, et al.
Pubblicazione: (2025)

FastAdaSP: Multitask-Adapted Efficient Inference for Large Speech Language Model
di: Lu, Yichen, et al.
Pubblicazione: (2024)

Do We Need Frontier Models to Verify Mathematical Proofs?
di: Naik, Aaditya, et al.
Pubblicazione: (2026)

Large Language Models are Efficient Learners of Noise-Robust Speech Recognition
di: Hu, Yuchen, et al.
Pubblicazione: (2024)

When Every Token Counts: Optimal Segmentation for Low-Resource Language Models
di: Raj, Bharath, et al.
Pubblicazione: (2024)

UITron-Speech: Towards Automated GUI Agents Based on Speech Instructions
di: Han, Wenkang, et al.
Pubblicazione: (2025)

SpeechPrune: Context-aware Token Pruning for Speech Information Retrieval
di: Lin, Yueqian, et al.
Pubblicazione: (2024)

TIDE: Every Layer Knows the Token Beneath the Context
di: Jaiswal, Ajay, et al.
Pubblicazione: (2026)

Conditioning Large Language Models on Legal Systems? Detecting Punishable Hate Speech
di: Ludwig, Florian, et al.
Pubblicazione: (2025)

Locate-and-Focus: Enhancing Terminology Translation in Speech Language Models
di: Wu, Suhang, et al.
Pubblicazione: (2025)

Streamlining Redundant Layers to Compress Large Language Models
di: Chen, Xiaodong, et al.
Pubblicazione: (2024)

GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators
di: Hu, Yuchen, et al.
Pubblicazione: (2024)

From Flat Language Labels to Typological Priors: Structured Language Conditioning for Multilingual Speech-to-Speech Translation
di: Pan, Yu, et al.
Pubblicazione: (2026)

Speech-FT: Merging Pre-trained And Fine-Tuned Speech Representation Models For Cross-Task Generalization
di: Lin, Tzu-Quan, et al.
Pubblicazione: (2025)

Cross-Lingual Interleaving for Speech Language Models
di: Moumen, Adel, et al.
Pubblicazione: (2025)

Efficient Training for Cross-lingual Speech Language Models
di: Zhou, Yan, et al.
Pubblicazione: (2026)

Enhancing Large Language Models for Mobility Analytics with Semantic Location Tokenization
di: Chen, Yile, et al.
Pubblicazione: (2025)

First Token Probability Guided RAG for Telecom Question Answering
di: Chen, Tingwei, et al.
Pubblicazione: (2025)

Incorporating Contextual Paralinguistic Understanding in Large Speech-Language Models
di: Wang, Qiongqiong, et al.
Pubblicazione: (2025)

SpeechIQ: Speech-Agentic Intelligence Quotient Across Cognitive Levels in Voice Understanding by Large Language Models
di: Wan, Zhen, et al.
Pubblicazione: (2025)