Copertina

Cross-Modal Knowledge Distillation for Speech Large Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wang, Enzhi, Li, Qicheng, Tang, Zhiyuan, Jia, Yuhang
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Model
di: Long, Zuwei, et al.
Pubblicazione: (2025)

Cross-Modal Consistency in Multimodal Large Language Models
di: Zhang, Xiang, et al.
Pubblicazione: (2024)

EasyDistill: A Comprehensive Toolkit for Effective Knowledge Distillation of Large Language Models
di: Wang, Chengyu, et al.
Pubblicazione: (2025)

Dual-Space Knowledge Distillation for Large Language Models
di: Zhang, Songming, et al.
Pubblicazione: (2024)

LLMR: Knowledge Distillation with a Large Language Model-Induced Reward
di: Li, Dongheng, et al.
Pubblicazione: (2024)

Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Application
di: Yang, Chuanpeng, et al.
Pubblicazione: (2024)

Contextualization Distillation from Large Language Model for Knowledge Graph Completion
di: Li, Dawei, et al.
Pubblicazione: (2024)

Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models
di: Wu, Taiqiang, et al.
Pubblicazione: (2024)

KGPA: Robustness Evaluation for Large Language Models via Cross-Domain Knowledge Graphs
di: Pei, Aihua, et al.
Pubblicazione: (2024)

Distilling Event Sequence Knowledge From Large Language Models
di: Wadhwa, Somin, et al.
Pubblicazione: (2024)

Cross-Lingual Knowledge Editing in Large Language Models
di: Wang, Jiaan, et al.
Pubblicazione: (2023)

Teaching-Assistant-in-the-Loop: Improving Knowledge Distillation from Imperfect Teacher Models in Low-Budget Scenarios
di: Zhou, Yuhang, et al.
Pubblicazione: (2024)

Understanding the Modality Gap: An Empirical Study on the Speech-Text Alignment Mechanism of Large Speech Language Models
di: Xiang, Bajian, et al.
Pubblicazione: (2025)

Delta Knowledge Distillation for Large Language Models
di: Cao, Yihan, et al.
Pubblicazione: (2025)

Cross-Lingual Conversational Speech Summarization with Large Language Models
di: Nelson, Max, et al.
Pubblicazione: (2024)

Knowledge Distillation for Large Language Models
di: La Torre, Alejandro Paredes, et al.
Pubblicazione: (2026)

Enhancing Multimodal Sentiment Analysis for Missing Modality through Self-Distillation and Unified Modality Cross-Attention
di: Weng, Yuzhe, et al.
Pubblicazione: (2024)

Brainstorming Brings Power to Large Language Models of Knowledge Reasoning
di: Qin, Zining, et al.
Pubblicazione: (2024)

Table as a Modality for Large Language Models
di: Li, Liyao, et al.
Pubblicazione: (2025)

X-OPD: Cross-Modal On-Policy Distillation for Capability Alignment in Speech LLMs
di: Cao, Di, et al.
Pubblicazione: (2026)

WAND: Windowed Attention and Knowledge Distillation for Efficient Autoregressive Text-to-Speech Models
di: Lee, Hanna, et al.
Pubblicazione: (2026)

Less is More: Selective Reflection for Compatible and Efficient Knowledge Distillation in Large Language Models
di: Liu, Lingyuan, et al.
Pubblicazione: (2025)

Declarative Knowledge Distillation from Large Language Models for Visual Question Answering Datasets
di: Eiter, Thomas, et al.
Pubblicazione: (2024)

LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Models
di: Yang, Runming, et al.
Pubblicazione: (2024)

Large Language Model Post-Training: A Unified View of Off-Policy and On-Policy Learning
di: Zhao, Shiwan, et al.
Pubblicazione: (2026)

Multi-Stage Balanced Distillation: Addressing Long-Tail Challenges in Sequence-Level Knowledge Distillation
di: Zhou, Yuhang, et al.
Pubblicazione: (2024)

Key-Point-Driven Mathematical Reasoning Distillation of Large Language Model
di: Zhu, Xunyu, et al.
Pubblicazione: (2024)

MiniLLM: On-Policy Distillation of Large Language Models
di: Gu, Yuxian, et al.
Pubblicazione: (2023)

CCHall: A Novel Benchmark for Joint Cross-Lingual and Cross-Modal Hallucinations Detection in Large Language Models
di: Zhang, Yongheng, et al.
Pubblicazione: (2025)

QCRD: Quality-guided Contrastive Rationale Distillation for Large Language Models
di: Wang, Wei, et al.
Pubblicazione: (2024)

Cross-Lingual Interleaving for Speech Language Models
di: Moumen, Adel, et al.
Pubblicazione: (2025)

Structured Agent Distillation for Large Language Model
di: Liu, Jun, et al.
Pubblicazione: (2025)

Black-Box On-Policy Distillation of Large Language Models
di: Ye, Tianzhu, et al.
Pubblicazione: (2025)

Cross-Modal Taxonomic Generalization in (Vision-) Language Models
di: Xu, Tianyang, et al.
Pubblicazione: (2026)

AA-Omniscience: Evaluating Cross-Domain Knowledge Reliability in Large Language Models
di: Jackson, Declan, et al.
Pubblicazione: (2025)

SpeechR: A Benchmark for Speech Reasoning in Large Audio-Language Models
di: Yang, Wanqi, et al.
Pubblicazione: (2025)

RealTalk-CN: A Realistic Chinese Speech-Text Dialogue Benchmark With Cross-Modal Interaction Analysis
di: Wang, Enzhi, et al.
Pubblicazione: (2025)

Pedagogically-Inspired Data Synthesis for Language Model Knowledge Distillation
di: He, Bowei, et al.
Pubblicazione: (2026)

Leveraging Large Language Models For Optimized Item Categorization using UNSPSC Taxonomy
di: Singh, Anmolika, et al.
Pubblicazione: (2024)

How does Misinformation Affect Large Language Model Behaviors and Preferences?
di: Peng, Miao, et al.
Pubblicazione: (2025)