Understanding the Modality Gap: An Empirical Study on the Speech-Text Alignment Mechanism of Large Speech Language Models

Ähnliche Einträge

• Advancing Speech Language Models by Scaling Supervised Fine-Tuning with Over 60,000 Hours of Synthetic Speech Dialogue Data
  von: Zhao, Shuaijiang, et al.
  Veröffentlicht: (2024)
• Do We Need Distinct Representations for Every Speech Token? Unveiling and Exploiting Redundancy in Large Speech Language Models
  von: Xiang, Bajian, et al.
  Veröffentlicht: (2026)
• Optimal Transport Regularization for Speech Text Alignment in Spoken Language Models
  von: Xu, Wenze, et al.
  Veröffentlicht: (2025)
• Cross-Modal Knowledge Distillation for Speech Large Language Models
  von: Wang, Enzhi, et al.
  Veröffentlicht: (2025)
• Closing the Gap Between Text and Speech Understanding in LLMs
  von: Cuervo, Santiago, et al.
  Veröffentlicht: (2025)