Saved in:
Bibliographic Details
Main Authors: Zheng, Haolong, Yegorova, Yekaterina, Hasegawa-Johnson, Mark
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2509.13395
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Speech foundation models have recently demonstrated the ability to perform Speech In-Context Learning (SICL). Selecting effective in-context examples is crucial for SICL performance, yet selection methodologies remain underexplored. In this work, we propose Text-Embedding KNN for SICL (TICL), a simple pipeline that uses semantic context to enhance off-the-shelf large multimodal models' speech recognition ability without fine-tuning. Across challenging automatic speech recognition tasks, including accented English, multilingual speech, and children's speech, our method enables models to surpass zero-shot performance with up to 84.7% relative WER reduction. We conduct ablation studies to show the robustness and efficiency of our method.