ZO-ASR: Zeroth-Order Fine-Tuning of Speech Foundation Models without Back-Propagation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Peng, Yuezhang, Liu, Yuxin, Li, Yao, Wang, Sheng, Wen, Fei, Chen, Xie
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917115863236608
author Peng, Yuezhang
Liu, Yuxin
Li, Yao
Wang, Sheng
Wen, Fei
Chen, Xie
author_facet Peng, Yuezhang
Liu, Yuxin
Li, Yao
Wang, Sheng
Wen, Fei
Chen, Xie
contents Fine-tuning pre-trained speech foundation models for Automatic Speech Recognition (ASR) is prevalent, yet constrained by substantial GPU memory requirements. We introduce ZO-ASR, a memory-efficient Zeroth-Order (ZO) method that avoids Back-Propagation (BP) and activation memory by estimating gradients via forward passes. When combined with SGD optimizer, ZO-ASR-SGD fine-tunes ASR models using only inference memory. Our evaluation spans supervised and unsupervised tasks. For Supervised Domain Adaptation on Whisper-Large-V3, ZO-ASR's multiple query mechanism enhances robustness and achieves up to an 18.9\% relative Word Error Rate reduction over zero-shot baselines, outperforming existing ZO methods. For unsupervised Test-Time Adaptation on Wav2Vec2-Base, ZO-ASR exhibits moderately lower performance compared to first-order optimizer Adam. Our BP-free approach provides a viable solution for fine-tuning ASR models in computationally resource-constrained or gradient-inaccessible scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2512_01267
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ZO-ASR: Zeroth-Order Fine-Tuning of Speech Foundation Models without Back-Propagation
Peng, Yuezhang
Liu, Yuxin
Li, Yao
Wang, Sheng
Wen, Fei
Chen, Xie
Multimedia
Sound
Fine-tuning pre-trained speech foundation models for Automatic Speech Recognition (ASR) is prevalent, yet constrained by substantial GPU memory requirements. We introduce ZO-ASR, a memory-efficient Zeroth-Order (ZO) method that avoids Back-Propagation (BP) and activation memory by estimating gradients via forward passes. When combined with SGD optimizer, ZO-ASR-SGD fine-tunes ASR models using only inference memory. Our evaluation spans supervised and unsupervised tasks. For Supervised Domain Adaptation on Whisper-Large-V3, ZO-ASR's multiple query mechanism enhances robustness and achieves up to an 18.9\% relative Word Error Rate reduction over zero-shot baselines, outperforming existing ZO methods. For unsupervised Test-Time Adaptation on Wav2Vec2-Base, ZO-ASR exhibits moderately lower performance compared to first-order optimizer Adam. Our BP-free approach provides a viable solution for fine-tuning ASR models in computationally resource-constrained or gradient-inaccessible scenarios.
title ZO-ASR: Zeroth-Order Fine-Tuning of Speech Foundation Models without Back-Propagation
topic Multimedia
Sound
url https://arxiv.org/abs/2512.01267