DSFlow: Dual Supervision and Step-Aware Architecture for One-Step Flow Matching Speech Synthesis

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Lin, Bin, Yang, Peng, Yan, Chao, Liu, Xiaochen, Wang, Wei, Wu, Boyong, Tan, Pengfei, Yang, Xuerui
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911435384160256
author Lin, Bin
Yang, Peng
Yan, Chao
Liu, Xiaochen
Wang, Wei
Wu, Boyong
Tan, Pengfei
Yang, Xuerui
author_facet Lin, Bin
Yang, Peng
Yan, Chao
Liu, Xiaochen
Wang, Wei
Wu, Boyong
Tan, Pengfei
Yang, Xuerui
contents Flow-matching models have enabled high-quality text-to-speech synthesis, but their iterative sampling process during inference incurs substantial computational cost. Although distillation is widely used to reduce the number of inference steps, existing methods often suffer from process variance due to endpoint error accumulation. Moreover, directly reusing continuous-time architectures for discrete, fixed-step generation introduces structural parameter inefficiencies. To address these challenges, we introduce DSFlow, a modular distillation framework for few-step and one-step synthesis. DSFlow reformulates generation as a discrete prediction task and explicitly adapts the student model to the target inference regime. It improves training stability through a dual supervision strategy that combines endpoint matching with deterministic mean-velocity alignment, enforcing consistent generation trajectories across inference steps. In addition, DSFlow improves parameter efficiency by replacing continuous-time timestep conditioning with lightweight step-aware tokens, aligning model capacity with the significantly reduced timestep space of the discrete task. Extensive experiments across diverse flow-based text-to-speech architectures demonstrate that DSFlow consistently outperforms standard distillation approaches, achieving strong few-step and one-step synthesis quality while reducing model parameters and inference cost.
format Preprint
id arxiv_https___arxiv_org_abs_2602_09041
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle DSFlow: Dual Supervision and Step-Aware Architecture for One-Step Flow Matching Speech Synthesis
Lin, Bin
Yang, Peng
Yan, Chao
Liu, Xiaochen
Wang, Wei
Wu, Boyong
Tan, Pengfei
Yang, Xuerui
Sound
Artificial Intelligence
Audio and Speech Processing
Flow-matching models have enabled high-quality text-to-speech synthesis, but their iterative sampling process during inference incurs substantial computational cost. Although distillation is widely used to reduce the number of inference steps, existing methods often suffer from process variance due to endpoint error accumulation. Moreover, directly reusing continuous-time architectures for discrete, fixed-step generation introduces structural parameter inefficiencies. To address these challenges, we introduce DSFlow, a modular distillation framework for few-step and one-step synthesis. DSFlow reformulates generation as a discrete prediction task and explicitly adapts the student model to the target inference regime. It improves training stability through a dual supervision strategy that combines endpoint matching with deterministic mean-velocity alignment, enforcing consistent generation trajectories across inference steps. In addition, DSFlow improves parameter efficiency by replacing continuous-time timestep conditioning with lightweight step-aware tokens, aligning model capacity with the significantly reduced timestep space of the discrete task. Extensive experiments across diverse flow-based text-to-speech architectures demonstrate that DSFlow consistently outperforms standard distillation approaches, achieving strong few-step and one-step synthesis quality while reducing model parameters and inference cost.
title DSFlow: Dual Supervision and Step-Aware Architecture for One-Step Flow Matching Speech Synthesis
topic Sound
Artificial Intelligence
Audio and Speech Processing
url https://arxiv.org/abs/2602.09041