Query-Based Asymmetric Modeling with Decoupled Input-Output Rates for Speech Restoration
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911403161419776 |
|---|---|
| author | Shin, Ui-Hyeop Ko, Jaehyun Jeong, Woocheol Park, Hyung-Min |
| author_facet | Shin, Ui-Hyeop Ko, Jaehyun Jeong, Woocheol Park, Hyung-Min |
| contents | Speech restoration in real-world conditions is challenging due to compounded distortions and mismatches between input and desired output rates. Most existing systems assume a fixed and shared input-output rate, relying on external resampling that incurs redundant computation and limits generality. We address this setting by formulating speech restoration under decoupled input-output rates, and propose TF-Restormer, a query-based asymmetric modeling framework. The encoder concentrates analysis on the observed input bandwidth using a time-frequency dual-path architecture, while a lightweight decoder reconstructs missing spectral content via frequency extension queries. This design enables a single model to operate consistently across arbitrary input-output rate pairs without redundant resampling. Experiments across diverse sampling rates, degradations, and operating modes show that TF-Restormer maintains stable restoration behavior and balanced perceptual quality, including in real-time streaming scenarios. Code and demos are available at https://tf-restormer.github.io/demo. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_21003 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Query-Based Asymmetric Modeling with Decoupled Input-Output Rates for Speech Restoration Shin, Ui-Hyeop Ko, Jaehyun Jeong, Woocheol Park, Hyung-Min Audio and Speech Processing Speech restoration in real-world conditions is challenging due to compounded distortions and mismatches between input and desired output rates. Most existing systems assume a fixed and shared input-output rate, relying on external resampling that incurs redundant computation and limits generality. We address this setting by formulating speech restoration under decoupled input-output rates, and propose TF-Restormer, a query-based asymmetric modeling framework. The encoder concentrates analysis on the observed input bandwidth using a time-frequency dual-path architecture, while a lightweight decoder reconstructs missing spectral content via frequency extension queries. This design enables a single model to operate consistently across arbitrary input-output rate pairs without redundant resampling. Experiments across diverse sampling rates, degradations, and operating modes show that TF-Restormer maintains stable restoration behavior and balanced perceptual quality, including in real-time streaming scenarios. Code and demos are available at https://tf-restormer.github.io/demo. |
| title | Query-Based Asymmetric Modeling with Decoupled Input-Output Rates for Speech Restoration |
| topic | Audio and Speech Processing |
| url | https://arxiv.org/abs/2509.21003 |