Copertina

Synergistic Effects of Knowledge Distillation and Structured Pruning for Self-Supervised Speech Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	C, Shiva Kumar, Dhiman, Jitendra Kumar, Adiga, Nagaraj, Singh, Shatrughan
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Audio and Speech Processing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Distillation and Pruning for Scalable Self-Supervised Representation-Based Speech Quality Assessment
di: Stahl, Benjamin, et al.
Pubblicazione: (2025)

Hybrid Pruning: In-Situ Compression of Self-Supervised Speech Models for Speaker Verification and Anti-Spoofing
di: Peng, Junyi, et al.
Pubblicazione: (2025)

Efficient and Generalizable Speaker Diarization via Structured Pruning of Self-Supervised Models
di: Han, Jiangyu, et al.
Pubblicazione: (2025)

Fine-tune Before Structured Pruning: Towards Compact and Accurate Self-Supervised Models for Speaker Diarization
di: Han, Jiangyu, et al.
Pubblicazione: (2025)

Rethinking Mamba in Speech Processing by Self-Supervised Models
di: Zhang, Xiangyu, et al.
Pubblicazione: (2024)

Exploring Effective Distillation of Self-Supervised Speech Models for Automatic Speech Recognition
di: Wang, Yujin, et al.
Pubblicazione: (2022)

Emotion-Aware Speech Self-Supervised Representation Learning with Intensity Knowledge
di: Liu, Rui, et al.
Pubblicazione: (2024)

Large Language Model Guided Decoding for Self-Supervised Speech Recognition
di: Cohen, Eyal, et al.
Pubblicazione: (2025)

Analysis of Self-Supervised Speech Models on Children's Speech and Infant Vocalizations
di: Li, Jialu, et al.
Pubblicazione: (2024)

STaR: Distilling Speech Temporal Relation for Lightweight Speech Self-Supervised Learning Models
di: Jang, Kangwook, et al.
Pubblicazione: (2023)

Textless Acoustic Model with Self-Supervised Distillation for Noise-Robust Expressive Speech-to-Speech Translation
di: Hwang, Min-Jae, et al.
Pubblicazione: (2024)

On the use of Performer and Agent Attention for Spoken Language Identification
di: dhiman, Jitendra Kumar, et al.
Pubblicazione: (2025)

Enhancing Speaker Verification with w2v-BERT 2.0 and Knowledge Distillation guided Structured Pruning
di: Li, Ze, et al.
Pubblicazione: (2025)

Context-Driven Dynamic Pruning for Large Speech Foundation Models
di: Someki, Masao, et al.
Pubblicazione: (2025)

XLSR-Transducer: Streaming ASR for Self-Supervised Pretrained Models
di: Kumar, Shashi, et al.
Pubblicazione: (2024)

SPADE: Structured Pruning and Adaptive Distillation for Efficient LLM-TTS
di: Nguyen, Tan Dat, et al.
Pubblicazione: (2025)

Adaptive Federated Fine-Tuning of Self-Supervised Speech Representations
di: Guo, Xin, et al.
Pubblicazione: (2026)

Leveraging Self-Supervised Models for Automatic Whispered Speech Recognition
di: Farhadipour, Aref, et al.
Pubblicazione: (2024)

Dynamic Frequency-Adaptive Knowledge Distillation for Speech Enhancement
di: Yuan, Xihao, et al.
Pubblicazione: (2025)

Frequency-mix Knowledge Distillation for Fake Speech Detection
di: Fan, Cunhang, et al.
Pubblicazione: (2024)

A High-Quality and Low-Complexity Streamable Neural Speech Codec with Knowledge Distillation
di: Zhang, En-Wei, et al.
Pubblicazione: (2025)

Prosody as Supervision: Bridging the Non-Verbal--Verbal for Multilingual Speech Emotion Recognition
di: Girish, et al.
Pubblicazione: (2026)

Multi-Distillation from Speech and Music Representation Models
di: Wei, Jui-Chiang, et al.
Pubblicazione: (2025)

SpeechGLUE: How Well Can Self-Supervised Speech Models Capture Linguistic Knowledge?
di: Ashihara, Takanori, et al.
Pubblicazione: (2023)

Evaluating Self-Supervised Speech Models via Text-Based LLMS
di: Maekaku, Takashi, et al.
Pubblicazione: (2025)

Towards Automatic Assessment of Self-Supervised Speech Models using Rank
di: Aldeneh, Zakaria, et al.
Pubblicazione: (2024)

Cyclostationarity Analysis as a Complement to Self-Supervised Representations for Speech Deepfake Detection
di: Hanilçi, Cemal, et al.
Pubblicazione: (2026)

Audio-Visual Representation Learning via Knowledge Distillation from Speech Foundation Models
di: Zhang, Jing-Xuan, et al.
Pubblicazione: (2025)

Leveraging Self-Supervised Audio-Visual Pretrained Models to Improve Vocoded Speech Intelligibility in Cochlear Implant Simulation
di: Lai, Richard Lee, et al.
Pubblicazione: (2023)

Self-Supervised Speech Quality Assessment (S3QA): Leveraging Speech Foundation Models for a Scalable Speech Quality Metric
di: Ogg, Mattson, et al.
Pubblicazione: (2025)

SLASH: Self-Supervised Speech Pitch Estimation Leveraging DSP-derived Absolute Pitch
di: Terashima, Ryo, et al.
Pubblicazione: (2025)

SA-WavLM: Speaker-Aware Self-Supervised Pre-training for Mixture Speech
di: Lin, Jingru, et al.
Pubblicazione: (2024)

Dual-Branch Knowledge Distillation for Noise-Robust Synthetic Speech Detection
di: Fan, Cunhang, et al.
Pubblicazione: (2023)

Task-Agnostic Structured Pruning of Speech Representation Models
di: Wang, Haoyu, et al.
Pubblicazione: (2023)

Distil-DCCRN: A Small-footprint DCCRN Leveraging Feature-based Knowledge Distillation in Speech Enhancement
di: Han, Runduo, et al.
Pubblicazione: (2024)

Efficient Speech Watermarking for Speech Synthesis via Progressive Knowledge Distillation
di: Cui, Yang, et al.
Pubblicazione: (2025)

SepPrune: Structured Pruning for Efficient Deep Speech Separation
di: Li, Yuqi, et al.
Pubblicazione: (2025)

Comparison of Knowledge Distillation Methods for Low-complexity Multi-microphone Speech Enhancement using the FT-JNF Architecture
di: Metzger, Robert, et al.
Pubblicazione: (2025)

Enhancing Fully Formatted End-to-End Speech Recognition with Knowledge Distillation via Multi-Codebook Vector Quantization
di: You, Jian, et al.
Pubblicazione: (2025)

k2SSL: A Faster and Better Framework for Self-Supervised Speech Representation Learning
di: Yang, Yifan, et al.
Pubblicazione: (2024)