Copertina

A dual task learning approach to fine-tune a multilingual semantic speech encoder for Spoken Language Understanding

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Laperrière, Gaëlle, Ghannay, Sahar, Jabaian, Bassam, Estève, Yannick
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Sound Audio and Speech Processing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Semantic enrichment towards efficient speech representations
di: Laperrière, Gaëlle, et al.
Pubblicazione: (2023)

Distilling a speech and music encoder with task arithmetic
di: Ritter-Gutierrez, Fabian, et al.
Pubblicazione: (2025)

Robust fine-tuning of speech recognition models via model merging: application to disordered speech
di: Ducorroy, Alexandre, et al.
Pubblicazione: (2025)

Towards noise-robust speech inversion through multi-task learning with speech enhancement
di: Tabatabaee, Saba, et al.
Pubblicazione: (2026)

DualSep: A Light-weight dual-encoder convolutional recurrent network for real-time in-car speech separation
di: Wang, Ziqian, et al.
Pubblicazione: (2024)

MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmark
di: Wang, Dingdong, et al.
Pubblicazione: (2025)

WHISMA: A Speech-LLM to Perform Zero-shot Spoken Language Understanding
di: Li, Mohan, et al.
Pubblicazione: (2024)

A Study of Data Selection Strategies for Pre-training Self-Supervised Speech Models
di: Whetten, Ryan, et al.
Pubblicazione: (2026)

A correlation-permutation approach for speech-music encoders model merging
di: Ritter-Gutierrez, Fabian, et al.
Pubblicazione: (2025)

The CHiME-7 UDASE task: Unsupervised domain adaptation for conversational speech enhancement
di: Leglaive, Simon, et al.
Pubblicazione: (2023)

Advancing LLM-based phoneme-to-grapheme for multilingual speech recognition
di: Dong, Lukuang, et al.
Pubblicazione: (2026)

SpeechCLIP+: Self-supervised multi-task representation learning for speech via CLIP and speech-image data
di: Wang, Hsuan-Fu, et al.
Pubblicazione: (2024)

On the use of Performer and Agent Attention for Spoken Language Identification
di: dhiman, Jitendra Kumar, et al.
Pubblicazione: (2025)

On the Evaluation of Speech Foundation Models for Spoken Language Understanding
di: Arora, Siddhant, et al.
Pubblicazione: (2024)

A lightweight dual-stage framework for personalized speech enhancement based on DeepFilterNet2
di: Serre, Thomas, et al.
Pubblicazione: (2024)

Improving Spoken Language Modeling with Phoneme Classification: A Simple Fine-tuning Approach
di: Poli, Maxime, et al.
Pubblicazione: (2024)

MSP-Podcast SER Challenge 2024: L'antenne du Ventoux Multimodal Self-Supervised Learning for Speech Emotion Recognition
di: Duret, Jarod, et al.
Pubblicazione: (2024)

In-context learning capabilities of Large Language Models to detect suicide risk among adolescents from speech transcripts
di: Roquefort, Filomene, et al.
Pubblicazione: (2025)

Scaling up masked audio encoder learning for general audio classification
di: Dinkel, Heinrich, et al.
Pubblicazione: (2024)

Monaural speech enhancement on drone via Adapter based transfer learning
di: Chen, Xingyu, et al.
Pubblicazione: (2024)

Zipformer: A faster and better encoder for automatic speech recognition
di: Yao, Zengwei, et al.
Pubblicazione: (2023)

E-chat: Emotion-sensitive Spoken Dialogue System with Large Language Models
di: Xue, Hongfei, et al.
Pubblicazione: (2023)

Using RLHF to align speech enhancement approaches to mean-opinion quality scores
di: Kumar, Anurag, et al.
Pubblicazione: (2024)

Interventional Speech Noise Injection for ASR Generalizable Spoken Language Understanding
di: Jung, Yeonjoon, et al.
Pubblicazione: (2024)

Blind estimation of audio effects using an auto-encoder approach and differentiable digital signal processing
di: Peladeau, Côme, et al.
Pubblicazione: (2023)

UniverSLU: Universal Spoken Language Understanding for Diverse Tasks with Natural Language Instructions
di: Arora, Siddhant, et al.
Pubblicazione: (2023)

An adaptive filter bank based neural network approach for time delay estimation and speech enhancement
di: Ma, Lu
Pubblicazione: (2025)

Thinking in cocktail party: Chain-of-Thought and reinforcement learning for target speaker automatic speech recognition
di: Zhang, Yiru, et al.
Pubblicazione: (2025)

Charting 15 years of progress in deep learning for speech emotion recognition: A replication study
di: Triantafyllopoulos, Andreas, et al.
Pubblicazione: (2025)

Voxtlm: unified decoder-only models for consolidating speech recognition/synthesis and speech/text continuation tasks
di: Maiti, Soumi, et al.
Pubblicazione: (2023)

PRoDeliberation: Parallel Robust Deliberation for End-to-End Spoken Language Understanding
di: Le, Trang, et al.
Pubblicazione: (2024)

A two-step approach for speech enhancement in low-SNR scenarios using cyclostationary beamforming and DNNs
di: Bologni, Giovanni, et al.
Pubblicazione: (2026)

Performance Analysis of Speech Encoders for Low-Resource SLU and ASR in Tunisian Dialect
di: Mdhaffar, Salima, et al.
Pubblicazione: (2024)

Language model integration based on memory control for sequence to sequence speech recognition
di: Cho, Jaejin, et al.
Pubblicazione: (2018)

On the relationship between speech and hearing
di: Umesh, Srinivasan, et al.
Pubblicazione: (2024)

LALM-as-a-Judge: Benchmarking Large Audio-Language Models for Safety Evaluation in Multi-Turn Spoken Dialogues
di: Ivry, Amir, et al.
Pubblicazione: (2026)

"Alexa, can you forget me?" Machine Unlearning Benchmark in Spoken Language Understanding
di: Koudounas, Alkis, et al.
Pubblicazione: (2025)

VoxEval: Benchmarking the Knowledge Understanding Capabilities of End-to-End Spoken Language Models
di: Cui, Wenqian, et al.
Pubblicazione: (2025)

ALAS: Measuring Latent Speech-Text Alignment For Spoken Language Understanding In Multimodal LLMs
di: Mousavi, Pooneh, et al.
Pubblicazione: (2025)

Keyword Mamba: Spoken Keyword Spotting with State Space Models
di: Ding, Hanyu, et al.
Pubblicazione: (2025)