Image de couverture de livre

UAF: A Unified Audio Front-end LLM for Full-Duplex Speech Interaction

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Li, Yadong, Wu, Guoxin, Hou, Haiping, Li, Biye
Format:	Preprint
Publié:	2026
Sujets:	Artificial Intelligence Sound Audio and Speech Processing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

A Small-footprint Acoustic Echo Cancellation Solution for Mobile Full-Duplex Speech Interactions
par: Jiang, Yiheng, et autres
Publié: (2025)

LLM-Guided Reinforcement Learning for Audio-Visual Speech Enhancement
par: Chen, Chih-Ning, et autres
Publié: (2026)

Phoenix-VAD: Streaming Semantic Endpoint Detection for Full-Duplex Speech Interaction
par: Wu, Weijie, et autres
Publié: (2025)

ASPIRin: Action Space Projection for Interactivity-Optimized Reinforcement Learning in Full-Duplex Speech Language Models
par: Hsiao, Chi-Yuan, et autres
Publié: (2026)

Should Audio Front-ends be Adaptive? Comparing Learnable and Adaptive Front-ends
par: Zhang, Qiquan, et autres
Publié: (2025)

Sommelier: Scalable Open Multi-turn Audio Pre-processing for Full-duplex Speech Language Models
par: Jung, Kyudan, et autres
Publié: (2026)

TDFNet: An Efficient Audio-Visual Speech Separation Model with Top-down Fusion
par: Pegg, Samuel, et autres
Publié: (2024)

Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representation
par: Yan, Canxiang, et autres
Publié: (2025)

SongPrep: A Preprocessing Framework and End-to-end Model for Full-song Structure Parsing and Lyrics Transcription
par: Tan, Wei, et autres
Publié: (2025)

DASB - Discrete Audio and Speech Benchmark
par: Mousavi, Pooneh, et autres
Publié: (2024)

A Unified Speech LLM for Diarization and Speech Recognition in Multilingual Conversations
par: Saengthong, Phurich, et autres
Publié: (2025)

FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMs
par: An, Keyu, et autres
Publié: (2024)

UltraEval-Audio: A Unified Framework for Comprehensive Evaluation of Audio Foundation Models
par: Shi, Qundong, et autres
Publié: (2026)

VoiceShop: A Unified Speech-to-Speech Framework for Identity-Preserving Zero-Shot Voice Editing
par: Anastassiou, Philip, et autres
Publié: (2024)

HyperPotter: Spell the Charm of High-Order Interactions in Audio Deepfake Detection
par: Wen, Qing, et autres
Publié: (2026)

JASTIN: Aligning LLMs for Zero-Shot Audio and Speech Evaluation via Natural Language Instructions
par: Zhang, Leying, et autres
Publié: (2026)

Audio Deepfake Detection in the Age of Advanced Text-to-Speech models
par: Singh, Robin, et autres
Publié: (2026)

Audio Codec Augmentation for Robust Collaborative Watermarking of Speech Synthesis
par: Juvela, Lauri, et autres
Publié: (2024)

Investigation of Whisper ASR Hallucinations Induced by Non-Speech Audio
par: Barański, Mateusz, et autres
Publié: (2025)

Codecfake: An Initial Dataset for Detecting LLM-based Deepfake Audio
par: Lu, Yi, et autres
Publié: (2024)

Safe Guard: an LLM-agent for Real-time Voice-based Hate Speech Detection in Social Virtual Reality
par: Xu, Yiwen, et autres
Publié: (2024)

LearnAFE: Circuit-Algorithm Co-design Framework for Learnable Audio Analog Front-End
par: Hu, Jinhai, et autres
Publié: (2025)

VoxPrivacy: A Benchmark for Evaluating Interactional Privacy of Speech Language Models
par: Wang, Yuxiang, et autres
Publié: (2026)

The Multimodal Information Based Speech Processing (MISP) 2025 Challenge: Audio-Visual Diarization and Recognition
par: Gao, Ming, et autres
Publié: (2025)

The Sounds of Home: A Speech-Removed Residential Audio Dataset for Sound Event Detection
par: Bibbó, Gabriel, et autres
Publié: (2024)

Unifying Speech Recognition, Synthesis and Conversion with Autoregressive Transformers
par: Cai, Runyuan, et autres
Publié: (2026)

Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokens
par: Wang, Xinsheng, et autres
Publié: (2025)

Improving Robustness of LLM-based Speech Synthesis by Learning Monotonic Alignment
par: Neekhara, Paarth, et autres
Publié: (2024)

Listening and Seeing Again: Generative Error Correction for Audio-Visual Speech Recognition
par: Liu, Rui, et autres
Publié: (2025)

Exploring Finetuned Audio-LLM on Heart Murmur Features
par: Florea, Adrian, et autres
Publié: (2025)

DialogueSidon: Recovering Full-Duplex Dialogue Tracks from In-the-Wild Dialogue Audio
par: Nakata, Wataru, et autres
Publié: (2026)

UniTTS: An end-to-end TTS system without decoupling of acoustic and semantic information
par: Wang, Rui, et autres
Publié: (2025)

Representation-Regularized Convolutional Audio Transformer for Audio Understanding
par: Han, Bing, et autres
Publié: (2026)

Step-Audio: Unified Understanding and Generation in Intelligent Speech Interaction
par: Huang, Ailin, et autres
Publié: (2025)

A unified multichannel far-field speech recognition system: combining neural beamforming with attention based end-to-end model
par: Zhao, Dongdi, et autres
Publié: (2024)

DPI-TTS: Directional Patch Interaction for Fast-Converging and Style Temporal Modeling in Text-to-Speech
par: Qi, Xin, et autres
Publié: (2024)

Zero-Shot Parkinson's Disease Detection from Speech: Comparing Large Audio and Language Models
par: Kabir, Muhammad Ashad, et autres
Publié: (2026)

MLCA-AVSR: Multi-Layer Cross Attention Fusion based Audio-Visual Speech Recognition
par: Wang, He, et autres
Publié: (2024)

WavShape: Information-Theoretic Speech Representation Learning for Fair and Privacy-Aware Audio Processing
par: Baser, Oguzhan, et autres
Publié: (2025)

TurnGuide: Enhancing Meaningful Full Duplex Spoken Interactions via Dynamic Turn-Level Text-Speech Interleaving
par: Cui, Wenqian, et autres
Publié: (2025)