Copertina

RESOUND: Speech Reconstruction from Silent Videos via Acoustic-Semantic Decomposed Modeling

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Pham, Long-Khanh, Tran, Thanh V. T., Pham, Minh-Tan, Nguyen, Van
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Sound Computer Vision and Pattern Recognition Audio and Speech Processing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

MAGE: A Coarse-to-Fine Speech Enhancer with Masked Generative Model
di: Pham, The Hieu, et al.
Pubblicazione: (2025)

Emotional Vietnamese Speech-Based Depression Diagnosis Using Dynamic Attention Mechanism
di: D., Quang-Anh N., et al.
Pubblicazione: (2024)

Optimal Scalogram for Computational Complexity Reduction in Acoustic Recognition Using Deep Learning
di: Phan, Dang Thoai, et al.
Pubblicazione: (2025)

ChunkFormer: Masked Chunking Conformer For Long-Form Speech Transcription
di: Le, Khanh, et al.
Pubblicazione: (2025)

Shushing! Let's Imagine an Authentic Speech from the Silent Video
di: Ye, Jiaxin, et al.
Pubblicazione: (2025)

SegAug: CTC-Aligned Segmented Augmentation For Robust RNN-Transducer Based Speech Recognition
di: Le, Khanh, et al.
Pubblicazione: (2025)

FoleyCrafter: Bring Silent Videos to Life with Lifelike and Synchronized Sounds
di: Zhang, Yiming, et al.
Pubblicazione: (2024)

Dynamic Context-Aware Streaming Pretrained Language Model For Inverse Text Normalization
di: Ho, Luong, et al.
Pubblicazione: (2025)

EgoSonics: Generating Synchronized Audio for Silent Egocentric Videos
di: Rai, Aashish, et al.
Pubblicazione: (2024)

MultiMed: Multilingual Medical Speech Recognition via Attention Encoder Decoder
di: Le-Duc, Khai, et al.
Pubblicazione: (2024)

LipVoicer: Generating Speech from Silent Videos Guided by Lip Reading
di: Yemini, Yochai, et al.
Pubblicazione: (2023)

A Comprehensive Survey with Critical Analysis for Deepfake Speech Detection
di: Pham, Lam, et al.
Pubblicazione: (2024)

Novel-View Acoustic Synthesis from 3D Reconstructed Rooms
di: Ahn, Byeongjoo, et al.
Pubblicazione: (2023)

The Impact of Frequency Bands on Acoustic Anomaly Detection of Machines using Deep Learning Based Model
di: Nguyen, Tin, et al.
Pubblicazione: (2024)

MDSGen: Fast and Efficient Masked Diffusion Temporal-Aware Transformers for Open-Domain Sound Generation
di: Pham, Trung X., et al.
Pubblicazione: (2024)

Improving Acoustic Scene Classification with City Features
di: Cai, Yiqiang, et al.
Pubblicazione: (2025)

V2SFlow: Video-to-Speech Generation with Speech Decomposition and Rectified Flow
di: Choi, Jeongsoo, et al.
Pubblicazione: (2024)

SOAF: Scene Occlusion-aware Neural Acoustic Field
di: Gao, Huiyu, et al.
Pubblicazione: (2024)

Sonicmesh: Enhancing 3D Human Mesh Reconstruction in Vision-Impaired Environments With Acoustic Signals
di: Liang, Xiaoxuan, et al.
Pubblicazione: (2024)

UniCUE: Unified Recognition and Generation Framework for Chinese Cued Speech Video-to-Speech Generation
di: Wang, Jinting, et al.
Pubblicazione: (2025)

SAC: Neural Speech Codec with Semantic-Acoustic Dual-Stream Quantization
di: Chen, Wenxi, et al.
Pubblicazione: (2025)

Improving Code Switching with Supervised Fine Tuning and GELU Adapters
di: Pham, Linh
Pubblicazione: (2025)

VMAS: Video-to-Music Generation via Semantic Alignment in Web Music Videos
di: Lin, Yan-Bo, et al.
Pubblicazione: (2024)

Semantic Gesticulator: Semantics-Aware Co-Speech Gesture Synthesis
di: Zhang, Zeyi, et al.
Pubblicazione: (2024)

Prosody-Enhanced Acoustic Pre-training and Acoustic-Disentangled Prosody Adapting for Movie Dubbing
di: Zhang, Zhedong, et al.
Pubblicazione: (2025)

CoLM-DSR: Leveraging Neural Codec Language Modeling for Multi-Modal Dysarthric Speech Reconstruction
di: Chen, Xueyuan, et al.
Pubblicazione: (2024)

Speech2rtMRI: Speech-Guided Diffusion Model for Real-time MRI Video of the Vocal Tract during Speech
di: Nguyen, Hong, et al.
Pubblicazione: (2024)

Improving Streaming Speech Recognition With Time-Shifted Contextual Attention And Dynamic Right Context Masking
di: Le, Khanh, et al.
Pubblicazione: (2025)

Wav2Sem: Plug-and-Play Audio Semantic Decoupling for 3D Speech-Driven Facial Animation
di: Li, Hao, et al.
Pubblicazione: (2025)

Parallel GPT: Harmonizing the Independence and Interdependence of Acoustic and Semantic Information for Zero-Shot Text-to-Speech
di: Xing, Jingyuan, et al.
Pubblicazione: (2025)

SAVE: Segment Audio-Visual Easy way using Segment Anything Model
di: Nguyen, Khanh-Binh, et al.
Pubblicazione: (2024)

PrismAudio: Decomposed Chain-of-Thoughts and Multi-dimensional Rewards for Video-to-Audio Generation
di: Liu, Huadai, et al.
Pubblicazione: (2025)

FilmComposer: LLM-Driven Music Production for Silent Film Clips
di: Xie, Zhifeng, et al.
Pubblicazione: (2025)

Sing-On-Your-Beat: Simple Text-Controllable Accompaniment Generations
di: Trinh, Quoc-Huy, et al.
Pubblicazione: (2024)

Let There Be Sound: Reconstructing High Quality Speech from Silent Videos
di: Kim, Ji-Hoon, et al.
Pubblicazione: (2023)

DeepAudio-V1:Towards Multi-Modal Multi-Stage End-to-End Video to Speech and Audio Generation
di: Zhang, Haomin, et al.
Pubblicazione: (2025)

MuteSwap: Visual-informed Silent Video Identity Conversion
di: Liu, Yifan, et al.
Pubblicazione: (2025)

Few-shot Acoustic Synthesis with Multimodal Flow Matching
di: Brunetto, Amandine
Pubblicazione: (2026)

Towards General Discrete Speech Codec for Complex Acoustic Environments: A Study of Reconstruction and Downstream Task Consistency
di: Wang, Haoran, et al.
Pubblicazione: (2025)

Efficient Audiovisual Speech Processing via MUTUD: Multimodal Training and Unimodal Deployment
di: Hong, Joanna, et al.
Pubblicazione: (2025)