Copertina

InstructDubber: Instruction-based Alignment for Zero-shot Movie Dubbing

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhang, Zhedong, Li, Liang, Cong, Gaoxiang, Liu, Chunshan, Gao, Yuhan, Wang, Xiaowan, Gu, Tao, Qi, Yuankai
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Sound
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

FlowDubber: Movie Dubbing with LLM-based Semantic-aware Learning and Flow Matching based Voice Enhancing
di: Cong, Gaoxiang, et al.
Pubblicazione: (2025)

EmoDubber: Towards High Quality and Emotion Controllable Movie Dubbing
di: Cong, Gaoxiang, et al.
Pubblicazione: (2024)

CoSyncDiT: Cognitive Synchronous Diffusion Transformer for Movie Dubbing
di: Cong, Gaoxiang, et al.
Pubblicazione: (2026)

Prosody-Enhanced Acoustic Pre-training and Acoustic-Disentangled Prosody Adapting for Movie Dubbing
di: Zhang, Zhedong, et al.
Pubblicazione: (2025)

StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing
di: Cong, Gaoxiang, et al.
Pubblicazione: (2024)

Towards Expressive Video Dubbing with Multiscale Multimodal Context Interaction
di: Zhao, Yuan, et al.
Pubblicazione: (2024)

DiFlowDubber: Discrete Flow Matching for Automated Video Dubbing via Cross-Modal Alignment and Synchronization
di: Nguyen, Ngoc-Son, et al.
Pubblicazione: (2026)

MM-MovieDubber: Towards Multi-Modal Learning for Multi-Modal Movie Dubbing
di: Zheng, Junjie, et al.
Pubblicazione: (2025)

Fine-grained Video Dubbing Duration Alignment with Segment Supervised Preference Optimization
di: Cui, Chaoqun, et al.
Pubblicazione: (2025)

M3-TTS: Multi-modal DiT Alignment & Mel-latent for Zero-shot High-fidelity Speech Synthesis
di: Wang, Xiaopeng, et al.
Pubblicazione: (2025)

DubWise: Video-Guided Speech Duration Control in Multimodal LLM-based Text-to-Speech for Dubbing
di: Sahipjohn, Neha, et al.
Pubblicazione: (2024)

Generating High-quality Symbolic Music Using Fine-grained Discriminators
di: Zhang, Zhedong, et al.
Pubblicazione: (2024)

OV-InstructTTS: Towards Open-Vocabulary Instruct Text-to-Speech
di: Ren, Yong, et al.
Pubblicazione: (2026)

TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis
di: Zhang, Yu, et al.
Pubblicazione: (2025)

Dub-S2ST: Textless Speech-to-Speech Translation for Seamless Dubbing
di: Choi, Jeongsoo, et al.
Pubblicazione: (2025)

Advancing Zero-shot Text-to-Speech Intelligibility across Diverse Domains via Preference Alignment
di: Zhang, Xueyao, et al.
Pubblicazione: (2025)

SAO-Instruct: Free-form Audio Editing using Natural Language Instructions
di: Ungersböck, Michael, et al.
Pubblicazione: (2025)

WHISMA: A Speech-LLM to Perform Zero-shot Spoken Language Understanding
di: Li, Mohan, et al.
Pubblicazione: (2024)

MCDubber: Multimodal Context-Aware Expressive Video Dubbing
di: Zhao, Yuan, et al.
Pubblicazione: (2024)

Investigation of Zero-shot Text-to-Speech Models for Enhancing Short-Utterance Speaker Verification
di: Zhao, Yiyang, et al.
Pubblicazione: (2025)

CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokens
di: Du, Zhihao, et al.
Pubblicazione: (2024)

OneVoice: One Model, Triple Scenarios-Towards Unified Zero-shot Voice Conversion
di: Wang, Zhichao, et al.
Pubblicazione: (2026)

Zero-shot Voice Conversion with Diffusion Transformers
di: Liu, Songting
Pubblicazione: (2024)

VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling
di: Zhou, Yixuan, et al.
Pubblicazione: (2024)

MEDIC: Zero-shot Music Editing with Disentangled Inversion Control
di: Liu, Huadai, et al.
Pubblicazione: (2024)

InstructTTSEval: Benchmarking Complex Natural-Language Instruction Following in Text-to-Speech Systems
di: Huang, Kexin, et al.
Pubblicazione: (2025)

Improving Noise Robustness of LLM-based Zero-shot TTS via Discrete Acoustic Token Denoising
di: Lu, Ye-Xin, et al.
Pubblicazione: (2025)

Vox-Evaluator: Enhancing Stability and Fidelity for Zero-shot TTS with A Multi-Level Evaluator
di: Wang, Hualei, et al.
Pubblicazione: (2025)

InstructSing: High-Fidelity Singing Voice Generation via Instructing Yourself
di: Zeng, Chang, et al.
Pubblicazione: (2024)

FlexiVoice: Enabling Flexible Style Control in Zero-Shot TTS with Natural Language Instructions
di: Chen, Dekun, et al.
Pubblicazione: (2026)

Zero- and Few-shot Sound Event Localization and Detection
di: Shimada, Kazuki, et al.
Pubblicazione: (2023)

Zero-shot Cross-lingual Voice Transfer for TTS
di: Biadsy, Fadi, et al.
Pubblicazione: (2024)

Exploring Meta Information for Audio-based Zero-shot Bird Classification
di: Gebhard, Alexander, et al.
Pubblicazione: (2023)

DualDub: Video-to-Soundtrack Generation via Joint Speech and Background Audio Synthesis
di: Tian, Wenjie, et al.
Pubblicazione: (2025)

Length Aware Speech Translation for Video Dubbing
di: Chadha, Harveen Singh, et al.
Pubblicazione: (2025)

ControlSpeech: Towards Simultaneous and Independent Zero-shot Speaker Cloning and Zero-shot Language Style Control
di: Ji, Shengpeng, et al.
Pubblicazione: (2024)

Joint Multi-scale Cross-lingual Speaking Style Transfer with Bidirectional Attention Mechanism for Automatic Dubbing
di: Li, Jingbei, et al.
Pubblicazione: (2023)

MINT: a Multi-modal Image and Narrative Text Dubbing Dataset for Foley Audio Content Planning and Generation
di: Fu, Ruibo, et al.
Pubblicazione: (2024)

SSR-Speech: Towards Stable, Safe and Robust Zero-shot Text-based Speech Editing and Synthesis
di: Wang, Helin, et al.
Pubblicazione: (2024)

YingMusic-Singer: Zero-shot Singing Voice Synthesis and Editing with Annotation-free Melody Guidance
di: Zheng, Junjie, et al.
Pubblicazione: (2025)