Cover Image

Scalable Multilingual Multimodal Machine Translation with Speech-Text Fusion

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Du, Yexing, Pan, Youcheng, Wang, Zekun, Chu, Zheng, Huang, Yichong, Liu, Kaiyuan, Yang, Bo, Xiang, Yang, Liu, Ming, Qin, Bing
Format:	Preprint
Published:	2026
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Bandwidth-Efficient and Privacy-Preserving Edge-Cloud Many-to-Many Speech Translation
by: Du, Yexing, et al.
Published: (2026)

CCFQA: A Benchmark for Cross-Lingual and Cross-Modal Speech and Text Factuality Evaluation
by: Du, Yexing, et al.
Published: (2025)

MCAT: Scaling Many-to-Many Speech-to-Text Translation with MLLMs to 70 Languages
by: Du, Yexing, et al.
Published: (2025)

Making LLMs Better Many-to-Many Speech-to-Text Translators with Curriculum Learning
by: Du, Yexing, et al.
Published: (2024)

ProjectEval: A Benchmark for Programming Agents Automated Evaluation on Project-Level Code Generation
by: Liu, Kaiyuan, et al.
Published: (2025)

MCGA: A Multi-task Classical Chinese Literary Genre Audio Corpus
by: Du, Yexing, et al.
Published: (2026)

NiuTrans.LMT: Toward Inclusive and Scalable Multilingual Machine Translation with LLMs
by: Luo, Yingfeng, et al.
Published: (2025)

m3P: Towards Multimodal Multilingual Translation with Multimodal Prompt
by: Yang, Jian, et al.
Published: (2024)

GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators
by: Hu, Yuchen, et al.
Published: (2024)

Aligning Translation-Specific Understanding to General Understanding in Large Language Models
by: Huang, Yichong, et al.
Published: (2024)

Ensemble Learning for Heterogeneous Large Language Models with Deep Parallel Collaboration
by: Huang, Yichong, et al.
Published: (2024)

Relay Decoding: Concatenating Large Language Models for Machine Translation
by: Fu, Chengpeng, et al.
Published: (2024)

Diffusion Synthesizer for Efficient Multilingual Speech to Speech Translation
by: Hirschkind, Nameer, et al.
Published: (2024)

OmniFusion: Simultaneous Multilingual Multimodal Translations via Modular Fusion
by: Koneru, Sai, et al.
Published: (2025)

S2ST-Omni: Hierarchical Language-Aware SpeechLLM Adaptation for Multilingual Speech-to-Speech Translation
by: Pan, Yu, et al.
Published: (2025)

Transformer-Encoder Trees for Efficient Multilingual Machine Translation and Speech Translation
by: Guan, Yiwen, et al.
Published: (2025)

Divide-and-Conquer Meets Consensus: Unleashing the Power of Functions in Code Generation
by: Chen, Jingchang, et al.
Published: (2024)

LongSpeech: A Scalable Benchmark for Transcription, Translation and Understanding in Long Speech
by: Yang, Fei, et al.
Published: (2026)

Invariance under Structure Translation as the Origin of Host Immune Capacity Conservation from Noether's Theorem
by: Chen, Yexing, et al.
Published: (2025)

Mitigating Translationese Bias in Multilingual LLM-as-a-Judge via Disentangled Information Bottleneck
by: Zhang, Hongbin, et al.
Published: (2026)

PRIM: Towards Practical In-Image Multilingual Machine Translation
by: Tian, Yanzhi, et al.
Published: (2025)

CC-Tuning: A Cross-Lingual Connection Mechanism for Improving Joint Multilingual Supervised Fine-Tuning
by: Ye, Yangfan, et al.
Published: (2025)

Position: Towards Responsible Evaluation for Text-to-Speech
by: Yang, Yifan, et al.
Published: (2025)

MolFusion: Multimodal Fusion Learning for Molecular Representations via Multi-granularity Views
by: Cai, Muzhen, et al.
Published: (2024)

BharathVaani: A Speech-to-Text and Multilingual Translation Web Application
by: K. Revanth Venkat, et al.
Published: (2026)

FroM: Frobenius Norm-Based Data-Free Adaptive Model Merging
by: Li, Zijian, et al.
Published: (2025)

From Flat Language Labels to Typological Priors: Structured Language Conditioning for Multilingual Speech-to-Speech Translation
by: Pan, Yu, et al.
Published: (2026)

CLAIM: Mitigating Multilingual Object Hallucination in Large Vision-Language Models with Cross-Lingual Attention Intervention
by: Ye, Zekai, et al.
Published: (2025)

Translation as a Scalable Proxy for Multilingual Evaluation
by: Issaka, Sheriff, et al.
Published: (2026)

Multimodal Fusion of Skeleton Dynamics and Clinical Gait Features for Video-Based Cerebral Palsy Severity Assessment
by: Yang, Kaiyuan, et al.
Published: (2026)

Multilingual Non-Autoregressive Machine Translation without Knowledge Distillation
by: Huang, Chenyang, et al.
Published: (2025)

ViT-TTS: Visual Text-to-Speech with Scalable Diffusion Transformer
by: Liu, Huadai, et al.
Published: (2023)

Cross-lingual Embedding Clustering for Hierarchical Softmax in Low-Resource Multilingual Speech Recognition
by: Yang, Zhengdong, et al.
Published: (2025)

Culture-Aware Machine Translation in Large Language Models: Benchmarking and Investigation
by: Yuan, Zekun, et al.
Published: (2026)

An Empirical Study on the Robustness of Massively Multilingual Neural Machine Translation
by: Supryadi, et al.
Published: (2024)

PART: Progressive Alignment Representation Training for Multilingual Speech-To-Text with LLMs
by: Zhang, Pei, et al.
Published: (2025)

Lost in Translation? Translation Errors and Challenges for Fair Assessment of Text-to-Image Models on Multilingual Concepts
by: Saxon, Michael, et al.
Published: (2024)

OWLS: Scaling Laws for Multilingual Speech Recognition and Translation Models
by: Chen, William, et al.
Published: (2025)

Language-Informed Beam Search Decoding for Multilingual Machine Translation
by: Yang, Yilin, et al.
Published: (2024)

Streaming Speech-to-Text Translation with a SpeechLLM
by: Parcollet, Titouan, et al.
Published: (2026)