Cover Image

OmniFusion: Simultaneous Multilingual Multimodal Translations via Modular Fusion

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Koneru, Sai, Huck, Matthias, Niehues, Jan
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Contextual Refinement of Translations: Large Language Models for Sentence and Document-Level Post-Editing
by: Koneru, Sai, et al.
Published: (2023)

Plug, Play, and Fuse: Zero-Shot Joint Decoding via Word-Level Re-ranking Across Diverse Vocabularies
by: Koneru, Sai, et al.
Published: (2024)

OmniFusion Technical Report
by: Goncharova, Elizaveta, et al.
Published: (2024)

KIT's Offline Speech Translation and Instruction Following Submission for IWSLT 2025
by: Koneru, Sai, et al.
Published: (2025)

How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models?
by: Liu, Danni, et al.
Published: (2023)

Quality-Aware Decoding: Unifying Quality Estimation and Decoding
by: Koneru, Sai, et al.
Published: (2025)

OmniFuser: Adaptive Multimodal Fusion for Service-Oriented Predictive Maintenance
by: Wang, Ziqi, et al.
Published: (2025)

Blending LLMs into Cascaded Speech Translation: KIT's Offline Speech Translation System for IWSLT 2024
by: Koneru, Sai, et al.
Published: (2024)

End-to-End Evaluation for Low-Latency Simultaneous Speech Translation
by: Huber, Christian, et al.
Published: (2023)

Multimodal In-context Learning for ASR of Low-resource Languages
by: Li, Zhaolin, et al.
Published: (2026)

MuSaG: A Multimodal German Sarcasm Dataset with Full-Modal Annotations
by: Scott, Aaron, et al.
Published: (2025)

Can Large Language Models Discern Evidence for Scientific Hypotheses? Case Studies in the Social Sciences
by: Koneru, Sai, et al.
Published: (2023)

CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
by: Yu, Shoubin, et al.
Published: (2024)

2M-NER: Contrastive Learning for Multilingual and Multimodal NER with Language and Modal Fusion
by: Wang, Dongsheng, et al.
Published: (2024)

Do Slides Help? Multi-modal Context for Automatic Transcription of Conference Talks
by: Sinhamahapatra, Supriti, et al.
Published: (2025)

Middle-Layer Representation Alignment for Cross-Lingual Transfer in Fine-Tuned LLMs
by: Liu, Danni, et al.
Published: (2025)

In-context Language Learning for Endangered Languages in Speech Recognition
by: Li, Zhaolin, et al.
Published: (2025)

Context Selection for Hypothesis and Statistical Evidence Extraction from Full-Text Scientific Articles
by: Koneru, Sai, et al.
Published: (2026)

m3P: Towards Multimodal Multilingual Translation with Multimodal Prompt
by: Yang, Jian, et al.
Published: (2024)

Conditions for Catastrophic Forgetting in Multilingual Translation
by: Liu, Danni, et al.
Published: (2025)

Assessing the Effectiveness of GPT-4o in Climate Change Evidence Synthesis and Systematic Assessments: Preliminary Insights
by: Joe, Elphin Tom, et al.
Published: (2024)

BOOM: Beyond Only One Modality KIT's Multimodal Multilingual Lecture Companion
by: Koneru, Sai, et al.
Published: (2025)

Language-Independent Representations Improve Zero-Shot Summarization
by: Solovyev, Vladimir, et al.
Published: (2024)

Round-Trip Translation Reveals What Frontier Multilingual Benchmarks Miss
by: Skorobogat, Ronald, et al.
Published: (2026)

Is Multilingual LLM Watermarking Truly Multilingual? Scaling Robustness to 100+ Languages via Back-Translation
by: Mohamed, Asim, et al.
Published: (2025)

Knowledge Fusion of Large Language Models Via Modular SkillPacks
by: Du, Guodong, et al.
Published: (2025)

Augmenting Automatic Speech Recognition Models with Disfluency Detection
by: Amann, Robin, et al.
Published: (2024)

OWLS: Scaling Laws for Multilingual Speech Recognition and Translation Models
by: Chen, William, et al.
Published: (2025)

Knowledge Fusion via Bidirectional Information Aggregation
by: Zhai, Songlin, et al.
Published: (2025)

PMMT: Preference Alignment in Multilingual Machine Translation via LLM Distillation
by: Sun, Shuqiao, et al.
Published: (2024)

Glancing Future for Simultaneous Machine Translation
by: Guo, Shoutao, et al.
Published: (2023)

Learning When to Translate for Multilingual Reasoning
by: Kang, Deokhyung, et al.
Published: (2026)

Document Classification Pattern Recognition via Information Fusion: A Systematic Review of Multimodal and Multiview Representation Approaches
by: Mirończuk, Marcin Michał
Published: (2026)

Rethinking Multimodal Sentiment Analysis: A High-Accuracy, Simplified Fusion Architecture
by: Mandal, Nischal, et al.
Published: (2025)

AMPLE: Emotion-Aware Multimodal Fusion Prompt Learning for Fake News Detection
by: Xu, Xiaoman, et al.
Published: (2024)

Transformer-Encoder Trees for Efficient Multilingual Machine Translation and Speech Translation
by: Guan, Yiwen, et al.
Published: (2025)

GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators
by: Hu, Yuchen, et al.
Published: (2024)

M-MiniGPT4: Multilingual VLLM Alignment via Translated Data
by: Han, Seung Hun, et al.
Published: (2026)

A Unified Framework for Emotion Recognition and Sentiment Analysis via Expert-Guided Multimodal Fusion with Large Language Models
by: Qiao, Jiaqi, et al.
Published: (2026)

On the Shortcut Learning in Multilingual Neural Machine Translation
by: Wang, Wenxuan, et al.
Published: (2024)