Cover Image

Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Luo, Yingfeng, Zheng, Tong, Mu, Yongyu, Li, Bei, Zhang, Qinghong, Gao, Yongqi, Xu, Ziqiang, Feng, Peinan, Liu, Xiaoqian, Xiao, Tong, Zhu, Jingbo
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

NiuTrans.LMT: Toward Inclusive and Scalable Multilingual Machine Translation with LLMs
by: Luo, Yingfeng, et al.
Published: (2025)

Translate-and-Revise: Boosting Large Language Models for Constrained Translation
by: Huang, Pengcheng, et al.
Published: (2024)

Revealing the Parallel Multilingual Learning within Large Language Models
by: Mu, Yongyu, et al.
Published: (2024)

Recent Advances in End-to-End Simultaneous Speech Translation
by: Liu, Xiaoqian, et al.
Published: (2024)

Efficient Prompting Methods for Large Language Models: A Survey
by: Chang, Kaiyan, et al.
Published: (2024)

Language-Specific Layer Matters: Efficient Multilingual Enhancement for Large Vision-Language Models
by: Fan, Yuchun, et al.
Published: (2025)

PartialFormer: Modeling Part Instead of Whole for Machine Translation
by: Zheng, Tong, et al.
Published: (2023)

Boosting Text-To-Image Generation via Multilingual Prompting in Large Multimodal Models
by: Mu, Yongyu, et al.
Published: (2025)

Hybrid Alignment Training for Large Language Models
by: Wang, Chenglong, et al.
Published: (2024)

Early Exit Is a Natural Capability in Transformer-based Models: An Empirical Study on Early Exit without Joint Optimization
by: Shan, Weiqiao, et al.
Published: (2024)

One Size Does Not Fit All: A Distribution-Aware Sparsification for More Precise Model Merging
by: Luo, Yingfeng, et al.
Published: (2025)

RouteLMT: Learned Sample Routing for Hybrid LLM Translation Deployment
by: Luo, Yingfeng, et al.
Published: (2026)

MTP-S2UT: Enhancing Speech-to-Speech Translation Quality with Multi-token Prediction
by: Wang, Jianjin, et al.
Published: (2025)

Dissecting Long-Chain-of-Thought Reasoning Models: An Empirical Study
by: Mu, Yongyu, et al.
Published: (2025)

Enhancing Speech Large Language Models with Prompt-Aware Mixture of Audio Encoders
by: Shan, Weiqiao, et al.
Published: (2025)

EIT: Enhanced Interactive Transformer
by: Zheng, Tong, et al.
Published: (2022)

Step-level Verifier-guided Hybrid Test-Time Scaling for Large Language Models
by: Chang, Kaiyan, et al.
Published: (2025)

APR: Penalizing Structural Redundancy in Large Reasoning Models via Anchor-based Process Rewards
by: Chang, Kaiyan, et al.
Published: (2026)

SLAM: Towards Efficient Multilingual Reasoning via Selective Language Alignment
by: Fan, Yuchun, et al.
Published: (2025)

Foundations of Large Language Models
by: Xiao, Tong, et al.
Published: (2025)

Machine Translation with Large Language Models: Decoder Only vs. Encoder-Decoder
by: M., Abhinav P., et al.
Published: (2024)

Decoder-only Streaming Transformer for Simultaneous Translation
by: Guo, Shoutao, et al.
Published: (2024)

DaPT: A Dual-Path Framework for Multilingual Multi-hop Question Answering
by: Wang, Yilin, et al.
Published: (2026)

Can LLMs Learn from Previous Mistakes? Investigating LLMs' Errors to Boost for Reasoning
by: Tong, Yongqi, et al.
Published: (2024)

GRAM: A Generative Foundation Reward Model for Reward Generalization
by: Wang, Chenglong, et al.
Published: (2025)

A Modular-based Strategy for Mitigating Gradient Conflicts in Simultaneous Speech Translation
by: Liu, Xiaoqian, et al.
Published: (2024)

Memory Reviving, Continuing Learning and Beyond: Evaluation of Pre-trained Encoders and Decoders for Multimodal Machine Translation
by: Yu, Zhuang, et al.
Published: (2025)

Offline Exploration-Aware Fine-Tuning for Long-Chain Mathematical Reasoning
by: Mu, Yongyu, et al.
Published: (2026)

Investigating Decoder-only Large Language Models for Speech-to-text Translation
by: Huang, Chao-Wei, et al.
Published: (2024)

LANG: Reinforcement Learning for Multilingual Reasoning with Language-Adaptive Hint Guidance
by: Fan, Yuchun, et al.
Published: (2026)

Cross-lingual Transfer or Machine Translation? On Data Augmentation for Monolingual Semantic Textual Similarity
by: Hoshino, Sho, et al.
Published: (2024)

Small Encoders Can Rival Large Decoders in Detecting Groundedness
by: Abbes, Istabrak, et al.
Published: (2025)

Improving Language Transfer Capability of Decoder-only Architecture in Multilingual Neural Machine Translation
by: Qu, Zhi, et al.
Published: (2024)

Cross-layer Attention Sharing for Pre-trained Large Language Models
by: Mu, Yongyu, et al.
Published: (2024)

Encoder-Decoder or Decoder-Only? Revisiting Encoder-Decoder Large Language Model
by: Zhang, Biao, et al.
Published: (2025)

SPS: Steering Probability Squeezing for Better Exploration in Reinforcement Learning for Large Language Models
by: Huo, Yifu, et al.
Published: (2026)

LRHP: Learning Representations for Human Preferences via Preference Pairs
by: Wang, Chenglong, et al.
Published: (2024)

GRAM-R$^2$: Self-Training Generative Foundation Reward Models for Reward Reasoning
by: Wang, Chenglong, et al.
Published: (2025)

MRO: Enhancing Reasoning in Diffusion Language Models via Multi-Reward Optimization
by: Wang, Chenglong, et al.
Published: (2025)

Probing Preference Representations: A Multi-Dimensional Evaluation and Analysis Method for Reward Models
by: Wang, Chenglong, et al.
Published: (2025)