Cover Image

Preserving Multilingual Quality While Tuning Query Encoder on English Only

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Vasilyev, Oleg, Sawaya, Randy, Bohannon, John
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

How important is Recall for Measuring Retrieval Quality?
by: Schwartz, Shelly, et al.
Published: (2025)

How to Discern Important Urgent News?
by: Vasilyev, Oleg, et al.
Published: (2024)

Linear Cross-Lingual Mapping of Sentence Embeddings
by: Vasilyev, Oleg, et al.
Published: (2023)

Multilingual Pretraining and Instruction Tuning Improve Cross-Lingual Knowledge Alignment, But Only Shallowly
by: Gao, Changjiang, et al.
Published: (2024)

Encoder-Decoder or Decoder-Only? Revisiting Encoder-Decoder Large Language Model
by: Zhang, Biao, et al.
Published: (2025)

Multilingual Sentence-T5: Scalable Sentence Encoders for Multilingual Applications
by: Yano, Chihiro, et al.
Published: (2024)

CorPipe at CRAC 2025: Evaluating Multilingual Encoders for Multilingual Coreference Resolution
by: Straka, Milan
Published: (2025)

How to Tune a Multilingual Encoder Model for Germanic Languages: A Study of PEFT, Full Fine-Tuning, and Language Adapters
by: Oji, Romina, et al.
Published: (2025)

WebQAmGaze: A Multilingual Webcam Eye-Tracking-While-Reading Dataset
by: Ribeiro, Tiago, et al.
Published: (2023)

Learning While Staying Curious: Entropy-Preserving Supervised Fine-Tuning via Adaptive Self-Distillation for Large Reasoning Models
by: Wang, Hao, et al.
Published: (2026)

Will LLMs Replace the Encoder-Only Models in Temporal Relation Classification?
by: Roccabruna, Gabriel, et al.
Published: (2024)

Causal Reasoning Favors Encoders: On The Limits of Decoder-Only Models
by: Roy, Amartya, et al.
Published: (2025)

Assessing Logical Reasoning Capabilities of Encoder-Only Transformer Models
by: Pirozelli, Paulo, et al.
Published: (2023)

Modular Adaptation of Multilingual Encoders to Written Swiss German Dialect
by: Vamvas, Jannis, et al.
Published: (2024)

On Multilingual Encoder Language Model Compression for Low-Resource Languages
by: Gurgurov, Daniil, et al.
Published: (2025)

M-DaQ: Retrieving Samples with Multilingual Diversity and Quality for Instruction Fine-Tuning Datasets
by: Zhao, Chunguang, et al.
Published: (2025)

Shaping Explanations: Semantic Reward Modeling with Encoder-Only Transformers for GRPO
by: Pappone, Francesco, et al.
Published: (2025)

EuroBERT: Scaling Multilingual Encoders for European Languages
by: Boizard, Nicolas, et al.
Published: (2025)

MoGU: A Framework for Enhancing Safety of Open-Sourced LLMs While Preserving Their Usability
by: Du, Yanrui, et al.
Published: (2024)

BOOM: Beyond Only One Modality KIT's Multimodal Multilingual Lecture Companion
by: Koneru, Sai, et al.
Published: (2025)

Languages Transferred Within the Encoder: On Representation Transfer in Zero-Shot Multilingual Translation
by: Qu, Zhi, et al.
Published: (2024)

Utilizing Multilingual Encoders to Improve Large Language Models for Low-Resource Languages
by: Puranegedara, Imalsha, et al.
Published: (2025)

MoL for LLMs: Dual-Loss Optimization to Enhance Domain Expertise While Preserving General Capabilities
by: Chen, Jingxue, et al.
Published: (2025)

Language-Aware Distillation for Multilingual Instruction-Following Speech LLMs with ASR-Only Supervision
by: Gopal, Shreyas, et al.
Published: (2026)

Investigating Multilingual Instruction-Tuning: Do Polyglot Models Demand for Multilingual Instructions?
by: Weber, Alexander Arno, et al.
Published: (2024)

Scaling Laws of Decoder-Only Models on the Multilingual Machine Translation Task
by: Caillaut, Gaëtan, et al.
Published: (2024)

Improving Multilingual Capabilities with Cultural and Local Knowledge in Large Language Models While Enhancing Native Performance
by: Kadiyala, Ram Mohan Rao, et al.
Published: (2025)

Contextual Multilingual Spellchecker for User Queries
by: Sharma, Sanat, et al.
Published: (2023)

Integrating Multi-Head Convolutional Encoders with Cross-Attention for Improved SPARQL Query Translation
by: Chen, Yi-Hui, et al.
Published: (2024)

Transformer-Encoder Trees for Efficient Multilingual Machine Translation and Speech Translation
by: Guan, Yiwen, et al.
Published: (2025)

Enhancing Low-Resource NMT with a Multilingual Encoder and Knowledge Distillation: A Case Study
by: Roy, Aniruddha, et al.
Published: (2024)

Neither Here Nor There: Cross-Lingual Representation Dynamics of Code-Mixed Text in Multilingual Encoders
by: Mazumder, Debajyoti, et al.
Published: (2026)

Language on Demand, Knowledge at Core: Composing LLMs with Encoder-Decoder Translation Models for Extensible Multilinguality
by: Bu, Mengyu, et al.
Published: (2026)

MERLIN: Multi-Stage Curriculum Alignment for Multilingual Encoder-LLM Integration in Cross-Lingual Reasoning
by: Uemura, Kosei, et al.
Published: (2025)

Do Llamas Work in English? On the Latent Language of Multilingual Transformers
by: Wendler, Chris, et al.
Published: (2024)

Beyond English: Unveiling Multilingual Bias in LLM Copyright Compliance
by: Chen, Yupeng, et al.
Published: (2025)

Multi-Agent Collaboration for Multilingual Code Instruction Tuning
by: Yang, Jian, et al.
Published: (2025)

The Roles of English in Evaluating Multilingual Language Models
by: Poelman, Wessel, et al.
Published: (2024)

Machine Translation with Large Language Models: Decoder Only vs. Encoder-Decoder
by: M., Abhinav P., et al.
Published: (2024)

Towards Universal and Black-Box Query-Response Only Attack on LLMs with QROA
by: Jawad, Hussein, et al.
Published: (2024)