Copertina

Middle-Layer Representation Alignment for Cross-Lingual Transfer in Fine-Tuned LLMs

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Liu, Danni, Niehues, Jan
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models?
di: Liu, Danni, et al.
Pubblicazione: (2023)

Language-Independent Representations Improve Zero-Shot Summarization
di: Solovyev, Vladimir, et al.
Pubblicazione: (2024)

mOthello: When Do Cross-Lingual Representation Alignment and Cross-Lingual Transfer Emerge in Multilingual Models?
di: Hua, Tianze, et al.
Pubblicazione: (2024)

CrossIn: An Efficient Instruction Tuning Approach for Cross-Lingual Knowledge Alignment
di: Lin, Geyu, et al.
Pubblicazione: (2024)

How do Multimodal Foundation Models Encode Text and Speech? An Analysis of Cross-Lingual and Cross-Modal Representations
di: Lee, Hyunji, et al.
Pubblicazione: (2024)

When Does Language Transfer Help? Sequential Fine-Tuning for Cross-Lingual Euphemism Detection
di: Sammartino, Julia, et al.
Pubblicazione: (2025)

Soft Prompt Tuning for Cross-Lingual Transfer: When Less is More
di: Philippy, Fred, et al.
Pubblicazione: (2024)

Efficiently Aligned Cross-Lingual Transfer Learning for Conversational Tasks using Prompt-Tuning
di: Tu, Lifu, et al.
Pubblicazione: (2023)

MEXA: Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment
di: Kargaran, Amir Hossein, et al.
Pubblicazione: (2024)

Blending LLMs into Cascaded Speech Translation: KIT's Offline Speech Translation System for IWSLT 2024
di: Koneru, Sai, et al.
Pubblicazione: (2024)

DeFTX: Denoised Sparse Fine-Tuning for Zero-Shot Cross-Lingual Transfer
di: Simon, Sona Elza, et al.
Pubblicazione: (2025)

Layer Swapping for Zero-Shot Cross-Lingual Transfer in Large Language Models
di: Bandarkar, Lucas, et al.
Pubblicazione: (2024)

LiveCLKTBench: Towards Reliable Evaluation of Cross-Lingual Knowledge Transfer in Multilingual LLMs
di: Guo, Pei-Fu, et al.
Pubblicazione: (2025)

Implicit Cross-Lingual Rewarding for Efficient Multilingual Preference Alignment
di: Yang, Wen, et al.
Pubblicazione: (2025)

Untangling Input Language from Reasoning Language: A Diagnostic Framework for Cross-Lingual Moral Alignment in LLMs
di: Li, Nan, et al.
Pubblicazione: (2026)

SDA: Steering-Driven Distribution Alignment for Open LLMs without Fine-Tuning
di: Xia, Wei, et al.
Pubblicazione: (2025)

Do Slides Help? Multi-modal Context for Automatic Transcription of Conference Talks
di: Sinhamahapatra, Supriti, et al.
Pubblicazione: (2025)

In-context Language Learning for Endangered Languages in Speech Recognition
di: Li, Zhaolin, et al.
Pubblicazione: (2025)

Multimodal In-context Learning for ASR of Low-resource Languages
di: Li, Zhaolin, et al.
Pubblicazione: (2026)

LuxInstruct: A Cross-Lingual Instruction Tuning Dataset For Luxembourgish
di: Philippy, Fred, et al.
Pubblicazione: (2025)

CroCo: Cross-Lingual Contrastive Preference Tuning on Self-Generations
di: Zhang, Mike, et al.
Pubblicazione: (2026)

Breaking mBad! Supervised Fine-tuning for Cross-Lingual Detoxification
di: Beniwal, Himanshu, et al.
Pubblicazione: (2025)

SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning
di: Wang, Bin, et al.
Pubblicazione: (2023)

The Unreasonable Effectiveness of Model Merging for Cross-Lingual Transfer in LLMs
di: Bandarkar, Lucas, et al.
Pubblicazione: (2025)

Hierarchical Alignment: Surgical Fine-Tuning via Functional Layer Specialization in Large Language Models
di: Zhang, Yukun, et al.
Pubblicazione: (2025)

CCL-XCoT: An Efficient Cross-Lingual Knowledge Transfer Method for Mitigating Hallucination Generation
di: Zheng, Weihua, et al.
Pubblicazione: (2025)

Cross-Lingual Stability and Bias in Instruction-Tuned Language Models for Humanitarian NLP
di: Nemkova, Poli, et al.
Pubblicazione: (2025)

Identifying the Correlation Between Language Distance and Cross-Lingual Transfer in a Multilingual Representation Space
di: Philippy, Fred, et al.
Pubblicazione: (2023)

TaCo: Enhancing Cross-Lingual Transfer for Low-Resource Languages in LLMs through Translation-Assisted Chain-of-Thought Processes
di: Upadhayay, Bibek, et al.
Pubblicazione: (2023)

Rethinking Cross-lingual Alignment: Balancing Transfer and Cultural Erasure in Multilingual LLMs
di: Han, HyoJung, et al.
Pubblicazione: (2025)

DA-Net: A Disentangled and Adaptive Network for Multi-Source Cross-Lingual Transfer Learning
di: Ge, Ling, et al.
Pubblicazione: (2024)

Code-Switching In-Context Learning for Cross-Lingual Transfer of Large Language Models
di: Yoo, Haneul, et al.
Pubblicazione: (2025)

Event Extraction in Basque: Typologically motivated Cross-Lingual Transfer-Learning Analysis
di: Zubillaga, Mikel, et al.
Pubblicazione: (2024)

Lost in Translation? A Comparative Study on the Cross-Lingual Transfer of Composite Harms
di: Shukla, Vaibhav, et al.
Pubblicazione: (2026)

GradPruner: Gradient-Guided Layer Pruning Enabling Efficient Fine-Tuning and Inference for LLMs
di: Huang, Wei, et al.
Pubblicazione: (2026)

Layer-Wise Evolution of Representations in Fine-Tuned Transformers: Insights from Sparse AutoEncoders
di: Nadipalli, Suneel
Pubblicazione: (2025)

Languages are Modalities: Cross-Lingual Alignment via Encoder Injection
di: Agarwal, Rajan, et al.
Pubblicazione: (2025)

Conditions for Catastrophic Forgetting in Multilingual Translation
di: Liu, Danni, et al.
Pubblicazione: (2025)

When Language Shapes Thought: Cross-Lingual Transfer of Factual Knowledge in Question Answering
di: Kang, Eojin, et al.
Pubblicazione: (2025)

ECLeKTic: a Novel Challenge Set for Evaluation of Cross-Lingual Knowledge Transfer
di: Goldman, Omer, et al.
Pubblicazione: (2025)