Cover Image

Family Matters: Language Transfer and Merging for Adapting Small LLMs to Faroese

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kunz, Jenny, Debess, Iben Nyholm, Simonsen, Annika
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

FoQA: A Faroese Question-Answering Dataset
by: Simonsen, Annika, et al.
Published: (2025)

The Impact of Language Adapters in Cross-Lingual Transfer for NLU
by: Kunz, Jenny, et al.
Published: (2024)

Train More Parameters But Mind Their Placement: Insights into Language Adaptation with PEFT
by: Kunz, Jenny
Published: (2024)

Preferences for Idiomatic Language are Acquired Slowly -- and Forgotten Quickly: A Case Study on Swedish
by: Kunz, Jenny
Published: (2026)

A Diagnostic Benchmark for Sweden-Related Factual Knowledge
by: Kunz, Jenny
Published: (2025)

Training Models on Dialects of Translationese Shows How Lexical Diversity and Source-Target Syntactic Similarity Shape Learning
by: Kunz, Jenny
Published: (2026)

Grow Up and Merge: Scaling Strategies for Efficient Language Adaptation
by: Glocker, Kevin, et al.
Published: (2025)

How to Tune a Multilingual Encoder Model for Germanic Languages: A Study of PEFT, Full Fine-Tuning, and Language Adapters
by: Oji, Romina, et al.
Published: (2025)

MTA: A Merge-then-Adapt Framework for Personalized Large Language Model
by: Li, Xiaopeng, et al.
Published: (2025)

Adapting Language-Specific LLMs to a Reasoning Model in One Day via Model Merging -- An Open Recipe
by: Pipatanakul, Kunat, et al.
Published: (2025)

A Hypothesis-Driven Framework for the Analysis of Self-Rationalising Models
by: Braun, Marc, et al.
Published: (2024)

Don't Adapt Small Language Models for Tools; Adapt Tool Schemas to the Models
by: Lee, Jonggeun, et al.
Published: (2025)

Probabilistic energy profiler for statically typed JVM-based programming languages
by: Nyholm, Joel, et al.
Published: (2025)

A Dataset for Probing Translationese Preferences in English-to-Swedish Translation
by: Kunz, Jenny, et al.
Published: (2026)

Properties and Challenges of LLM-Generated Explanations
by: Kunz, Jenny, et al.
Published: (2024)

AdaMergeX: Cross-Lingual Transfer with Large Language Models via Adaptive Adapter Merging
by: Zhao, Yiran, et al.
Published: (2024)

Adapting Language Models to Indonesian Local Languages: An Empirical Study of Language Transferability on Zero-Shot Settings
by: Putri, Rifki Afina
Published: (2025)

AdaptMI: Adaptive Skill-based In-context Math Instruction for Small Language Models
by: He, Yinghui, et al.
Published: (2025)

The Unreasonable Effectiveness of Model Merging for Cross-Lingual Transfer in LLMs
by: Bandarkar, Lucas, et al.
Published: (2025)

Rethinking Multilingual Continual Pretraining: Data Mixing for Adapting LLMs Across Languages and Resources
by: Li, Zihao, et al.
Published: (2025)

Adapting Multilingual Models to Code-Mixed Tasks via Model Merging
by: Kodali, Prashant, et al.
Published: (2025)

Domain-Adapted Small Language Models for Reliable Clinical Triage
by: Aljohani, Manar, et al.
Published: (2026)

Improving Transfer Learning for Sequence Labeling Tasks by Adapting Pre-trained Neural Language Models
by: Dukić, David
Published: (2025)

Model Tells You Where to Merge: Adaptive KV Cache Merging for LLMs on Long-Context Tasks
by: Wang, Zheng, et al.
Published: (2024)

1bit-Merging: Dynamic Quantized Merging for Large Language Models
by: Liu, Shuqi, et al.
Published: (2025)

Cross-Linguistic Transfer in Multilingual NLP: The Role of Language Families and Morphology
by: Bankula, Ajitesh, et al.
Published: (2025)

Adapting Small Language Models to Low-Resource Domains: A Case Study in Hindi Tourism QA
by: Majhi, Sandipan, et al.
Published: (2025)

What Matters for Model Merging at Scale?
by: Yadav, Prateek, et al.
Published: (2024)

Sharing Matters: Analysing Neurons Across Languages and Tasks in LLMs
by: Wang, Weixuan, et al.
Published: (2024)

Adapting Psycholinguistic Research for LLMs: Gender-inclusive Language in a Coreference Context
by: Bartl, Marion, et al.
Published: (2025)

Pruning via Merging: Compressing LLMs via Manifold Alignment Based Layer Merging
by: Liu, Deyuan, et al.
Published: (2024)

Adapting Multilingual LLMs to Low-Resource Languages with Knowledge Graphs via Adapters
by: Gurgurov, Daniil, et al.
Published: (2024)

CSIRO-LT at SemEval-2025 Task 11: Adapting LLMs for Emotion Recognition for Multiple Languages
by: Chen, Jiyu, et al.
Published: (2025)

Transferring Textual Preferences to Vision-Language Understanding through Model Merging
by: Li, Chen-An, et al.
Published: (2025)

Information Loss in LLMs' Multilingual Translation: The Role of Training Data, Language Proximity, and Language Family
by: Lin, Yumeng, et al.
Published: (2025)

Efficiently Democratizing Medical LLMs for 50 Languages via a Mixture of Language Family Experts
by: Zheng, Guorui, et al.
Published: (2024)

Thunder-LLM: Efficiently Adapting LLMs to Korean with Minimal Resources
by: Kim, Jinpyo, et al.
Published: (2025)

Vuyko Mistral: Adapting LLMs for Low-Resource Dialectal Translation
by: Kyslyi, Roman, et al.
Published: (2025)

ChipNeMo: Domain-Adapted LLMs for Chip Design
by: Liu, Mingjie, et al.
Published: (2023)

To Adapt or not to Adapt, Rethinking the Value of Medical Knowledge-Aware Large Language Models
by: Domingo-Aldama, Ane G., et al.
Published: (2026)