Imagen de Portada

Train More Parameters But Mind Their Placement: Insights into Language Adaptation with PEFT

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Kunz, Jenny
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

How to Tune a Multilingual Encoder Model for Germanic Languages: A Study of PEFT, Full Fine-Tuning, and Language Adapters
por: Oji, Romina, et al.
Publicado: (2025)

Training Models on Dialects of Translationese Shows How Lexical Diversity and Source-Target Syntactic Similarity Shape Learning
por: Kunz, Jenny
Publicado: (2026)

Preferences for Idiomatic Language are Acquired Slowly -- and Forgotten Quickly: A Case Study on Swedish
por: Kunz, Jenny
Publicado: (2026)

PEFT-Factory: Unified Parameter-Efficient Fine-Tuning of Autoregressive Large Language Models
por: Belanec, Robert, et al.
Publicado: (2025)

The Impact of Language Adapters in Cross-Lingual Transfer for NLU
por: Kunz, Jenny, et al.
Publicado: (2024)

A Diagnostic Benchmark for Sweden-Related Factual Knowledge
por: Kunz, Jenny
Publicado: (2025)

PEFT for Speech: Unveiling Optimal Placement, Merging Strategies, and Ensemble Techniques
por: Lin, Tzu-Han, et al.
Publicado: (2024)

PEFT-Bench: A Parameter-Efficient Fine-Tuning Methods Benchmark
por: Belanec, Robert, et al.
Publicado: (2025)

PEFT-U: Parameter-Efficient Fine-Tuning for User Personalization
por: Clarke, Christopher, et al.
Publicado: (2024)

ShadowPEFT: Shadow Network for Parameter-Efficient Fine-Tuning
por: Li, Xianming, et al.
Publicado: (2026)

On the Scaling of PEFT: Towards Million Personal Models of Trillion Parameters
por: Lab, Mind, et al.
Publicado: (2026)

Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning
por: Gu, Naibin, et al.
Publicado: (2024)

PEFT A2Z: Parameter-Efficient Fine-Tuning Survey for Large Language and Vision Models
por: Prottasha, Nusrat Jahan, et al.
Publicado: (2025)

Hybrid and Unitary PEFT for Resource-Efficient Large Language Models
por: Qi, Haomin, et al.
Publicado: (2025)

A Hypothesis-Driven Framework for the Analysis of Self-Rationalising Models
por: Braun, Marc, et al.
Publicado: (2024)

Not How Many, But Which: Parameter Placement in Low-Rank Adaptation
por: Sehanobish, Arijit, et al.
Publicado: (2026)

Grow Up and Merge: Scaling Strategies for Efficient Language Adaptation
por: Glocker, Kevin, et al.
Publicado: (2025)

TS-PEFT: Unveiling Token-Level Redundancy in Parameter-Efficient Fine-Tuning
por: Ma, Dabiao, et al.
Publicado: (2025)

MambaPEFT: Exploring Parameter-Efficient Fine-Tuning for Mamba
por: Yoshimura, Masakazu, et al.
Publicado: (2024)

Family Matters: Language Transfer and Merging for Adapting Small LLMs to Faroese
por: Kunz, Jenny, et al.
Publicado: (2025)

AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning
por: Zhou, Han, et al.
Publicado: (2023)

PEFT-Arena: Understanding Parameter-Efficient Finetuning from a Stability-Plasticity Perspective
por: Huang, Yangyi, et al.
Publicado: (2026)

ComPEFT: Compression for Communicating Parameter Efficient Updates via Sparsification and Quantization
por: Yadav, Prateek, et al.
Publicado: (2023)

Q-PEFT: Query-dependent Parameter Efficient Fine-tuning for Text Reranking with Large Language Models
por: Peng, Zhiyuan, et al.
Publicado: (2024)

A Dataset for Probing Translationese Preferences in English-to-Swedish Translation
por: Kunz, Jenny, et al.
Publicado: (2026)

FISH-Tuning: Enhancing PEFT Methods with Fisher Information
por: Xue, Kang, et al.
Publicado: (2025)

Properties and Challenges of LLM-Generated Explanations
por: Kunz, Jenny, et al.
Publicado: (2024)

X-PEFT: eXtremely Parameter-Efficient Fine-Tuning for Extreme Multi-Profile Scenarios
por: Kwak, Namju, et al.
Publicado: (2024)

Finer Parameter Steps for Low-Rank PEFT: A Controlled Study with CP Tensor Adapters
por: Wang, Xinjue, et al.
Publicado: (2026)

Challenges in Adapting Multilingual LLMs to Low-Resource Languages using LoRA PEFT Tuning
por: Khade, Omkar, et al.
Publicado: (2024)

Enhancing Low-Resource LLMs Classification with PEFT and Synthetic Data
por: Patwa, Parth, et al.
Publicado: (2024)

Dependency Parsing is More Parameter-Efficient with Normalization
por: Gajo, Paolo, et al.
Publicado: (2025)

COMPASS: COntinual Multilingual PEFT with Adaptive Semantic Sampling
por: Flynn, Noah
Publicado: (2026)

Lil-Bevo: Explorations of Strategies for Training Language Models in More Humanlike Ways
por: Govindarajan, Venkata S, et al.
Publicado: (2023)

From Text to Emoji: How PEFT-Driven Personality Manipulation Unleashes the Emoji Potential in LLMs
por: Jain, Navya, et al.
Publicado: (2024)

Output Composability of QLoRA PEFT Modules for Plug-and-Play Attribute-Controlled Text Generation
por: Lorandi, Michela, et al.
Publicado: (2026)

Mind the Motions: Benchmarking Theory-of-Mind in Everyday Body Language
por: Lee, Seungbeen, et al.
Publicado: (2025)

Is Less More? Exploring Token Condensation as Training-free Test-time Adaptation
por: Wang, Zixin, et al.
Publicado: (2024)

FedP$^2$EFT: Federated Learning to Personalize PEFT for Multilingual LLMs
por: Lee, Royson, et al.
Publicado: (2025)

Advantageous Parameter Expansion Training Makes Better Large Language Models
por: Gu, Naibin, et al.
Publicado: (2025)