Image de couverture de livre

Joint Localization and Activation Editing for Low-Resource Fine-Tuning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Lai, Wen, Fraser, Alexander, Titov, Ivan
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language Artificial Intelligence Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Blending Supervised and Reinforcement Fine-Tuning with Prefix Sampling
par: Huang, Zeyu, et autres
Publié: (2025)

Model Editing by Standard Fine-Tuning
par: Gangadhar, Govind, et autres
Publié: (2024)

What's New in My Data? Novelty Exploration via Contrastive Generation
par: Isonuma, Masaru, et autres
Publié: (2024)

Localized LoRA: A Structured Low-Rank Approximation for Efficient Fine-Tuning
par: Barazandeh, Babak, et autres
Publié: (2025)

Evaluating Fine-Tuned LLM Model For Medical Transcription With Small Low-Resource Languages Validated Dataset
par: Chowdhury, Mohammed Nowshad Ruhani, et autres
Publié: (2026)

Shared Doubt: Zero-shot Cross-Lingual Confidence Estimation for Language Models
par: Kyriakou, Athina, et autres
Publié: (2026)

IA2: Alignment with ICL Activations Improves Supervised Fine-Tuning
par: Mishra, Aayush, et autres
Publié: (2025)

Parameter-Efficient Fine-Tuning for Low-Resource Languages: A Comparative Study of LLMs for Bengali Hate Speech Detection
par: Islam, Akif, et autres
Publié: (2025)

Bridging the Gap: Enhancing LLM Performance for Low-Resource African Languages with New Benchmarks, Fine-Tuning, and Cultural Adjustments
par: Alhanai, Tuka, et autres
Publié: (2024)

NeuroAda: Activating Each Neuron's Potential for Parameter-Efficient Fine-Tuning
par: Zhang, Zhi, et autres
Publié: (2025)

Scaling Sparse Fine-Tuning to Large Language Models
par: Ansell, Alan, et autres
Publié: (2024)

Finding Culture-Sensitive Neurons in Vision-Language Models
par: Zhao, Xiutian, et autres
Publié: (2025)

SAKE: Steering Activations for Knowledge Editing
par: Scialanga, Marco, et autres
Publié: (2025)

AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning
par: Zhou, Han, et autres
Publié: (2023)

BEFT: Bias-Efficient Fine-Tuning of Language Models in Low-Data Regimes
par: Huang, Baichuan, et autres
Publié: (2025)

Fine-Tune an SLM or Prompt an LLM? The Case of Generating Low-Code Workflows
par: Ayala, Orlando Marquez, et autres
Publié: (2025)

Amplifying, Not Learning: Fine-Tuned AI Text Detectors Amplify a Pretrained Direction
par: Smirnov, Alexander
Publié: (2026)

An Efficient Sparse Fine-Tuning with Low Quantization Error via Neural Network Pruning
par: Li, Cen-Jhih, et autres
Publié: (2025)

Proximal Supervised Fine-Tuning
par: Zhu, Wenhong, et autres
Publié: (2025)

Reinforcement Fine-Tuning Naturally Mitigates Forgetting in Continual Post-Training
par: Lai, Song, et autres
Publié: (2025)

Spectral Editing of Activations for Large Language Model Alignment
par: Qiu, Yifu, et autres
Publié: (2024)

LaMDA: Large Model Fine-Tuning via Spectrally Decomposed Low-Dimensional Adaptation
par: Azizi, Seyedarmin, et autres
Publié: (2024)

MatryoshkaLoRA: Learning Accurate Hierarchical Low-Rank Representations for LLM Fine-Tuning
par: Modoranu, Ionut-Vlad, et autres
Publié: (2026)

Activation Oracles: Training and Evaluating LLMs as General-Purpose Activation Explainers
par: Karvonen, Adam, et autres
Publié: (2025)

Scalpel vs. Hammer: GRPO Amplifies Existing Capabilities, SFT Replaces Them
par: Rajani, Neel, et autres
Publié: (2025)

LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
par: Yang, Yifan, et autres
Publié: (2024)

MURI: High-Quality Instruction Tuning Datasets for Low-Resource Languages via Reverse Instructions
par: Köksal, Abdullatif, et autres
Publié: (2024)

FedALT: Federated Fine-Tuning through Adaptive Local Training with Rest-of-World LoRA
par: Bian, Jieming, et autres
Publié: (2025)

Initialization using Update Approximation is a Silver Bullet for Extremely Efficient Low-Rank Fine-Tuning
par: Ponkshe, Kaustubh, et autres
Publié: (2024)

AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models
par: Liu, Zeyu, et autres
Publié: (2024)

Order-Independence Without Fine Tuning
par: McIlroy-Young, Reid, et autres
Publié: (2024)

Team Trifecta at Factify5WQA: Setting the Standard in Fact Verification with Fine-Tuning
par: Chiang, Shang-Hsuan, et autres
Publié: (2024)

Efficient Model Editing with Task-Localized Sparse Fine-tuning
par: Iurada, Leonardo, et autres
Publié: (2025)

Parameter-Efficient Fine-Tuning for Foundation Models
par: Zhang, Dan, et autres
Publié: (2025)

Supervised Fine-Tuning as Inverse Reinforcement Learning
par: Sun, Hao
Publié: (2024)

Boosting Large Language Models with Mask Fine-Tuning
par: Zhang, Mingyuan, et autres
Publié: (2025)

Teaching LLMs How to Learn with Contextual Fine-Tuning
par: Choi, Younwoo, et autres
Publié: (2025)

Fine-Tuning and Evaluating Conversational AI for Agricultural Advisory
par: Singh, Sanyam, et autres
Publié: (2026)

Parameter-Efficient Fine-Tuning with Discrete Fourier Transform
par: Gao, Ziqi, et autres
Publié: (2024)

ROSA: Random Subspace Adaptation for Efficient Fine-Tuning
par: Hameed, Marawan Gamal Abdel, et autres
Publié: (2024)