Image de couverture de livre

Parameter Importance is Not Static: Evolving Parameter Isolation for Supervised Fine-Tuning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Lin, Zekai, Xue, Chao, Liang, Di, Han, Xingsheng, Liu, Peiyang, Wu, Xianjie, Jiang, Lei, Lu, Yu, Shi, Haibo, Liang, Shuang, Peng, Minlong
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Why Supervised Fine-Tuning Fails to Learn: A Systematic Study of Incomplete Learning in Large Language Models
par: Xue, Chao, et autres
Publié: (2026)

Not All Parameters Are Created Equal: Smart Isolation Boosts Fine-Tuning Performance
par: Wang, Yao, et autres
Publié: (2025)

Reason Only When Needed: Efficient Generative Reward Modeling via Model-Internal Uncertainty
par: Xue, Chao, et autres
Publié: (2026)

DPI: Exploiting Parameter Heterogeneity for Interference-Free Fine-Tuning
par: Liu, Xiaoyu, et autres
Publié: (2026)

TRACE: Discovering Task-Specific Parameter via Adaptation-Aware Probing for Continual Fine-Tuning
par: Han, Xiaosong, et autres
Publié: (2026)

DeCoRL: Decoupling Reasoning Chains via Parallel Sub-Step Generation and Cascaded Reinforcement for Interpretable and Scalable RLHF
par: Gao, Ziyuan, et autres
Publié: (2025)

Analyzing the Effects of Supervised Fine-Tuning on Model Knowledge from Token and Parameter Levels
par: Ye, Junjie, et autres
Publié: (2025)

Adapt Once, Thrive with Updates: Transferable Parameter-Efficient Fine-Tuning on Evolving Base Models
par: Gu, Naibin, et autres
Publié: (2025)

Parameter-Efficient Fine-Tuning with Discrete Fourier Transform
par: Gao, Ziqi, et autres
Publié: (2024)

Parameter-Efficient Fine-Tuning for Foundation Models
par: Zhang, Dan, et autres
Publié: (2025)

Structural Reward Model: Enhancing Interpretability, Efficiency, and Scalability in Reward Modeling
par: Liu, Xiaoyu, et autres
Publié: (2025)

Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey
par: Han, Zeyu, et autres
Publié: (2024)

iPREFER: An Intelligent Parameter Extractor based on Features for BSIM-CMG Models
par: Peng, Zhiliang, et autres
Publié: (2024)

A Comprehensive Evaluation of Parameter-Efficient Fine-Tuning on Code Smell Detection
par: Zhang, Beiqi, et autres
Publié: (2024)

From Parameters to Prompts: Understanding and Mitigating the Factuality Gap between Fine-Tuned LLMs
par: Gong, Xuan, et autres
Publié: (2025)

Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud Learning
par: Liang, Dingkang, et autres
Publié: (2024)

A Survey on Parameter-Efficient Fine-Tuning for Foundation Models in Federated Learning
par: Bian, Jieming, et autres
Publié: (2025)

Position-Aware Parameter Efficient Fine-Tuning Approach for Reducing Positional Bias in LLMs
par: Zhang, Zheng, et autres
Publié: (2024)

Parameter-Efficient Fine-Tuning With Adapters
par: Chen, Keyu, et autres
Publié: (2024)

SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
par: Lu, Xudong, et autres
Publié: (2024)

Parameter-Efficient Fine-Tuning of 3D DDPM for MRI Image Generation Using Tensor Networks
par: Li, Binghua, et autres
Publié: (2025)

DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning
par: Shi, Zhengxiang, et autres
Publié: (2023)

Parameter-Efficient Fine-Tuning for Medical Text Summarization: A Comparative Study of Lora, Prompt Tuning, and Full Fine-Tuning
par: Shernazarov, Ulugbek, et autres
Publié: (2026)

Task-Adaptive Parameter-Efficient Fine-Tuning for Weather Foundation Models
par: Cao, Shilei, et autres
Publié: (2025)

LoCA: Location-Aware Cosine Adaptation for Parameter-Efficient Fine-Tuning
par: Du, Zhekai, et autres
Publié: (2025)

Understanding and Guiding Layer Placement in Parameter-Efficient Fine-Tuning of Large Language Models
par: Xu, Yichen, et autres
Publié: (2026)

DLoRA: Distributed Parameter-Efficient Fine-Tuning Solution for Large Language Model
par: Gao, Chao, et autres
Publié: (2024)

AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning
par: Zhou, Han, et autres
Publié: (2023)

High-Rank Structured Modulation for Parameter-Efficient Fine-Tuning
par: Liu, Yongkang, et autres
Publié: (2026)

Preserving Domain Generalization in Fine-Tuning via Joint Parameter Selection
par: Pan, Bin, et autres
Publié: (2025)

Semantic Hierarchical Prompt Tuning for Parameter-Efficient Fine-Tuning
par: Zhu, Haowei, et autres
Publié: (2024)

Spectrum-Aware Parameter Efficient Fine-Tuning for Diffusion Models
par: Zhang, Xinxi, et autres
Publié: (2024)

VLA-GSE: Boosting Parameter-Efficient Fine-Tuning in VLA with Generalized and Specialized Experts
par: Jiang, Yuhua, et autres
Publié: (2026)

Pin-Tuning: Parameter-Efficient In-Context Tuning for Few-Shot Molecular Property Prediction
par: Wang, Liang, et autres
Publié: (2024)

TriAdaptLoRA: Brain-Inspired Triangular Adaptive Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
par: Liang, Yao, et autres
Publié: (2025)

GateRA: Token-Aware Modulation for Parameter-Efficient Fine-Tuning
par: Ou, Jie, et autres
Publié: (2025)

VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks
par: Li, Yang, et autres
Publié: (2024)

Structure-Learnable Adapter Fine-Tuning for Parameter-Efficient Large Language Models
par: Gong, Ming, et autres
Publié: (2025)

Unlocking Parameter-Efficient Fine-Tuning for Low-Resource Language Translation
par: Su, Tong, et autres
Publié: (2024)

PERFT: Parameter-Efficient Routed Fine-Tuning for Mixture-of-Expert Model
par: Liu, Yilun, et autres
Publié: (2024)