Imagen de Portada

Parameter Importance is Not Static: Evolving Parameter Isolation for Supervised Fine-Tuning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Lin, Zekai, Xue, Chao, Liang, Di, Han, Xingsheng, Liu, Peiyang, Wu, Xianjie, Jiang, Lei, Lu, Yu, Shi, Haibo, Liang, Shuang, Peng, Minlong
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Why Supervised Fine-Tuning Fails to Learn: A Systematic Study of Incomplete Learning in Large Language Models
por: Xue, Chao, et al.
Publicado: (2026)

Not All Parameters Are Created Equal: Smart Isolation Boosts Fine-Tuning Performance
por: Wang, Yao, et al.
Publicado: (2025)

Reason Only When Needed: Efficient Generative Reward Modeling via Model-Internal Uncertainty
por: Xue, Chao, et al.
Publicado: (2026)

DPI: Exploiting Parameter Heterogeneity for Interference-Free Fine-Tuning
por: Liu, Xiaoyu, et al.
Publicado: (2026)

TRACE: Discovering Task-Specific Parameter via Adaptation-Aware Probing for Continual Fine-Tuning
por: Han, Xiaosong, et al.
Publicado: (2026)

DeCoRL: Decoupling Reasoning Chains via Parallel Sub-Step Generation and Cascaded Reinforcement for Interpretable and Scalable RLHF
por: Gao, Ziyuan, et al.
Publicado: (2025)

Analyzing the Effects of Supervised Fine-Tuning on Model Knowledge from Token and Parameter Levels
por: Ye, Junjie, et al.
Publicado: (2025)

Adapt Once, Thrive with Updates: Transferable Parameter-Efficient Fine-Tuning on Evolving Base Models
por: Gu, Naibin, et al.
Publicado: (2025)

Parameter-Efficient Fine-Tuning with Discrete Fourier Transform
por: Gao, Ziqi, et al.
Publicado: (2024)

Parameter-Efficient Fine-Tuning for Foundation Models
por: Zhang, Dan, et al.
Publicado: (2025)

Structural Reward Model: Enhancing Interpretability, Efficiency, and Scalability in Reward Modeling
por: Liu, Xiaoyu, et al.
Publicado: (2025)

Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey
por: Han, Zeyu, et al.
Publicado: (2024)

iPREFER: An Intelligent Parameter Extractor based on Features for BSIM-CMG Models
por: Peng, Zhiliang, et al.
Publicado: (2024)

A Comprehensive Evaluation of Parameter-Efficient Fine-Tuning on Code Smell Detection
por: Zhang, Beiqi, et al.
Publicado: (2024)

From Parameters to Prompts: Understanding and Mitigating the Factuality Gap between Fine-Tuned LLMs
por: Gong, Xuan, et al.
Publicado: (2025)

Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud Learning
por: Liang, Dingkang, et al.
Publicado: (2024)

A Survey on Parameter-Efficient Fine-Tuning for Foundation Models in Federated Learning
por: Bian, Jieming, et al.
Publicado: (2025)

Position-Aware Parameter Efficient Fine-Tuning Approach for Reducing Positional Bias in LLMs
por: Zhang, Zheng, et al.
Publicado: (2024)

Parameter-Efficient Fine-Tuning With Adapters
por: Chen, Keyu, et al.
Publicado: (2024)

SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
por: Lu, Xudong, et al.
Publicado: (2024)

Parameter-Efficient Fine-Tuning of 3D DDPM for MRI Image Generation Using Tensor Networks
por: Li, Binghua, et al.
Publicado: (2025)

DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning
por: Shi, Zhengxiang, et al.
Publicado: (2023)

Parameter-Efficient Fine-Tuning for Medical Text Summarization: A Comparative Study of Lora, Prompt Tuning, and Full Fine-Tuning
por: Shernazarov, Ulugbek, et al.
Publicado: (2026)

Task-Adaptive Parameter-Efficient Fine-Tuning for Weather Foundation Models
por: Cao, Shilei, et al.
Publicado: (2025)

LoCA: Location-Aware Cosine Adaptation for Parameter-Efficient Fine-Tuning
por: Du, Zhekai, et al.
Publicado: (2025)

Understanding and Guiding Layer Placement in Parameter-Efficient Fine-Tuning of Large Language Models
por: Xu, Yichen, et al.
Publicado: (2026)

DLoRA: Distributed Parameter-Efficient Fine-Tuning Solution for Large Language Model
por: Gao, Chao, et al.
Publicado: (2024)

AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning
por: Zhou, Han, et al.
Publicado: (2023)

High-Rank Structured Modulation for Parameter-Efficient Fine-Tuning
por: Liu, Yongkang, et al.
Publicado: (2026)

Preserving Domain Generalization in Fine-Tuning via Joint Parameter Selection
por: Pan, Bin, et al.
Publicado: (2025)

Semantic Hierarchical Prompt Tuning for Parameter-Efficient Fine-Tuning
por: Zhu, Haowei, et al.
Publicado: (2024)

Spectrum-Aware Parameter Efficient Fine-Tuning for Diffusion Models
por: Zhang, Xinxi, et al.
Publicado: (2024)

VLA-GSE: Boosting Parameter-Efficient Fine-Tuning in VLA with Generalized and Specialized Experts
por: Jiang, Yuhua, et al.
Publicado: (2026)

Pin-Tuning: Parameter-Efficient In-Context Tuning for Few-Shot Molecular Property Prediction
por: Wang, Liang, et al.
Publicado: (2024)

TriAdaptLoRA: Brain-Inspired Triangular Adaptive Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
por: Liang, Yao, et al.
Publicado: (2025)

GateRA: Token-Aware Modulation for Parameter-Efficient Fine-Tuning
por: Ou, Jie, et al.
Publicado: (2025)

VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks
por: Li, Yang, et al.
Publicado: (2024)

Structure-Learnable Adapter Fine-Tuning for Parameter-Efficient Large Language Models
por: Gong, Ming, et al.
Publicado: (2025)

Unlocking Parameter-Efficient Fine-Tuning for Low-Resource Language Translation
por: Su, Tong, et al.
Publicado: (2024)

PERFT: Parameter-Efficient Routed Fine-Tuning for Mixture-of-Expert Model
por: Liu, Yilun, et al.
Publicado: (2024)