Neural Parameter Search for Slimmer Fine-Tuned Models and Better Transfer

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Du, Guodong, Fang, Zitao, Li, Jing, Li, Junlin, Jiang, Runhua, Yu, Shuyang, Guo, Yifei, Chen, Yangneng, Goh, Sim Kuan, Tang, Ho-Kin, He, Daojing, Liu, Honghai, Zhang, Min
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Parameter Competition Balancing for Model Merging
by: Du, Guodong, et al.
Published: (2024)

CADE: Cosine Annealing Differential Evolution for Spiking Neural Network
by: Jiang, Runhua, et al.
Published: (2024)

Knowledge Fusion By Evolving Weights of Language Models
by: Du, Guodong, et al.
Published: (2024)

To See a World in a Spark of Neuron: Disentangling Multi-task Interference for Training-free Model Merging
by: Fang, Zitao, et al.
Published: (2025)

Multi-Modality Expansion and Retention for LLMs through Parameter Merging and Decoupling
by: Li, Junlin, et al.
Published: (2025)

Evolutionary Neural Architecture Search for 3D Point Cloud Analysis
by: Yang, Yisheng, et al.
Published: (2024)

Impacts of Darwinian Evolution on Pre-trained Deep Neural Networks
by: Du, Guodong, et al.
Published: (2024)

NeurIPT: Foundation Model for Neural Interfaces
by: Fang, Zitao, et al.
Published: (2025)

Vocabulary Hijacking in LVLMs: Unveiling Critical Attention Heads by Excluding Inert Tokens to Mitigate Hallucination
by: Chen, Yangneng, et al.
Published: (2026)

Language Bias in LVLMs: From In-Depth Analysis to Simple and Effective Mitigation
by: Chen, Yangneng, et al.
Published: (2026)

Meta-heuristic Optimizer Inspired by the Philosophy of Yi Jing
by: Yang, Yisheng, et al.
Published: (2024)

Slimmer Geminals For Accurate F12 Electronic Structure Models
by: Powell, Samuel R., et al.
Published: (2025)

One Model Transfer to All: On Robust Jailbreak Prompts Generation against LLMs
by: Li, Linbao, et al.
Published: (2025)

KALIE: Fine-Tuning Vision-Language Models for Open-World Manipulation without Robot Data
by: Tang, Grace, et al.
Published: (2024)

LoCA: Location-Aware Cosine Adaptation for Parameter-Efficient Fine-Tuning
by: Du, Zhekai, et al.
Published: (2025)

HiFT: A Hierarchical Full Parameter Fine-Tuning Strategy
by: Liu, Yongkang, et al.
Published: (2024)

Knowledge Fusion of Large Language Models Via Modular SkillPacks
by: Du, Guodong, et al.
Published: (2025)

Supervised Fine-Tuning or Contrastive Learning? Towards Better Multimodal LLM Reranking
by: Dai, Ziqi, et al.
Published: (2025)

Reward Sharpness-Aware Fine-Tuning for Diffusion Models
by: Kim, Kwanyoung, et al.
Published: (2026)

Less but Better: Parameter-Efficient Fine-Tuning of Large Language Models for Personality Detection
by: Shen, Lingzhi, et al.
Published: (2025)

FRoD: Full-Rank Efficient Fine-Tuning with Rotational Degrees for Fast Convergence
by: Wan, Guoan, et al.
Published: (2025)

How Does Fine-Tuning Impact Out-of-Distribution Detection for Vision-Language Models?
by: Ming, Yifei, et al.
Published: (2023)

AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning
by: Zhou, Han, et al.
Published: (2023)

GIFT: Guided Fine-Tuning and Transfer for Enhancing Instruction-Tuned Language Models
by: Ruan, Zhiwen, et al.
Published: (2026)

ShadowPEFT: Shadow Network for Parameter-Efficient Fine-Tuning
by: Li, Xianming, et al.
Published: (2026)

TsqLoRA: Towards Sensitivity and Quality Low-Rank Adaptation for Efficient Fine-Tuning
by: Chen, Yu, et al.
Published: (2025)

Sparse MeZO: Less Parameters for Better Performance in Zeroth-Order LLM Fine-Tuning
by: Liu, Yong, et al.
Published: (2024)

SIBO: A Simple Booster for Parameter-Efficient Fine-Tuning
by: Wen, Zhihao, et al.
Published: (2024)

Parameter-Efficient Fine-Tuning via Circular Convolution
by: Chen, Aochuan, et al.
Published: (2024)

FTFT: Efficient and Robust Fine-Tuning by Transferring Training Dynamics
by: Du, Yupei, et al.
Published: (2023)

Two Heads Are Better Than One: Averaging along Fine-Tuning to Improve Targeted Transferability
by: Zeng, Hui, et al.
Published: (2024)

TuneShift-KD: Knowledge Distillation and Transfer for Fine-tuned Models
by: Guan, Yushi, et al.
Published: (2026)

Mixed Text Recognition with Efficient Parameter Fine-Tuning and Transformer
by: Chang, Da, et al.
Published: (2024)

ReFineVLA: Reasoning-Aware Teacher-Guided Transfer Fine-Tuning
by: Van Vo, Tuan, et al.
Published: (2025)

In-Context Learning Distillation for Efficient Few-Shot Fine-Tuning
by: Duan, Yifei, et al.
Published: (2024)

STEPS: A Temporal Smooth Error Propagation Solver on the Manifolds for Test-Time Adaptation in Time Series Forecasting
by: Liu, Jiaqi, et al.
Published: (2026)

Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Models
by: Fang, Zihan, et al.
Published: (2024)

Detecting Voice Phishing with Precision: Fine-Tuning Small Language Models
by: Sim, Ju Yong, et al.
Published: (2025)

Donors and Recipients: On Asymmetric Transfer Across Tasks and Languages with Parameter-Efficient Fine-Tuning
by: Dymkiewicz, Kajetan, et al.
Published: (2025)

Parameter-Efficient Fine-Tuning with Discrete Fourier Transform
by: Gao, Ziqi, et al.
Published: (2024)