Cover Image

Meta-Learning Hyperparameters for Parameter Efficient Fine-Tuning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tian, Zichen, Liu, Yaoyao, Sun, Qianru
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Scalable Multi-Task Low-Rank Model Adaptation
by: Tian, Zichen, et al.
Published: (2026)

Using Sequential Statistical Tests for Efficient Hyperparameter Tuning
by: Buczak, Philip, et al.
Published: (2021)

Efficient Hyperparameter Tuning via Trajectory Invariance Principle
by: Li, Bingrui, et al.
Published: (2025)

Parameter-Efficient Fine-Tuning with Circulant and Diagonal Vectors
by: Ding, Xinyu, et al.
Published: (2025)

Parameter-Efficient Fine-Tuning via Circular Convolution
by: Chen, Aochuan, et al.
Published: (2024)

Parameter-Efficient Continual Fine-Tuning: A Survey
by: Coleman, Eric Nuertey, et al.
Published: (2025)

Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey
by: Han, Zeyu, et al.
Published: (2024)

Exploring Parameter-Efficient Fine-Tuning to Enable Foundation Models in Federated Learning
by: Sun, Guangyu, et al.
Published: (2022)

MetaTT: A Global Tensor-Train Adapter for Parameter-Efficient Fine-Tuning
by: Lopez-Piqueres, Javier, et al.
Published: (2025)

Task-Adaptive Parameter-Efficient Fine-Tuning for Weather Foundation Models
by: Cao, Shilei, et al.
Published: (2025)

Memba: Membrane-driven Parameter-Efficient Fine-Tuning for Mamba
by: Lee, Donghyun, et al.
Published: (2025)

F-Adapter: Frequency-Adaptive Parameter-Efficient Fine-Tuning in Scientific Machine Learning
by: Zhang, Hangwei, et al.
Published: (2025)

Bilevel ZOFO: Efficient LLM Fine-Tuning and Meta-Training
by: Shirkavand, Reza, et al.
Published: (2025)

Parameter-Efficient Fine-Tuning for Continual Learning: A Neural Tangent Kernel Perspective
by: Liu, Jingren, et al.
Published: (2024)

Parameter-Efficient Fine-Tuning with Discrete Fourier Transform
by: Gao, Ziqi, et al.
Published: (2024)

Parameter-Efficient Fine-Tuning of State Space Models
by: Galim, Kevin, et al.
Published: (2024)

Parameter-Efficient Fine-Tuning for Foundation Models
by: Zhang, Dan, et al.
Published: (2025)

MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
by: Jiang, Ting, et al.
Published: (2024)

A Survey on Parameter-Efficient Fine-Tuning for Foundation Models in Federated Learning
by: Bian, Jieming, et al.
Published: (2025)

Cost-Sensitive Freeze-thaw Bayesian Optimization for Efficient Hyperparameter Tuning
by: Lee, Dong Bok, et al.
Published: (2025)

PLoRA: Efficient LoRA Hyperparameter Tuning for Large Models
by: Yan, Minghao, et al.
Published: (2025)

LoRAFusion: Efficient LoRA Fine-Tuning for LLMs
by: Zhu, Zhanda, et al.
Published: (2025)

Generative Bayesian Hyperparameter Tuning
by: Lopes, Hedibert, et al.
Published: (2025)

PERFT: Parameter-Efficient Routed Fine-Tuning for Mixture-of-Expert Model
by: Liu, Yilun, et al.
Published: (2024)

State-offset Tuning: State-based Parameter-Efficient Fine-Tuning for State Space Models
by: Kang, Wonjun, et al.
Published: (2025)

SMoA: Spectrum Modulation Adapter for Parameter-Efficient Fine-Tuning
by: Liu, Yongkang, et al.
Published: (2026)

Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning
by: Wang, Yiran, et al.
Published: (2024)

Certified PEFTSmoothing: Parameter-Efficient Fine-Tuning with Randomized Smoothing
by: Fu, Chengyan, et al.
Published: (2024)

Parameter-Efficient Fine-Tuning of LLaMA for the Clinical Domain
by: Gema, Aryo Pradipta, et al.
Published: (2023)

FuRA: Full-Rank Parameter-Efficient Fine-Tuning with Spectral Preconditioning
by: Zhao, Yequan, et al.
Published: (2026)

On Catastrophic Forgetting in Low-Rank Decomposition-Based Parameter-Efficient Fine-Tuning
by: Ahmad, Muhammad, et al.
Published: (2026)

BoHA: Blockwise Hadamard Product Adaptation for Parameter-Efficient Fine-Tuning
by: Yu, Feng, et al.
Published: (2025)

Towards Scalable Exact Machine Unlearning Using Parameter-Efficient Fine-Tuning
by: Chowdhury, Somnath Basu Roy, et al.
Published: (2024)

SVFT: Parameter-Efficient Fine-Tuning with Singular Vectors
by: Lingam, Vijay, et al.
Published: (2024)

Meta SAC-Lag: Towards Deployable Safe Reinforcement Learning via MetaGradient-based Hyperparameter Tuning
by: Honari, Homayoun, et al.
Published: (2024)

Bayesian Parameter-Efficient Fine-Tuning for Overcoming Catastrophic Forgetting
by: Chen, Haolin, et al.
Published: (2024)

A Comparative Study of Hyperparameter Tuning Methods
by: Dasgupta, Subhasis, et al.
Published: (2024)

Hyperparameter Tuning Through Pessimistic Bilevel Optimization
by: Ustun, Meltem Apaydin, et al.
Published: (2024)

Sparse Orthogonal Parameters Tuning for Continual Learning
by: Ning, Kun-Peng, et al.
Published: (2024)

PiCa: Parameter-Efficient Fine-Tuning with Column Space Projection
by: Hwang, Junseo, et al.
Published: (2025)