Cover Image

Gradient Projection For Continual Parameter-Efficient Tuning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Qiao, Jingyang, Zhang, Zhizhong, Tan, Xin, Qu, Yanyun, Zhang, Wensheng, Han, Zhi, Xie, Yuan
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Continual-NExT: A Unified Comprehension And Generation Continual Learning Framework
by: Qiao, Jingyang, et al.
Published: (2026)

Large Continual Instruction Assistant
by: Qiao, Jingyang, et al.
Published: (2024)

T2S: Tokenized Skill Scaling for Lifelong Imitation Learning
by: Zhang, Hongquan, et al.
Published: (2025)

HiDe-PET: Continual Learning via Hierarchical Decomposition of Parameter-Efficient Tuning
by: Wang, Liyuan, et al.
Published: (2024)

DiPO: Disentangled Perplexity Policy Optimization for Fine-grained Exploration-Exploitation Trade-Off
by: Li, Xiaofan, et al.
Published: (2026)

Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey
by: Han, Zeyu, et al.
Published: (2024)

FuRA: Full-Rank Parameter-Efficient Fine-Tuning with Spectral Preconditioning
by: Zhao, Yequan, et al.
Published: (2026)

IPGO: Indirect Prompt Gradient Optimization for Parameter-Efficient Prompt-level Fine-Tuning on Text-to-Image Models
by: Ye, Jianping, et al.
Published: (2025)

Exploring the Untouched Sweeps for Conflict-Aware 3D Segmentation Pretraining
by: Sun, Tianfang, et al.
Published: (2024)

Beyond the Label Itself: Latent Labels Enhance Semi-supervised Point Cloud Panoptic Segmentation
by: Chen, Yujun, et al.
Published: (2023)

Sparse Orthogonal Parameters Tuning for Continual Learning
by: Ning, Kun-Peng, et al.
Published: (2024)

Parameter-Efficient Continual Fine-Tuning: A Survey
by: Coleman, Eric Nuertey, et al.
Published: (2025)

Plug-and-Play Parameter-Efficient Tuning of Embeddings for Federated Recommendation
by: Yuan, Haochen, et al.
Published: (2025)

NeuroAda: Activating Each Neuron's Potential for Parameter-Efficient Fine-Tuning
by: Zhang, Zhi, et al.
Published: (2025)

PiCa: Parameter-Efficient Fine-Tuning with Column Space Projection
by: Hwang, Junseo, et al.
Published: (2025)

Parameter-Efficient Fine-Tuning for Continual Learning: A Neural Tangent Kernel Perspective
by: Liu, Jingren, et al.
Published: (2024)

Continual Gradient Low-Rank Projection Fine-Tuning for LLMs
by: Wang, Chenxu, et al.
Published: (2025)

Muon-OGD: Muon-based Spectral Orthogonal Gradient Projection for LLM Continual Learning
by: Lu, Binghang, et al.
Published: (2026)

TreeLoRA: Efficient Continual Learning via Layer-Wise LoRAs Guided by a Hierarchical Gradient-Similarity Tree
by: Qian, Yu-Yang, et al.
Published: (2025)

COAP: Memory-Efficient Training with Correlation-Aware Gradient Projection
by: Xiao, Jinqi, et al.
Published: (2024)

Policy Gradient with Adaptive Entropy Annealing for Continual Fine-Tuning
by: Zhang, Yaqian, et al.
Published: (2026)

NaviMaster: Learning a Unified Policy for GUI and Embodied Navigation Tasks
by: Luo, Zhihao, et al.
Published: (2025)

Optimizing Specific and Shared Parameters for Efficient Parameter Tuning
by: Nguyen, Van-Anh, et al.
Published: (2025)

SAFE: Slow and Fast Parameter-Efficient Tuning for Continual Learning with Pre-Trained Models
by: Zhao, Linglan, et al.
Published: (2024)

Building a Strong Pre-Training Baseline for Universal 3D Large-Scale Perception
by: Chen, Haoming, et al.
Published: (2024)

Gradient Inversion Attacks on Parameter-Efficient Fine-Tuning
by: Sami, Hasin Us, et al.
Published: (2025)

Towards Fast LLM Fine-tuning through Zeroth-Order Optimization with Projected Gradient-Aligned Perturbations
by: Mi, Zhendong, et al.
Published: (2025)

SAN: Hypothesizing Long-Term Synaptic Development and Neural Engram Mechanism in Scalable Model's Parameter-Efficient Fine-Tuning
by: Dai, Gaole, et al.
Published: (2024)

Vision-language models lag human performance on physical dynamics and intent reasoning
by: Gu, Tianjun, et al.
Published: (2026)

Parameter-Efficient Fine-Tuning for Foundation Models
by: Zhang, Dan, et al.
Published: (2025)

DropLoRA: Sparse Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
by: Zhang, Haojie
Published: (2025)

F-Adapter: Frequency-Adaptive Parameter-Efficient Fine-Tuning in Scientific Machine Learning
by: Zhang, Hangwei, et al.
Published: (2025)

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
by: Zhao, Jiawei, et al.
Published: (2024)

COTR: Compact Occupancy TRansformer for Vision-based 3D Occupancy Prediction
by: Ma, Qihang, et al.
Published: (2023)

Transformers Efficiently Perform In-Context Logistic Regression via Normalized Gradient Descent
by: Zhang, Chenyang, et al.
Published: (2026)

Spectrum-Aware Parameter Efficient Fine-Tuning for Diffusion Models
by: Zhang, Xinxi, et al.
Published: (2024)

GenFT: A Generative Parameter-Efficient Fine-Tuning Method for Pretrained Foundation Models
by: Zhang, Baoquan, et al.
Published: (2025)

MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
by: Jiang, Ting, et al.
Published: (2024)

Efficient Utility-Preserving Machine Unlearning with Implicit Gradient Surgery
by: Zhou, Shiji, et al.
Published: (2025)

Parameter-Efficient Fine-Tuning with Circulant and Diagonal Vectors
by: Ding, Xinyu, et al.
Published: (2025)