Cover Image

Generalized Tensor-based Parameter-Efficient Fine-Tuning via Lie Group Transformations

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Si, Chongjie, Shi, Zhiyi, Wang, Xuehui, Xiao, Yichen, Yang, Xiaokang, Shen, Wei
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Task-Specific Directions: Definition, Exploration, and Utilization in Parameter Efficient Fine-Tuning
by: Si, Chongjie, et al.
Published: (2024)

See Further for Parameter Efficient Fine-tuning by Standing on the Shoulders of Decomposition
by: Si, Chongjie, et al.
Published: (2024)

Appeal: Allow Mislabeled Samples the Chance to be Rectified in Partial Label Learning
by: Si, Chongjie, et al.
Published: (2023)

MAP: Revisiting Weight Decomposition for Low-Rank Adaptation
by: Si, Chongjie, et al.
Published: (2025)

Revisiting Sparsity Constraint Under High-Rank Property in Partial Multi-Label Learning
by: Si, Chongjie, et al.
Published: (2025)

Why Can Accurate Models Be Learned from Inaccurate Annotations?
by: Si, Chongjie, et al.
Published: (2025)

Weight Spectra Induced Efficient Model Adaptation
by: Si, Chongjie, et al.
Published: (2025)

Maintaining Structural Integrity in Parameter Spaces for Parameter Efficient Fine-tuning
by: Si, Chongjie, et al.
Published: (2024)

Tendency-driven Mutual Exclusivity for Weakly Supervised Incremental Semantic Segmentation
by: Si, Chongjie, et al.
Published: (2024)

AdaMuon: Adaptive Muon Optimizer
by: Si, Chongjie, et al.
Published: (2025)

Preserving Domain Generalization in Fine-Tuning via Joint Parameter Selection
by: Pan, Bin, et al.
Published: (2025)

Parameter-Efficient Fine-Tuning with Discrete Fourier Transform
by: Gao, Ziqi, et al.
Published: (2024)

Unveiling the Mystery of Weight in Large Foundation Models: Gaussian Distribution Never Fades
by: Si, Chongjie, et al.
Published: (2025)

Memba: Membrane-driven Parameter-Efficient Fine-Tuning for Mamba
by: Lee, Donghyun, et al.
Published: (2025)

Parameter-Efficient Fine-Tuning via Circular Convolution
by: Chen, Aochuan, et al.
Published: (2024)

Parameter-Efficient Fine-Tuning with Circulant and Diagonal Vectors
by: Ding, Xinyu, et al.
Published: (2025)

Understanding and Guiding Layer Placement in Parameter-Efficient Fine-Tuning of Large Language Models
by: Xu, Yichen, et al.
Published: (2026)

NAN: A Training-Free Solution to Coefficient Estimation in Model Merging
by: Si, Chongjie, et al.
Published: (2025)

MetaTT: A Global Tensor-Train Adapter for Parameter-Efficient Fine-Tuning
by: Lopez-Piqueres, Javier, et al.
Published: (2025)

Memory-Efficient Fine-Tuning of Transformers via Token Selection
by: Simoulin, Antoine, et al.
Published: (2025)

Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models: A Survey and Benchmark
by: Xin, Yi, et al.
Published: (2024)

SVFit: Parameter-Efficient Fine-Tuning of Large Pre-Trained Models Using Singular Values
by: Sun, Chengwei, et al.
Published: (2024)

Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation
by: Ma, Xinyu, et al.
Published: (2024)

State-offset Tuning: State-based Parameter-Efficient Fine-Tuning for State Space Models
by: Kang, Wonjun, et al.
Published: (2025)

From Parameters to Data: A Task-Parameter-Guided Fine-Tuning Pipeline for Efficient LLM Alignment
by: Chen, Hao, et al.
Published: (2026)

SMoA: Spectrum Modulation Adapter for Parameter-Efficient Fine-Tuning
by: Liu, Yongkang, et al.
Published: (2026)

Meta-Learning Hyperparameters for Parameter Efficient Fine-Tuning
by: Tian, Zichen, et al.
Published: (2026)

Task-Adaptive Parameter-Efficient Fine-Tuning for Weather Foundation Models
by: Cao, Shilei, et al.
Published: (2025)

Parameter-Efficient Continual Fine-Tuning: A Survey
by: Coleman, Eric Nuertey, et al.
Published: (2025)

Solo Connection: A Parameter Efficient Fine-Tuning Technique for Transformers
by: Pathak, Harsh Nilesh, et al.
Published: (2025)

TuckA: Hierarchical Compact Tensor Experts for Efficient Fine-Tuning
by: Lei, Qifeng, et al.
Published: (2025)

Communication-Efficient and Tensorized Federated Fine-Tuning of Large Language Models
by: Ghiasvand, Sajjad, et al.
Published: (2024)

Parameter-Efficient Fine-Tuning for Foundation Models
by: Zhang, Dan, et al.
Published: (2025)

Certified PEFTSmoothing: Parameter-Efficient Fine-Tuning with Randomized Smoothing
by: Fu, Chengyan, et al.
Published: (2024)

PAE MobiLLM: Privacy-Aware and Efficient LLM Fine-Tuning on the Mobile Device via Additive Side-Tuning
by: Yang, Xingke, et al.
Published: (2025)

GD-FPS: Growth-Driven Feedforward Parameter Selection for Efficient Fine-Tuning
by: Yang, Kenneth, et al.
Published: (2025)

Look Within or Look Beyond? A Theoretical Comparison Between Parameter-Efficient and Full Fine-Tuning
by: Liu, Yongkang, et al.
Published: (2025)

MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
by: Jiang, Ting, et al.
Published: (2024)

Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies
by: Wang, Luping, et al.
Published: (2024)

TrainDeeploy: Hardware-Accelerated Parameter-Efficient Fine-Tuning of Small Transformer Models at the Extreme Edge
by: Wang, Run, et al.
Published: (2026)