Cover Image

Revisiting LoRA through the Lens of Parameter Redundancy: Spectral Encoding Helps

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Cheng, Jiashun, Chen, Aochuan, Chen, Nuo, Gao, Ziqi, Li, Yuhan, Li, Jia, Tsung, Fugee
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Parameter-Efficient Fine-Tuning via Circular Convolution
by: Chen, Aochuan, et al.
Published: (2024)

Semantic-guided LoRA Parameters Generation
by: Li, Miaoge, et al.
Published: (2025)

A Survey of Cross-domain Graph Learning: Progress and Future Directions
by: Zhao, Haihong, et al.
Published: (2025)

PRoLoRA: Partial Rotation Empowers More Parameter-Efficient LoRA
by: Wang, Sheng, et al.
Published: (2024)

Spectral Geometry of LoRA Adapters Encodes Training Objective and Predicts Harmful Compliance
by: Paul, Roi
Published: (2026)

LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation
by: Zhou, Hongyun, et al.
Published: (2024)

FedLoRA-Optimizer: Federated LoRA Fine-Tuning with Global and Local Optimization in Heterogeneous Data Scenarios
by: Zhao, Jianzhe, et al.
Published: (2025)

Conditional LoRA Parameter Generation
by: Jin, Xiaolong, et al.
Published: (2024)

CE-LoRA: Computation-Efficient LoRA Fine-Tuning for Language Models
by: Chen, Guanduo, et al.
Published: (2025)

Cross-LoRA: A Data-Free LoRA Transfer Framework across Heterogeneous LLMs
by: Xia, Feifan, et al.
Published: (2025)

LoRA-PAR: A Flexible Dual-System LoRA Partitioning Approach to Efficient LLM Fine-Tuning
by: Huang, Yining, et al.
Published: (2025)

Run LoRA Run: Faster and Lighter LoRA Implementations
by: Cherniuk, Daria, et al.
Published: (2023)

Parameter-Efficient Fine-Tuning with Discrete Fourier Transform
by: Gao, Ziqi, et al.
Published: (2024)

LoRA and Privacy: When Random Projections Help (and When They Don't)
by: Hu, Yaxi, et al.
Published: (2026)

S-LoRA: Serving Thousands of Concurrent LoRA Adapters
by: Sheng, Ying, et al.
Published: (2023)

LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routing
by: Li, Wenbing, et al.
Published: (2025)

CirT: Global Subseasonal-to-Seasonal Forecasting with Geometry-inspired Transformer
by: Liu, Yang, et al.
Published: (2025)

Graph Pre-Training Models Are Strong Anomaly Detectors
by: Cheng, Jiashun, et al.
Published: (2024)

LoRA Diffusion: Zero-Shot LoRA Synthesis for Diffusion Model Personalization
by: Smith, Ethan, et al.
Published: (2024)

AFA-LoRA: Enabling Non-Linear Adaptations in LoRA with Activation Function Annealing
by: Li, Jiacheng, et al.
Published: (2025)

A Note on LoRA
by: Fomenko, Vlad, et al.
Published: (2024)

HiP-LoRA: Budgeted Spectral Plasticity for Robust Low-Rank Adaptation
by: Chen, Lixian, et al.
Published: (2026)

IterIS: Iterative Inference-Solving Alignment for LoRA Merging
by: Chen, Hongxu, et al.
Published: (2024)

CopRA: A Progressive LoRA Training Strategy
by: Zhuang, Zhan, et al.
Published: (2024)

PLoRA: Efficient LoRA Hyperparameter Tuning for Large Models
by: Yan, Minghao, et al.
Published: (2025)

LoRA-BAM: Input Filtering for Fine-tuned LLMs via Boxed Abstraction Monitors over LoRA Layers
by: Wu, Changshun, et al.
Published: (2025)

Block-Diagonal LoRA for Eliminating Communication Overhead in Tensor Parallel LoRA Serving
by: Wang, Xinyu, et al.
Published: (2025)

Sci-LoRA: Mixture of Scientific LoRAs for Cross-Domain Lay Paraphrasing
by: Cheng, Ming, et al.
Published: (2025)

HRP: High-Rank Preheating for Superior LoRA Initialization
by: Chen, Yuzhu, et al.
Published: (2025)

Balanced LoRA: Removing Parameter Invariance to Accelerate Convergence
by: Castin, Valérie, et al.
Published: (2026)

LoRA Soups: Merging LoRAs for Practical Skill Composition Tasks
by: Prabhakar, Akshara, et al.
Published: (2024)

tLoRA: Efficient Multi-LoRA Training with Elastic Shared Super-Models
by: Li, Kevin, et al.
Published: (2026)

Leaner Training, Lower Leakage: Revisiting Memorization in LLM Fine-Tuning with LoRA
by: Wang, Fei, et al.
Published: (2025)

SEGNO: Generalizing Equivariant Graph Neural Networks with Physical Inductive Biases
by: Liu, Yang, et al.
Published: (2023)

WinFLoRA: Incentivizing Client-Adaptive Aggregation in Federated LoRA under Privacy Heterogeneity
by: Kou, Mengsha, et al.
Published: (2026)

Formalising the Logit Shift Induced by LoRA: A Technical Note
by: Shi, Xiang, et al.
Published: (2026)

LoRA on the Go: Instance-level Dynamic LoRA Selection and Merging
by: Lee, Seungeon, et al.
Published: (2025)

Uniform Spectral Growth and Convergence of Muon in LoRA-Style Matrix Factorization
by: Kang, Changmin, et al.
Published: (2026)

LoBAM: LoRA-Based Backdoor Attack on Model Merging
by: Yin, Ming, et al.
Published: (2024)

Latent Space Factorization in LoRA
by: Kumar, Shashi, et al.
Published: (2025)