Cover Image

Orthogonal Subspace Projection for Continual Machine Unlearning via SVD-Based LoRA

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Rahulamathavan, Yogachandran, Iqbal, Nasir, Hu, Juncheng, Lambotharan, Sangarapillai
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

QuantFL: Sustainable Federated Learning for Edge IoT via Pre-Trained Model Quantisation
by: Herath, Charuka, et al.
Published: (2026)

Enhancing Federated Learning Convergence with Dynamic Data Queue and Data Entropy-driven Participant Selection
by: Herath, Charuka, et al.
Published: (2024)

DSFL: A Dual-Server Byzantine-Resilient Federated Learning Framework via Group-Based Secure Aggregation
by: Herath, Charuka, et al.
Published: (2025)

FheFL: Fully Homomorphic Encryption Friendly Privacy-Preserving Federated Learning with Byzantine Users
by: Rahulamathavan, Yogachandran, et al.
Published: (2023)

FedSVD: Adaptive Orthogonalization for Private Federated Learning with LoRA
by: Lee, Seanie, et al.
Published: (2025)

Unraveling LoRA Interference: Orthogonal Subspaces for Robust Model Merging
by: Zhang, Haobo, et al.
Published: (2025)

SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA
by: Luo, Minrui, et al.
Published: (2025)

BID-LoRA: A Parameter-Efficient Framework for Continual Learning and Unlearning
by: Rachapudi, Jagadeesh, et al.
Published: (2026)

Disentangling Task Conflicts in Multi-Task LoRA via Orthogonal Gradient Projection
by: Yang, Ziyu, et al.
Published: (2026)

Shared LoRA Subspaces for almost Strict Continual Learning
by: Kaushik, Prakhar, et al.
Published: (2026)

Rethinking LoRA for Data Heterogeneous Federated Learning: Subspace and State Alignment
by: Peng, Hongyi, et al.
Published: (2026)

A Neural Rejection System Against Universal Adversarial Perturbations in Radio Signal Classification
by: Zhang, Lu, et al.
Published: (2025)

Wireless Federated Multi-Task LLM Fine-Tuning via Sparse-and-Orthogonal LoRA
by: Yang, Nuocheng, et al.
Published: (2026)

Ortho-Hydra: Orthogonalized Experts for DiT LoRA
by: Ji, Seunghyun
Published: (2026)

Retrieval-Augmented Mixture of LoRA Experts for Uploadable Machine Learning
by: Zhao, Ziyu, et al.
Published: (2024)

Kron-LoRA: Hybrid Kronecker-LoRA Adapters for Scalable, Sustainable Fine-tuning
by: Shen, Yixin
Published: (2025)

R-LoRA: Randomized Multi-Head LoRA for Efficient Multi-Task Learning
by: Liu, Jinda, et al.
Published: (2025)

LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routing
by: Li, Wenbing, et al.
Published: (2025)

GEM-Style Constraints for PEFT with Dual Gradient Projection in LoRA
by: Tekmen, Brian, et al.
Published: (2026)

SCALE-LoRA: Auditing Post-Retrieval LoRA Composition with Residual Merging and View Reliability
by: Zhou, Shuaipeng, et al.
Published: (2026)

LoRA on the Go: Instance-level Dynamic LoRA Selection and Merging
by: Lee, Seungeon, et al.
Published: (2025)

Conditional LoRA Parameter Generation
by: Jin, Xiaolong, et al.
Published: (2024)

S-LoRA: Serving Thousands of Concurrent LoRA Adapters
by: Sheng, Ying, et al.
Published: (2023)

FiLoRA: Focus-and-Ignore LoRA for Controllable Feature Reliance
by: Chung, Hyunsuk, et al.
Published: (2026)

LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization
by: Yen, Jui-Nan, et al.
Published: (2024)

mLoRA: Fine-Tuning LoRA Adapters via Highly-Efficient Pipeline Parallelism in Multiple GPUs
by: Ye, Zhengmao, et al.
Published: (2023)

$α$-LoRA: Effective Fine-Tuning via Base Model Rescaling
by: Firdoussi, Aymane El, et al.
Published: (2025)

Efficient Modular Learning through Naive LoRA Summation: Leveraging Orthogonality in High-Dimensional Models
by: Cao, Zhanhao, et al.
Published: (2025)

A Note on LoRA
by: Fomenko, Vlad, et al.
Published: (2024)

Exploring Gradient Subspaces: Addressing and Overcoming LoRA's Limitations in Federated Fine-Tuning of Large Language Models
by: Mahla, Navyansh, et al.
Published: (2024)

Subliminal Learning is a LoRA Artifact
by: Nief, Todd, et al.
Published: (2026)

Semantic-guided LoRA Parameters Generation
by: Li, Miaoge, et al.
Published: (2025)

Riemannian Optimization for LoRA on the Stiefel Manifold
by: Park, Juneyoung, et al.
Published: (2025)

Text-to-LoRA: Instant Transformer Adaption
by: Charakorn, Rujikorn, et al.
Published: (2025)

KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
by: Azimi, Rambod, et al.
Published: (2024)

The Scaling Law for LoRA Base on Mutual Information Upper Bound
by: Zhang, Jing, et al.
Published: (2025)

HiLoRA: Adaptive Hierarchical LoRA Routing for Training-Free Domain Generalization
by: Han, Ziyi, et al.
Published: (2025)

Robust Federated Finetuning of LLMs via Alternating Optimization of LoRA
by: Chen, Shuangyi, et al.
Published: (2025)

Machine Unlearning in Low-Dimensional Feature Subspace
by: Fang, Kun, et al.
Published: (2026)

Tina: Tiny Reasoning Models via LoRA
by: Wang, Shangshang, et al.
Published: (2025)