Imagen de Portada

Improving Fisher Information Estimation and Efficiency for LoRA-based LLM Unlearning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Kim, Yejin, Kim, Eunwon, Chang, Buru, Choe, Junsuk
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Knowledge Vector Weakening: Efficient Training-free Unlearning for Large Vision-Language Models
por: Kim, Yejin, et al.
Publicado: (2026)

ConVis: Contrastive Decoding with Hallucination Visualization for Mitigating Hallucinations in Multimodal Large Language Models
por: Park, Yeji, et al.
Publicado: (2024)

NegMerge: Sign-Consensual Weight Merging for Machine Unlearning
por: Kim, Hyo Seo, et al.
Publicado: (2024)

Recover-to-Forget: Gradient Reconstruction from LoRA for Efficient LLM Unlearning
por: Liu, Yezi, et al.
Publicado: (2025)

LoRA Unlearns More and Retains More (Student Abstract)
por: Mittal, Atharv
Publicado: (2024)

LRAgent: Efficient KV Cache Sharing for Multi-LoRA LLM Agents
por: Jeon, Hyesung, et al.
Publicado: (2026)

SHARE: Shared Memory-Aware Open-Domain Long-Term Dialogue Dataset Constructed from Movie Script
por: Kim, Eunwon, et al.
Publicado: (2024)

LUNE: Efficient LLM Unlearning via LoRA Fine-Tuning with Negative Examples
por: Liu, Yezi, et al.
Publicado: (2025)

R-LoRA: Randomized Multi-Head LoRA for Efficient Multi-Task Learning
por: Liu, Jinda, et al.
Publicado: (2025)

Run LoRA Run: Faster and Lighter LoRA Implementations
por: Cherniuk, Daria, et al.
Publicado: (2023)

Learning in the Fisher Subspace: A Guided Initialization for LoRA Fine-Tuning
por: Feng, Zhi-Quan, et al.
Publicado: (2026)

LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation
por: Zhou, Hongyun, et al.
Publicado: (2024)

Improving LoRA with Variational Learning
por: Cong, Bai, et al.
Publicado: (2025)

FiLoRA: Focus-and-Ignore LoRA for Controllable Feature Reliance
por: Chung, Hyunsuk, et al.
Publicado: (2026)

Riemannian Optimization for LoRA on the Stiefel Manifold
por: Park, Juneyoung, et al.
Publicado: (2025)

CE-LoRA: Computation-Efficient LoRA Fine-Tuning for Language Models
por: Chen, Guanduo, et al.
Publicado: (2025)

LoRA Diffusion: Zero-Shot LoRA Synthesis for Diffusion Model Personalization
por: Smith, Ethan, et al.
Publicado: (2024)

FIM-LoRA: Task-Informative Rank Allocation for LoRA via Calibration-Time Gradient-Variance Estimation
por: Sathyavageeswaran, Ramakrishnan
Publicado: (2026)

FedRot-LoRA: Mitigating Rotational Misalignment in Federated LoRA
por: Zhang, Haoran, et al.
Publicado: (2026)

BID-LoRA: A Parameter-Efficient Framework for Continual Learning and Unlearning
por: Rachapudi, Jagadeesh, et al.
Publicado: (2026)

Block-Diagonal LoRA for Eliminating Communication Overhead in Tensor Parallel LoRA Serving
por: Wang, Xinyu, et al.
Publicado: (2025)

LoRA-PAR: A Flexible Dual-System LoRA Partitioning Approach to Efficient LLM Fine-Tuning
por: Huang, Yining, et al.
Publicado: (2025)

S-LoRA: Serving Thousands of Concurrent LoRA Adapters
por: Sheng, Ying, et al.
Publicado: (2023)

Cross-LoRA: A Data-Free LoRA Transfer Framework across Heterogeneous LLMs
por: Xia, Feifan, et al.
Publicado: (2025)

LoRA on the Go: Instance-level Dynamic LoRA Selection and Merging
por: Lee, Seungeon, et al.
Publicado: (2025)

Orthogonal Subspace Projection for Continual Machine Unlearning via SVD-Based LoRA
por: Rahulamathavan, Yogachandran, et al.
Publicado: (2026)

The Scaling Law for LoRA Base on Mutual Information Upper Bound
por: Zhang, Jing, et al.
Publicado: (2025)

Latent Space Factorization in LoRA
por: Kumar, Shashi, et al.
Publicado: (2025)

Kron-LoRA: Hybrid Kronecker-LoRA Adapters for Scalable, Sustainable Fine-tuning
por: Shen, Yixin
Publicado: (2025)

AFA-LoRA: Enabling Non-Linear Adaptations in LoRA with Activation Function Annealing
por: Li, Jiacheng, et al.
Publicado: (2025)

LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routing
por: Li, Wenbing, et al.
Publicado: (2025)

Two Stage Wireless Federated LoRA Fine-Tuning with Sparsified Orthogonal Updates
por: Kim, Bumjun, et al.
Publicado: (2025)

LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
por: Bian, Jieming, et al.
Publicado: (2024)

LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization
por: Yen, Jui-Nan, et al.
Publicado: (2024)

Mixture of LoRA Experts
por: Wu, Xun, et al.
Publicado: (2024)

CopRA: A Progressive LoRA Training Strategy
por: Zhuang, Zhan, et al.
Publicado: (2024)

LoRA-MME: Multi-Model Ensemble of LoRA-Tuned Encoders for Code Comment Classification
por: Haider, Md Akib, et al.
Publicado: (2026)

SCALE-LoRA: Auditing Post-Retrieval LoRA Composition with Residual Merging and View Reliability
por: Zhou, Shuaipeng, et al.
Publicado: (2026)

MoRA: LoRA Guided Multi-Modal Disease Diagnosis with Missing Modality
por: Shi, Zhiyi, et al.
Publicado: (2024)

Machine Unlearning on Pre-trained Models by Residual Feature Alignment Using LoRA
por: Qin, Laiqiao, et al.
Publicado: (2024)