Cover Image

Gradient Deconfliction via Orthogonal Projections onto Subspaces For Multi-task Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhu, Shijie, Zhao, Hui, Wu, Tianshu, Wang, Pengjie, Deng, Hongbo, Xu, Jian, Zheng, Bo
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Powering Up Zeroth-Order Training via Subspace Gradient Orthogonalization
by: Lang, Yicheng, et al.
Published: (2026)

Muon-OGD: Muon-based Spectral Orthogonal Gradient Projection for LLM Continual Learning
by: Lu, Binghang, et al.
Published: (2026)

Safety Alignment as Continual Learning: Mitigating the Alignment Tax via Orthogonal Gradient Projection
by: Sun, Guanglong, et al.
Published: (2026)

CENSOR: Defense Against Gradient Inversion via Orthogonal Subspace Bayesian Sampling
by: Zhang, Kaiyuan, et al.
Published: (2025)

Conflict-Averse Gradient Descent for Multi-task Learning
by: Liu, Bo, et al.
Published: (2021)

OrthAlign: Orthogonal Subspace Decomposition for Non-Interfering Multi-Objective Alignment
by: Lin, Liang, et al.
Published: (2025)

Orthogonal Subspace Projection for Continual Machine Unlearning via SVD-Based LoRA
by: Rahulamathavan, Yogachandran, et al.
Published: (2026)

Fisher-Orthogonal Projected Natural Gradient Descent for Continual Learning
by: Garg, Ishir, et al.
Published: (2026)

Efficient Orthogonal Fine-Tuning with Principal Subspace Adaptation
by: Wu, Fei, et al.
Published: (2025)

Perturbations in the Orthogonal Complement Subspace for Efficient Out-of-Distribution Detection
by: Huang, Zhexiao, et al.
Published: (2025)

SOMP: Scalable Gradient Inversion for Large Language Models via Subspace-Guided Orthogonal Matching Pursuit
by: Li, Yibo, et al.
Published: (2026)

Efficient Training of Multi-task Neural Solver for Combinatorial Optimization
by: Wang, Chenguang, et al.
Published: (2023)

Disentangling Task Conflicts in Multi-Task LoRA via Orthogonal Gradient Projection
by: Yang, Ziyu, et al.
Published: (2026)

Improving the Sensitivity of Backdoor Detectors via Class Subspace Orthogonalization
by: Yang, Guangmingmei, et al.
Published: (2025)

Deep Network Trainability via Persistent Subspace Orthogonality
by: Massucco, Alex, et al.
Published: (2025)

Meta Policy Switching for Secure UAV Deconfliction in Adversarial Airspace
by: Panda, Deepak Kumar, et al.
Published: (2025)

A Unified Framework for Data-Free One-Step Sampling via Wasserstein Gradient Flows
by: Wang, Chenguang, et al.
Published: (2026)

Real-Time Bayesian Detection of Drift-Evasive GNSS Spoofing in Reinforcement Learning Based UAV Deconfliction
by: Panda, Deepak Kumar, et al.
Published: (2025)

Privacy-Aware Video Anomaly Detection through Orthogonal Subspace Projection
by: Wang, Lei, et al.
Published: (2026)

Curriculum-Guided Antifragile Reinforcement Learning for Secure UAV Deconfliction under Observation-Space Attacks
by: Panda, Deepak Kumar, et al.
Published: (2025)

Multi-task Offline Reinforcement Learning for Online Advertising in Recommender Systems
by: Liu, Langming, et al.
Published: (2025)

Deep Prompt Multi-task Network for Abuse Language Detection
by: Zhu, Jian, et al.
Published: (2024)

Model Unlearning via Sparse Autoencoder Subspace Guided Projections
by: Wang, Xu, et al.
Published: (2025)

Gradient Projection onto Historical Descent Directions for Communication-Efficient Federated Learning
by: Descours, Arnaud, et al.
Published: (2025)

Safe and Reliable Diffusion Models via Subspace Projection
by: Chen, Huiqiang, et al.
Published: (2025)

LightSplit: Practical Privacy-Preserving Split Learning via Orthogonal Projections
by: Cihangiroglu, Mert, et al.
Published: (2026)

GPFL: A Gradient Projection-Based Client Selection Framework for Efficient Federated Learning
by: Na, Shijie, et al.
Published: (2024)

Feed m Birds with One Scone: Accelerating Multi-task Gradient Balancing via Bi-level Optimization
by: Chen, Xuxing, et al.
Published: (2026)

Adaptive Budget Allocation for Orthogonal-Subspace Adapter Tuning in LLMs Continual Learning
by: Wan, Zhiyi, et al.
Published: (2025)

OCP: Orthogonal Constrained Projection for Sparse Scaling in Industrial Commodity Recommendation
by: Sun, Chen, et al.
Published: (2026)

CORE-MTL: Rethinking Gradient Balancing via Causal Orthogonal Representations
by: Wu, Chengfeng, et al.
Published: (2026)

Bayesian Fine-tuning in Projected Subspaces
by: Dubovik, Viktar, et al.
Published: (2026)

VALUE: Value-Aware Large Language Model for Query Rewriting via Weighted Trie in Sponsored Search
by: Zhang, Xiao, et al.
Published: (2025)

FG-OrIU: Towards Better Forgetting via Feature-Gradient Orthogonality for Incremental Unlearning
by: Feng, Qian, et al.
Published: (2026)

Secrets of GFlowNets' Learning Behavior: A Theoretical Study
by: Yu, Tianshu
Published: (2025)

Customized Multiple Clustering via Multi-Modal Subspace Proxy Learning
by: Yao, Jiawei, et al.
Published: (2024)

High-Dimensional Bayesian Optimization via Random Projection of Manifold Subspaces
by: Nguyen, Quoc-Anh Hoang, et al.
Published: (2024)

Towards Principled Task Grouping for Multi-Task Learning
by: Wang, Chenguang, et al.
Published: (2024)

Approximated Orthogonal Projection Unit: Stabilizing Regression Network Training Using Natural Gradient
by: Wang, Shaoqi, et al.
Published: (2024)

Beyond the Mean: Fisher-Orthogonal Projection for Natural Gradient Descent in Large Batch Training
by: Lu, Yishun, et al.
Published: (2025)