Cover Image

Understanding and Enforcing Weight Disentanglement in Task Arithmetic

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, Shangge, Yin, Yuehan, Wang, Lei, Fan, Qi, Shi, Yinghuan, Li, Wenbin, Gao, Yang, Tao, Dacheng
Format:	Preprint
Published:	2026
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LibContinual: A Comprehensive Library towards Realistic Continual Learning
by: Li, Wenbin, et al.
Published: (2025)

Balanced Direction from Multifarious Choices: Arithmetic Meta-Learning for Domain Generalization
by: Wang, Xiran, et al.
Published: (2025)

Dataless Weight Disentanglement in Task Arithmetic via Kronecker-Factored Approximate Curvature
by: Porrello, Angelo, et al.
Published: (2026)

CLASP: Class-Adaptive Layer Fusion and Dual-Stage Pruning for Multimodal Large Language Models
by: Dang, Yunkai, et al.
Published: (2026)

Towards the Connection between Activation Sparsity and Flat Minima
by: Peng, Ze, et al.
Published: (2026)

On the Implicit Adversariality of Catastrophic Forgetting in Deep Continual Learning
by: Peng, Ze, et al.
Published: (2025)

Taste More, Taste Better: Diverse Data and Strong Model Boost Semi-Supervised Crowd Counting
by: Yang, Maochen, et al.
Published: (2025)

Drawback of Enforcing Equivariance and its Compensation via the Lens of Expressive Power
by: Chen, Yuzhu, et al.
Published: (2025)

Principled Understanding of Generalization for Generative Transformer Models in Arithmetic Reasoning Tasks
by: Xu, Xingcheng, et al.
Published: (2024)

Graph-Augmented Reasoning: Evolving Step-by-Step Knowledge Graph Retrieval for LLM Reasoning
by: Wu, Wenjie, et al.
Published: (2025)

Task-Aware Harmony Multi-Task Decision Transformer for Offline Reinforcement Learning
by: Fan, Ziqing, et al.
Published: (2024)

Towards Theoretical Understandings of Self-Consuming Generative Models
by: Fu, Shi, et al.
Published: (2024)

Mastering Massive Multi-Task Reinforcement Learning via Mixture-of-Expert Decision Transformer
by: Kong, Yilun, et al.
Published: (2025)

MAGIC: Achieving Superior Model Merging via Magnitude Calibration
by: Li, Yayuan, et al.
Published: (2025)

Disentangling Policy from Offline Task Representation Learning via Adversarial Data Augmentation
by: Jia, Chengxing, et al.
Published: (2024)

Bus-Conditioned Zero-Shot Trajectory Generation via Task Arithmetic
by: Liu, Shuai, et al.
Published: (2026)

Continual Task Learning through Adaptive Policy Self-Composition
by: Hu, Shengchao, et al.
Published: (2024)

Collaborative Cognitive Diagnosis with Disentangled Representation Learning for Learner Modeling
by: Gao, Weibo, et al.
Published: (2024)

Review of Hallucination Understanding in Large Language and Vision Models
by: Ho, Zhengyi, et al.
Published: (2025)

A Step Back: Prefix Importance Ratio Stabilizes Policy Optimization
by: Lei, Shiye, et al.
Published: (2026)

Offline Behavior Distillation
by: Lei, Shiye, et al.
Published: (2024)

Offline Behavioral Data Selection
by: Lei, Shiye, et al.
Published: (2025)

Escaping Optimization Stagnation: Taking Steps Beyond Task Arithmetic via Difference Vectors
by: Wang, Jinping, et al.
Published: (2025)

Quantum-Enhanced Multi-Task Learning with Learnable Weighting for Pharmacokinetic and Toxicity Prediction
by: Zhang, Han, et al.
Published: (2025)

Why Self-Rewarding Works: Theoretical Guarantees for Iterative Alignment of Language Models
by: Fu, Shi, et al.
Published: (2026)

Revisiting LLM Reasoning via Information Bottleneck
by: Lei, Shiye, et al.
Published: (2025)

Enforcing Orderedness to Improve Feature Consistency
by: Wang, Sophie L., et al.
Published: (2025)

Task-Distributionally Robust Data-Free Meta-Learning
by: Hu, Zixuan, et al.
Published: (2023)

DETACH: Cross-domain Learning for Long-Horizon Tasks via Mixture of Disentangled Experts
by: Shen, Yutong, et al.
Published: (2025)

A Theoretical Survey on Foundation Models
by: Fu, Shi, et al.
Published: (2024)

HiCrew: Hierarchical Reasoning for Long-Form Video Understanding via Question-Aware Multi-Agent Collaboration
by: Zhu, Yuehan, et al.
Published: (2026)

Representation Surgery for Multi-Task Model Merging
by: Yang, Enneng, et al.
Published: (2024)

Learning Network Representations with Disentangled Graph Auto-Encoder
by: Fan, Di, et al.
Published: (2024)

Language Models Do Hard Arithmetic Tasks Easily and Hardly Do Easy Arithmetic Tasks
by: Gambardella, Andrew, et al.
Published: (2024)

An Empirical Study of Knowledge Distillation for Code Understanding Tasks
by: Wang, Ruiqi, et al.
Published: (2025)

Task Arithmetic for Language Expansion in Speech Translation
by: Cheng, Yao-Fei, et al.
Published: (2024)

ME: Trigger Element Combination Backdoor Attack on Copyright Infringement
by: Yang, Feiyu, et al.
Published: (2025)

DeFacto: Counterfactual Thinking with Images for Enforcing Evidence-Grounded and Faithful Reasoning
by: Xu, Tianrun, et al.
Published: (2025)

Learning Generalizable Models via Disentangling Spurious and Enhancing Potential Correlations
by: Wang, Na, et al.
Published: (2024)

Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
by: Liu, Weichen, et al.
Published: (2025)