Cover Image

Parameter Efficient Multi-task Model Fusion with Partial Linearization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tang, Anke, Shen, Li, Luo, Yong, Zhan, Yibing, Hu, Han, Du, Bo, Chen, Yixin, Tao, Dacheng
Format:	Preprint
Published:	2023
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

FusionBench: A Unified Library and Comprehensive Benchmark for Deep Model Fusion
by: Tang, Anke, et al.
Published: (2024)

Towards Efficient Pareto Set Approximation via Mixture of Experts Based Model Fusion
by: Tang, Anke, et al.
Published: (2024)

Merging Models on the Fly Without Retraining: A Sequential Approach to Scalable Continual Model Merging
by: Tang, Anke, et al.
Published: (2025)

Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging
by: Shen, Li, et al.
Published: (2024)

SMILE: Zero-Shot Sparse Mixture of Low-Rank Experts Construction From Pre-Trained Foundation Models
by: Tang, Anke, et al.
Published: (2024)

Learning from models beyond fine-tuning
by: Zheng, Hongling, et al.
Published: (2023)

Merging Multi-Task Models via Weight-Ensembling Mixture of Experts
by: Tang, Anke, et al.
Published: (2024)

Joint Input and Output Coordination for Class-Incremental Learning
by: Wang, Shuai, et al.
Published: (2024)

Confronting Reward Overoptimization for Diffusion Models: A Perspective of Inductive and Primacy Biases
by: Zhang, Ziyi, et al.
Published: (2024)

Efficient Learning for Linear Properties of Bounded-Gate Quantum Circuits
by: Du, Yuxuan, et al.
Published: (2024)

Federated Learning with Only Positive Labels by Exploring Label Correlations
by: An, Xuming, et al.
Published: (2024)

Learning Multi-Agent Communication from Graph Modeling Perspective
by: Hu, Shengchao, et al.
Published: (2024)

Late Fusion Multi-task Learning for Semiparametric Inference with Nuisance Parameters
by: Bhattacharya, Sohom, et al.
Published: (2025)

Modeling All Response Surfaces in One for Conditional Search Spaces
by: Li, Jiaxing, et al.
Published: (2025)

Communication Learning in Multi-Agent Systems from Graph Modeling Perspective
by: Hu, Shengchao, et al.
Published: (2024)

Separable Power of Classical and Quantum Learning Protocols Through the Lens of No-Free-Lunch Theorem
by: Wang, Xinbiao, et al.
Published: (2024)

Topology-aware Embedding Memory for Continual Learning on Expanding Networks
by: Zhang, Xikun, et al.
Published: (2024)

Demonstration of Efficient Predictive Surrogates for Large-scale Quantum Processors
by: Liao, Wei-You, et al.
Published: (2025)

On the Parameter Identifiability of Partially Observed Linear Causal Models
by: Dong, Xinshuai, et al.
Published: (2024)

Partial Feedback Online Learning
by: Shao, Shihao, et al.
Published: (2026)

Aligning Few-Step Diffusion Models with Dense Reward Difference Learning
by: Zhang, Ziyi, et al.
Published: (2024)

Stability and Generalization for Distributed SGDA
by: Zhu, Miaoxi, et al.
Published: (2024)

On exploring the potential of quantum auto-encoder for learning quantum systems
by: Du, Yuxuan, et al.
Published: (2021)

Low-Precision Training of Large Language Models: Methods, Challenges, and Opportunities
by: Hao, Zhiwei, et al.
Published: (2025)

MG-Net: Learn to Customize QAOA with Circuit Depth Awareness
by: Qian, Yang, et al.
Published: (2024)

Modeling Multi-Task Model Merging as Adaptive Projective Gradient Descent
by: Wei, Yongxian, et al.
Published: (2025)

Improving Complex Reasoning over Knowledge Graph with Logic-Aware Curriculum Tuning
by: Xia, Tianle, et al.
Published: (2024)

Optimal Sampling for Generalized Linear Model under Measurement Constraint with Surrogate Variables
by: Shen, Yixin, et al.
Published: (2025)

Explorable INR: An Implicit Neural Representation for Ensemble Simulation Enabling Efficient Spatial and Parameter Exploration
by: Chen, Yi-Tang, et al.
Published: (2025)

SOFTS: Efficient Multivariate Time Series Forecasting with Series-Core Fusion
by: Han, Lu, et al.
Published: (2024)

On Geometry-Enhanced Parameter-Efficient Fine-Tuning for 3D Scene Segmentation
by: Tang, Liyao, et al.
Published: (2025)

HarmoDT: Harmony Multi-Task Decision Transformer for Offline Reinforcement Learning
by: Hu, Shengchao, et al.
Published: (2024)

Reverse Prompt: Cracking the Recipe Inside Text-to-Image Generation
by: Ren, Zhiyao, et al.
Published: (2025)

Cross-Domain Diffusion with Progressive Alignment for Efficient Adaptive Retrieval
by: Luo, Junyu, et al.
Published: (2025)

SkipNode: On Alleviating Performance Degradation for Deep Graph Convolutional Networks
by: Lu, Weigang, et al.
Published: (2021)

Large Language Models as an Indirect Reasoner: Contrapositive and Contradiction for Automated Reasoning
by: Zhang, Yanfang, et al.
Published: (2024)

One for All: Towards Training One Graph Model for All Classification Tasks
by: Liu, Hao, et al.
Published: (2023)

A Unified Generalization Framework for Model Merging: Trade-offs, Non-Linearity, and Scaling Laws
by: Li, Qinglun, et al.
Published: (2026)

Learning System Dynamics without Forgetting
by: Zhang, Xikun, et al.
Published: (2024)

MaskPro: Linear-Space Probabilistic Learning for Strict (N:M)-Sparsity on LLMs
by: Sun, Yan, et al.
Published: (2025)