Cover Image

Exploring Sparse Adapters for Scalable Merging of Parameter Efficient Experts

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Arnob, Samin Yeasar, Su, Zhan, Kim, Minseon, Ostapenko, Oleksiy, Ohib, Riyasat, Saleh, Esra'a, Precup, Doina, Caccia, Lucas, Sordoni, Alessandro
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Sparse-Reg: Improving Sample Complexity in Offline Reinforcement Learning using Sparsity
by: Arnob, Samin Yeasar, et al.
Published: (2025)

Trade-offs in Ensembling, Merging and Routing Among Parameter-Efficient Experts
by: Lotfi, Sanae, et al.
Published: (2026)

Guiding Language Model Reasoning with Planning Tokens
by: Wang, Xinyi, et al.
Published: (2023)

Towards Modular LLMs by Building and Reusing a Library of LoRAs
by: Ostapenko, Oleksiy, et al.
Published: (2024)

Learning to Solve Complex Problems via Dataset Decomposition
by: Zhao, Wanru, et al.
Published: (2026)

Learning to Extract Context for Context-Aware LLM Inference
by: Kim, Minseon, et al.
Published: (2025)

Explicit Group Sparse Projection with Applications to Deep Learning and NMF
by: Ohib, Riyasat, et al.
Published: (2019)

SSFL: Discovering Sparse Unified Subnetworks at Initialization for Efficient Federated Learning
by: Ohib, Riyasat, et al.
Published: (2024)

AraHopeCorpus: Annotation Guidelines and Dataset for Hope Speech in Arabic Social Media Crisis Discourse
by: Sharqawi, Esra'a, et al.
Published: (2026)

Training Plug-n-Play Knowledge Modules with Deep Context Distillation
by: Caccia, Lucas, et al.
Published: (2025)

Artifacts as Memory Beyond the Agent Boundary
by: Martin, John D., et al.
Published: (2026)

Learning to Query History: Nonstationary Classification via Learned Retrieval
by: Gammell, Jimmy, et al.
Published: (2026)

Blood Pressure in Young Adults in Iowa
by: Esra'a I. Khader, et al.
Published: (2025)

Diversity-Enriched Option-Critic
by: Kamat, Anand, et al.
Published: (2020)

Functional Acceleration for Policy Mirror Descent
by: Chelu, Veronica, et al.
Published: (2024)

A Look at Value-Based Decision-Time vs. Background Planning Methods Across Different Settings
by: Alver, Safa, et al.
Published: (2022)

A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative Learning
by: Yadav, Prateek, et al.
Published: (2024)

BugPilot: Complex Bug Generation for Efficient Learning of SWE Skills
by: Sonwane, Atharv, et al.
Published: (2025)

A Modular Approach for Clinical SLMs Driven by Synthetic Data with Pre-Instruction Tuning, Model Merging, and Clinical-Tasks Alignment
by: Corbeil, Jean-Philippe, et al.
Published: (2025)

Mixtures of Experts Unlock Parameter Scaling for Deep RL
by: Obando-Ceron, Johan, et al.
Published: (2024)

Balancing Plasticity and Stability with Fast and Slow Successor Features
by: Chua, Raymond, et al.
Published: (2026)

On the Privacy of Selection Mechanisms with Gaussian Noise
by: Lebensold, Jonathan, et al.
Published: (2024)

debug-gym: A Text-Based Environment for Interactive Debugging
by: Yuan, Xingdi, et al.
Published: (2025)

HAM: Hierarchical Adapter Merging for Scalable Continual Learning
by: Coleman, Eric Nuertey, et al.
Published: (2025)

Conditions on Preference Relations that Guarantee the Existence of Optimal Policies
by: Carr, Jonathan Colaço, et al.
Published: (2023)

Adaptive Exploration for Data-Efficient General Value Function Evaluations
by: Jain, Arushi, et al.
Published: (2024)

Fluid-Agent Reinforcement Learning
by: Sharma, Shishir, et al.
Published: (2026)

Partial Models for Building Adaptive Model-Based Reinforcement Learning Agents
by: Alver, Safa, et al.
Published: (2024)

Gistify! Codebase-Level Understanding via Runtime Execution
by: Lee, Hyunji, et al.
Published: (2025)

MedRiskEval: Medical Risk Evaluation Benchmark of Language Models, On the Importance of User Perspectives in Healthcare Settings
by: Corbeil, Jean-Philippe, et al.
Published: (2025)

Expert Merging in Sparse Mixture of Experts with Nash Bargaining
by: Nguyen, Dung V., et al.
Published: (2025)

Parseval Regularization for Continual Reinforcement Learning
by: Chung, Wesley, et al.
Published: (2024)

Relative Trajectory Balance is equivalent to Trust-PCL
by: Deleu, Tristan, et al.
Published: (2025)

Effects of term weighting approach with and without stop words removing on Arabic text classification
by: Alhenawi, Esra'a, et al.
Published: (2024)

Adapter Merging with Centroid Prototype Mapping for Scalable Class-Incremental Learning
by: Fukuda, Takuma, et al.
Published: (2024)

DiffuMamba: High-Throughput Diffusion LMs with Mamba Backbone
by: Singh, Vaibhav, et al.
Published: (2025)

Incorporating Spatial Information into Goal-Conditioned Hierarchical Reinforcement Learning via Graph Representations
by: Zhang, Shuyuan, et al.
Published: (2025)

SCAR: Shapley Credit Assignment for More Efficient RLHF
by: Cao, Meng, et al.
Published: (2025)

Capacity-Constrained Continual Learning
by: Wen, Zheng, et al.
Published: (2025)

Finite time analysis of temporal difference learning with linear function approximation: Tail averaging and regularisation
by: Patil, Gandharv, et al.
Published: (2022)