Cover Image

Arcee's MergeKit: A Toolkit for Merging Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Goddard, Charles, Siriwardhana, Shamane, Ehghaghi, Malikeh, Meyers, Luke, Karpukhin, Vlad, Benedict, Brian, McQuade, Mark, Solawetz, Jacob
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Merging in a Bottle: Differentiable Adaptive Merging (DAM) and the Path from Averaging to Automation
by: Gauthier-Caron, Thomas, et al.
Published: (2024)

Domain Adaptation of Llama3-70B-Instruct through Continual Pre-Training and Model Merging: A Comprehensive Evaluation
by: Siriwardhana, Shamane, et al.
Published: (2024)

Arcee Trinity Large Technical Report
by: Singh, Varun, et al.
Published: (2026)

Menopause transitions and the workplace theorizing transitions, responsibilities and interventions Edited by VanessaBeck and JoBrewis. Bristol University Press, Jan 10, 2024, 186 pp., ISBN: 978–1529215700, Price GBP 79.99, h/b
by: Laura McQuade
Published: (2024)

Novel regulators of nucleic acid sensing drive neurotoxic interferon response in microglia
by: Amanda McQuade
Published: (2025)

Factors affecting secondary teacher wellbeing in England: Self‐perceptions, policy and politics
by: Laura McQuade
Published: (2024)

Zero-Shot Multi-Lingual Speaker Verification in Clinical Trials
by: Akram, Ali, et al.
Published: (2024)

Jointly Fine-Tuning "BERT-like" Self Supervised Models to Improve Multimodal Speech Emotion Recognition
by: Siriwardhana, Shamane, et al.
Published: (2020)

Fine-tune the Entire RAG Architecture (including DPR retriever) for Question-Answering
by: Siriwardhana, Shamane, et al.
Published: (2021)

RAG-KG-IL: A Multi-Agent Hybrid Framework for Reducing Hallucinations and Enhancing LLM Reasoning through RAG and Incremental Knowledge Graph Learning Integration
by: Yu, Hong Qing, et al.
Published: (2025)

TokSuite: Measuring the Impact of Tokenizer Choice on Language Model Behavior
by: Altıntaş, Gül Sena, et al.
Published: (2025)

Dispelling the magic of artificial intelligence in medical education
by: Casey N. McQuade, et al.
Published: (2024)

Transport and Merge: Cross-Architecture Merging for Large Language Models
by: Cui, Chenhang, et al.
Published: (2026)

Merge-Bench: Resolve Merge Conflicts with Large Language Models
by: Schesch, Benedikt, et al.
Published: (2026)

Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question Answering
by: Siriwardhana, Shamane, et al.
Published: (2022)

Arcee: An OCM-Solver
by: Boehmer, Kimon, et al.
Published: (2024)

Merge to Learn: Efficiently Adding Skills to Language Models with Model Merging
by: Morrison, Jacob, et al.
Published: (2024)

1bit-Merging: Dynamic Quantized Merging for Large Language Models
by: Liu, Shuqi, et al.
Published: (2025)

Merge Hijacking: Backdoor Attacks to Model Merging of Large Language Models
by: Yuan, Zenghui, et al.
Published: (2025)

Relation Extraction Across Entire Books to Reconstruct Community Networks: The AffilKG Datasets
by: Cai, Erica, et al.
Published: (2025)

Sens-Merging: Sensitivity-Guided Parameter Balancing for Merging Large Language Models
by: Liu, Shuqi, et al.
Published: (2025)

K-Merge: Online Continual Merging of Adapters for On-device Large Language Models
by: Shenaj, Donald, et al.
Published: (2025)

Shattering the Shield: Embracing Complexity in Undergraduate Medical Education
by: Cara Bezzina, et al.
Published: (2025)

The Development of Professional Standards in Forensic Anthropology
by: Eric J. Bartelink, et al.
Published: (2025)

LoRE-Merging: Exploring Low-Rank Estimation For Large Language Model Merging
by: Liu, Zehua, et al.
Published: (2025)

AgentsCoMerge: Large Language Model Empowered Collaborative Decision Making for Ramp Merging
by: Hu, Senkang, et al.
Published: (2024)

MIN-Merging: Merge the Important Neurons for Model Merging
by: Liang, Yunfei
Published: (2025)

Target trial emulation without matching: a more efficient approach for evaluating vaccine effectiveness using observational data
by: Wu, Emily, et al.
Published: (2025)

Activation-Informed Merging of Large Language Models
by: Nobari, Amin Heyrani, et al.
Published: (2025)

EvoMerge: Neuroevolution for Large Language Models
by: Jiang, Yushu
Published: (2024)

FW-Merging: Scaling Model Merging with Frank-Wolfe Optimization
by: Chen, Hao Mark, et al.
Published: (2025)

ASD-RSD; To Merge or Not to Merge
by: Sinclair, Dorothy
Published: (1971)

Survival Disparities among Alzheimer’s Patients in Hawaii: Exploring Racial/Ethnic Disparities and Machine Learning for Survival Prediction in the Hawaii Medicare Population
by: Chathura Siriwardhana
Published: (2024)

AlignMerge - Alignment-Preserving Large Language Model Merging via Fisher-Guided Geometric Constraints
by: Roy, Aniruddha, et al.
Published: (2025)

MergePrint: Merge-Resistant Fingerprints for Robust Black-box Ownership Verification of Large Language Models
by: Yamabe, Shojiro, et al.
Published: (2024)

AdaMergeX: Cross-Lingual Transfer with Large Language Models via Adaptive Adapter Merging
by: Zhao, Yiran, et al.
Published: (2024)

To Merge and Not to Merge: Israel's Union List of Monographs in the Context of Merging Algorithms.
by: Lazinger, Susan S.
Published: (1994)

Mix Data or Merge Models? Balancing the Helpfulness, Honesty, and Harmlessness of Large Language Model via Model Merging
by: Yang, Jinluan, et al.
Published: (2025)

Pharmacy residency leave time: One size does not fit all
by: Vinh K. Thai, et al.
Published: (2025)

Model Merging Scaling Laws in Large Language Models
by: Wang, Yuanyi, et al.
Published: (2025)