Image de couverture de livre

Fisher Mask Nodes for Language Model Merging

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	K, Thennal D, Nathan, Ganesh, S, Suchithra M
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Artificial Intelligence Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Large Language Models Are Overparameterized Text Encoders
par: K, Thennal D, et autres
Publié: (2024)

Arcee's MergeKit: A Toolkit for Merging Large Language Models
par: Goddard, Charles, et autres
Publié: (2024)

K-Merge: Online Continual Merging of Adapters for On-device Large Language Models
par: Shenaj, Donald, et autres
Publié: (2025)

Mix Data or Merge Models? Balancing the Helpfulness, Honesty, and Harmlessness of Large Language Model via Model Merging
par: Yang, Jinluan, et autres
Publié: (2025)

MrT5: Dynamic Token Merging for Efficient Byte-level Language Models
par: Kallini, Julie, et autres
Publié: (2024)

Soft-Masked Diffusion Language Models
par: Hersche, Michael, et autres
Publié: (2025)

Merge to Mix: Mixing Datasets via Model Merging
par: Tao, Zhixu Silvia, et autres
Publié: (2025)

Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging
par: Lu, Zhenyi, et autres
Publié: (2024)

Simple and Effective Masked Diffusion Language Models
par: Sahoo, Subham Sekhar, et autres
Publié: (2024)

On the Reasoning Abilities of Masked Diffusion Language Models
par: Svete, Anej, et autres
Publié: (2025)

Iterative Mask Filling: An Effective Text Augmentation Method Using Masked Language Modeling
par: Kesgin, Himmet Toprak, et autres
Publié: (2024)

Data-driven Clustering and Merging of Adapters for On-device Large Language Models
par: Bohdal, Ondrej, et autres
Publié: (2026)

Branch-Solve-Merge Improves Large Language Model Evaluation and Generation
par: Saha, Swarnadeep, et autres
Publié: (2023)

Understanding and Accelerating the Training of Masked Diffusion Language Models
par: Hong, Chunsan, et autres
Publié: (2026)

Boosting Large Language Models with Mask Fine-Tuning
par: Zhang, Mingyuan, et autres
Publié: (2025)

Label-free Node Classification on Graphs with Large Language Models (LLMS)
par: Chen, Zhikai, et autres
Publié: (2023)

Model Merging for Knowledge Editing
par: Fu, Zichuan, et autres
Publié: (2025)

How Important Is Tokenization in French Medical Masked Language Models?
par: Labrak, Yanis, et autres
Publié: (2024)

Labrador: Exploring the Limits of Masked Language Modeling for Laboratory Data
par: Bellamy, David R., et autres
Publié: (2023)

Confidence Regularized Masked Language Modeling using Text Length
par: Ji, Seunghyun, et autres
Publié: (2025)

Masked Thought: Simply Masking Partial Reasoning Steps Can Improve Mathematical Reasoning Learning of Language Models
par: Chen, Changyu, et autres
Publié: (2024)

GMLM: Bridging Graph Neural Networks and Language Models for Heterophilic Node Classification
par: Sinha, Aarush
Publié: (2025)

What Matters for Model Merging at Scale?
par: Yadav, Prateek, et autres
Publié: (2024)

Dynamic Model Merging Made Slim
par: Du, Guodong, et autres
Publié: (2026)

Channel Merging: Preserving Specialization for Merged Experts
par: Zhang, Mingyang, et autres
Publié: (2024)

EvoMerge: Neuroevolution for Large Language Models
par: Jiang, Yushu
Publié: (2024)

MaskLLM: Learnable Semi-Structured Sparsity for Large Language Models
par: Fang, Gongfan, et autres
Publié: (2024)

ILRR: Inference-Time Steering Method for Masked Diffusion Language Models
par: Avrahami, Eden, et autres
Publié: (2026)

Grow Up and Merge: Scaling Strategies for Efficient Language Adaptation
par: Glocker, Kevin, et autres
Publié: (2025)

STAR: Spectral Truncation and Rescale for Model Merging
par: Lee, Yu-Ang, et autres
Publié: (2025)

Model Merging by Uncertainty-Based Gradient Matching
par: Daheim, Nico, et autres
Publié: (2023)

Optimal Brain Iterative Merging: Mitigating Interference in LLM Merging
par: Wang, Zhixiang, et autres
Publié: (2025)

Exploring Gradient-Guided Masked Language Model to Detect Textual Adversarial Attacks
par: Zhang, Xiaomei, et autres
Publié: (2025)

Merging Text Transformer Models from Different Initializations
par: Verma, Neha, et autres
Publié: (2024)

Model Assembly Learning with Heterogeneous Layer Weight Merging
par: Zhang, Yi-Kai, et autres
Publié: (2025)

Variational Masked Diffusion Models
par: Zhang, Yichi, et autres
Publié: (2025)

Masked Diffusion Models are Secretly Time-Agnostic Masked Models and Exploit Inaccurate Categorical Sampling
par: Zheng, Kaiwen, et autres
Publié: (2024)

Mechanism Shift During Post-training from Autoregressive to Masked Diffusion Language Models
par: Kong, Injin, et autres
Publié: (2026)

Parallelism and Generation Order in Masked Diffusion Language Models: Limits Today, Potential Tomorrow
par: Zhong, Yangyang, et autres
Publié: (2026)

Beyond Masks: Efficient, Flexible Diffusion Language Models via Deletion-Insertion Processes
par: Ding, Fangyu, et autres
Publié: (2026)