Copertina

Fisher Mask Nodes for Language Model Merging

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	K, Thennal D, Nathan, Ganesh, S, Suchithra M
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Artificial Intelligence Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Large Language Models Are Overparameterized Text Encoders
di: K, Thennal D, et al.
Pubblicazione: (2024)

Arcee's MergeKit: A Toolkit for Merging Large Language Models
di: Goddard, Charles, et al.
Pubblicazione: (2024)

K-Merge: Online Continual Merging of Adapters for On-device Large Language Models
di: Shenaj, Donald, et al.
Pubblicazione: (2025)

Mix Data or Merge Models? Balancing the Helpfulness, Honesty, and Harmlessness of Large Language Model via Model Merging
di: Yang, Jinluan, et al.
Pubblicazione: (2025)

MrT5: Dynamic Token Merging for Efficient Byte-level Language Models
di: Kallini, Julie, et al.
Pubblicazione: (2024)

Soft-Masked Diffusion Language Models
di: Hersche, Michael, et al.
Pubblicazione: (2025)

Merge to Mix: Mixing Datasets via Model Merging
di: Tao, Zhixu Silvia, et al.
Pubblicazione: (2025)

Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging
di: Lu, Zhenyi, et al.
Pubblicazione: (2024)

Simple and Effective Masked Diffusion Language Models
di: Sahoo, Subham Sekhar, et al.
Pubblicazione: (2024)

On the Reasoning Abilities of Masked Diffusion Language Models
di: Svete, Anej, et al.
Pubblicazione: (2025)

Iterative Mask Filling: An Effective Text Augmentation Method Using Masked Language Modeling
di: Kesgin, Himmet Toprak, et al.
Pubblicazione: (2024)

Data-driven Clustering and Merging of Adapters for On-device Large Language Models
di: Bohdal, Ondrej, et al.
Pubblicazione: (2026)

Branch-Solve-Merge Improves Large Language Model Evaluation and Generation
di: Saha, Swarnadeep, et al.
Pubblicazione: (2023)

Understanding and Accelerating the Training of Masked Diffusion Language Models
di: Hong, Chunsan, et al.
Pubblicazione: (2026)

Boosting Large Language Models with Mask Fine-Tuning
di: Zhang, Mingyuan, et al.
Pubblicazione: (2025)

Label-free Node Classification on Graphs with Large Language Models (LLMS)
di: Chen, Zhikai, et al.
Pubblicazione: (2023)

Model Merging for Knowledge Editing
di: Fu, Zichuan, et al.
Pubblicazione: (2025)

How Important Is Tokenization in French Medical Masked Language Models?
di: Labrak, Yanis, et al.
Pubblicazione: (2024)

Labrador: Exploring the Limits of Masked Language Modeling for Laboratory Data
di: Bellamy, David R., et al.
Pubblicazione: (2023)

Confidence Regularized Masked Language Modeling using Text Length
di: Ji, Seunghyun, et al.
Pubblicazione: (2025)

Masked Thought: Simply Masking Partial Reasoning Steps Can Improve Mathematical Reasoning Learning of Language Models
di: Chen, Changyu, et al.
Pubblicazione: (2024)

GMLM: Bridging Graph Neural Networks and Language Models for Heterophilic Node Classification
di: Sinha, Aarush
Pubblicazione: (2025)

What Matters for Model Merging at Scale?
di: Yadav, Prateek, et al.
Pubblicazione: (2024)

Dynamic Model Merging Made Slim
di: Du, Guodong, et al.
Pubblicazione: (2026)

Channel Merging: Preserving Specialization for Merged Experts
di: Zhang, Mingyang, et al.
Pubblicazione: (2024)

EvoMerge: Neuroevolution for Large Language Models
di: Jiang, Yushu
Pubblicazione: (2024)

MaskLLM: Learnable Semi-Structured Sparsity for Large Language Models
di: Fang, Gongfan, et al.
Pubblicazione: (2024)

ILRR: Inference-Time Steering Method for Masked Diffusion Language Models
di: Avrahami, Eden, et al.
Pubblicazione: (2026)

Grow Up and Merge: Scaling Strategies for Efficient Language Adaptation
di: Glocker, Kevin, et al.
Pubblicazione: (2025)

STAR: Spectral Truncation and Rescale for Model Merging
di: Lee, Yu-Ang, et al.
Pubblicazione: (2025)

Model Merging by Uncertainty-Based Gradient Matching
di: Daheim, Nico, et al.
Pubblicazione: (2023)

Optimal Brain Iterative Merging: Mitigating Interference in LLM Merging
di: Wang, Zhixiang, et al.
Pubblicazione: (2025)

Exploring Gradient-Guided Masked Language Model to Detect Textual Adversarial Attacks
di: Zhang, Xiaomei, et al.
Pubblicazione: (2025)

Merging Text Transformer Models from Different Initializations
di: Verma, Neha, et al.
Pubblicazione: (2024)

Model Assembly Learning with Heterogeneous Layer Weight Merging
di: Zhang, Yi-Kai, et al.
Pubblicazione: (2025)

Variational Masked Diffusion Models
di: Zhang, Yichi, et al.
Pubblicazione: (2025)

Masked Diffusion Models are Secretly Time-Agnostic Masked Models and Exploit Inaccurate Categorical Sampling
di: Zheng, Kaiwen, et al.
Pubblicazione: (2024)

Wanda++: Pruning Large Language Models via Regional Gradients
di: Yang, Yifan, et al.
Pubblicazione: (2025)

Mechanism Shift During Post-training from Autoregressive to Masked Diffusion Language Models
di: Kong, Injin, et al.
Pubblicazione: (2026)

Parallelism and Generation Order in Masked Diffusion Language Models: Limits Today, Potential Tomorrow
di: Zhong, Yangyang, et al.
Pubblicazione: (2026)