Skip to content
Universidad del Mar SIBUMAR Descubridor Institucional UMAR
  • Inicio
  • Búsqueda avanzada
  • Explorar
  • Login
    • English
    • Deutsch
    • Español
    • Français
    • Italiano
Advanced
  • Model Merging in Pre-training of Large Language Models
Cover Image

Model Merging in Pre-training of Large Language Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Yunshui, Ma, Yiyuan, Yan, Shen, Zhang, Chaoyi, Liu, Jing, Lu, Jianqiao, Xu, Ziwen, Chen, Mengzhao, Wang, Minrui, Zhan, Shiyi, Ma, Jin, Lai, Xunhao, Liu, Deyi, Luo, Yao, Bin, Xingyan, Ren, Hongbin, Han, Mingji, Hao, Wenhao, Yi, Bairen, Liu, LingJun, Ma, Bole, Jia, Xiaoying, Zhou, Xun, Qiao, Siyuan, Xiang, Liang, Wu, Yonghui
Format: Preprint
Published: 2025
Subjects:
Computation and Language
Machine Learning
Online Access:
Acceder al recurso
Tags: Add Tag
No Tags, Be the first to tag this record!
  • Cite this
  • Text this
  • Email this
  • Print
  • Export Record
    • Export to RefWorks
    • Export to EndNoteWeb
    • Export to EndNote
  • Save to List
  • Permanent link
  • Holdings
  • Description
  • Comments
  • Similar Items
  • Staff View

Internet

https://arxiv.org/abs/2505.12082

Similar Items

  • FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
    by: Lai, Xunhao, et al.
    Published: (2025)
  • SPARKLING: Balancing Signal Preservation and Symmetry Breaking for Width-Progressive Learning
    by: Yu, Qifan, et al.
    Published: (2026)
  • MergeMoE: Efficient Compression of MoE Models via Expert Output Merging
    by: Miao, Ruijie, et al.
    Published: (2025)
  • Balanced Actor Initialization: Stable RLHF Training of Distillation-Based Reasoning Models
    by: Zheng, Chen, et al.
    Published: (2025)
  • GatePro: Parameter-Free Expert Selection Optimization for Mixture-of-Experts Models
    by: Zheng, Chen, et al.
    Published: (2025)
Universidad del Mar
Universidad del MarSistema Bibliotecario de la Universidad del MarDescubridor Institucional UMARImplementación y desarrollo: Mtro. Carlos Alonso Albores Pérez
InicioBúsqueda avanzadaExplorar
Visitas al Descubridor: 33,245© 2026 Universidad del Mar