LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training

Documenti analoghi

• LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training
  di: Zhu, Tong, et al.
  Pubblicazione: (2024)
• LLaMA Pro: Progressive LLaMA with Block Expansion
  di: Wu, Chengyue, et al.
  Pubblicazione: (2024)
• ECHO-LLaMA: Efficient Caching for High-Performance LLaMA Training
  di: Dialameh, Maryam, et al.
  Pubblicazione: (2025)
• LLaMA-Reg: Using LLaMA 2 for Unsupervised Medical Image Registration
  di: Ma, Mingrui, et al.
  Pubblicazione: (2024)
• Tailored-LLaMA: Optimizing Few-Shot Learning in Pruned LLaMA Models with Task-Specific Prompts
  di: Aftab, Danyal, et al.
  Pubblicazione: (2024)