Not All Layers Need Tuning: Selective Layer Restoration Recovers Diversity

Documenti analoghi

• Extract, Define, Canonicalize: An LLM-based Framework for Knowledge Graph Construction
  di: Zhang, Bowen, et al.
  Pubblicazione: (2024)
• Rethinking Data Selection at Scale: Random Selection is Almost All You Need
  di: Xia, Tingyu, et al.
  Pubblicazione: (2024)
• Similarity is Not All You Need: Endowing Retrieval Augmented Generation with Multi Layered Thoughts
  di: Gan, Chunjing, et al.
  Pubblicazione: (2024)
• Not All Documents Are What You Need for Extracting Instruction Tuning Data
  di: Zhang, Chi, et al.
  Pubblicazione: (2025)
• Higher Layers Need More LoRA Experts
  di: Gao, Chongyang, et al.
  Pubblicazione: (2024)