CausalLM is not optimal for in-context learning

Documenti analoghi

• In-context Learning and Gradient Descent Revisited
  di: Deutch, Gilad, et al.
  Pubblicazione: (2023)
• Bayesian scaling laws for in-context learning
  di: Arora, Aryaman, et al.
  Pubblicazione: (2024)
• Omni-SMoLA: Boosting Generalist Multimodal Models with Soft Mixture of Low-rank Experts
  di: Wu, Jialin, et al.
  Pubblicazione: (2023)
• The broader spectrum of in-context learning
  di: Lampinen, Andrew Kyle, et al.
  Pubblicazione: (2024)
• Re-examining learning linear functions in context
  di: Naim, Omar, et al.
  Pubblicazione: (2024)