$100K or 100 Days: Trade-offs when Pre-Training with Academic Resources

Documenti analoghi

• How Do Language Models Compose Functions?
  di: Khandelwal, Apoorv, et al.
  Pubblicazione: (2025)
• Does CLIP Bind Concepts? Probing Compositionality in Large Image Models
  di: Lewis, Martha, et al.
  Pubblicazione: (2022)
• Talking Heads: Understanding Inter-layer Communication in Transformer Language Models
  di: Merullo, Jack, et al.
  Pubblicazione: (2024)
• Circuit Component Reuse Across Tasks in Transformer Language Models
  di: Merullo, Jack, et al.
  Pubblicazione: (2023)
• Language Models Implement Simple Word2Vec-style Vector Arithmetic
  di: Merullo, Jack, et al.
  Pubblicazione: (2023)