AboutMe: Using Self-Descriptions in Webpages to Document the Effects of English Pretraining Data Filters

Documenti analoghi

• Time is Encoded in the Weights of Finetuned Language Models
  di: Nylund, Kai, et al.
  Pubblicazione: (2023)
• LESS: Selecting Influential Data for Targeted Instruction Tuning
  di: Xia, Mengzhou, et al.
  Pubblicazione: (2024)
• Gradient Localization Improves Lifelong Pretraining of Language Models
  di: Fernandez, Jared, et al.
  Pubblicazione: (2024)
• Holistically Evaluating the Environmental Impact of Creating Language Models
  di: Morrison, Jacob, et al.
  Pubblicazione: (2025)
• Scalable Data Ablation Approximations for Language Models through Modular Training and Merging
  di: Na, Clara, et al.
  Pubblicazione: (2024)