LP Data Pipeline: Lightweight, Purpose-driven Data Pipeline for Large Language Models

Documenti analoghi

• 1 Trillion Token (1TT) Platform: A Novel Framework for Efficient Data Sharing and Compensation in Large Language Models
  di: Park, Chanjun, et al.
  Pubblicazione: (2024)
• Rethinking KenLM: Good and Bad Model Ensembles for Efficient Text Quality Filtering in Large Web Corpora
  di: Kim, Yungi, et al.
  Pubblicazione: (2024)
• Dataverse: Open-Source ETL (Extract, Transform, Load) Pipeline for Large Language Models
  di: Park, Hyunbyung, et al.
  Pubblicazione: (2024)
• Open Ko-LLM Leaderboard2: Bridging Foundational and Practical Evaluation for Korean LLMs
  di: Kim, Hyeonwoo, et al.
  Pubblicazione: (2024)
• Representing the Under-Represented: Cultural and Core Capability Benchmarks for Developing Thai Large Language Models
  di: Kim, Dahyun, et al.
  Pubblicazione: (2024)