Cover Image

1.5-Pints Technical Report: Pretraining in Days, Not Months -- Your Language Model Thrives on Quality Data

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tan, Calvin, Wang, Jerome
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

HY-MT1.5 Technical Report
by: Zheng, Mao, et al.
Published: (2025)

Phoenix-VL 1.5 Medium Technical Report
by: Phoenix, Team, et al.
Published: (2026)

Baichuan-Omni-1.5 Technical Report
by: Li, Yadong, et al.
Published: (2025)

UI-Venus-1.5 Technical Report
by: Venus Team, et al.
Published: (2026)

Don't Throw Away Your Pretrained Model
by: Feng, Shangbin, et al.
Published: (2025)

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
by: Abdin, Marah, et al.
Published: (2024)

Multilingual Language Model Pretraining using Machine-translated Data
by: Wang, Jiayi, et al.
Published: (2025)

ERNIE 5.0 Technical Report
by: Wang, Haifeng, et al.
Published: (2026)

Embedding And Clustering Your Data Can Improve Contrastive Pretraining
by: Merrick, Luke
Published: (2024)

On the importance of Data Scale in Pretraining Arabic Language Models
by: Ghaddar, Abbas, et al.
Published: (2024)

Finetune-RAG: Fine-Tuning Language Models to Resist Hallucination in Retrieval-Augmented Generation
by: Lee, Zhan Peng, et al.
Published: (2025)

NorwAI's Large Language Models: Technical Report
by: Gulla, Jon Atle, et al.
Published: (2026)

Qwen2.5-1M Technical Report
by: Yang, An, et al.
Published: (2025)

Judging Quality Across Languages: A Multilingual Approach to Pretraining Data Filtering with Language Models
by: Ali, Mehdi, et al.
Published: (2025)

Qwen2.5 Technical Report
by: Qwen, et al.
Published: (2024)

EXAONE 4.5 Technical Report
by: Choi, Eunbi, et al.
Published: (2026)

Ruyi2.5 Technical Report
by: Song, Huan, et al.
Published: (2026)

Your Vision-Language Model Itself Is a Strong Filter: Towards High-Quality Instruction Tuning with Data Selection
by: Chen, Ruibo, et al.
Published: (2024)

QuaDMix: Quality-Diversity Balanced Data Selection for Efficient LLM Pretraining
by: Liu, Fengze, et al.
Published: (2025)

MuRating: A High Quality Data Selecting Approach to Multilingual Large Language Model Pretraining
by: Chen, Zhixun, et al.
Published: (2025)

Megrez2 Technical Report
by: Li, Boxun, et al.
Published: (2025)

Nyonic Technical Report
by: Tian, Junfeng, et al.
Published: (2024)

LexPro-1.0 Technical Report
by: Chen, Haotian, et al.
Published: (2025)

Improving Romanian LLM Pretraining Data using Diversity and Quality Filtering
by: Negoita, Vlad, et al.
Published: (2025)

On Linear Representations and Pretraining Data Frequency in Language Models
by: Merullo, Jack, et al.
Published: (2025)

Qwen2.5-Coder Technical Report
by: Hui, Binyuan, et al.
Published: (2024)

Qwen2.5-VL Technical Report
by: Bai, Shuai, et al.
Published: (2025)

Progressive Residual Warmup for Language Model Pretraining
by: Chen, Tianhao, et al.
Published: (2026)

Adapt Once, Thrive with Updates: Transferable Parameter-Efficient Fine-Tuning on Evolving Base Models
by: Gu, Naibin, et al.
Published: (2025)

The Data-Quality Illusion: Rethinking Classifier-Based Quality Filtering for LLM Pretraining
by: Saada, Thiziri Nait, et al.
Published: (2025)

Has Your Pretrained Model Improved? A Multi-head Posterior Based Approach
by: Aboagye, Prince, et al.
Published: (2024)

Efficient Pretraining Data Selection for Language Models via Multi-Actor Collaboration
by: Bai, Tianyi, et al.
Published: (2024)

Improving Non-autoregressive Translation Quality with Pretrained Language Model, Embedding Distillation and Upsampling Strategy for CTC
by: Syu, Shen-sian, et al.
Published: (2023)

Pretraining Language Models Using Translationese
by: Doshi, Meet, et al.
Published: (2024)

Geographic Adaptation of Pretrained Language Models
by: Hofmann, Valentin, et al.
Published: (2022)

Nanbeige4-3B Technical Report: Exploring the Frontier of Small Language Models
by: Yang, Chen, et al.
Published: (2025)

Procedural Pretraining: Warming Up Language Models with Abstract Data
by: Jiang, Liangze, et al.
Published: (2026)

Analyzing Similarity Metrics for Data Selection for Language Model Pretraining
by: Sam, Dylan, et al.
Published: (2025)

DNA 1.0 Technical Report
by: Lee, Jungyup, et al.
Published: (2025)

Set the Clock: Temporal Alignment of Pretrained Language Models
by: Zhao, Bowen, et al.
Published: (2024)