Image de couverture de livre

Using Scaling Laws for Data Source Utility Estimation in Domain-Specific Pre-Training

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Ostapenko, Oleksiy, Guille-Escuret, Charles, Kumar, Luke, Tian, Max, Kocetkov, Denis, Subbaraj, Gopeshh, Li, Raymond, Lamy-Poirier, Joel, Paquet, Sebastien, Scholak, Torsten
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Apriel-H1: Towards Efficient Enterprise Reasoning Models
par: Ostapenko, Oleksiy, et autres
Publié: (2025)

Super Apriel: One Checkpoint, Many Speeds
par: Labs, SLAM, et autres
Publié: (2026)

DiffuMamba: High-Throughput Diffusion LMs with Mamba Backbone
par: Singh, Vaibhav, et autres
Publié: (2025)

GFlowNet Pretraining with Inexpensive Rewards
par: Pandey, Mohit, et autres
Publié: (2024)

From Conformal Predictions to Confidence Regions
par: Guille-Escuret, Charles, et autres
Publié: (2024)

Finite Sample Confidence Regions for Linear Regression Parameters Using Arbitrary Predictors
par: Guille-Escuret, Charles, et autres
Publié: (2024)

Enabling Realtime Reinforcement Learning at Scale with Staggered Asynchronous Inference
par: Riemer, Matthew, et autres
Publié: (2024)

Revisiting Replay and Gradient Alignment for Continual Pre-Training of Large Language Models
par: Abbes, Istabrak, et autres
Publié: (2025)

Pretraining Generative Flow Networks with Inexpensive Rewards for Molecular Graph Generation
par: Pandey, Mohit, et autres
Publié: (2025)

Gradient Descent Is Optimal Under Lower Restricted Secant Inequality And Upper Error Bound
par: Guille-Escuret, Charles, et autres
Publié: (2022)

A Study of Condition Numbers for First-Order Optimization
par: Guille-Escuret, Charles, et autres
Publié: (2020)

Perplexed: Understanding When Large Language Models are Confused
par: Cooper, Nathan, et autres
Publié: (2024)

CADet: Fully Self-Supervised Out-Of-Distribution Detection With Contrastive Learning
par: Guille-Escuret, Charles, et autres
Publié: (2022)

Expecting The Unexpected: Towards Broad Out-Of-Distribution Detection
par: Guille-Escuret, Charles, et autres
Publié: (2023)

Unifying Autoregressive and Diffusion-Based Sequence Generation
par: Fathi, Nima, et autres
Publié: (2025)

Seq-VCR: Preventing Collapse in Intermediate Transformer Representations for Enhanced Reasoning
par: Arefin, Md Rifat, et autres
Publié: (2024)

Triple negative breast cancer: 5-year results of combined treatment
par: Valerijus Ostapenko
Publié: (2013)

DSCLAP: Domain-Specific Contrastive Language-Audio Pre-Training
par: Liu, Shengqiang, et autres
Publié: (2024)

Guiding Language Model Reasoning with Planning Tokens
par: Wang, Xinyi, et autres
Publié: (2023)

D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Models
par: Que, Haoran, et autres
Publié: (2024)

Life Cycle Assessment of Alkali Activator Solutions With Different Silica Modulus by ATR‐FTIR and 2 9 Si NMR: Influence on the Geopolymerization of Fly Ash ‐ GGBS System
par: Siva Shankari Subbaraj Velmurugan, et autres
Publié: (2026)

A homotopical algebra approach to the computation of higher limits
par: Santiago, Guille Carrión
Publié: (2024)

Política del antagonismo, política de la hospitalidad. Derivas de la teoría del discurso en Laclau y Derrida
par: Gustavo Patricio Guille
Publié: (2019)

De la historia natural a la biología moderna: máquinas, robots y cabinas de vuelo en el Natural History Museum (NHM , Museo de Historia Natural), Londres, Reino Unido
par: Gustavo Corral Guillé
Publié: (2017)

ESCUDRIÑANDO LA RAZÓN: NATURALEZA Y PROPÓSITOS DE LA CIENCIA
par: Gustavo Corral-Guillé
Publié: (2021)

Democracia versus populismo. Entre el mito y el dogma
par: Gustavo P. Guille
Publié: (2019)

Laclau y lo político. Esteban Vergalito
par: Gustavo P. Guille
Publié: (2019)

La constitución de subjetividades políticas en tiempos "post- estatales": un contrapunto entre Agamben, Nergri y Laclau
par: Gustavo Patricio Guille
Publié: (2017)

Understanding Adam Requires Better Rotation Dependent Assumptions
par: Zhang, Tianyue H., et autres
Publié: (2024)

Source-Free Domain Adaptation Guided by Vision and Vision-Language Pre-Training
par: Zhang, Wenyu, et autres
Publié: (2024)

DALIP: Distribution Alignment-based Language-Image Pre-Training for Domain-Specific Data
par: Wu, Junjie, et autres
Publié: (2025)

ARCHITECTURAL MODERNIZATION OF RESIDENTIAL BUILDINGS AS A FACTOR IN IMPROVING THE QUALITY OF THE URBAN ENVIRONMENT: THEORETICAL ASPECTS AND REGIONAL PRACTICES
par: Ostapenko I., et autres
Publié: (2025)

NATURE IN THE CITY: THE ROLE OF ECOAGROARCHITECTURE IN SHAPING A COMFORTABLE URBAN ENVIRONMENT
par: Ostapenko I., et autres
Publié: (2025)

Minimax Extrapolation Problem For Harmonizable Stable Sequences With Noise Observations
par: Moklyachuk, Mikhail, et autres
Publié: (2016)

Novel Adaptive Schemes for Hyperbolic Conservation Laws
par: Chu, Shaoshuai, et autres
Publié: (2025)

HUKUKBERT: Domain-Specific Language Model for Turkish Law
par: Öztürk, Mehmet Utku, et autres
Publié: (2026)

PTPP-Aware Adaptation Scaling Laws: Predicting Domain-Adaptation Performance at Unseen Pre-Training Budgets
par: Goffinet, Etienne, et autres
Publié: (2025)

Tate-Shafarevich groups and algebras
par: Kunyavskii, Boris, et autres
Publié: (2022)

Partition regularity of Pythagorean pairs
par: Frantzikinakis, Nikos, et autres
Publié: (2023)

Partition regularity of generalized Pythagorean pairs
par: Frantzikinakis, Nikos, et autres
Publié: (2024)