Image de couverture de livre

Adaptive Data Optimization: Dynamic Sample Selection with Scaling Laws

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Jiang, Yiding, Zhou, Allan, Feng, Zhili, Malladi, Sadhika, Kolter, J. Zico
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

On the SDEs and Scaling Rules for Adaptive Gradient Algorithms
par: Malladi, Sadhika, et autres
Publié: (2022)

Scaling Laws for Data Filtering -- Data Curation cannot be Compute Agnostic
par: Goyal, Sachin, et autres
Publié: (2024)

An Axiomatic Approach to Model-Agnostic Concept Explanations
par: Feng, Zhili, et autres
Publié: (2024)

Looking beyond the next token
par: Thankaraj, Abitha, et autres
Publié: (2025)

LESS: Selecting Influential Data for Targeted Instruction Tuning
par: Xia, Mengzhou, et autres
Publié: (2024)

FUSE-ing Language Models: Zero-Shot Adapter Discovery for Prompt Optimization Across Tokenizers
par: Williams, Joshua Nathaniel, et autres
Publié: (2024)

TOFU: A Task of Fictitious Unlearning for LLMs
par: Maini, Pratyush, et autres
Publié: (2024)

Rethinking LLM Memorization through the Lens of Adversarial Compression
par: Schwarzschild, Avi, et autres
Publié: (2024)

In Good GRACEs: Principled Teacher Selection for Knowledge Distillation
par: Panigrahi, Abhishek, et autres
Publié: (2025)

From Entropy to Epiplexity: Rethinking Information for Computationally Bounded Intelligence
par: Finzi, Marc, et autres
Publié: (2026)

Measuring Five-Nines Reliability: Sample-Efficient LLM Evaluation in Saturated Benchmarks
par: Kim, Eungyeup, et autres
Publié: (2026)

Provable unlearning in topic modeling and downstream tasks
par: Wei, Stanley, et autres
Publié: (2024)

Trainable Transformer in Transformer
par: Panigrahi, Abhishek, et autres
Publié: (2023)

AcceleratedLiNGAM: Learning Causal DAGs at the speed of GPUs
par: Akinwande, Victor, et autres
Publié: (2024)

Why is SAM Robust to Label Noise?
par: Baek, Christina, et autres
Publié: (2024)

Equilibrium Reasoners: Learning Attractors Enables Scalable Reasoning
par: Huang, Benhao, et autres
Publié: (2026)

Mimetic Initialization of MLPs
par: Trockman, Asher, et autres
Publié: (2026)

Progressive distillation induces an implicit curriculum
par: Panigrahi, Abhishek, et autres
Publié: (2024)

Predicting the Performance of Black-box LLMs through Follow-up Queries
par: Sam, Dylan, et autres
Publié: (2025)

Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization
par: Razin, Noam, et autres
Publié: (2024)

The Marginal Value of Momentum for Small Learning Rate SGD
par: Wang, Runzhe, et autres
Publié: (2023)

Not All Rollouts are Useful: Down-Sampling Rollouts in LLM Reinforcement Learning
par: Xu, Yixuan Even, et autres
Publié: (2025)

Training a Generally Curious Agent
par: Tajwar, Fahim, et autres
Publié: (2025)

Diffusing Differentiable Representations
par: Savani, Yash, et autres
Publié: (2024)

One-Step Diffusion Distillation via Deep Equilibrium Models
par: Geng, Zhengyang, et autres
Publié: (2023)

Generative Posterior Networks for Approximately Bayesian Epistemic Uncertainty Estimation
par: Roderick, Melrose, et autres
Publié: (2023)

Prompt Recovery for Image Generation Models: A Comparative Study of Discrete Optimizers
par: Williams, Joshua Nathaniel, et autres
Publié: (2024)

Rethinking Distance Metrics for Counterfactual Explainability
par: Williams, Joshua Nathaniel, et autres
Publié: (2024)

Context-Parametric Inversion: Why Instruction Finetuning Can Worsen Context Reliance
par: Goyal, Sachin, et autres
Publié: (2024)

Massive Activations in Large Language Models
par: Sun, Mingjie, et autres
Publié: (2024)

The Mixing method: low-rank coordinate descent for semidefinite programming with diagonal constraints
par: Wang, Po-Wei, et autres
Publié: (2017)

Existing Large Language Model Unlearning Evaluations Are Inconclusive
par: Feng, Zhili, et autres
Publié: (2025)

Safety Pretraining: Toward the Next Generation of Safe AI
par: Maini, Pratyush, et autres
Publié: (2025)

Understanding Hallucinations in Diffusion Models through Mode Interpolation
par: Aithal, Sumukh K, et autres
Publié: (2024)

Evaluating Language Model Reasoning about Confidential Information
par: Sam, Dylan, et autres
Publié: (2025)

When Should We Introduce Safety Interventions During Pretraining?
par: Sam, Dylan, et autres
Publié: (2026)

Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression
par: Zhai, Runtian, et autres
Publié: (2023)

A Simple and Effective Pruning Approach for Large Language Models
par: Sun, Mingjie, et autres
Publié: (2023)

Understanding Optimization in Deep Learning with Central Flows
par: Cohen, Jeremy M., et autres
Publié: (2024)

Bayesian Neural Networks with Domain Knowledge Priors
par: Sam, Dylan, et autres
Publié: (2024)