Image de couverture de livre

Data Scaling as Progressive Coverage of a Predictive Contribution Spectrum

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Song, Zihui, Ji, Shihao, Li, Hongxi, Cheng, Shuaizhi, Huang, Chunlin
Format:	Preprint
Publié:	2026
Sujets:	Computation and Language Artificial Intelligence Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

L-MoE: End-to-End Training of a Lightweight Mixture of Low-Rank Adaptation Experts
par: Ji, Shihao, et autres
Publié: (2025)

MyGO: Memory Yielding Generative Offline-consolidation for Lifelong Learning Systems
par: Ji, Shihao, et autres
Publié: (2025)

Credal Transformer: A Principled Approach for Quantifying and Mitigating Hallucinations in Large Language Models
par: Ji, Shihao, et autres
Publié: (2025)

Soft-NBCE: Entropy-Weighted Chunk Fusion for Long-Context
par: Ji, Shihao, et autres
Publié: (2026)

Xiaoice: Training-Free Video Understanding via Self-Supervised Spatio-Temporal Clustering of Semantic Features
par: Ji, Shihao, et autres
Publié: (2025)

The Importance of Online Data: Understanding Preference Fine-tuning via Coverage
par: Song, Yuda, et autres
Publié: (2024)

Scaling Laws for Predicting Downstream Performance in LLMs
par: Chen, Yangyi, et autres
Publié: (2024)

Formalising the Logit Shift Induced by LoRA: A Technical Note
par: Shi, Xiang, et autres
Publié: (2026)

AutoScale: Scale-Aware Data Mixing for Pre-Training LLMs
par: Kang, Feiyang, et autres
Publié: (2024)

HyperMLP: An Integrated Perspective for Sequence Modeling
par: Lu, Jiecheng, et autres
Publié: (2026)

Free Energy Mixer
par: Lu, Jiecheng, et autres
Publié: (2026)

Predicting Task Performance with Context-aware Scaling Laws
par: Montgomery, Kyle, et autres
Publié: (2025)

Controlling Multimodal Conversational Agents with Coverage-Enhanced Latent Actions
par: Li, Yongqi, et autres
Publié: (2026)

Incremental Summarization for Customer Support via Progressive Note-Taking and Agent Feedback
par: Wu, Yisha, et autres
Publié: (2025)

ProgressGym: Alignment with a Millennium of Moral Progress
par: Qiu, Tianyi, et autres
Publié: (2024)

ConU: Conformal Uncertainty in Large Language Models with Correctness Coverage Guarantees
par: Wang, Zhiyuan, et autres
Publié: (2024)

The Override Gap: A Magnitude Account of Knowledge Conflict Failure in Hypernetwork-Based Instant LLM Adaptation
par: Cheng, Shuaizhi, et autres
Publié: (2026)

IPAD: Inverse Prompt for AI Detection - A Robust and Interpretable LLM-Generated Text Detector
par: Chen, Zheng, et autres
Publié: (2025)

In-context Time Series Predictor
par: Lu, Jiecheng, et autres
Publié: (2024)

Developing an End-to-End Framework for Predicting the Social Communication Severity Scores of Children with Autism Spectrum Disorder
par: Mun, Jihyun, et autres
Publié: (2024)

EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesis
par: Song, Xiaoshuai, et autres
Publié: (2026)

Skywork-Math: Data Scaling Laws for Mathematical Reasoning in Large Language Models -- The Story Goes On
par: Zeng, Liang, et autres
Publié: (2024)

DISCO Balances the Scales: Adaptive Domain- and Difficulty-Aware Reinforcement Learning on Imbalanced Data
par: Zhou, Yuhang, et autres
Publié: (2025)

RedStar: Does Scaling Long-CoT Data Unlock Better Slow-Reasoning Systems?
par: Xu, Haotian, et autres
Publié: (2025)

ReAct Meets ActRe: When Language Agents Enjoy Training Data Autonomy
par: Yang, Zonghan, et autres
Publié: (2024)

Can Interpretation Predict Behavior on Unseen Data?
par: Li, Victoria R., et autres
Publié: (2025)

Scaling Data-Constrained Language Models
par: Muennighoff, Niklas, et autres
Publié: (2023)

Progressive Knowledge Graph Completion
par: Li, Jiayi, et autres
Publié: (2024)

Loss-to-Loss Prediction: Scaling Laws for All Datasets
par: Brandfonbrener, David, et autres
Publié: (2024)

Scaling with Collapse: Efficient and Predictable Training of LLM Families
par: Bergsma, Shane, et autres
Publié: (2025)

Observational Scaling Laws and the Predictability of Language Model Performance
par: Ruan, Yangjun, et autres
Publié: (2024)

Balancing Coverage and Draft Latency in Vocabulary Trimming for Faster Speculative Decoding
par: Shoham, Ofir Ben
Publié: (2026)

Scaling DPPs for RAG: Density Meets Diversity
par: Sun, Xun, et autres
Publié: (2026)

Scaling Inference-Efficient Language Models
par: Bian, Song, et autres
Publié: (2025)

Generating Pretraining Tokens from Organic Data for Data-Bound Scaling
par: Yu, Zichun, et autres
Publié: (2026)

Health Insurance Coverage Rule Interpretation Corpus: Law, Policy, and Medical Guidance for Health Insurance Coverage Understanding
par: Gartner, Mike
Publié: (2025)

Theoretical Foundations of Scaling Law in Familial Models
par: Song, Huan, et autres
Publié: (2025)

An Empirical Study of Data Ability Boundary in LLMs' Math Reasoning
par: Chen, Zui, et autres
Publié: (2024)

Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-training
par: Yang, Kailai, et autres
Publié: (2025)

Efficient Test-Time Scaling via Self-Calibration
par: Huang, Chengsong, et autres
Publié: (2025)