Imagen de Portada

Predictive Data Selection: The Data That Predicts Is the Data That Teaches

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Shum, Kashun, Huang, Yuzhen, Zou, Hongjian, Ding, Qi, Liao, Yixuan, Chen, Xiaoxin, Liu, Qian, He, Junxian
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Caption First, VQA Second: Knowledge Density, Not Task Format, Drives Multimodal Scaling
por: Zou, Hongjian, et al.
Publicado: (2026)

Benchmark Shadows: Data Alignment, Parameter Footprints, and Generalization in Large Language Models
por: Zou, Hongjian, et al.
Publicado: (2026)

What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning
por: Liu, Wei, et al.
Publicado: (2023)

Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data
por: Shum, KaShun, et al.
Publicado: (2023)

SWE-RM: Execution-free Feedback For Software Engineering Agents
por: Shum, KaShun, et al.
Publicado: (2025)

From Accuracy to Robustness: A Study of Rule- and Model-based Verifiers in Mathematical Reasoning
por: Huang, Yuzhen, et al.
Publicado: (2025)

SimpleRL-Zoo: Investigating and Taming Zero Reinforcement Learning for Open Base Models in the Wild
por: Zeng, Weihao, et al.
Publicado: (2025)

Unmasking Deceptive Visuals: Benchmarking Multimodal Large Language Models on Misleading Chart Question Answering
por: Chen, Zixin, et al.
Publicado: (2025)

EvoSelect: Data-Efficient LLM Evolution for Targeted Task Adaptation
por: Li, Ting-Wei, et al.
Publicado: (2026)

Compression Represents Intelligence Linearly
por: Huang, Yuzhen, et al.
Publicado: (2024)

Breaking the Data Barrier -- Building GUI Agents Through Task Generalization
por: Zhang, Junlei, et al.
Publicado: (2025)

RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models
por: Niu, Cheng, et al.
Publicado: (2023)

Resolving Knowledge Conflicts in Domain-specific Data Selection: A Case Study on Medical Instruction-tuning
por: Zhong, Qihuang, et al.
Publicado: (2025)

Entropy-Based Data Selection for Language Models
por: Li, Hongming, et al.
Publicado: (2026)

Adaptive Data Augmentation for Aspect Sentiment Quad Prediction
por: Zhang, Wenyuan, et al.
Publicado: (2024)

Your Vision-Language Model Itself Is a Strong Filter: Towards High-Quality Instruction Tuning with Data Selection
por: Chen, Ruibo, et al.
Publicado: (2024)

Data Quality Enhancement on the Basis of Diversity with Large Language Models for Text Classification: Uncovered, Difficult, and Noisy
por: Zeng, Min, et al.
Publicado: (2024)

Bi-directional Bias Attribution: Debiasing Large Language Models without Modifying Prompts
por: Lin, Yujie, et al.
Publicado: (2026)

A Learning Rate Path Switching Training Paradigm for Version Updates of Large Language Models
por: Wang, Zhihao, et al.
Publicado: (2024)

DataDecide: How to Predict Best Pretraining Data with Small Experiments
por: Magnusson, Ian, et al.
Publicado: (2025)

DataProphet: Demystifying Supervision Data Generalization in Multimodal LLMs
por: Qi, Xuan, et al.
Publicado: (2026)

LLM-Driven Preference Data Synthesis for Proactive Prediction of the Next User Utterance in Human-Machine Dialogue
por: Wang, Jinqiang, et al.
Publicado: (2025)

Enhancing Traffic Prediction with Textual Data Using Large Language Models
por: Huang, Xiannan
Publicado: (2024)

Selective Annotation via Data Allocation: These Data Should Be Triaged to Experts for Annotation Rather Than the Model
por: Huang, Chen, et al.
Publicado: (2024)

Adaptive Block-Scaled Data Types
por: Cook, Jack, et al.
Publicado: (2026)

B-STaR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners
por: Zeng, Weihao, et al.
Publicado: (2024)

SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyond
por: Liu, Junteng, et al.
Publicado: (2025)

Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performance
por: Ye, Jiasheng, et al.
Publicado: (2024)

DAComp: Benchmarking Data Agents across the Full Data Intelligence Lifecycle
por: Lei, Fangyu, et al.
Publicado: (2025)

Selecting Auxiliary Data via Neural Tangent Kernels for Low-Resource Domains
por: Wang, Pingjie, et al.
Publicado: (2025)

gzip Predicts Data-dependent Scaling Laws
por: Pandey, Rohan
Publicado: (2024)

Accurate and Data-Efficient Toxicity Prediction when Annotators Disagree
por: Jaggi, Harbani, et al.
Publicado: (2024)

Alignment Data Map for Efficient Preference Data Selection and Diagnosis
por: Lee, Seohyeong, et al.
Publicado: (2025)

Unified Data Selection for LLM Reasoning
por: Li, Xiaoyuan, et al.
Publicado: (2026)

Mixed Preference Optimization: Reinforcement Learning with Data Selection and Better Reference Model
por: Gou, Qi, et al.
Publicado: (2024)

More Data or Better Data? A Critical Analysis of Data Selection and Synthesis for Mathematical Reasoning
por: Zhao, Yike, et al.
Publicado: (2025)

Token Cleaning: Fine-Grained Data Selection for LLM Supervised Fine-Tuning
por: Pang, Jinlong, et al.
Publicado: (2025)

A Scoping Review of Synthetic Data Generation by Language Models in Biomedical Research and Application: Data Utility and Quality Perspectives
por: Rao, Hanshu, et al.
Publicado: (2025)

I Predict Therefore I Am: Is Next Token Prediction Enough to Learn Human-Interpretable Concepts from Data?
por: Liu, Yuhang, et al.
Publicado: (2025)

Learn to Reason Efficiently with Adaptive Length-based Reward Shaping
por: Liu, Wei, et al.
Publicado: (2025)