Not Every AI Problem is a Data Problem: We Should Be Intentional About Data Scaling
Fuente:
arXiv
Saved in:
| Main Authors: | Rodchenko, Tanya, Noy, Natasha, Scherrer, Nino |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
How Should LLMs Consume High-Quality Data? Optimal Data Scheduling via Quality-Aware Functional Scaling Laws
by: Zhu, Zhitao, et al.
Published: (2026)
by: Zhu, Zhitao, et al.
Published: (2026)
Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale
by: Zhou, Fan, et al.
Published: (2024)
by: Zhou, Fan, et al.
Published: (2024)
Generative Modeling for Robust Deep Reinforcement Learning on the Traveling Salesman Problem
by: Li, Michael, et al.
Published: (2025)
by: Li, Michael, et al.
Published: (2025)
How Should We Meta-Learn Reinforcement Learning Algorithms?
by: Goldie, Alexander David, et al.
Published: (2025)
by: Goldie, Alexander David, et al.
Published: (2025)
Principled Data Augmentation for Learning to Solve Quadratic Programming Problems
by: Qian, Chendi, et al.
Published: (2025)
by: Qian, Chendi, et al.
Published: (2025)
Should We Ever Prefer Decision Transformer for Offline Reinforcement Learning?
by: Omori, Yumi, et al.
Published: (2025)
by: Omori, Yumi, et al.
Published: (2025)
AI Should Sense Better, Not Just Scale Bigger: Adaptive Sensing as a Paradigm Shift
by: Baek, Eunsu, et al.
Published: (2025)
by: Baek, Eunsu, et al.
Published: (2025)
HardCore Generation: Generating Hard UNSAT Problems for Data Augmentation
by: Cotnareanu, Joseph, et al.
Published: (2024)
by: Cotnareanu, Joseph, et al.
Published: (2024)
For How Long Should We Be Punching? Learning Action Duration in Fighting Games
by: Nguyen, Hoang Hai, et al.
Published: (2026)
by: Nguyen, Hoang Hai, et al.
Published: (2026)
How Should We Represent History in Interpretable Models of Clinical Policies?
by: Matsson, Anton, et al.
Published: (2024)
by: Matsson, Anton, et al.
Published: (2024)
Fusing Cross-Domain Knowledge from Multimodal Data to Solve Problems in the Physical World
by: Zheng, Yu
Published: (2025)
by: Zheng, Yu
Published: (2025)
Every Rollout Counts: Optimal Resource Allocation for Efficient Test-Time Scaling
by: Wang, Xinglin, et al.
Published: (2025)
by: Wang, Xinglin, et al.
Published: (2025)
We Should Identify and Mitigate Third-Party Safety Risks in MCP-Powered Agent Systems
by: Fang, Junfeng, et al.
Published: (2025)
by: Fang, Junfeng, et al.
Published: (2025)
Inducing Group Fairness in Prompt-Based Language Model Decisions
by: Atwood, James, et al.
Published: (2024)
by: Atwood, James, et al.
Published: (2024)
ScaleDiff: Scaling Difficult Problems for Advanced Mathematical Reasoning
by: Pei, Qizhi, et al.
Published: (2025)
by: Pei, Qizhi, et al.
Published: (2025)
Infer Human's Intentions Before Following Natural Language Instructions
by: Wan, Yanming, et al.
Published: (2024)
by: Wan, Yanming, et al.
Published: (2024)
Position: Weight Space Should Be a First-Class Generative AI Modality
by: Wang, Zhangyang, et al.
Published: (2026)
by: Wang, Zhangyang, et al.
Published: (2026)
Scale Dependent Data Duplication
by: Kazdan, Joshua, et al.
Published: (2026)
by: Kazdan, Joshua, et al.
Published: (2026)
DataMaster: Data-Centric Autonomous AI Research
by: Du, Yaxin, et al.
Published: (2026)
by: Du, Yaxin, et al.
Published: (2026)
Matching Problems to Solutions: An Explainable Way of Solving Machine Learning Problems
by: Saleh, Lokman, et al.
Published: (2024)
by: Saleh, Lokman, et al.
Published: (2024)
Data-driven Projection Generation for Efficiently Solving Heterogeneous Quadratic Programming Problems
by: Iwata, Tomoharu, et al.
Published: (2025)
by: Iwata, Tomoharu, et al.
Published: (2025)
OPT-BENCH: Evaluating LLM Agent on Large-Scale Search Spaces Optimization Problems
by: Li, Xiaozhe, et al.
Published: (2025)
by: Li, Xiaozhe, et al.
Published: (2025)
Open Problems in Machine Unlearning for AI Safety
by: Barez, Fazl, et al.
Published: (2025)
by: Barez, Fazl, et al.
Published: (2025)
Data Value in the Age of Scaling: Understanding LLM Scaling Dynamics Under Real-Synthetic Data Mixtures
by: Wang, Haohui, et al.
Published: (2025)
by: Wang, Haohui, et al.
Published: (2025)
When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time?
by: Li, Chenyang, et al.
Published: (2025)
by: Li, Chenyang, et al.
Published: (2025)
Multi-Task Learning for Routing Problem with Cross-Problem Zero-Shot Generalization
by: Liu, Fei, et al.
Published: (2024)
by: Liu, Fei, et al.
Published: (2024)
Cyborg Data: Merging Human with AI Generated Training Data
by: North, Kai, et al.
Published: (2025)
by: North, Kai, et al.
Published: (2025)
Trust Your $\nabla$: Gradient-based Intervention Targeting for Causal Discovery
by: Olko, Mateusz, et al.
Published: (2022)
by: Olko, Mateusz, et al.
Published: (2022)
Solving a Research Problem in Mathematical Statistics with AI Assistance
by: Dobriban, Edgar
Published: (2025)
by: Dobriban, Edgar
Published: (2025)
Enhancing LLMs for Physics Problem-Solving using Reinforcement Learning with Human-AI Feedback
by: Anand, Avinash, et al.
Published: (2024)
by: Anand, Avinash, et al.
Published: (2024)
Uncovering Competency Gaps in Large Language Models and Their Benchmarks
by: Bohacek, Maty, et al.
Published: (2025)
by: Bohacek, Maty, et al.
Published: (2025)
We are not able to identify AI-generated images
by: Pavão, Adrien
Published: (2025)
by: Pavão, Adrien
Published: (2025)
GeoUni: A Unified Model for Generating Geometry Diagrams, Problems and Problem Solutions
by: Cheng, Jo-Ku, et al.
Published: (2025)
by: Cheng, Jo-Ku, et al.
Published: (2025)
Should We Attend More or Less? Modulating Attention for Fairness
by: Zayed, Abdelrahman, et al.
Published: (2023)
by: Zayed, Abdelrahman, et al.
Published: (2023)
Sandbagging in a Simple Survival Bandit Problem
by: Dyer, Joel, et al.
Published: (2025)
by: Dyer, Joel, et al.
Published: (2025)
On Revealing the Hidden Problem Structure in Real-World and Theoretical Problems Using Walsh Coefficient Influence
by: Przewozniczek, M. W., et al.
Published: (2025)
by: Przewozniczek, M. W., et al.
Published: (2025)
On the Effects of Data Scale on UI Control Agents
by: Li, Wei, et al.
Published: (2024)
by: Li, Wei, et al.
Published: (2024)
Selective Reviews of Bandit Problems in AI via a Statistical View
by: Zhou, Pengjie, et al.
Published: (2024)
by: Zhou, Pengjie, et al.
Published: (2024)
Do Depth-Grown Models Overcome the Curse of Depth? An In-Depth Analysis
by: Kapl, Ferdinand, et al.
Published: (2025)
by: Kapl, Ferdinand, et al.
Published: (2025)
Position: We Need An Algorithmic Understanding of Generative AI
by: Eberle, Oliver, et al.
Published: (2025)
by: Eberle, Oliver, et al.
Published: (2025)
Similar Items
-
How Should LLMs Consume High-Quality Data? Optimal Data Scheduling via Quality-Aware Functional Scaling Laws
by: Zhu, Zhitao, et al.
Published: (2026) -
Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale
by: Zhou, Fan, et al.
Published: (2024) -
Generative Modeling for Robust Deep Reinforcement Learning on the Traveling Salesman Problem
by: Li, Michael, et al.
Published: (2025) -
How Should We Meta-Learn Reinforcement Learning Algorithms?
by: Goldie, Alexander David, et al.
Published: (2025) -
Principled Data Augmentation for Learning to Solve Quadratic Programming Problems
by: Qian, Chendi, et al.
Published: (2025)