Not Every AI Problem is a Data Problem: We Should Be Intentional About Data Scaling
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916776011366400 |
|---|---|
| author | Rodchenko, Tanya Noy, Natasha Scherrer, Nino |
| author_facet | Rodchenko, Tanya Noy, Natasha Scherrer, Nino |
| contents | While Large Language Models require more and more data to train and scale, rather than looking for any data to acquire, we should consider what types of tasks are more likely to benefit from data scaling. We should be intentional in our data acquisition. We argue that the shape of the data itself, such as its compositional and structural patterns, informs which tasks to prioritize in data scaling, and shapes the development of the next generation of compute paradigms for tasks where data scaling is inefficient, or even insufficient. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_13779 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Not Every AI Problem is a Data Problem: We Should Be Intentional About Data Scaling Rodchenko, Tanya Noy, Natasha Scherrer, Nino Machine Learning Artificial Intelligence While Large Language Models require more and more data to train and scale, rather than looking for any data to acquire, we should consider what types of tasks are more likely to benefit from data scaling. We should be intentional in our data acquisition. We argue that the shape of the data itself, such as its compositional and structural patterns, informs which tasks to prioritize in data scaling, and shapes the development of the next generation of compute paradigms for tasks where data scaling is inefficient, or even insufficient. |
| title | Not Every AI Problem is a Data Problem: We Should Be Intentional About Data Scaling |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2501.13779 |