Position: the Stochastic Parrot in the Coal Mine. Model Collapse is a Threat to Low-Resource Communities
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866916067557769216 |
|---|---|
| author | Jarvis, Devon Klein, Richard Rosman, Benjamin James, Steven Mannelli, Stefano Sarao |
| author_facet | Jarvis, Devon Klein, Richard Rosman, Benjamin James, Steven Mannelli, Stefano Sarao |
| contents | Model collapse, the degradation in performance that arises when generative models are trained on the outputs of prior models, is an increasing concern as artificially generated content proliferates. Related critiques of large language models have highlighted their tendency to reproduce frequent patterns in training data, their reliance on vast datasets, and their substantial environmental cost. Together, these factors contribute to data degradation, the reinforcement of cultural biases, and inefficient resource use. In this position paper we aim to combine these views and argue that model collapse threatens current efforts to democratize AI. By reducing training efficiency and skewing data distributions away from the tails of their support, model collapse disproportionately impacts low-resource and marginalized communities. We examine both the environmental and cultural implications of this phenomenon, situate our position within recent position papers on model collapse, and conclude with a call to action. Finally, we outline initial directions for mitigating these effects. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_04127 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Position: the Stochastic Parrot in the Coal Mine. Model Collapse is a Threat to Low-Resource Communities Jarvis, Devon Klein, Richard Rosman, Benjamin James, Steven Mannelli, Stefano Sarao Machine Learning Computation and Language Computers and Society Model collapse, the degradation in performance that arises when generative models are trained on the outputs of prior models, is an increasing concern as artificially generated content proliferates. Related critiques of large language models have highlighted their tendency to reproduce frequent patterns in training data, their reliance on vast datasets, and their substantial environmental cost. Together, these factors contribute to data degradation, the reinforcement of cultural biases, and inefficient resource use. In this position paper we aim to combine these views and argue that model collapse threatens current efforts to democratize AI. By reducing training efficiency and skewing data distributions away from the tails of their support, model collapse disproportionately impacts low-resource and marginalized communities. We examine both the environmental and cultural implications of this phenomenon, situate our position within recent position papers on model collapse, and conclude with a call to action. Finally, we outline initial directions for mitigating these effects. |
| title | Position: the Stochastic Parrot in the Coal Mine. Model Collapse is a Threat to Low-Resource Communities |
| topic | Machine Learning Computation and Language Computers and Society |
| url | https://arxiv.org/abs/2605.04127 |