Epistemic Diversity and Knowledge Collapse in Large Language Models
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866918309717344256 |
|---|---|
| author | Wright, Dustin Masud, Sarah Moore, Jared Yadav, Srishti Antoniak, Maria Christensen, Peter Ebert Park, Chan Young Augenstein, Isabelle |
| author_facet | Wright, Dustin Masud, Sarah Moore, Jared Yadav, Srishti Antoniak, Maria Christensen, Peter Ebert Park, Chan Young Augenstein, Isabelle |
| contents | Large language models (LLMs) tend to generate homogenous texts, which may impact the diversity of knowledge generated across different outputs. Given their potential to replace existing forms of knowledge acquisition, this poses a risk of knowledge collapse, where homogenous LLMs may lead most people to be exposed to largely the same information, thus mediating a shrinking in the range of accessible information over time as underepresented knowledge is forgotten. To assess the risk of knowledge collapse with LLMs, we present a new methodology to measure epistemic diversity, i.e., variation in real-world claims in LLM outputs. We use this to perform a broad empirical study testing 27 LLMs, 155 topics covering 12 countries, and 200 prompt templates sourced from real user chats. For the topics in our study, we show that while newer models tend to generate more diverse claims, all models are less epistemically diverse than a basic web search. We find that model size has a negative impact on epistemic diversity, while retrieval-augmented generation (RAG) has a positive impact, though the improvement from RAG varies by the cultural context. Finally, compared to a traditional knowledge source (Wikipedia), we find that country-specific claims reflect the English language more than the local one, highlighting a gap in epistemic representation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_04226 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Epistemic Diversity and Knowledge Collapse in Large Language Models Wright, Dustin Masud, Sarah Moore, Jared Yadav, Srishti Antoniak, Maria Christensen, Peter Ebert Park, Chan Young Augenstein, Isabelle Computation and Language Artificial Intelligence Computers and Society Information Retrieval Machine Learning Large language models (LLMs) tend to generate homogenous texts, which may impact the diversity of knowledge generated across different outputs. Given their potential to replace existing forms of knowledge acquisition, this poses a risk of knowledge collapse, where homogenous LLMs may lead most people to be exposed to largely the same information, thus mediating a shrinking in the range of accessible information over time as underepresented knowledge is forgotten. To assess the risk of knowledge collapse with LLMs, we present a new methodology to measure epistemic diversity, i.e., variation in real-world claims in LLM outputs. We use this to perform a broad empirical study testing 27 LLMs, 155 topics covering 12 countries, and 200 prompt templates sourced from real user chats. For the topics in our study, we show that while newer models tend to generate more diverse claims, all models are less epistemically diverse than a basic web search. We find that model size has a negative impact on epistemic diversity, while retrieval-augmented generation (RAG) has a positive impact, though the improvement from RAG varies by the cultural context. Finally, compared to a traditional knowledge source (Wikipedia), we find that country-specific claims reflect the English language more than the local one, highlighting a gap in epistemic representation. |
| title | Epistemic Diversity and Knowledge Collapse in Large Language Models |
| topic | Computation and Language Artificial Intelligence Computers and Society Information Retrieval Machine Learning |
| url | https://arxiv.org/abs/2510.04226 |