Recommender systems, stigmergy, and the tyranny of popularity

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Dunivin, Zackary Okun, Smaldino, Paul E.
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912464482861056
author Dunivin, Zackary Okun
Smaldino, Paul E.
author_facet Dunivin, Zackary Okun
Smaldino, Paul E.
contents Scientific recommender systems, such as Google Scholar and Web of Science, are essential tools for discovery. Search algorithms that power work through stigmergy, a collective intelligence mechanism that surfaces useful paths through repeated engagement. While generally effective, this "rich-get-richer" dynamic results in a small number of high-profile papers that dominate visibility. This essay argues argue that these algorithm over-reliance on popularity fosters intellectual homogeneity and exacerbates structural inequities, stifling innovative and diverse perspectives critical for scientific progress. We propose an overhaul of search platforms to incorporate user-specific calibration, allowing researchers to manually adjust the weights of factors like popularity, recency, and relevance. We also advise platform developers on how text embeddings and LLMs could be implemented in ways that increase user autonomy. While our suggestions are particularly pertinent to aligning recommender systems with scientific values, these ideas are broadly applicable to information access systems in general. Designing platforms that increase user autonomy is an important step toward more robust and dynamic information
format Preprint
id arxiv_https___arxiv_org_abs_2506_06162
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Recommender systems, stigmergy, and the tyranny of popularity
Dunivin, Zackary Okun
Smaldino, Paul E.
Computers and Society
Artificial Intelligence
Human-Computer Interaction
Information Retrieval
Scientific recommender systems, such as Google Scholar and Web of Science, are essential tools for discovery. Search algorithms that power work through stigmergy, a collective intelligence mechanism that surfaces useful paths through repeated engagement. While generally effective, this "rich-get-richer" dynamic results in a small number of high-profile papers that dominate visibility. This essay argues argue that these algorithm over-reliance on popularity fosters intellectual homogeneity and exacerbates structural inequities, stifling innovative and diverse perspectives critical for scientific progress. We propose an overhaul of search platforms to incorporate user-specific calibration, allowing researchers to manually adjust the weights of factors like popularity, recency, and relevance. We also advise platform developers on how text embeddings and LLMs could be implemented in ways that increase user autonomy. While our suggestions are particularly pertinent to aligning recommender systems with scientific values, these ideas are broadly applicable to information access systems in general. Designing platforms that increase user autonomy is an important step toward more robust and dynamic information
title Recommender systems, stigmergy, and the tyranny of popularity
topic Computers and Society
Artificial Intelligence
Human-Computer Interaction
Information Retrieval
url https://arxiv.org/abs/2506.06162