Guardado en:
Detalles Bibliográficos
Autores principales: Zhang, Peixian, Ye, Qiming, Peng, Zifan, Garimella, Kiran, Tyson, Gareth
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:https://arxiv.org/abs/2512.09483
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917136619798528
author Zhang, Peixian
Ye, Qiming
Peng, Zifan
Garimella, Kiran
Tyson, Gareth
author_facet Zhang, Peixian
Ye, Qiming
Peng, Zifan
Garimella, Kiran
Tyson, Gareth
contents LLM-based Search Engines (LLM-SEs) introduces a new paradigm for information seeking. Unlike Traditional Search Engines (TSEs) (e.g., Google), these systems summarize results, often providing limited citation transparency. The implications of this shift remain largely unexplored, yet raises key questions regarding trust and transparency. In this paper, we present a large-scale empirical study of LLM-SEs, analyzing 55,936 queries and the corresponding search results across six LLM-SEs and two TSEs. We confirm that LLM-SEs cites domain resources with greater diversity than TSEs. Indeed, 37% of domains are unique to LLM-SEs. However, certain risks still persist: LLM-SEs do not outperform TSEs in credibility, political neutrality and safety metrics. Finally, to understand the selection criteria of LLM-SEs, we perform a feature-based analysis to identify key factors influencing source choice. Our findings provide actionable insights for end users, website owners, and developers.
format Preprint
id arxiv_https___arxiv_org_abs_2512_09483
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Source Coverage and Citation Bias in LLM-based vs. Traditional Search Engines
Zhang, Peixian
Ye, Qiming
Peng, Zifan
Garimella, Kiran
Tyson, Gareth
Computation and Language
Computers and Society
LLM-based Search Engines (LLM-SEs) introduces a new paradigm for information seeking. Unlike Traditional Search Engines (TSEs) (e.g., Google), these systems summarize results, often providing limited citation transparency. The implications of this shift remain largely unexplored, yet raises key questions regarding trust and transparency. In this paper, we present a large-scale empirical study of LLM-SEs, analyzing 55,936 queries and the corresponding search results across six LLM-SEs and two TSEs. We confirm that LLM-SEs cites domain resources with greater diversity than TSEs. Indeed, 37% of domains are unique to LLM-SEs. However, certain risks still persist: LLM-SEs do not outperform TSEs in credibility, political neutrality and safety metrics. Finally, to understand the selection criteria of LLM-SEs, we perform a feature-based analysis to identify key factors influencing source choice. Our findings provide actionable insights for end users, website owners, and developers.
title Source Coverage and Citation Bias in LLM-based vs. Traditional Search Engines
topic Computation and Language
Computers and Society
url https://arxiv.org/abs/2512.09483