From Coverage to Prestige: A Comprehensive Assessment of Large-Scale Scientometric Data

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Rong, Guoyang, Chen, Ying, Koch, Thorsten, Honda, Keisuke
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913719991140352
author Rong, Guoyang
Chen, Ying
Koch, Thorsten
Honda, Keisuke
author_facet Rong, Guoyang
Chen, Ying
Koch, Thorsten
Honda, Keisuke
contents As research in the Scientometric deepens, the impact of data quality on research outcomes has garnered increasing attention. This study, based on Web of Science (WoS) and Crossref datasets, systematically evaluates the differences between data sources and the effects of data merging through matching, comparison, and integration. Two core metrics were employed: Reference Coverage Rate (RCR) and Article Scientific Prestige (ASP), which respectively measure citation completeness (quantity) and academic influence (quality). The results indicate that the WoS dataset outperforms Crossref in its coverage of high-impact literature and ASP scores, while the Crossref dataset provides complementary value through its broader coverage of literature. Data merging significantly improves the completeness of the citation network, with particularly pronounced benefits in smaller disciplinary clusters such as Education and Arts. However, data merging also introduces some low-quality citations, resulting in a polarization of overall data quality. Moreover, the impact of data merging varies across disciplines; high-impact clusters such as Science, Biology, and Medicine benefit the most, whereas clusters like Social Sciences and Arts are more vulnerable to negative effects. This study highlights the critical role of data sources in Scientometric research and provides a framework for assessing and improving data quality.
format Preprint
id arxiv_https___arxiv_org_abs_2503_03251
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle From Coverage to Prestige: A Comprehensive Assessment of Large-Scale Scientometric Data
Rong, Guoyang
Chen, Ying
Koch, Thorsten
Honda, Keisuke
Digital Libraries
Applications
As research in the Scientometric deepens, the impact of data quality on research outcomes has garnered increasing attention. This study, based on Web of Science (WoS) and Crossref datasets, systematically evaluates the differences between data sources and the effects of data merging through matching, comparison, and integration. Two core metrics were employed: Reference Coverage Rate (RCR) and Article Scientific Prestige (ASP), which respectively measure citation completeness (quantity) and academic influence (quality). The results indicate that the WoS dataset outperforms Crossref in its coverage of high-impact literature and ASP scores, while the Crossref dataset provides complementary value through its broader coverage of literature. Data merging significantly improves the completeness of the citation network, with particularly pronounced benefits in smaller disciplinary clusters such as Education and Arts. However, data merging also introduces some low-quality citations, resulting in a polarization of overall data quality. Moreover, the impact of data merging varies across disciplines; high-impact clusters such as Science, Biology, and Medicine benefit the most, whereas clusters like Social Sciences and Arts are more vulnerable to negative effects. This study highlights the critical role of data sources in Scientometric research and provides a framework for assessing and improving data quality.
title From Coverage to Prestige: A Comprehensive Assessment of Large-Scale Scientometric Data
topic Digital Libraries
Applications
url https://arxiv.org/abs/2503.03251