Copertina

Can ChatGPT evaluate research quality?

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Thelwall, Mike
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Digital Libraries Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Assessing the societal influence of academic research with ChatGPT: Impact case study evaluations
di: Kousha, Kayvan, et al.
Pubblicazione: (2024)

Evaluating the quality of published medical research with ChatGPT
di: Thelwall, Mike, et al.
Pubblicazione: (2024)

Evaluating Research Quality with Large Language Models: An Analysis of ChatGPT's Effectiveness with Different Settings and Inputs
di: Thelwall, Mike
Pubblicazione: (2024)

Which stylistic features fool ChatGPT research evaluations?
di: Kousha, Kayvan, et al.
Pubblicazione: (2026)

Can ChatGPT evaluate research environments? Evidence from REF2021
di: Kousha, Kayvan, et al.
Pubblicazione: (2025)

In which fields do ChatGPT scores align better than citations with research quality?
di: Thelwall, Mike
Pubblicazione: (2025)

Research evaluation with ChatGPT: Is it age, country, length, or field biased?
di: Thelwall, Mike, et al.
Pubblicazione: (2024)

Can ChatGPT be a good follower of academic paradigms? Research quality evaluations in conflicting areas of sociology
di: Thelwall, Mike, et al.
Pubblicazione: (2025)

In which fields can ChatGPT detect journal article quality? An evaluation of REF2021 results
di: Thelwall, Mike, et al.
Pubblicazione: (2024)

Estimating the quality of academic books from their descriptions with ChatGPT
di: Thelwall, Mike, et al.
Pubblicazione: (2025)

Can Smaller Large Language Models Evaluate Research Quality?
di: Thelwall, Mike
Pubblicazione: (2025)

A Global South Strategy for Evaluating Research Value with ChatGPT
di: Nunkoo, Robin, et al.
Pubblicazione: (2025)

Implicit and Explicit Research Quality Score Probabilities from ChatGPT
di: Thelwall, Mike, et al.
Pubblicazione: (2025)

Journal Quality Factors from ChatGPT: More meaningful than Impact Factors?
di: Thelwall, Mike, et al.
Pubblicazione: (2024)

Can Small and Reasoning Large Language Models Score Journal Articles for Research Quality and Do Averaging and Few-shot Help?
di: Thelwall, Mike, et al.
Pubblicazione: (2025)

How much are LLMs changing the language of academic papers after ChatGPT? A multi-database and full text analysis
di: Kousha, Kayvan, et al.
Pubblicazione: (2025)

Evaluating the Predictive Capacity of ChatGPT for Academic Peer Review Outcomes Across Multiple Platforms
di: Thelwall, Mike, et al.
Pubblicazione: (2024)

FAIR GPT: A virtual consultant for research data management in ChatGPT
di: Shigapov, Renat, et al.
Pubblicazione: (2024)

Research quality evaluation by AI in the era of Large Language Models: Advantages, disadvantages, and systemic effects
di: Thelwall, Mike
Pubblicazione: (2025)

Authority Signals in AI Cited Health Sources: A Framework for Evaluating Source Credibility in ChatGPT Responses
di: Jacques, Erin, et al.
Pubblicazione: (2026)

Is ChatGPT Transforming Academics' Writing Style?
di: Geng, Mingmeng, et al.
Pubblicazione: (2024)

An Experiment with the Use of ChatGPT for LCSH Subject Assignment on Electronic Theses and Dissertations
di: Chow, Eric H. C., et al.
Pubblicazione: (2024)

Will AI be overconfident about academic research findings when reliant on abstracts? (v1)
di: Thelwall, Mike
Pubblicazione: (2026)

Can social media provide early warning of retraction? Evidence from critical tweets identified by human annotation and large language models
di: Zheng, Er-Te, et al.
Pubblicazione: (2024)

Can Large Language Models Evaluate Grant Proposal Quality? Revisiting the Wennerås and Wold Peer Review Data
di: Sandström, Ulf, et al.
Pubblicazione: (2026)

Quantitative Methods in Research Evaluation Citation Indicators, Altmetrics, and Artificial Intelligence
di: Thelwall, Mike
Pubblicazione: (2024)

Prompt perturbation and fraction facilitation sometimes strengthen Large Language Model scores
di: Thelwall, Mike
Pubblicazione: (2025)

Do Large Language Models know Which Published Articles have been Retracted?
di: Thelwall, Mike
Pubblicazione: (2026)

Are ChatGPT and Other Similar Systems the Modern Lernaean Hydras of AI?
di: Ioannidis, Dimitrios, et al.
Pubblicazione: (2023)

Can news and social media attention reduce the influence of problematic research?
di: Zheng, Er-Te, et al.
Pubblicazione: (2025)

Designing large language model prompts to extract scores from messy text: A shared dataset and challenge
di: Thelwall, Mike
Pubblicazione: (2026)

From ChatGPT, DALL-E 3 to Sora: How has Generative AI Changed Digital Humanities Research and Services?
di: Liu, Jiangfeng, et al.
Pubblicazione: (2024)

Is OpenAlex Suitable for Research Quality Evaluation and Which Citation Indicator is Best?
di: Thelwall, Mike, et al.
Pubblicazione: (2025)

Have LLM-associated terms increased in article full texts in all fields?
di: Thelwall, Mike, et al.
Pubblicazione: (2026)

ChatGPT "contamination": estimating the prevalence of LLMs in the scholarly literature
di: Gray, Andrew
Pubblicazione: (2024)

Chatting with Papers: A Hybrid Approach Using LLMs and Knowledge Graphs
di: Tykhonov, Vyacheslav, et al.
Pubblicazione: (2025)

Web Archives Metadata Generation with GPT-4o: Challenges and Insights
di: Nair, Ashwin, et al.
Pubblicazione: (2024)

Streamlining the Selection Phase of Systematic Literature Reviews (SLRs) Using AI-Enabled GPT-4 Assistant API
di: Jafari, Seyed Mohammad Ali
Pubblicazione: (2024)

Large language models for post-publication research evaluation: Evidence from expert recommendations and citation indicators
di: Wu, Mengjia, et al.
Pubblicazione: (2026)

ArchiveGPT: A human-centered evaluation of using a vision language model for image cataloguing
di: Abele, Line, et al.
Pubblicazione: (2025)