Cover Image

Is GPT-4 a reliable rater? Evaluating Consistency in GPT-4 Text Ratings

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hackl, Veronika, Müller, Alexandra Elena, Granitzer, Michael, Sailer, Maximilian
Format:	Preprint
Published:	2023
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The AI Literacy Heptagon: A Structured Approach to AI Literacy in Higher Education
by: Hackl, Veronika, et al.
Published: (2025)

GPTEval: A Survey on Assessments of ChatGPT and GPT-4
by: Mao, Rui, et al.
Published: (2023)

GPT-4 Technical Report
by: OpenAI, et al.
Published: (2023)

Comparative Analysis of ChatGPT, GPT-4, and Microsoft Bing Chatbots for GRE Test
by: Abu-Haifa, Mohammad, et al.
Published: (2023)

Iterative Prompt Refinement for Dyslexia-Friendly Text Summarization Using GPT-4o
by: Bhojwani, Samay, et al.
Published: (2026)

Does GPT-4 pass the Turing test?
by: Jones, Cameron R., et al.
Published: (2023)

Evaluation of GPT-4o and GPT-4o-mini's Vision Capabilities for Compositional Analysis from Dried Solution Drops
by: Dangi, Deven B., et al.
Published: (2024)

Evaluating ChatGPT-4 Vision on Brazil's National Undergraduate Computer Science Exam
by: Mendonça, Nabor C.
Published: (2024)

How Prevalent is Gender Bias in ChatGPT? -- Exploring German and English ChatGPT Responses
by: Urchs, Stefanie, et al.
Published: (2023)

Evaluating Students' Open-ended Written Responses with LLMs: Using the RAG Framework for GPT-3.5, GPT-4, Claude-3, and Mistral-Large
by: Jauhiainen, Jussi S., et al.
Published: (2024)

Building another Spanish dictionary, this time with GPT-4
by: Ortega-Martín, Miguel, et al.
Published: (2024)

Will GPT-4 Run DOOM?
by: de Wynter, Adrian
Published: (2024)

Single layer tiny Co$^4$ outpaces GPT-2 and GPT-BERT
by: Zain, Noor Ul, et al.
Published: (2025)

RogueGPT: dis-ethical tuning transforms ChatGPT4 into a Rogue AI in 158 Words
by: Buscemi, Alessio, et al.
Published: (2024)

ChatGPT as a Math Questioner? Evaluating ChatGPT on Generating Pre-university Math Questions
by: Van Long, Phuoc Pham, et al.
Published: (2023)

Is It Bad to Work All the Time? Cross-Cultural Evaluation of Social Norm Biases in GPT-4
by: Liu, Zhuozhuo Joy, et al.
Published: (2025)

Removing RLHF Protections in GPT-4 via Fine-Tuning
by: Zhan, Qiusi, et al.
Published: (2023)

Understanding the Role of Temperature in Diverse Question Generation by GPT-4
by: Agarwal, Arav, et al.
Published: (2024)

Forma mentis networks predict creativity ratings of short texts via interpretable artificial intelligence in human and GPT-simulated raters
by: Haim, Edith, et al.
Published: (2024)

Benchmarking GPT-4 on Algorithmic Problems: A Systematic Evaluation of Prompting Strategies
by: Petruzzellis, Flavio, et al.
Published: (2024)

Putting GPT-4o to the Sword: A Comprehensive Evaluation of Language, Vision, Speech, and Multimodal Proficiency
by: Shahriar, Sakib, et al.
Published: (2024)

Differentiate ChatGPT-generated and Human-written Medical Texts
by: Liao, Wenxiong, et al.
Published: (2023)

Optimal path for Biomedical Text Summarization Using Pointer GPT
by: Han, Hyunkyung, et al.
Published: (2024)

"Only ChatGPT gets me": An Empirical Analysis of GPT versus other Large Language Models for Emotion Detection in Text
by: Lecourt, Florian, et al.
Published: (2025)

Gemini Pro Defeated by GPT-4V: Evidence from Education
by: Lee, Gyeong-Geon, et al.
Published: (2023)

Can GPT-4 learn to analyse moves in research article abstracts?
by: Yu, Danni, et al.
Published: (2024)

GPT-4 on Clinic Depression Assessment: An LLM-Based Pilot Study
by: Lorenzoni, Giuliano, et al.
Published: (2024)

Automated Coding of Communication Data Using ChatGPT: Consistency Across Subgroups
by: Hao, Jiangang, et al.
Published: (2025)

Does GPT-4 surpass human performance in linguistic pragmatics?
by: Bojic, Ljubisa, et al.
Published: (2023)

Using GPT-4 to Augment Unbalanced Data for Automatic Scoring
by: Fang, Luyang, et al.
Published: (2023)

GPT-4V Cannot Generate Radiology Reports Yet
by: Jiang, Yuyang, et al.
Published: (2024)

Benchmarking GPT-4 against Human Translators: A Comprehensive Evaluation Across Languages, Domains, and Expertise Levels
by: Yan, Jianhao, et al.
Published: (2024)

Translating Radiology Reports into Plain Language using ChatGPT and GPT-4 with Prompt Learning: Promising Results, Limitations, and Potential
by: Lyu, Qing, et al.
Published: (2023)

Evaluating ChatGPT on Nuclear Domain-Specific Data
by: Anwar, Muhammad, et al.
Published: (2024)

Selecting Between BERT and GPT for Text Classification in Political Science Research
by: Wang, Yu, et al.
Published: (2024)

M-MiniGPT4: Multilingual VLLM Alignment via Translated Data
by: Han, Seung Hun, et al.
Published: (2026)

GPT-4 passes most of the 297 written Polish Board Certification Examinations
by: Pokrywka, Jakub, et al.
Published: (2024)

Enhancing Rhetorical Figure Annotation: An Ontology-Based Web Application with RAG Integration
by: Kühn, Ramona, et al.
Published: (2024)

Can GPT Redefine Medical Understanding? Evaluating GPT on Biomedical Machine Reading Comprehension
by: Vatsal, Shubham, et al.
Published: (2024)

ChatGPT Rates Natural Language Explanation Quality Like Humans: But on Which Scales?
by: Huang, Fan, et al.
Published: (2024)