Cover Image

Can GPT replace human raters? Validity and reliability of machine-generated norms for metaphors

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Mangiaterra, Veronica, Al-Azary, Hamad, Pietro, Chiara Barattieri di San, Canal, Paolo, Bambini, Valentina
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ERC_Cog PROMENADE - WP1: Diachronic evolution of Italian literary metaphors
by: Mangiaterra, Veronica, et al.
Published: (2026)

Metaphors' journeys across time and genre: tracking the evolution of literary metaphors with temporal embeddings
by: Mangiaterra, Veronica, et al.
Published: (2026)

MetaClimage: A novel database of visual metaphors related to Climate Change, with costs and benefits analysis
by: Scalingi, Biagio, et al.
Published: (2025)

Figurative Archive: an open dataset and web-based application for the study of metaphor
by: Bressler, Maddalena, et al.
Published: (2025)

Revisiting reliability with human and machine learning raters under scoring design and rater configuration in the many‐facet Rasch model
by: Xingyao Xiao, et al.
Published: (2026)

Is GPT-4 a reliable rater? Evaluating Consistency in GPT-4 Text Ratings
by: Hackl, Veronika, et al.
Published: (2023)

Intra‐rater and inter‐rater reliability of ultrasonographic intestinal wall thickness measurements in healthy horses
by: Tina Hansen, et al.
Published: (2026)

Internal and inter-rater reliability of the ASQ-3 in Mexican preschoolers
by: Silvia Ortiz-León
Published: (2018)

Inter-rater reliability of measures to characterize the tobacco retail environment in Mexico
by: Marissa G Hall
Published: (2015)

Collaborative Innovation in Agrometeorology: Coordination Strategies to Develop a Monitoring IT System for Brazil
by: Martha Delphino Bambini
Published: (2014)

Test-retest, inter- and intra-rater reliability of the flexicurve for evaluation of the spine in children
by: Juliana A. Sedrez
Published: (2016)

Intra and inter-rater reliability study of pelvic floor muscle dynamometric measurements
by: Natalia M. Martinho
Published: (2015)

Towards a Fully Interpretable and More Scalable RSA Model for Metaphor Understanding
by: Carenini, Gaia, et al.
Published: (2024)

An AI‐generated metaphor (unlabelled): In this issue
by: Karine Caunes
Published: (2025)

Clinical SANTI classification of arthrogenic muscle inhibition has an excellent inter‐rater and intra‐rater reliability in preoperative and post‐operative anterior cruciate ligament rupture
by: Alexandre Le Guen, et al.
Published: (2025)

Forma mentis networks predict creativity ratings of short texts via interpretable artificial intelligence in human and GPT-simulated raters
by: Haim, Edith, et al.
Published: (2024)

Can video generation replace cinematographers? Research on the cinematic language of generated video
by: Li, Xiaozhe, et al.
Published: (2024)

An exploratory analysis of disabled people accessibility to urban public transport: the use of Geographical Information Systems
by: Verónica Cañal-Fernández
Published: (2014)

Evaluation of inter-rater reliability of subjective and objective criteria for diagnosis of lymphedema in upper and lower limbs
by: Larissa Louise Campanholi
Published: (2015)

Practical hearing aid skills test: results at the time of fitting and comparison of inter-rater reliability
by: Deborah Viviane Ferrari
Published: (2015)

Inter‐rater and intra‐rater reliability of multi‐slice CT and three‐dimensional reconstructed imaging analysis of mesenteric vascular anatomy for planning and performing complete mesocolic excision
by: Jordan Fletcher, et al.
Published: (2025)

The value of human and machine in machine-generated creative contents
by: Jin, Weina
Published: (2025)

Can humans teach machines to code?
by: Hocquette, Céline, et al.
Published: (2024)

Investigating NMR T2-Cutoffs: Towards better reservoir Characterization
by: Ali, Farhan, et al.
Published: (2025)

Assessing the reliability of interprofessional raters on peripheral muscle ultrasonography in pediatric oncology: A prospective observational study
by: Corey Hawes, et al.
Published: (2025)

Inter‐rater reliability of the Team Formulation Quality Rating Scale ( TFQS ) in inpatient mental health teams
by: Joshua Eli Thompson, et al.
Published: (2026)

Ultrasound imaging in women’s arm flexor muscles: intra-rater reliability of muscle thickness and echo intensity
by: Amilton Vieira
Published: (2016)

Can generative AI and ChatGPT outperform humans on cognitive-demanding problem-solving tasks in science?
by: Zhai, Xiaoming, et al.
Published: (2024)

Validity and reliability evidence and norms for the Spanish version of the Sexual Inhibition/Sexual Excitation Scales-Short Form
by: Sierra, Juan Carlos, et al.
Published: (2024)

Assessing quality of selection procedures: Lower bound of false positive rate as a function of inter-rater reliability
by: Bartoš, František, et al.
Published: (2022)

Assessing quality of selection procedures: Lower bound of false positive rate as a function of inter‐rater reliability
by: František Bartoš, et al.
Published: (2024)

Validation of machine learning based scenario generators
by: Junike, Gero, et al.
Published: (2023)

Validation of machine learning based scenario generators
by: Gero Junike, et al.
Published: (2026)

Scalable random number generation for truncated log-concave distributions
by: Miniato, Lambardi di San, et al.
Published: (2022)

Intra and inter-rater reliability of infrared image analysis of masticatory and upper trapezius muscles in women with and without temporomandibular disorder
by: Ana C. S. Costa
Published: (2013)

Student‐generated metaphor in research supervision: An arts‐based method
by: Christine E. Ramsey‐Wade, et al.
Published: (2024)

Can AI replace humans? Comparing the capabilities of AI tools and human performance in a business management education scenario
by: Dinuka B. Herath, et al.
Published: (2025)

Can professional translators identify machine-generated text?
by: Farrell, Michael
Published: (2026)

Can large language models replace humans in systematic reviews? Evaluating GPT‐4's efficacy in screening and extracting data from peer‐reviewed and grey literature in multiple languages
by: Qusai Khraisha, et al.
Published: (2024)

Habitus, política y educación / Susana Beatriz di Pietro
by: di Pietro, Susana Beatriz
Published: (2002)