Cover Image

Impact of Label Noise from Large Language Models Generated Annotations on Evaluation of Diagnostic Model Performance

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chavoshi, Mohammadreza, Trivedi, Hari, Newsome, Janice, Mansuri, Aawez, Sanyika, Chiratidzo Rudado, Isaac, Rohan Satya, Li, Frank, Dapamede, Theo, Gichoya, Judy
Format:	Preprint
Published:	2025
Subjects:	Methodology Applications
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Evaluating Vision Language Models (VLMs) for Radiology: A Comprehensive Analysis
by: Li, Frank, et al.
Published: (2025)

Feature Quality and Adaptability of Medical Foundation Models: A Comparative Evaluation for Radiographic Classification and Segmentation
by: Li, Frank, et al.
Published: (2025)

MultiMedVision: Multi-Modal Medical Vision Framework
by: Li, Frank, et al.
Published: (2026)

Subgroup Performance of a Commercial Digital Breast Tomosynthesis Model for Breast Cancer Detection
by: Brown-Mulry, Beatrice, et al.
Published: (2025)

Novel AI-Based Quantification of Breast Arterial Calcification to Predict Cardiovascular Risk
by: Dapamede, Theodorus, et al.
Published: (2025)

Emory Knee Radiograph (MRKR) Dataset
by: Price, Brandon, et al.
Published: (2024)

Diagnostics for Regression Models with Semicontinuous Outcomes
by: Yang, Lu
Published: (2024)

Evaluating WAIC and PSIS-LOO for Bayesian Diagnostic Classification Model Selection
by: Jung, Ae Kyong, et al.
Published: (2024)

Evaluating Aggregated Relational Data Models with Simple Diagnostics
by: Laga, Ian, et al.
Published: (2026)

A Comparison of Joint and Stepwise Dynamic Cognitive Diagnostic Models
by: Ma, Yawen, et al.
Published: (2026)

A User-Focused Approach to Evaluating Probabilistic and Categorical Forecasts
by: Loveday, Nicholas, et al.
Published: (2023)

Categorising the World into Local Climate Zones -- Towards Quantifying Labelling Uncertainty for Machine Learning Models
by: Hechinger, Katharina, et al.
Published: (2023)

Balancing Interpretability and Flexibility in Modeling Diagnostic Trajectories with an Embedded Neural Hawkes Process Model
by: Zhao, Yuankang, et al.
Published: (2025)

Understanding When Graph Convolutional Networks Help: A Diagnostic Study on Label Scarcity and Structural Properties
by: Subedi, Nischal, et al.
Published: (2025)

Same Prompt, Different Outcomes: Evaluating the Reproducibility of Data Analysis by LLMs
by: Cui, Jiaxin, et al.
Published: (2026)

Noise-Robust Phase Connectivity Estimation via Bayesian Circular Functional Models
by: Sugasawa, Shonosuke, et al.
Published: (2025)

The Influence of Validation Data on Logical and Scientific Interpretations of Forensic Expert Opinions
by: Lund, Steven P., et al.
Published: (2024)

Decomposing Global AUC into Cluster-Level Contributions for Localized Model Diagnostics
by: Sudjianto, Agus, et al.
Published: (2025)

Evaluation of Minimal Residual Disease as a Surrogate for Progression-Free Survival in Hematology Oncology Trials: A Meta-Analytic Review
by: She, Jane, et al.
Published: (2026)

Development of Capabilities to Assimilate ABI GOES ‐18 Satellite Radiance in NGFS Modeling System and Its Application in Simulation of Pacific Hurricane Hilary
by: Sujata Pattanayak, et al.
Published: (2025)

Design Effect Ratios for Bayesian Survey Models: A Diagnostic Framework for Identifying Survey-Sensitive Parameters
by: Lee, JoonHo
Published: (2026)

bioLeak: Leakage-Aware Modeling and Diagnostics for Machine Learning in R
by: Korkmaz, Selçuk
Published: (2026)

"All that Glitters": Approaches to Evaluations with Unreliable Model and Human Annotations
by: Hardy, Michael
Published: (2024)

Scale dependence in hidden Markov models for animal movement
by: Michelot, Théo, et al.
Published: (2025)

Enhancing Forecast Verification in National Meteorological and Hydrological Services
by: Thomas C. Pagano, et al.
Published: (2025)

Evaluation of Individual and Trial Level Association Metrics in the Validation of a Binary Surrogate Endpoint for a True Time-to-Event Endpoint
by: Ge, Renee Y., et al.
Published: (2026)

Synthetically Enhanced: Unveiling Synthetic Data's Potential in Medical Imaging Research
by: Khosravi, Bardia, et al.
Published: (2023)

Uncertainty Annotations for Holistic Test Description of Cyber-physical Energy Systems
by: Heussen, Kai, et al.
Published: (2025)

An evaluation of empirical equations for assessing local scour around bridge piers using global sensitivity analysis
by: Gavriel, Gianna, et al.
Published: (2026)

A Log-Linear Analytics Approach to Cost Model Regularization for Inpatient Stays through Diagnostic Code Merging
by: Lu, Chi-Ken, et al.
Published: (2025)

Distribution-Based Sub-Population Selection (DSPS): A Method for in-Silico Reproduction of Clinical Trials Outcomes
by: Ganji, Mohammadreza, et al.
Published: (2024)

Refuting "Debunking the GAMLSS Myth: Simplicity Reigns in Pulmonary Function Diagnostics"
by: Rigby, Robert A., et al.
Published: (2025)

Markovianity-Based Conditioning Depth Diagnostics for Hidden Confounding in Observational Datasets
by: Adedayo, S. A.
Published: (2026)

A Diagnostic Tool for Functional Causal Discovery
by: Prakash, Shreya, et al.
Published: (2024)

Modeling Extreme Events: Univariate and Multivariate Data-Driven Approaches
by: Buriticá, Gloria, et al.
Published: (2024)

A Plot is Worth a Thousand Tests: Assessing Residual Diagnostics with the Lineup Protocol
by: Li, Weihao, et al.
Published: (2023)

Multiscale modelling of animal movement with persistent dynamics
by: Michelot, Théo, et al.
Published: (2024)

Efficient Inference in First Passage Time Models
by: Liu, Sicheng, et al.
Published: (2025)

Understanding Wind Characteristics Over Different Terrains for Wind Turbine Deployment
by: Rohan Kumar, et al.
Published: (2025)

An Information-Theoretic Diagnostic Analytics Framework for Mapping Past-Future Dependence in Horizon-Specific Forecastability
by: Catt, Peter Maurice
Published: (2026)