Cover Image

Comparative Experimentation of Accuracy Metrics in Automated Medical Reporting: The Case of Otitis Consultations

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Faber, Wouter, Bootsma, Renske Eline, Huibers, Tom, van Dulmen, Sandra, Brinkkemper, Sjaak
Format:	Preprint
Published:	2023
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Enhancing Summarization Performance through Transformer-Based Prompt Engineering in Automated Medical Reporting
by: van Zandvoort, Daphne, et al.
Published: (2023)

Summarizing long regulatory documents with a multi-step pipeline
by: Sie, Mika, et al.
Published: (2024)

Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies
by: Kocmi, Tom, et al.
Published: (2024)

GPT-NL Public Corpus: A Permissively Licensed, Dutch-First Dataset for LLM Pre-training
by: van Oort, Jesse, et al.
Published: (2026)

Healthcare Copilot: Eliciting the Power of General LLMs for Medical Consultation
by: Ren, Zhiyao, et al.
Published: (2024)

Contextual Metric Meta-Evaluation by Measuring Local Metric Accuracy
by: Deviyani, Athiya, et al.
Published: (2025)

Towards Reliable Medical LLMs: Benchmarking and Enhancing Confidence Estimation of Large Language Models in Medical Consultation
by: Ren, Zhiyao, et al.
Published: (2026)

Comparing Large Language Models and Traditional Machine Translation Tools for Translating Medical Consultation Summaries: A Pilot Study
by: Li, Andy, et al.
Published: (2025)

Beyond Idealized Patients: Evaluating LLMs under Challenging Patient Behaviors in Medical Consultations
by: Li, Yahan, et al.
Published: (2026)

Tool Calling: Enhancing Medication Consultation via Retrieval-Augmented Large Language Models
by: Huang, Zhongzhen, et al.
Published: (2024)

EMRModel: A Large Language Model for Extracting Medical Consultation Dialogues into Structured Medical Records
by: Zhao, Shuguang, et al.
Published: (2025)

Format Inertia: A Failure Mechanism of LLMs in Medical Pre-Consultation
by: Lim, Seungseop, et al.
Published: (2025)

Evaluating Causal Explanation in Medical Reports with LLM-Based and Human-Aligned Metrics
by: Cho, Yousang, et al.
Published: (2025)

ReEvalMed: Rethinking Medical Report Evaluation by Aligning Metrics with Real-World Clinical Judgment
by: Li, Ruochen, et al.
Published: (2025)

CASPR: Automated Evaluation Metric for Contrastive Summarization
by: Ananthamurugan, Nirupan, et al.
Published: (2024)

An Automated Length-Aware Quality Metric for Summarization
by: Foland, Andrew D.
Published: (2025)

SpeechMedAssist: Efficiently and Effectively Adapting Speech Language Models for Medical Consultation
by: Chen, Sirry, et al.
Published: (2026)

Satisfactory Medical Consultation based on Terminology-Enhanced Information Retrieval and Emotional In-Context Learning
by: Zuo, Kaiwen, et al.
Published: (2025)

Research on Medical Named Entity Identification Based On Prompt-Biomrc Model and Its Application in Intelligent Consultation System
by: Yang, Jinzhu
Published: (2025)

Med-PMC: Medical Personalized Multi-modal Consultation with a Proactive Ask-First-Observe-Next Paradigm
by: Liu, Hongcheng, et al.
Published: (2024)

A Debate-Driven Experiment on LLM Hallucinations and Accuracy
by: Li, Ray, et al.
Published: (2024)

Automated Medical Report Generation for ECG Data: Bridging Medical Text and Signal Processing with Deep Learning
by: Bleich, Amnon, et al.
Published: (2024)

Yes, this is what I was looking for! Towards Multi-modal Medical Consultation Concern Summary Generation
by: Tiwari, Abhisek, et al.
Published: (2024)

Granular Change Accuracy: A More Accurate Performance Metric for Dialogue State Tracking
by: Aksu, Taha, et al.
Published: (2024)

Claim Extraction for Fact-Checking: Data, Models, and Automated Metrics
by: Ullrich, Herbert, et al.
Published: (2025)

Overview of the MEDIQA-OE 2025 Shared Task on Medical Order Extraction from Doctor-Patient Consultations
by: Corbeil, Jean-Philippe, et al.
Published: (2025)

A Measure of the System Dependence of Automated Metrics
by: von Däniken, Pius, et al.
Published: (2024)

The Curious Case of Representational Alignment: Unravelling Visio-Linguistic Tasks in Emergent Communication
by: Kouwenhoven, Tom, et al.
Published: (2024)

LexGenie: Automated Generation of Structured Reports for European Court of Human Rights Case Law
by: Santosh, T. Y. S. S, et al.
Published: (2025)

Unveiling the Tapestry of Automated Essay Scoring: A Comprehensive Investigation of Accuracy, Fairness, and Generalizability
by: Yang, Kaixun, et al.
Published: (2024)

Voice Under Revision: Large Language Models and the Normalization of Personal Narrative
by: van Nuenen, Tom
Published: (2026)

Recognition Without Authorization: LLMs and the Moral Order of Online Advice
by: van Nuenen, Tom
Published: (2026)

DDO: Dual-Decision Optimization for LLM-Based Medical Consultation via Multi-Agent Collaboration
by: Jia, Zhihao, et al.
Published: (2025)

Beyond Accuracy: Risk-Sensitive Evaluation of Hallucinated Medical Advice
by: Doshi, Savan
Published: (2026)

Consultation on Industrial Machine Faults with Large language Models
by: Boonmee, Apiradee, et al.
Published: (2024)

Comparing Hallucination Detection Metrics for Multilingual Generation
by: Kang, Haoqiang, et al.
Published: (2024)

Compared to What? Baselines and Metrics for Counterfactual Prompting
by: Yang, Zihao, et al.
Published: (2026)

CAT: A Metric-Driven Framework for Analyzing the Consistency-Accuracy Relation of LLMs under Controlled Input Variations
by: Cavalin, Paulo, et al.
Published: (2025)

Evaluating Metrics for Safety with LLM-as-Judges
by: Clegg, Kester, et al.
Published: (2025)

RaTEScore: A Metric for Radiology Report Generation
by: Zhao, Weike, et al.
Published: (2024)