Cover Image

Evaluating Rare Disease Diagnostic Performance in Symptom Checkers: A Synthetic Vignette Simulation Approach

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Nishibayashi, Takashi, Kanazawa, Seiji, Yamada, Kumpei
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Structured Dataset of Disease-Symptom Associations to Improve Diagnostic Accuracy
by: Shafi, Abdullah Al, et al.
Published: (2025)

Oracle-Checker Scheme for Evaluating a Generative Large Language Model
by: Zeng, Yueling Jenny, et al.
Published: (2024)

RefChecker: Reference-based Fine-grained Hallucination Checker and Benchmark for Large Language Models
by: Hu, Xiangkun, et al.
Published: (2024)

ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities
by: Hong, Zhaochen, et al.
Published: (2025)

What Makes a Medical Checker Trainable? Diagnosing Signal Collapse and Reward Hacking in Checker-Guided RAG for Biomedical QA
by: Ji, Yuelyu, et al.
Published: (2026)

A Lazy, Concurrent Convertibility Checker
by: Courant, Nathanaëlle, et al.
Published: (2025)

Vibe Checker: Aligning Code Evaluation with Human Preference
by: Zhong, Ming, et al.
Published: (2025)

BSpell: A CNN-Blended BERT Based Bangla Spell Checker
by: Rahman, Chowdhury Rafeed, et al.
Published: (2022)

RareBench: Can LLMs Serve as Rare Diseases Specialists?
by: Chen, Xuanzhong, et al.
Published: (2024)

The Rarity Blind Spot: A Framework for Evaluating Statistical Reasoning in LLMs
by: Maekawa, Seiji, et al.
Published: (2025)

Evaluating the Impact of Lab Test Results on Large Language Models Generated Differential Diagnoses from Clinical Case Vignettes
by: Bhasuran, Balu, et al.
Published: (2024)

Uncovering Hidden Violent Tendencies in LLMs: A Demographic Analysis via Behavioral Vignettes
by: Myers, Quintin, et al.
Published: (2025)

Can Community Notes Replace Professional Fact-Checkers?
by: Borenstein, Nadav, et al.
Published: (2025)

Self-Checker: Plug-and-Play Modules for Fact-Checking with Large Language Models
by: Li, Miaoran, et al.
Published: (2023)

Synthetic Users, Real Differences: an Evaluation Framework for User Simulation in Multi-Turn Conversations
by: Liu, Yu Lu, et al.
Published: (2026)

Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personas
by: Kwok, Louis, et al.
Published: (2024)

The SCAN Statistical Model Checker
by: Ghiorzi, Enrico, et al.
Published: (2026)

Survey of Pseudonymization, Abstractive Summarization & Spell Checker for Hindi and Marathi
by: Ransing, Rasika, et al.
Published: (2024)

AutoTAMP: Autoregressive Task and Motion Planning with LLMs as Translators and Checkers
by: Chen, Yongchao, et al.
Published: (2023)

Digital Diagnostics: The Potential Of Large Language Models In Recognizing Symptoms Of Common Illnesses
by: Gupta, Gaurav Kumar, et al.
Published: (2024)

SynSym: A Synthetic Data Generation Framework for Psychiatric Symptom Identification
by: Kang, Migyeong, et al.
Published: (2026)

Towards Reliable Benchmarking: A Contamination Free, Controllable Evaluation Framework for Multi-step LLM Function Calling
by: Maekawa, Seiji, et al.
Published: (2025)

Double-Checker: Enhancing Reasoning of Slow-Thinking LLMs via Self-Critical Fine-Tuning
by: Xu, Xin, et al.
Published: (2025)

Are Large Language Models Table-based Fact-Checkers?
by: Zhang, Hanwen, et al.
Published: (2024)

A Hybrid Framework with Large Language Models for Rare Disease Phenotyping
by: Wu, Jinge, et al.
Published: (2024)

Co-FactChecker: A Framework for Human-AI Collaborative Claim Verification Using Large Reasoning Models
by: Sahnan, Dhruv, et al.
Published: (2026)

ConstraintChecker: A Plugin for Large Language Models to Reason on Commonsense Knowledge Bases
by: Do, Quyet V., et al.
Published: (2024)

RareAgents: Autonomous Multi-disciplinary Team for Rare Disease Diagnosis and Treatment
by: Chen, Xuanzhong, et al.
Published: (2024)

A Specialized Large Language Model for Clinical Reasoning and Diagnosis in Rare Diseases
by: Yang, Tao, et al.
Published: (2025)

FactCG: Enhancing Fact Checkers with Graph-Based Multi-Hop Data
by: Lei, Deren, et al.
Published: (2025)

GenAI vs. Human Fact-Checkers: Accurate Ratings, Flawed Rationales
by: Tai, Yuehong Cassandra, et al.
Published: (2025)

Inflated Excellence or True Performance? Rethinking Medical Diagnostic Benchmarks with Dynamic Evaluation
by: Zhang, Xiangxu, et al.
Published: (2025)

Evaluating Large Language Models on Rare Disease Diagnosis: A Case Study using House M.D
by: Gupta, Arsh, et al.
Published: (2025)

AC4: Algebraic Computation Checker for Circuit Constraints in ZKPs
by: Yang, Qizhe, et al.
Published: (2024)

Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checking
by: Warren, Greta, et al.
Published: (2025)

Overcoming the "Impracticality" of RAG: Proposing a Real-World Benchmark and Multi-Dimensional Diagnostic Framework
by: Narita, Kenichirou, et al.
Published: (2026)

GPUMC: A Stateless Model Checker for GPU Weak Memory Concurrency
by: Chakraborty, Soham, et al.
Published: (2025)

StepGap: A Hybrid NLI-LLM Checker for Step-Level Evidence-Gap Detectionin Multi-Hop Question Answering
by: Ji, Yuelyu, et al.
Published: (2026)

A Certified Proof Checker for Deep Neural Network Verification in Imandra
by: Desmartin, Remi, et al.
Published: (2024)

Interactive DualChecker for Mitigating Hallucinations in Distilling Large Language Models
by: Wang, Meiyun, et al.
Published: (2024)