Cover Image

A benchmark dataset for evaluating Syndrome Differentiation and Treatment in large language models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Kunning, Guo, Jianbin, Shang, Zhaoyang, Liu, Yiqing, Du, Hongmin, Liu, Lingling, Zhao, Yuping, Dong, Lifeng
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

AIDBench: A benchmark for evaluating the authorship identification capability of large language models
by: Wen, Zichen, et al.
Published: (2024)

The Harder The Better: Maintaining Supervised Fine-tuning Generalization with Less but Harder Data
by: Shang, Zhaoyang, et al.
Published: (2025)

A dataset and benchmark for hospital course summarization with adapted large language models
by: Aali, Asad, et al.
Published: (2024)

MaterialFigBENCH: benchmark dataset with figures for evaluating college-level materials science problem-solving abilities of multimodal large language models
by: Yoshitake, Michiko, et al.
Published: (2026)

Tgea: An error-annotated dataset and benchmark tasks for text generation from pretrained language models
by: He, Jie, et al.
Published: (2025)

Collaborative decoding of critical tokens for boosting factuality of large language models
by: Jin, Lifeng, et al.
Published: (2024)

A large-scale image-text dataset benchmark for farmland segmentation
by: Tao, Chao, et al.
Published: (2025)

FarsEval-PKBETS: A new diverse benchmark for evaluating Persian large language models
by: Shamsfard, Mehrnoush, et al.
Published: (2025)

GRASP: A novel benchmark for evaluating language GRounding And Situated Physics understanding in multimodal language models
by: Jassim, Serwan, et al.
Published: (2023)

TeleEval-OS: Performance evaluations of large language models for operations scheduling
by: Wang, Yanyan, et al.
Published: (2025)

Creativity Benchmark: A benchmark for marketing creativity for large language models
by: Bhat, Ninad, et al.
Published: (2025)

CCI3.0-HQ: a large-scale Chinese dataset of high quality designed for pre-training large language models
by: Wang, Liangdong, et al.
Published: (2024)

Re-evaluating Theory of Mind evaluation in large language models
by: Hu, Jennifer, et al.
Published: (2025)

TAGLAS: An atlas of text-attributed graph datasets in the era of large graph and language models
by: Feng, Jiarui, et al.
Published: (2024)

Factual consistency evaluation of summarization in the Era of large language models
by: Luo, Zheheng, et al.
Published: (2024)

A benchmark multimodal oro-dental dataset for large vision-language models
by: Lv, Haoxin, et al.
Published: (2025)

A thorough benchmark of automatic text classification: From traditional approaches to large language models
by: Cunha, Washington, et al.
Published: (2025)

Environmental large language model Evaluation (ELLE) dataset: A Benchmark for Evaluating Generative AI applications in Eco-environment Domain
by: Guo, Jing, et al.
Published: (2025)

Retrieval augmentation of large language models for lay language generation
by: Guo, Yue, et al.
Published: (2022)

Dynamic data sampler for cross-language transfer learning in large language models
by: Li, Yudong, et al.
Published: (2024)

Leveraging language models for summarizing mental state examinations: A comprehensive evaluation and dataset release
by: Sahu, Nilesh Kumar, et al.
Published: (2024)

COGNET-MD, an evaluation framework and dataset for Large Language Model benchmarks in the medical domain
by: Panagoulias, Dimitrios P., et al.
Published: (2024)

HESEIA: A community-based dataset for evaluating social biases in large language models, co-designed in real school settings in Latin America
by: Ivetta, Guido, et al.
Published: (2025)

The current status of large language models in summarizing radiology report impressions
by: Hu, Danqing, et al.
Published: (2024)

Long-form factuality in large language models
by: Wei, Jerry, et al.
Published: (2024)

Anchor function: a type of benchmark functions for studying language models
by: Zhang, Zhongwang, et al.
Published: (2024)

ECG-LLM -- training and evaluation of domain-specific large language models for electrocardiography
by: Ahrens, Lara, et al.
Published: (2025)

Robustness assessment of large audio language models in multiple-choice evaluation
by: López, Fernando, et al.
Published: (2025)

AlleNoise: large-scale text classification benchmark dataset with real-world label noise
by: Rączkowska, Alicja, et al.
Published: (2024)

Is your multimodal large language model a good science tutor?
by: Liu, Ming, et al.
Published: (2025)

WorldMedQA-V: a multilingual, multimodal medical examination dataset for multimodal language models evaluation
by: Matos, João, et al.
Published: (2024)

Are LLM-generated plain language summaries truly understandable? A large-scale crowdsourced evaluation
by: Guo, Yue, et al.
Published: (2025)

Multilingual large language models leak human stereotypes across language boundaries
by: Cao, Yang Trista, et al.
Published: (2023)

Advancing bioinformatics with large language models: components, applications and perspectives
by: Liu, Jiajia, et al.
Published: (2024)

Dissociating language and thought in large language models
by: Mahowald, Kyle, et al.
Published: (2023)

LongTail-Swap: benchmarking language models' abilities on rare words
by: Algayres, Robin, et al.
Published: (2025)

Developmental trajectories of decision making and affective dynamics in large language models
by: Wang, Zhihao, et al.
Published: (2025)

Do large language models resemble humans in language use?
by: Cai, Zhenguang G., et al.
Published: (2023)

\textsc{CantoNLU}: A benchmark for Cantonese natural language understanding
by: Min, Junghyun, et al.
Published: (2025)

Is 'Hope' a person or an idea? A pilot benchmark for NER: comparing traditional NLP tools and large language models on ambiguous entities
by: Latifi, Payam
Published: (2025)