Buchumschlag

CounselBench: A Large-Scale Expert Evaluation and Adversarial Benchmarking of Large Language Models in Mental Health Question Answering

Fuente: arXiv

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Li, Yahan, Yao, Jifan, Bunyi, John Bosco S., Frank, Adam C., Hwang, Angel Hsing-Chi, Liu, Ruishan
Format:	Preprint
Veröffentlicht:	2025
Schlagworte:	Computation and Language
Online-Zugang:	Acceder al recurso
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Ähnliche Einträge

CounselReflect: A Toolkit for Auditing Mental-Health Dialogues
von: Li, Yahan, et al.
Veröffentlicht: (2026)

MedAraBench: Large-Scale Arabic Medical Question Answering Dataset and Benchmark
von: Abu-Daoud, Mouath, et al.
Veröffentlicht: (2026)

A Large-Scale Benchmark for Evaluating Large Language Models on Medical Question Answering in Romanian
von: Rogoz, Ana-Cristina, et al.
Veröffentlicht: (2025)

MED-COPILOT: A Medical Assistant Powered by GraphRAG and Similar Patient Case Retrieval
von: Chen, Shuheng, et al.
Veröffentlicht: (2026)

InfiBench: Evaluating the Question-Answering Capabilities of Code Large Language Models
von: Li, Linyi, et al.
Veröffentlicht: (2024)

On the Calibration of Multilingual Question Answering LLMs
von: Yang, Yahan, et al.
Veröffentlicht: (2023)

ChineseVideoBench: Benchmarking Multi-modal Large Models for Chinese Video Question Answering
von: Nie, Yuxiang, et al.
Veröffentlicht: (2025)

Exploring the Efficacy of Large Language Models in Summarizing Mental Health Counseling Sessions: A Benchmark Study
von: Adhikary, Prottay Kumar, et al.
Veröffentlicht: (2024)

Evaluating Search Engines and Large Language Models for Answering Health Questions
von: Fernández-Pichel, Marcos, et al.
Veröffentlicht: (2024)

MedPriv-Bench: Benchmarking the Privacy-Utility Trade-off of Large Language Models in Medical Open-End Question Answering
von: Guan, Shaowei, et al.
Veröffentlicht: (2026)

TrustMH-Bench: A Comprehensive Benchmark for Evaluating the Trustworthiness of Large Language Models in Mental Health
von: Xiong, Zixin, et al.
Veröffentlicht: (2026)

When Can We Trust LLMs in Mental Health? Large-Scale Benchmarks for Reliable LLM Evaluation
von: Badawi, Abeer, et al.
Veröffentlicht: (2025)

An Expert Schema for Evaluating Large Language Model Errors in Scholarly Question-Answering Systems
von: Martin-Boyle, Anna, et al.
Veröffentlicht: (2026)

PsychCounsel-Bench: Evaluating the Psychology Intelligence of Large Language Models
von: Zeng, Min
Veröffentlicht: (2025)

"It was 80% me, 20% AI": Seeking Authenticity in Co-Writing with Large Language Models
von: Hwang, Angel Hsing-Chi, et al.
Veröffentlicht: (2024)

Do Large Language Models Align with Core Mental Health Counseling Competencies?
von: Nguyen, Viet Cuong, et al.
Veröffentlicht: (2024)

CARE-Bench: A Benchmark of Diverse Client Simulations Guided by Expert Principles for Evaluating LLMs in Psychological Counseling
von: Wang, Bichen, et al.
Veröffentlicht: (2025)

Comprehensive Evaluation for a Large Scale Knowledge Graph Question Answering Service
von: Potdar, Saloni, et al.
Veröffentlicht: (2025)

FinAgentBench: A Benchmark Dataset for Agentic Retrieval in Financial Question Answering
von: Choi, Chanyeol, et al.
Veröffentlicht: (2025)

WaterBench: Towards Holistic Evaluation of Watermarks for Large Language Models
von: Tu, Shangqing, et al.
Veröffentlicht: (2023)

Benchmarking Large Language Models for Conversational Question Answering in Multi-instructional Documents
von: Wu, Shiwei, et al.
Veröffentlicht: (2024)

FanOutQA: A Multi-Hop, Multi-Document Question Answering Benchmark for Large Language Models
von: Zhu, Andrew, et al.
Veröffentlicht: (2024)

RECAP: Resistance Capture in Text-based Mental Health Counseling with Large Language Models
von: Li, Anqi, et al.
Veröffentlicht: (2026)

RephQA: Evaluating Readability of Large Language Models in Public Health Question Answering
von: Qiu, Weikang, et al.
Veröffentlicht: (2025)

MHGraphBench: Knowledge Graph-Grounded Benchmarking of Mental Health Knowledge in Large Language Models
von: Liu, Weixin, et al.
Veröffentlicht: (2026)

Sports-QA: A Large-Scale Video Question Answering Benchmark for Complex and Professional Sports
von: Li, Haopeng, et al.
Veröffentlicht: (2024)

NCTB-QA: A Large-Scale Bangla Educational Question Answering Dataset and Benchmarking Performance
von: Eyasir, Abrar, et al.
Veröffentlicht: (2026)

OODRobustBench: a Benchmark and Large-Scale Analysis of Adversarial Robustness under Distribution Shift
von: Li, Lin, et al.
Veröffentlicht: (2023)

Evaluating Monolingual and Multilingual Large Language Models for Greek Question Answering: The DemosQA Benchmark
von: Mastrokostas, Charalampos, et al.
Veröffentlicht: (2026)

TableBench: A Comprehensive and Complex Benchmark for Table Question Answering
von: Wu, Xianjie, et al.
Veröffentlicht: (2024)

CBT-LLM: A Chinese Large Language Model for Cognitive Behavioral Therapy-based Mental Health Question Answering
von: Na, Hongbin
Veröffentlicht: (2024)

Beyond Empathy: Integrating Diagnostic and Therapeutic Reasoning with Large Language Models for Mental Health Counseling
von: Hu, He, et al.
Veröffentlicht: (2025)

MedExAgent: Training LLM Agents to Ask, Examine, and Diagnose in Noisy Clinical Environments
von: Gao, Yicheng, et al.
Veröffentlicht: (2026)

Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questions
von: Chen, Hanjie, et al.
Veröffentlicht: (2024)

HalluScore: Large Language Model Hallucination Question Answering Benchmark
von: Alansari, Aisha, et al.
Veröffentlicht: (2026)

PsychEthicsBench: Evaluating Large Language Models Against Australian Mental Health Ethics
von: Shen, Yaling, et al.
Veröffentlicht: (2026)

Evaluating Variance in Visual Question Answering Benchmarks
von: SR, Nikitha
Veröffentlicht: (2025)

Jamendo-QA: A Large-Scale Music Question Answering Dataset
von: Koh, Junyoung, et al.
Veröffentlicht: (2025)

Space3D-Bench: Spatial 3D Question Answering Benchmark
von: Szymanska, Emilia, et al.
Veröffentlicht: (2024)

CG-Bench: Clue-grounded Question Answering Benchmark for Long Video Understanding
von: Chen, Guo, et al.
Veröffentlicht: (2024)