Saved in:
Bibliographic Details
Main Authors: Dai, Chongyuan, Hu, Jinpeng, Shi, Hongchang, Li, Zhuo, Yang, Xun, Wang, Meng
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2508.10848
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912547974676480
author Dai, Chongyuan
Hu, Jinpeng
Shi, Hongchang
Li, Zhuo
Yang, Xun
Wang, Meng
author_facet Dai, Chongyuan
Hu, Jinpeng
Shi, Hongchang
Li, Zhuo
Yang, Xun
Wang, Meng
contents Amidst a shortage of qualified mental health professionals, the integration of large language models (LLMs) into psychological applications offers a promising way to alleviate the growing burden of mental health disorders. Recent reasoning-augmented LLMs have achieved remarkable performance in mathematics and programming, while research in the psychological domain has predominantly emphasized emotional support and empathetic dialogue, with limited attention to reasoning mechanisms that are beneficial to generating reliable responses. Therefore, in this paper, we propose Psyche-R1, the first Chinese psychological LLM that jointly integrates empathy, psychological expertise, and reasoning, built upon a novel data curation pipeline. Specifically, we design a comprehensive data synthesis pipeline that produces over 75k high-quality psychological questions paired with detailed rationales, generated through chain-of-thought (CoT) reasoning and iterative prompt-rationale optimization, along with 73k empathetic dialogues. Subsequently, we employ a hybrid training strategy wherein challenging samples are identified through a multi-LLM cross-selection strategy for group relative policy optimization (GRPO) to improve reasoning ability, while the remaining data is used for supervised fine-tuning (SFT) to enhance empathetic response generation and psychological domain knowledge. Extensive experiment results demonstrate the effectiveness of the Psyche-R1 across several psychological benchmarks, where our 7B Psyche-R1 achieves comparable results to 671B DeepSeek-R1.
format Preprint
id arxiv_https___arxiv_org_abs_2508_10848
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Psyche-R1: Towards Reliable Psychological LLMs through Unified Empathy, Expertise, and Reasoning
Dai, Chongyuan
Hu, Jinpeng
Shi, Hongchang
Li, Zhuo
Yang, Xun
Wang, Meng
Computation and Language
Amidst a shortage of qualified mental health professionals, the integration of large language models (LLMs) into psychological applications offers a promising way to alleviate the growing burden of mental health disorders. Recent reasoning-augmented LLMs have achieved remarkable performance in mathematics and programming, while research in the psychological domain has predominantly emphasized emotional support and empathetic dialogue, with limited attention to reasoning mechanisms that are beneficial to generating reliable responses. Therefore, in this paper, we propose Psyche-R1, the first Chinese psychological LLM that jointly integrates empathy, psychological expertise, and reasoning, built upon a novel data curation pipeline. Specifically, we design a comprehensive data synthesis pipeline that produces over 75k high-quality psychological questions paired with detailed rationales, generated through chain-of-thought (CoT) reasoning and iterative prompt-rationale optimization, along with 73k empathetic dialogues. Subsequently, we employ a hybrid training strategy wherein challenging samples are identified through a multi-LLM cross-selection strategy for group relative policy optimization (GRPO) to improve reasoning ability, while the remaining data is used for supervised fine-tuning (SFT) to enhance empathetic response generation and psychological domain knowledge. Extensive experiment results demonstrate the effectiveness of the Psyche-R1 across several psychological benchmarks, where our 7B Psyche-R1 achieves comparable results to 671B DeepSeek-R1.
title Psyche-R1: Towards Reliable Psychological LLMs through Unified Empathy, Expertise, and Reasoning
topic Computation and Language
url https://arxiv.org/abs/2508.10848