Saved in:
Bibliographic Details
Main Authors: Lee, Chaeeun, Yates, T. Michael, Minervini, Pasquale, Simpson, T. Ian
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2602.14160
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910023208140800
author Lee, Chaeeun
Yates, T. Michael
Minervini, Pasquale
Simpson, T. Ian
author_facet Lee, Chaeeun
Yates, T. Michael
Minervini, Pasquale
Simpson, T. Ian
contents Clinical decision-making requires nuanced reasoning over heterogeneous evidence and traceable justifications. While recent LLM multi-agent systems (MAS) show promise, they largely optimise for outcome accuracy while overlooking process-grounded reasoning aligned with clinical standards. One critical real-world case of this is gene-disease validity curation, where experts must determine whether a gene is causally implicated in a disease by synthesising diverse biomedical evidence. We introduce an agent-as-tool reinforcement learning framework for this task with two objectives: (i) process-level supervision to ensure reasoning follows valid clinical pathways, and (ii) efficient coordination via a hierarchical multi-agent system. Our evaluation on the ClinGen dataset shows that with outcome-only rewards, MAS with a GRPO-trained Qwen3-4B supervisor agent substantially improves final outcome accuracy from 0.195 with a base model supervisor to 0.732, but results in poor process alignment (0.392 F1). Conversely, with process + outcome rewards, MAS with GRPO-trained supervisor achieves higher outcome accuracy (0.750) while significantly improving process fidelity to 0.520 F1. Our code is available at https://github.com/chaeeunlee-io/GeneDiseaseCurationAgents.
format Preprint
id arxiv_https___arxiv_org_abs_2602_14160
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Process-Supervised Multi-Agent Reinforcement Learning for Reliable Clinical Reasoning
Lee, Chaeeun
Yates, T. Michael
Minervini, Pasquale
Simpson, T. Ian
Artificial Intelligence
Clinical decision-making requires nuanced reasoning over heterogeneous evidence and traceable justifications. While recent LLM multi-agent systems (MAS) show promise, they largely optimise for outcome accuracy while overlooking process-grounded reasoning aligned with clinical standards. One critical real-world case of this is gene-disease validity curation, where experts must determine whether a gene is causally implicated in a disease by synthesising diverse biomedical evidence. We introduce an agent-as-tool reinforcement learning framework for this task with two objectives: (i) process-level supervision to ensure reasoning follows valid clinical pathways, and (ii) efficient coordination via a hierarchical multi-agent system. Our evaluation on the ClinGen dataset shows that with outcome-only rewards, MAS with a GRPO-trained Qwen3-4B supervisor agent substantially improves final outcome accuracy from 0.195 with a base model supervisor to 0.732, but results in poor process alignment (0.392 F1). Conversely, with process + outcome rewards, MAS with GRPO-trained supervisor achieves higher outcome accuracy (0.750) while significantly improving process fidelity to 0.520 F1. Our code is available at https://github.com/chaeeunlee-io/GeneDiseaseCurationAgents.
title Process-Supervised Multi-Agent Reinforcement Learning for Reliable Clinical Reasoning
topic Artificial Intelligence
url https://arxiv.org/abs/2602.14160