Optimizing Long-Form Clinical Text Generation with Claim-Based Rewards

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Jhaveri, Samyak, Singh, Praphul, Kim, Jangwon, Taghavi, Tara, Kenthapadi, Krishnaram
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909821592141824
author Jhaveri, Samyak
Singh, Praphul
Kim, Jangwon
Taghavi, Tara
Kenthapadi, Krishnaram
author_facet Jhaveri, Samyak
Singh, Praphul
Kim, Jangwon
Taghavi, Tara
Kenthapadi, Krishnaram
contents Automating clinical documentation with large language models requires precise alignment with priorities such as completeness and factual grounding. We present an evaluation-integrated reinforcement learning framework for long-form clinical text generation that couples Group Relative Policy Optimization (GRPO) with DocLens, a claim-level evaluator that provides deterministic, dialogue-grounded rewards. Our method directly optimizes factual grounding and completeness without training a separate reward model or relying on human-authored references. Empirically, the approach improves clinical note quality and reduces training cost via a simple reward-gating strategy. An independent GPT-5 qualitative evaluation further supports these gains, showing higher preference for GRPO outputs in factuality, completeness, and brevity, with fewer omissions and hallucinations. Because the benchmarks are relatively clean and the base model already well aligned, these improvements likely represent a conservative lower bound. The framework is scalable to real-world settings and can incorporate custom objectives such as guideline adherence or billing preferences.
format Preprint
id arxiv_https___arxiv_org_abs_2510_02338
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Optimizing Long-Form Clinical Text Generation with Claim-Based Rewards
Jhaveri, Samyak
Singh, Praphul
Kim, Jangwon
Taghavi, Tara
Kenthapadi, Krishnaram
Computation and Language
Artificial Intelligence
Automating clinical documentation with large language models requires precise alignment with priorities such as completeness and factual grounding. We present an evaluation-integrated reinforcement learning framework for long-form clinical text generation that couples Group Relative Policy Optimization (GRPO) with DocLens, a claim-level evaluator that provides deterministic, dialogue-grounded rewards. Our method directly optimizes factual grounding and completeness without training a separate reward model or relying on human-authored references. Empirically, the approach improves clinical note quality and reduces training cost via a simple reward-gating strategy. An independent GPT-5 qualitative evaluation further supports these gains, showing higher preference for GRPO outputs in factuality, completeness, and brevity, with fewer omissions and hallucinations. Because the benchmarks are relatively clean and the base model already well aligned, these improvements likely represent a conservative lower bound. The framework is scalable to real-world settings and can incorporate custom objectives such as guideline adherence or billing preferences.
title Optimizing Long-Form Clinical Text Generation with Claim-Based Rewards
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2510.02338