Attention-Based Offline Reinforcement Learning and Clustering for Interpretable Sepsis Treatment

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kumar, Punit, Saran, Vaibhav, Patel, Divyesh, Kulkarni, Nitin, Vereshchaka, Alina
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918297152258048
author Kumar, Punit
Saran, Vaibhav
Patel, Divyesh
Kulkarni, Nitin
Vereshchaka, Alina
author_facet Kumar, Punit
Saran, Vaibhav
Patel, Divyesh
Kulkarni, Nitin
Vereshchaka, Alina
contents Sepsis remains one of the leading causes of mortality in intensive care units, where timely and accurate treatment decisions can significantly impact patient outcomes. In this work, we propose an interpretable decision support framework. Our system integrates four core components: (1) a clustering-based stratification module that categorizes patients into low, intermediate, and high-risk groups upon ICU admission, using clustering with statistical validation; (2) a synthetic data augmentation pipeline leveraging variational autoencoders (VAE) and diffusion models to enrich underrepresented trajectories such as fluid or vasopressor administration; (3) an offline reinforcement learning (RL) agent trained using Advantage Weighted Regression (AWR) with a lightweight attention encoder and supported by an ensemble models for conservative, safety-aware treatment recommendations; and (4) a rationale generation module powered by a multi-modal large language model (LLM), which produces natural-language justifications grounded in clinical context and retrieved expert knowledge. Evaluated on the MIMIC-III and eICU datasets, our approach achieves high treatment accuracy while providing clinicians with interpretable and robust policy recommendations.
format Preprint
id arxiv_https___arxiv_org_abs_2601_14228
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Attention-Based Offline Reinforcement Learning and Clustering for Interpretable Sepsis Treatment
Kumar, Punit
Saran, Vaibhav
Patel, Divyesh
Kulkarni, Nitin
Vereshchaka, Alina
Machine Learning
Sepsis remains one of the leading causes of mortality in intensive care units, where timely and accurate treatment decisions can significantly impact patient outcomes. In this work, we propose an interpretable decision support framework. Our system integrates four core components: (1) a clustering-based stratification module that categorizes patients into low, intermediate, and high-risk groups upon ICU admission, using clustering with statistical validation; (2) a synthetic data augmentation pipeline leveraging variational autoencoders (VAE) and diffusion models to enrich underrepresented trajectories such as fluid or vasopressor administration; (3) an offline reinforcement learning (RL) agent trained using Advantage Weighted Regression (AWR) with a lightweight attention encoder and supported by an ensemble models for conservative, safety-aware treatment recommendations; and (4) a rationale generation module powered by a multi-modal large language model (LLM), which produces natural-language justifications grounded in clinical context and retrieved expert knowledge. Evaluated on the MIMIC-III and eICU datasets, our approach achieves high treatment accuracy while providing clinicians with interpretable and robust policy recommendations.
title Attention-Based Offline Reinforcement Learning and Clustering for Interpretable Sepsis Treatment
topic Machine Learning
url https://arxiv.org/abs/2601.14228