Multi-Agent Reinforcement Learning Meets Leaf Sequencing in Radiotherapy

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gao, Riqiang, Ghesu, Florin C., Arberet, Simon, Basiri, Shahab, Kuusela, Esa, Kraus, Martin, Comaniciu, Dorin, Kamen, Ali
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913376371736576
author Gao, Riqiang
Ghesu, Florin C.
Arberet, Simon
Basiri, Shahab
Kuusela, Esa
Kraus, Martin
Comaniciu, Dorin
Kamen, Ali
author_facet Gao, Riqiang
Ghesu, Florin C.
Arberet, Simon
Basiri, Shahab
Kuusela, Esa
Kraus, Martin
Comaniciu, Dorin
Kamen, Ali
contents In contemporary radiotherapy planning (RTP), a key module leaf sequencing is predominantly addressed by optimization-based approaches. In this paper, we propose a novel deep reinforcement learning (DRL) model termed as Reinforced Leaf Sequencer (RLS) in a multi-agent framework for leaf sequencing. The RLS model offers improvements to time-consuming iterative optimization steps via large-scale training and can control movement patterns through the design of reward mechanisms. We have conducted experiments on four datasets with four metrics and compared our model with a leading optimization sequencer. Our findings reveal that the proposed RLS model can achieve reduced fluence reconstruction errors, and potential faster convergence when integrated in an optimization planner. Additionally, RLS has shown promising results in a full artificial intelligence RTP pipeline. We hope this pioneer multi-agent RL leaf sequencer can foster future research on machine learning for RTP.
format Preprint
id arxiv_https___arxiv_org_abs_2406_01853
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Multi-Agent Reinforcement Learning Meets Leaf Sequencing in Radiotherapy
Gao, Riqiang
Ghesu, Florin C.
Arberet, Simon
Basiri, Shahab
Kuusela, Esa
Kraus, Martin
Comaniciu, Dorin
Kamen, Ali
Machine Learning
Artificial Intelligence
Multiagent Systems
In contemporary radiotherapy planning (RTP), a key module leaf sequencing is predominantly addressed by optimization-based approaches. In this paper, we propose a novel deep reinforcement learning (DRL) model termed as Reinforced Leaf Sequencer (RLS) in a multi-agent framework for leaf sequencing. The RLS model offers improvements to time-consuming iterative optimization steps via large-scale training and can control movement patterns through the design of reward mechanisms. We have conducted experiments on four datasets with four metrics and compared our model with a leading optimization sequencer. Our findings reveal that the proposed RLS model can achieve reduced fluence reconstruction errors, and potential faster convergence when integrated in an optimization planner. Additionally, RLS has shown promising results in a full artificial intelligence RTP pipeline. We hope this pioneer multi-agent RL leaf sequencer can foster future research on machine learning for RTP.
title Multi-Agent Reinforcement Learning Meets Leaf Sequencing in Radiotherapy
topic Machine Learning
Artificial Intelligence
Multiagent Systems
url https://arxiv.org/abs/2406.01853