Saved in:
Bibliographic Details
Main Authors: Dong, Jing, Görgülü, Berk, Sarhangian, Vahid
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2501.10523
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912193195278336
author Dong, Jing
Görgülü, Berk
Sarhangian, Vahid
author_facet Dong, Jing
Görgülü, Berk
Sarhangian, Vahid
contents In many service systems, especially those in healthcare, customer waiting times can result in increased service requirements. Such service slowdowns can significantly impact system performance. Therefore, it is important to properly account for their impact when designing scheduling policies. Scheduling under wait-dependent service times is challenging, especially when multiple customer classes are heterogeneously affected by waiting. In this work, we study scheduling policies in multiclass, multiserver queues with wait-dependent service slowdowns. We propose a simulation-based Approximate Dynamic Programming (ADP) algorithm to find close-to-optimal scheduling policies. The ADP algorithm (i) represents the policy using classifiers based on the index policy structure, (ii) leverages a coupling method to estimate the differences of the relative value functions directly, and (iii) uses adaptive sampling for efficient state-space exploration. Through extensive numerical experiments, we illustrate that the ADP algorithm generates close-to-optimal policies that outperform well-known benchmarks. We also provide insights into the structure of the optimal policy, which reveals an important trade-off between instantaneous cost reduction and preventing the system from reaching high-cost equilibria. Lastly, we conduct a case study on scheduling admissions into rehabilitation care to illustrate the effectiveness of the ADP algorithm in practice.
format Preprint
id arxiv_https___arxiv_org_abs_2501_10523
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Multiclass Queue Scheduling Under Slowdown: An Approximate Dynamic Programming Approach
Dong, Jing
Görgülü, Berk
Sarhangian, Vahid
Optimization and Control
Systems and Control
In many service systems, especially those in healthcare, customer waiting times can result in increased service requirements. Such service slowdowns can significantly impact system performance. Therefore, it is important to properly account for their impact when designing scheduling policies. Scheduling under wait-dependent service times is challenging, especially when multiple customer classes are heterogeneously affected by waiting. In this work, we study scheduling policies in multiclass, multiserver queues with wait-dependent service slowdowns. We propose a simulation-based Approximate Dynamic Programming (ADP) algorithm to find close-to-optimal scheduling policies. The ADP algorithm (i) represents the policy using classifiers based on the index policy structure, (ii) leverages a coupling method to estimate the differences of the relative value functions directly, and (iii) uses adaptive sampling for efficient state-space exploration. Through extensive numerical experiments, we illustrate that the ADP algorithm generates close-to-optimal policies that outperform well-known benchmarks. We also provide insights into the structure of the optimal policy, which reveals an important trade-off between instantaneous cost reduction and preventing the system from reaching high-cost equilibria. Lastly, we conduct a case study on scheduling admissions into rehabilitation care to illustrate the effectiveness of the ADP algorithm in practice.
title Multiclass Queue Scheduling Under Slowdown: An Approximate Dynamic Programming Approach
topic Optimization and Control
Systems and Control
url https://arxiv.org/abs/2501.10523