Variational Quantum Rainbow Deep Q-Network for Optimizing Resource Allocation Problem

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Nguyen, Truong Thanh Hung, Nguyen, Truong Thinh, Cao, Hung
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917128336048128
author Nguyen, Truong Thanh Hung
Nguyen, Truong Thinh
Cao, Hung
author_facet Nguyen, Truong Thanh Hung
Nguyen, Truong Thinh
Cao, Hung
contents Resource allocation remains NP-hard due to combinatorial complexity. While deep reinforcement learning (DRL) methods, such as the Rainbow Deep Q-Network (DQN), improve scalability through prioritized replay and distributional heads, classical function approximators limit their representational power. We introduce Variational Quantum Rainbow DQN (VQR-DQN), which integrates ring-topology variational quantum circuits with Rainbow DQN to leverage quantum superposition and entanglement. We frame the human resource allocation problem (HRAP) as a Markov decision process (MDP) with combinatorial action spaces based on officer capabilities, event schedules, and transition times. On four HRAP benchmarks, VQR-DQN achieves 26.8% normalized makespan reduction versus random baselines and outperforms Double DQN and classical Rainbow DQN by 4.9-13.4%. These gains align with theoretical connections between circuit expressibility, entanglement, and policy quality, demonstrating the potential of quantum-enhanced DRL for large-scale resource allocation. Our implementation is available at: https://github.com/Analytics-Everywhere-Lab/qtrl/.
format Preprint
id arxiv_https___arxiv_org_abs_2512_05946
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Variational Quantum Rainbow Deep Q-Network for Optimizing Resource Allocation Problem
Nguyen, Truong Thanh Hung
Nguyen, Truong Thinh
Cao, Hung
Artificial Intelligence
Emerging Technologies
Software Engineering
Resource allocation remains NP-hard due to combinatorial complexity. While deep reinforcement learning (DRL) methods, such as the Rainbow Deep Q-Network (DQN), improve scalability through prioritized replay and distributional heads, classical function approximators limit their representational power. We introduce Variational Quantum Rainbow DQN (VQR-DQN), which integrates ring-topology variational quantum circuits with Rainbow DQN to leverage quantum superposition and entanglement. We frame the human resource allocation problem (HRAP) as a Markov decision process (MDP) with combinatorial action spaces based on officer capabilities, event schedules, and transition times. On four HRAP benchmarks, VQR-DQN achieves 26.8% normalized makespan reduction versus random baselines and outperforms Double DQN and classical Rainbow DQN by 4.9-13.4%. These gains align with theoretical connections between circuit expressibility, entanglement, and policy quality, demonstrating the potential of quantum-enhanced DRL for large-scale resource allocation. Our implementation is available at: https://github.com/Analytics-Everywhere-Lab/qtrl/.
title Variational Quantum Rainbow Deep Q-Network for Optimizing Resource Allocation Problem
topic Artificial Intelligence
Emerging Technologies
Software Engineering
url https://arxiv.org/abs/2512.05946