Saved in:
Bibliographic Details
Main Authors: Semiari, Omid, Nikopour, Hosein, Talwar, Shilpa
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2504.19499
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915262604771328
author Semiari, Omid
Nikopour, Hosein
Talwar, Shilpa
author_facet Semiari, Omid
Nikopour, Hosein
Talwar, Shilpa
contents Next-generation wireless cellular networks are expected to provide unparalleled Quality-of-Service (QoS) for emerging wireless applications, necessitating strict performance guarantees, e.g., in terms of link-level data rates. A critical challenge in meeting these QoS requirements is the prevention of cell congestion, which involves balancing the load to ensure sufficient radio resources are available for each cell to serve its designated User Equipments (UEs). In this work, a novel QoS-aware Load Balancing (LB) approach is developed to optimize the performance of Guaranteed Bit Rate (GBR) and Best Effort (BE) traffic in a multi-band Open Radio Access Network (O-RAN) under QoS and resource constraints. The proposed solution builds on Graph Reinforcement Learning (GRL), a powerful framework at the intersection of Graph Neural Network (GNN) and RL. The QoS-aware LB is modeled as a Markov Decision Process, with states represented as graphs. QoS consideration are integrated into both state representations and reward signal design. The LB agent is then trained using an off-policy dueling Deep Q Network (DQN) that leverages a GNN-based architecture. This design ensures the LB policy is invariant to the ordering of nodes (UE or cell), flexible in handling various network sizes, and capable of accounting for spatial node dependencies in LB decisions. Performance of the GRL-based solution is compared with two baseline methods. Results show substantial performance gains, including a $53\%$ reduction in QoS violations and a fourfold increase in the 5th percentile rate for BE traffic.
format Preprint
id arxiv_https___arxiv_org_abs_2504_19499
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Graph Reinforcement Learning for QoS-Aware Load Balancing in Open Radio Access Networks
Semiari, Omid
Nikopour, Hosein
Talwar, Shilpa
Artificial Intelligence
Information Theory
Machine Learning
Networking and Internet Architecture
Signal Processing
Next-generation wireless cellular networks are expected to provide unparalleled Quality-of-Service (QoS) for emerging wireless applications, necessitating strict performance guarantees, e.g., in terms of link-level data rates. A critical challenge in meeting these QoS requirements is the prevention of cell congestion, which involves balancing the load to ensure sufficient radio resources are available for each cell to serve its designated User Equipments (UEs). In this work, a novel QoS-aware Load Balancing (LB) approach is developed to optimize the performance of Guaranteed Bit Rate (GBR) and Best Effort (BE) traffic in a multi-band Open Radio Access Network (O-RAN) under QoS and resource constraints. The proposed solution builds on Graph Reinforcement Learning (GRL), a powerful framework at the intersection of Graph Neural Network (GNN) and RL. The QoS-aware LB is modeled as a Markov Decision Process, with states represented as graphs. QoS consideration are integrated into both state representations and reward signal design. The LB agent is then trained using an off-policy dueling Deep Q Network (DQN) that leverages a GNN-based architecture. This design ensures the LB policy is invariant to the ordering of nodes (UE or cell), flexible in handling various network sizes, and capable of accounting for spatial node dependencies in LB decisions. Performance of the GRL-based solution is compared with two baseline methods. Results show substantial performance gains, including a $53\%$ reduction in QoS violations and a fourfold increase in the 5th percentile rate for BE traffic.
title Graph Reinforcement Learning for QoS-Aware Load Balancing in Open Radio Access Networks
topic Artificial Intelligence
Information Theory
Machine Learning
Networking and Internet Architecture
Signal Processing
url https://arxiv.org/abs/2504.19499