A Novel Reinforcement Learning Routing Algorithm for Congestion Control in Complex Networks

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yajadda, Seyed Hassan, Safaei, Farshad
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916078104346624
author Yajadda, Seyed Hassan
Safaei, Farshad
author_facet Yajadda, Seyed Hassan
Safaei, Farshad
contents Despite technological advancements, the significance of interdisciplinary subjects like complex networks has grown. Exploring communication within these networks is crucial, with traffic becoming a key concern due to the expanding population and increased need for connections. Congestion tends to originate in specific network areas but quickly proliferates throughout. Consequently, understanding the transition from a flow-free state to a congested state is vital. Numerous studies have delved into comprehending the emergence and control of congestion in complex networks, falling into three general categories: soft strategies, hard strategies, and resource allocation strategies. This article introduces a routing algorithm leveraging reinforcement learning to address two primary objectives: congestion control and optimizing path length based on the shortest path algorithm, ultimately enhancing network throughput compared to previous methods. Notably, the proposed method proves effective not only in Barabási-Albert scale-free networks but also in other network models such as Watts-Strogatz (small-world) and Erdös-Rényi (random network). Simulation experiment results demonstrate that, across various traffic scenarios and network topologies, the proposed method can enhance efficiency criteria by up to 30% while reducing maximum node congestion by five times.
format Preprint
id arxiv_https___arxiv_org_abs_2401_00297
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle A Novel Reinforcement Learning Routing Algorithm for Congestion Control in Complex Networks
Yajadda, Seyed Hassan
Safaei, Farshad
Networking and Internet Architecture
Machine Learning
Despite technological advancements, the significance of interdisciplinary subjects like complex networks has grown. Exploring communication within these networks is crucial, with traffic becoming a key concern due to the expanding population and increased need for connections. Congestion tends to originate in specific network areas but quickly proliferates throughout. Consequently, understanding the transition from a flow-free state to a congested state is vital. Numerous studies have delved into comprehending the emergence and control of congestion in complex networks, falling into three general categories: soft strategies, hard strategies, and resource allocation strategies. This article introduces a routing algorithm leveraging reinforcement learning to address two primary objectives: congestion control and optimizing path length based on the shortest path algorithm, ultimately enhancing network throughput compared to previous methods. Notably, the proposed method proves effective not only in Barabási-Albert scale-free networks but also in other network models such as Watts-Strogatz (small-world) and Erdös-Rényi (random network). Simulation experiment results demonstrate that, across various traffic scenarios and network topologies, the proposed method can enhance efficiency criteria by up to 30% while reducing maximum node congestion by five times.
title A Novel Reinforcement Learning Routing Algorithm for Congestion Control in Complex Networks
topic Networking and Internet Architecture
Machine Learning
url https://arxiv.org/abs/2401.00297