Intelligent Task Scheduling for Microservices via A3C-Based Reinforcement Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Yang, Tang, Tengda, Fang, Zhou, Deng, Yingnan, Duan, Yifei
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908344379244544
author Wang, Yang
Tang, Tengda
Fang, Zhou
Deng, Yingnan
Duan, Yifei
author_facet Wang, Yang
Tang, Tengda
Fang, Zhou
Deng, Yingnan
Duan, Yifei
contents To address the challenges of high resource dynamism and intensive task concurrency in microservice systems, this paper proposes an adaptive resource scheduling method based on the A3C reinforcement learning algorithm. The scheduling problem is modeled as a Markov Decision Process, where policy and value networks are jointly optimized to enable fine-grained resource allocation under varying load conditions. The method incorporates an asynchronous multi-threaded learning mechanism, allowing multiple agents to perform parallel sampling and synchronize updates to the global network parameters. This design improves both policy convergence efficiency and model stability. In the experimental section, a real-world dataset is used to construct a scheduling scenario. The proposed method is compared with several typical approaches across multiple evaluation metrics, including task delay, scheduling success rate, resource utilization, and convergence speed. The results show that the proposed method delivers high scheduling performance and system stability in multi-task concurrent environments. It effectively alleviates the resource allocation bottlenecks faced by traditional methods under heavy load, demonstrating its practical value for intelligent scheduling in microservice systems.
format Preprint
id arxiv_https___arxiv_org_abs_2505_00299
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Intelligent Task Scheduling for Microservices via A3C-Based Reinforcement Learning
Wang, Yang
Tang, Tengda
Fang, Zhou
Deng, Yingnan
Duan, Yifei
Distributed, Parallel, and Cluster Computing
Machine Learning
To address the challenges of high resource dynamism and intensive task concurrency in microservice systems, this paper proposes an adaptive resource scheduling method based on the A3C reinforcement learning algorithm. The scheduling problem is modeled as a Markov Decision Process, where policy and value networks are jointly optimized to enable fine-grained resource allocation under varying load conditions. The method incorporates an asynchronous multi-threaded learning mechanism, allowing multiple agents to perform parallel sampling and synchronize updates to the global network parameters. This design improves both policy convergence efficiency and model stability. In the experimental section, a real-world dataset is used to construct a scheduling scenario. The proposed method is compared with several typical approaches across multiple evaluation metrics, including task delay, scheduling success rate, resource utilization, and convergence speed. The results show that the proposed method delivers high scheduling performance and system stability in multi-task concurrent environments. It effectively alleviates the resource allocation bottlenecks faced by traditional methods under heavy load, demonstrating its practical value for intelligent scheduling in microservice systems.
title Intelligent Task Scheduling for Microservices via A3C-Based Reinforcement Learning
topic Distributed, Parallel, and Cluster Computing
Machine Learning
url https://arxiv.org/abs/2505.00299