Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Liu, Zhang, Du, Hongyang, Hou, Xiangwang, Huang, Lianfen, Hosseinalipour, Seyyedali, Niyato, Dusit, Letaief, Khaled Ben
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2411.01458
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909376207388672
author Liu, Zhang
Du, Hongyang
Hou, Xiangwang
Huang, Lianfen
Hosseinalipour, Seyyedali
Niyato, Dusit
Letaief, Khaled Ben
author_facet Liu, Zhang
Du, Hongyang
Hou, Xiangwang
Huang, Lianfen
Hosseinalipour, Seyyedali
Niyato, Dusit
Letaief, Khaled Ben
contents Generative AI (GenAI) has emerged as a transformative technology, enabling customized and personalized AI-generated content (AIGC) services. In this paper, we address challenges of edge-enabled AIGC service provisioning, which remain underexplored in the literature. These services require executing GenAI models with billions of parameters, posing significant obstacles to resource-limited wireless edge. We subsequently introduce the formulation of joint model caching and resource allocation for AIGC services to balance a trade-off between AIGC quality and latency metrics. We obtain mathematical relationships of these metrics with the computational resources required by GenAI models via experimentation. Afterward, we decompose the formulation into a model caching subproblem on a long-timescale and a resource allocation subproblem on a short-timescale. Since the variables to be solved are discrete and continuous, respectively, we leverage a double deep Q-network (DDQN) algorithm to solve the former subproblem and propose a diffusion-based deep deterministic policy gradient (D3PG) algorithm to solve the latter. The proposed D3PG algorithm makes an innovative use of diffusion models as the actor network to determine optimal resource allocation decisions. Consequently, we integrate these two learning methods within the overarching two-timescale deep reinforcement learning (T2DRL) algorithm, the performance of which is studied through comparative numerical simulations.
format Preprint
id arxiv_https___arxiv_org_abs_2411_01458
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Two-Timescale Model Caching and Resource Allocation for Edge-Enabled AI-Generated Content Services
Liu, Zhang
Du, Hongyang
Hou, Xiangwang
Huang, Lianfen
Hosseinalipour, Seyyedali
Niyato, Dusit
Letaief, Khaled Ben
Machine Learning
Artificial Intelligence
Distributed, Parallel, and Cluster Computing
Generative AI (GenAI) has emerged as a transformative technology, enabling customized and personalized AI-generated content (AIGC) services. In this paper, we address challenges of edge-enabled AIGC service provisioning, which remain underexplored in the literature. These services require executing GenAI models with billions of parameters, posing significant obstacles to resource-limited wireless edge. We subsequently introduce the formulation of joint model caching and resource allocation for AIGC services to balance a trade-off between AIGC quality and latency metrics. We obtain mathematical relationships of these metrics with the computational resources required by GenAI models via experimentation. Afterward, we decompose the formulation into a model caching subproblem on a long-timescale and a resource allocation subproblem on a short-timescale. Since the variables to be solved are discrete and continuous, respectively, we leverage a double deep Q-network (DDQN) algorithm to solve the former subproblem and propose a diffusion-based deep deterministic policy gradient (D3PG) algorithm to solve the latter. The proposed D3PG algorithm makes an innovative use of diffusion models as the actor network to determine optimal resource allocation decisions. Consequently, we integrate these two learning methods within the overarching two-timescale deep reinforcement learning (T2DRL) algorithm, the performance of which is studied through comparative numerical simulations.
title Two-Timescale Model Caching and Resource Allocation for Edge-Enabled AI-Generated Content Services
topic Machine Learning
Artificial Intelligence
Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2411.01458