Joint Model Caching and Resource Allocation in Generative AI-Enabled Wireless Edge Networks

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Liu, Zhang, Du, Hongyang, Huang, Lianfen, Gao, Zhibin, Niyato, Dusit
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916479455199232
author Liu, Zhang
Du, Hongyang
Huang, Lianfen
Gao, Zhibin
Niyato, Dusit
author_facet Liu, Zhang
Du, Hongyang
Huang, Lianfen
Gao, Zhibin
Niyato, Dusit
contents With the rapid advancement of artificial intelligence (AI), generative AI (GenAI) has emerged as a transformative tool, enabling customized and personalized AI-generated content (AIGC) services. However, GenAI models with billions of parameters require substantial memory capacity and computational power for deployment and execution, presenting significant challenges to resource-limited edge networks. In this paper, we address the joint model caching and resource allocation problem in GenAI-enabled wireless edge networks. Our objective is to balance the trade-off between delivering high-quality AIGC and minimizing the delay in AIGC service provisioning. To tackle this problem, we employ a deep deterministic policy gradient (DDPG)-based reinforcement learning approach, capable of efficiently determining optimal model caching and resource allocation decisions for AIGC services in response to user mobility and time-varying channel conditions. Numerical results demonstrate that DDPG achieves a higher model hit ratio and provides superior-quality, lower-latency AIGC services compared to other benchmark solutions.
format Preprint
id arxiv_https___arxiv_org_abs_2411_08672
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Joint Model Caching and Resource Allocation in Generative AI-Enabled Wireless Edge Networks
Liu, Zhang
Du, Hongyang
Huang, Lianfen
Gao, Zhibin
Niyato, Dusit
Networking and Internet Architecture
Signal Processing
With the rapid advancement of artificial intelligence (AI), generative AI (GenAI) has emerged as a transformative tool, enabling customized and personalized AI-generated content (AIGC) services. However, GenAI models with billions of parameters require substantial memory capacity and computational power for deployment and execution, presenting significant challenges to resource-limited edge networks. In this paper, we address the joint model caching and resource allocation problem in GenAI-enabled wireless edge networks. Our objective is to balance the trade-off between delivering high-quality AIGC and minimizing the delay in AIGC service provisioning. To tackle this problem, we employ a deep deterministic policy gradient (DDPG)-based reinforcement learning approach, capable of efficiently determining optimal model caching and resource allocation decisions for AIGC services in response to user mobility and time-varying channel conditions. Numerical results demonstrate that DDPG achieves a higher model hit ratio and provides superior-quality, lower-latency AIGC services compared to other benchmark solutions.
title Joint Model Caching and Resource Allocation in Generative AI-Enabled Wireless Edge Networks
topic Networking and Internet Architecture
Signal Processing
url https://arxiv.org/abs/2411.08672