Digital Twin-Assisted Data-Driven Optimization for Reliable Edge Caching in Wireless Networks

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhang, Zifan, Liu, Yuchen, Peng, Zhiyuan, Chen, Mingzhe, Xu, Dongkuan, Cui, Shuguang
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916307452035072
author Zhang, Zifan
Liu, Yuchen
Peng, Zhiyuan
Chen, Mingzhe
Xu, Dongkuan
Cui, Shuguang
author_facet Zhang, Zifan
Liu, Yuchen
Peng, Zhiyuan
Chen, Mingzhe
Xu, Dongkuan
Cui, Shuguang
contents Optimizing edge caching is crucial for the advancement of next-generation (nextG) wireless networks, ensuring high-speed and low-latency services for mobile users. Existing data-driven optimization approaches often lack awareness of the distribution of random data variables and focus solely on optimizing cache hit rates, neglecting potential reliability concerns, such as base station overload and unbalanced cache issues. This oversight can result in system crashes and degraded user experience. To bridge this gap, we introduce a novel digital twin-assisted optimization framework, called D-REC, which integrates reinforcement learning (RL) with diverse intervention modules to ensure reliable caching in nextG wireless networks. We first develop a joint vertical and horizontal twinning approach to efficiently create network digital twins, which are then employed by D-REC as RL optimizers and safeguards, providing ample datasets for training and predictive evaluation of our cache replacement policy. By incorporating reliability modules into a constrained Markov decision process, D-REC can adaptively adjust actions, rewards, and states to comply with advantageous constraints, minimizing the risk of network failures. Theoretical analysis demonstrates comparable convergence rates between D-REC and vanilla data-driven methods without compromising caching performance. Extensive experiments validate that D-REC outperforms conventional approaches in cache hit rate and load balancing while effectively enforcing predetermined reliability intervention modules.
format Preprint
id arxiv_https___arxiv_org_abs_2407_00286
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Digital Twin-Assisted Data-Driven Optimization for Reliable Edge Caching in Wireless Networks
Zhang, Zifan
Liu, Yuchen
Peng, Zhiyuan
Chen, Mingzhe
Xu, Dongkuan
Cui, Shuguang
Networking and Internet Architecture
Machine Learning
Optimizing edge caching is crucial for the advancement of next-generation (nextG) wireless networks, ensuring high-speed and low-latency services for mobile users. Existing data-driven optimization approaches often lack awareness of the distribution of random data variables and focus solely on optimizing cache hit rates, neglecting potential reliability concerns, such as base station overload and unbalanced cache issues. This oversight can result in system crashes and degraded user experience. To bridge this gap, we introduce a novel digital twin-assisted optimization framework, called D-REC, which integrates reinforcement learning (RL) with diverse intervention modules to ensure reliable caching in nextG wireless networks. We first develop a joint vertical and horizontal twinning approach to efficiently create network digital twins, which are then employed by D-REC as RL optimizers and safeguards, providing ample datasets for training and predictive evaluation of our cache replacement policy. By incorporating reliability modules into a constrained Markov decision process, D-REC can adaptively adjust actions, rewards, and states to comply with advantageous constraints, minimizing the risk of network failures. Theoretical analysis demonstrates comparable convergence rates between D-REC and vanilla data-driven methods without compromising caching performance. Extensive experiments validate that D-REC outperforms conventional approaches in cache hit rate and load balancing while effectively enforcing predetermined reliability intervention modules.
title Digital Twin-Assisted Data-Driven Optimization for Reliable Edge Caching in Wireless Networks
topic Networking and Internet Architecture
Machine Learning
url https://arxiv.org/abs/2407.00286