Efficient Information Updates in Compute-First Networking via Reinforcement Learning with Joint AoI and VoI

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Qi, Jianpeng, Liu, Chao, Xu, Chengxiang, Wang, Rui, Dong, Junyu, Yu, Yanwei
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918015040225280
author Qi, Jianpeng
Liu, Chao
Xu, Chengxiang
Wang, Rui
Dong, Junyu
Yu, Yanwei
author_facet Qi, Jianpeng
Liu, Chao
Xu, Chengxiang
Wang, Rui
Dong, Junyu
Yu, Yanwei
contents Timely and efficient dissemination of service information is critical in compute-first networking systems, where user requests arrive dynamically and computing resources are constrained. In such systems, the access point (AP) plays a key role in forwarding user requests to a server based on its latest received service information. This paper considers a single-source, single-destination system and introduces an Age-and-Value-Aware (AVA) metric that jointly captures both the timeliness and the task relevance of service information. Unlike traditional freshness-based metrics, AVA explicitly incorporates variations in server-side service capacity and AP forwarding decisions, allowing more context-aware update evaluation. Building upon AVA, we propose a reinforcement learning-based update policy that learns to selectively transmit service information updates to the AP. It aims to maximize overall task success while minimizing unnecessary communications. Extensive simulations under diverse user request patterns and varying service capacities demonstrate that AVA reduces the update frequency by over 90% on average compared to baselines, with reductions reaching 98% in certain configurations. Crucially, this reduction is achieved without compromising the accuracy of task execution or the quality of decision making.
format Preprint
id arxiv_https___arxiv_org_abs_2505_06025
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Efficient Information Updates in Compute-First Networking via Reinforcement Learning with Joint AoI and VoI
Qi, Jianpeng
Liu, Chao
Xu, Chengxiang
Wang, Rui
Dong, Junyu
Yu, Yanwei
Networking and Internet Architecture
Distributed, Parallel, and Cluster Computing
Systems and Control
Timely and efficient dissemination of service information is critical in compute-first networking systems, where user requests arrive dynamically and computing resources are constrained. In such systems, the access point (AP) plays a key role in forwarding user requests to a server based on its latest received service information. This paper considers a single-source, single-destination system and introduces an Age-and-Value-Aware (AVA) metric that jointly captures both the timeliness and the task relevance of service information. Unlike traditional freshness-based metrics, AVA explicitly incorporates variations in server-side service capacity and AP forwarding decisions, allowing more context-aware update evaluation. Building upon AVA, we propose a reinforcement learning-based update policy that learns to selectively transmit service information updates to the AP. It aims to maximize overall task success while minimizing unnecessary communications. Extensive simulations under diverse user request patterns and varying service capacities demonstrate that AVA reduces the update frequency by over 90% on average compared to baselines, with reductions reaching 98% in certain configurations. Crucially, this reduction is achieved without compromising the accuracy of task execution or the quality of decision making.
title Efficient Information Updates in Compute-First Networking via Reinforcement Learning with Joint AoI and VoI
topic Networking and Internet Architecture
Distributed, Parallel, and Cluster Computing
Systems and Control
url https://arxiv.org/abs/2505.06025