Saved in:
Bibliographic Details
Main Authors: Lv, Bojie, Li, Qianren, Wang, Rui
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.06186
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916241592025088
author Lv, Bojie
Li, Qianren
Wang, Rui
author_facet Lv, Bojie
Li, Qianren
Wang, Rui
contents This paper proposes an adaptive channel contention mechanism to optimize the queuing performance of a distributed millimeter wave (mmWave) uplink system with the capability of environment and mobility sensing. The mobile agents determine their back-off timer parameters according to their local knowledge of the uplink queue lengths, channel quality, and future channel statistics, where the channel prediction relies on the environment and mobility sensing. The optimization of queuing performance with this adaptive channel contention mechanism is formulated as a decentralized multi-agent Markov decision process (MDP). Although the channel contention actions are determined locally at the mobile agents, the optimization of local channel contention policies of all mobile agents is conducted in a centralized manner according to the system statistics before the scheduling. In the solution, the local policies are approximated by analytical models, and the optimization of their parameters becomes a stochastic optimization problem along an adaptive Markov chain. An unbiased gradient estimation is proposed so that the local policies can be optimized efficiently via the stochastic gradient descent method. It is demonstrated by simulation that the proposed gradient estimation is significantly more efficient in optimization than the existing methods, e.g., simultaneous perturbation stochastic approximation (SPSA).
format Preprint
id arxiv_https___arxiv_org_abs_2405_06186
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Sensing-Assisted Adaptive Channel Contention for Mobile Delay-Sensitive Communications
Lv, Bojie
Li, Qianren
Wang, Rui
Information Theory
Signal Processing
This paper proposes an adaptive channel contention mechanism to optimize the queuing performance of a distributed millimeter wave (mmWave) uplink system with the capability of environment and mobility sensing. The mobile agents determine their back-off timer parameters according to their local knowledge of the uplink queue lengths, channel quality, and future channel statistics, where the channel prediction relies on the environment and mobility sensing. The optimization of queuing performance with this adaptive channel contention mechanism is formulated as a decentralized multi-agent Markov decision process (MDP). Although the channel contention actions are determined locally at the mobile agents, the optimization of local channel contention policies of all mobile agents is conducted in a centralized manner according to the system statistics before the scheduling. In the solution, the local policies are approximated by analytical models, and the optimization of their parameters becomes a stochastic optimization problem along an adaptive Markov chain. An unbiased gradient estimation is proposed so that the local policies can be optimized efficiently via the stochastic gradient descent method. It is demonstrated by simulation that the proposed gradient estimation is significantly more efficient in optimization than the existing methods, e.g., simultaneous perturbation stochastic approximation (SPSA).
title Sensing-Assisted Adaptive Channel Contention for Mobile Delay-Sensitive Communications
topic Information Theory
Signal Processing
url https://arxiv.org/abs/2405.06186