Whittle Index Based User Association in Dense Millimeter Wave Networks

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Nalavade, Mandar R., Kasbekar, Gaurav S., Borkar, Vivek S.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915250324897792
author Nalavade, Mandar R.
Kasbekar, Gaurav S.
Borkar, Vivek S.
author_facet Nalavade, Mandar R.
Kasbekar, Gaurav S.
Borkar, Vivek S.
contents We address the problem of user association in a dense millimeter wave (mmWave) network, in which each arriving user brings a file containing a random number of packets and each time slot is divided into multiple mini-slots. This problem is an instance of the restless multi-armed bandit problem, and is provably hard to solve. Using a technique introduced by Whittle, we relax the hard per-stage constraint that each arriving user must be associated with exactly one mmWave base station (mBS) to a long-term constraint and then use the Lagrangian multiplier technique to convert the problem into an unconstrained problem. This decouples the process governing the system into separate Markov Decision Processes at different mBSs. We prove that the problem is Whittle indexable, present a scheme for computing the Whittle indices of different mBSs, and propose an association scheme under which, each arriving user is associated with the mBS with the smallest value of the Whittle index. Using extensive simulations, we show that the proposed Whittle index based scheme outperforms several user association schemes proposed in prior work in terms of various performance metrics such as average cost, delay, throughput, and Jain's fairness index.
format Preprint
id arxiv_https___arxiv_org_abs_2403_09279
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Whittle Index Based User Association in Dense Millimeter Wave Networks
Nalavade, Mandar R.
Kasbekar, Gaurav S.
Borkar, Vivek S.
Networking and Internet Architecture
We address the problem of user association in a dense millimeter wave (mmWave) network, in which each arriving user brings a file containing a random number of packets and each time slot is divided into multiple mini-slots. This problem is an instance of the restless multi-armed bandit problem, and is provably hard to solve. Using a technique introduced by Whittle, we relax the hard per-stage constraint that each arriving user must be associated with exactly one mmWave base station (mBS) to a long-term constraint and then use the Lagrangian multiplier technique to convert the problem into an unconstrained problem. This decouples the process governing the system into separate Markov Decision Processes at different mBSs. We prove that the problem is Whittle indexable, present a scheme for computing the Whittle indices of different mBSs, and propose an association scheme under which, each arriving user is associated with the mBS with the smallest value of the Whittle index. Using extensive simulations, we show that the proposed Whittle index based scheme outperforms several user association schemes proposed in prior work in terms of various performance metrics such as average cost, delay, throughput, and Jain's fairness index.
title Whittle Index Based User Association in Dense Millimeter Wave Networks
topic Networking and Internet Architecture
url https://arxiv.org/abs/2403.09279