Learning-Based User Association for MmWave Vehicular Networks With Kernelized Contextual Bandits

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: He, Xiaoyang, Huang, Xiaoxia
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916691313688576
author He, Xiaoyang
Huang, Xiaoxia
author_facet He, Xiaoyang
Huang, Xiaoxia
contents Vehicles require timely channel conditions to determine the base station (BS) to communicate with, but it is costly to estimate the fast-fading mmWave channels frequently. Without additional channel estimations, the proposed Distributed Kernelized Upper Confidence Bound (DK-UCB) algorithm estimates the current instantaneous transmission rates utilizing past contexts, such as the vehicle's location and velocity, along with past instantaneous transmission rates. To capture the nonlinear mapping from a context to the instantaneous transmission rate, DK-UCB maps a context into the reproducing kernel Hilbert space (RKHS) where a linear mapping becomes observable. To improve estimation accuracy, we propose a novel kernel function in RKHS which incorporates the propagation characteristics of the mmWave signals. Moreover, DK-UCB encourages a vehicle to share necessary information when it has conducted significant explorations, which speeds up the learning process while maintaining affordable communication costs.
format Preprint
id arxiv_https___arxiv_org_abs_2504_10959
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Learning-Based User Association for MmWave Vehicular Networks With Kernelized Contextual Bandits
He, Xiaoyang
Huang, Xiaoxia
Machine Learning
Vehicles require timely channel conditions to determine the base station (BS) to communicate with, but it is costly to estimate the fast-fading mmWave channels frequently. Without additional channel estimations, the proposed Distributed Kernelized Upper Confidence Bound (DK-UCB) algorithm estimates the current instantaneous transmission rates utilizing past contexts, such as the vehicle's location and velocity, along with past instantaneous transmission rates. To capture the nonlinear mapping from a context to the instantaneous transmission rate, DK-UCB maps a context into the reproducing kernel Hilbert space (RKHS) where a linear mapping becomes observable. To improve estimation accuracy, we propose a novel kernel function in RKHS which incorporates the propagation characteristics of the mmWave signals. Moreover, DK-UCB encourages a vehicle to share necessary information when it has conducted significant explorations, which speeds up the learning process while maintaining affordable communication costs.
title Learning-Based User Association for MmWave Vehicular Networks With Kernelized Contextual Bandits
topic Machine Learning
url https://arxiv.org/abs/2504.10959