UAV-Enabled Data Collection for IoT Networks via Rainbow Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Jiao, Yingchao, Zhang, Xuhui, Liu, Wenchao, Wu, Yinyu, Ren, Jinke, Shen, Yanyan, Yang, Bo, Guan, Xinping
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918053988532224
author Jiao, Yingchao
Zhang, Xuhui
Liu, Wenchao
Wu, Yinyu
Ren, Jinke
Shen, Yanyan
Yang, Bo
Guan, Xinping
author_facet Jiao, Yingchao
Zhang, Xuhui
Liu, Wenchao
Wu, Yinyu
Ren, Jinke
Shen, Yanyan
Yang, Bo
Guan, Xinping
contents Unmanned aerial vehicles (UAVs) enabled Internet of things (IoT) systems have become an important part of future wireless communications. To achieve higher communication rate, the joint design of UAV trajectory and resource allocation is crucial. In this paper, a multi-antenna UAV is dispatched to simultaneously collect data from multiple ground IoT nodes (GNs) within a time interval. To improve the sum data collection (SDC) volume from the GNs, the UAV trajectory, the UAV receive beamforming, the scheduling of the GNs, and the transmit power of the GNs are jointly optimized. Since the problem is non-convex and the variables are highly coupled, it is hard to be solved using traditional methods. To find a near-optimal solution, a double-loop structured optimization-driven deep reinforcement learning (DRL) algorithm, called rainbow learning based algorithm (RLA), and a fully DRL-based algorithm are proposed to solve the problem effectively. Specifically, the outer-loop of the RLA utilizes a fusion deep Q-network to optimize the UAV trajectory, GN scheduling, and power allocation, while the inner-loop optimizes receive beamforming by successive convex approximation. Simulation results verify that the proposed algorithms outperform two benchmarks with significant improvement in SDC volumes, energy efficiency, and fairness.
format Preprint
id arxiv_https___arxiv_org_abs_2409_14521
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle UAV-Enabled Data Collection for IoT Networks via Rainbow Learning
Jiao, Yingchao
Zhang, Xuhui
Liu, Wenchao
Wu, Yinyu
Ren, Jinke
Shen, Yanyan
Yang, Bo
Guan, Xinping
Signal Processing
Information Theory
Unmanned aerial vehicles (UAVs) enabled Internet of things (IoT) systems have become an important part of future wireless communications. To achieve higher communication rate, the joint design of UAV trajectory and resource allocation is crucial. In this paper, a multi-antenna UAV is dispatched to simultaneously collect data from multiple ground IoT nodes (GNs) within a time interval. To improve the sum data collection (SDC) volume from the GNs, the UAV trajectory, the UAV receive beamforming, the scheduling of the GNs, and the transmit power of the GNs are jointly optimized. Since the problem is non-convex and the variables are highly coupled, it is hard to be solved using traditional methods. To find a near-optimal solution, a double-loop structured optimization-driven deep reinforcement learning (DRL) algorithm, called rainbow learning based algorithm (RLA), and a fully DRL-based algorithm are proposed to solve the problem effectively. Specifically, the outer-loop of the RLA utilizes a fusion deep Q-network to optimize the UAV trajectory, GN scheduling, and power allocation, while the inner-loop optimizes receive beamforming by successive convex approximation. Simulation results verify that the proposed algorithms outperform two benchmarks with significant improvement in SDC volumes, energy efficiency, and fairness.
title UAV-Enabled Data Collection for IoT Networks via Rainbow Learning
topic Signal Processing
Information Theory
url https://arxiv.org/abs/2409.14521