Saved in:
Bibliographic Details
Main Authors: Tripathi, Shalini, Bansal, Ankur, Kundu, Chinmoy
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2603.06046
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911492856610816
author Tripathi, Shalini
Bansal, Ankur
Kundu, Chinmoy
author_facet Tripathi, Shalini
Bansal, Ankur
Kundu, Chinmoy
contents This paper explores secure communication in an underwater energy-harvesting (EH) relay network that supports hybrid optical-acoustic transmission. The optical hop is modeled using a Gamma-Gamma turbulence channel with pointing errors and may occasionally be blocked by underwater obstacles. At the same time, an eavesdropper is assumed to monitor the acoustic hop, creating a secrecy concern. To address this, we formulate the relay power allocation problem as an infinite-horizon Markov decision process (MDP). A model-based reinforcement learning (RL) driven optimal power allocation (OPA) strategy is proposed to maximize long-term cumulative secrecy performance until the network stops functioning. To offer lower-complexity alternatives, we also develop a Greedy Algorithm (GA) and a Naive Algorithm (NA). Simulation results show that the RL based OPA adapts effectively to battery dynamics, varying channel conditions, and optical link availability, achieving the highest secure data transmission, while GA performs reasonably and NA performs poorly due to its short-sighted decisions.
format Preprint
id arxiv_https___arxiv_org_abs_2603_06046
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Reinforcement Learning for Secrecy Optimization in Underwater Energy Harvesting Relay Network
Tripathi, Shalini
Bansal, Ankur
Kundu, Chinmoy
Signal Processing
This paper explores secure communication in an underwater energy-harvesting (EH) relay network that supports hybrid optical-acoustic transmission. The optical hop is modeled using a Gamma-Gamma turbulence channel with pointing errors and may occasionally be blocked by underwater obstacles. At the same time, an eavesdropper is assumed to monitor the acoustic hop, creating a secrecy concern. To address this, we formulate the relay power allocation problem as an infinite-horizon Markov decision process (MDP). A model-based reinforcement learning (RL) driven optimal power allocation (OPA) strategy is proposed to maximize long-term cumulative secrecy performance until the network stops functioning. To offer lower-complexity alternatives, we also develop a Greedy Algorithm (GA) and a Naive Algorithm (NA). Simulation results show that the RL based OPA adapts effectively to battery dynamics, varying channel conditions, and optical link availability, achieving the highest secure data transmission, while GA performs reasonably and NA performs poorly due to its short-sighted decisions.
title Reinforcement Learning for Secrecy Optimization in Underwater Energy Harvesting Relay Network
topic Signal Processing
url https://arxiv.org/abs/2603.06046