Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2502.00940 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915134238097408 |
|---|---|
| author | Fernandez-Bes, Jesus Cid-Sueiro, Jesus Marques, Antonio G. |
| author_facet | Fernandez-Bes, Jesus Cid-Sueiro, Jesus Marques, Antonio G. |
| contents | In this paper, we propose a novel censoring policy for energy-efficient transmissions in energy-harvesting sensors. The problem is formulated as an infinite-horizon Markov Decision Process (MDP). The objective to be optimized is the expected sum of the importance (utility) of all transmitted messages. Assuming that such importance can be evaluated at the transmitting node, we show that, under certain conditions on the battery model, the optimal censoring policy is a threshold function on the importance value. Specifically, messages are transmitted only if their importance is above a threshold whose value depends on the battery level. Exploiting this property, we propose a model-based stochastic scheme that approximates the optimal solution, with less computational complexity and faster convergence speed than a conventional Q-learning algorithm. Numerical experiments in single-hop and multi-hop networks confirm the analytical advantages of the proposed scheme. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_00940 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | An MDP Model for Censoring in Harvesting Sensors: Optimal and Approximated Solutions Fernandez-Bes, Jesus Cid-Sueiro, Jesus Marques, Antonio G. Systems and Control Artificial Intelligence In this paper, we propose a novel censoring policy for energy-efficient transmissions in energy-harvesting sensors. The problem is formulated as an infinite-horizon Markov Decision Process (MDP). The objective to be optimized is the expected sum of the importance (utility) of all transmitted messages. Assuming that such importance can be evaluated at the transmitting node, we show that, under certain conditions on the battery model, the optimal censoring policy is a threshold function on the importance value. Specifically, messages are transmitted only if their importance is above a threshold whose value depends on the battery level. Exploiting this property, we propose a model-based stochastic scheme that approximates the optimal solution, with less computational complexity and faster convergence speed than a conventional Q-learning algorithm. Numerical experiments in single-hop and multi-hop networks confirm the analytical advantages of the proposed scheme. |
| title | An MDP Model for Censoring in Harvesting Sensors: Optimal and Approximated Solutions |
| topic | Systems and Control Artificial Intelligence |
| url | https://arxiv.org/abs/2502.00940 |