Energy-Efficient and High-Performance Data Transfers with DRL Agents
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866912982416490496 |
|---|---|
| author | Jamil, Hasibul Goldverg, Jacob Rodrigues, Elvis Nine, MD S Q Zulkar Kosar, Tevfik |
| author_facet | Jamil, Hasibul Goldverg, Jacob Rodrigues, Elvis Nine, MD S Q Zulkar Kosar, Tevfik |
| contents | The rapid growth of data across fields of science and industry has increased the need to improve the performance of end-to-end data transfers while using the resources more efficiently. In this paper, we present a dynamic, multiparameter deep reinforcement learning (DRL) framework that adjusts application-layer transfer settings during data transfers on shared networks. Our method strikes a balance between high throughput and low energy utilization by employing reward signals that focus on both energy efficiency and fairness. The DRL agents can pause and resume transfer threads as needed, pausing during heavy network use and resuming when resources are available, to prevent overload and save energy. We evaluate several DRL techniques and compare our solution with state-of-the-art methods by measuring computational overhead, adaptability, throughput, and energy consumption. Our experiments show up to 25% increase in throughput and up to 40% reduction in energy usage at the end systems compared to baseline methods, highlighting a fair and energy-efficient way to optimize data transfers in shared network environments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_13662 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Energy-Efficient and High-Performance Data Transfers with DRL Agents Jamil, Hasibul Goldverg, Jacob Rodrigues, Elvis Nine, MD S Q Zulkar Kosar, Tevfik Distributed, Parallel, and Cluster Computing Networking and Internet Architecture Performance The rapid growth of data across fields of science and industry has increased the need to improve the performance of end-to-end data transfers while using the resources more efficiently. In this paper, we present a dynamic, multiparameter deep reinforcement learning (DRL) framework that adjusts application-layer transfer settings during data transfers on shared networks. Our method strikes a balance between high throughput and low energy utilization by employing reward signals that focus on both energy efficiency and fairness. The DRL agents can pause and resume transfer threads as needed, pausing during heavy network use and resuming when resources are available, to prevent overload and save energy. We evaluate several DRL techniques and compare our solution with state-of-the-art methods by measuring computational overhead, adaptability, throughput, and energy consumption. Our experiments show up to 25% increase in throughput and up to 40% reduction in energy usage at the end systems compared to baseline methods, highlighting a fair and energy-efficient way to optimize data transfers in shared network environments. |
| title | Energy-Efficient and High-Performance Data Transfers with DRL Agents |
| topic | Distributed, Parallel, and Cluster Computing Networking and Internet Architecture Performance |
| url | https://arxiv.org/abs/2503.13662 |