A proximal policy optimization based intelligent home solar management

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Creer, Kode, Parvez, Imitiaz
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910439920631808
author Creer, Kode
Parvez, Imitiaz
author_facet Creer, Kode
Parvez, Imitiaz
contents In the smart grid, the prosumers can sell unused electricity back to the power grid, assuming the prosumers own renewable energy sources and storage units. The maximizing of their profits under a dynamic electricity market is a problem that requires intelligent planning. To address this, we propose a framework based on Proximal Policy Optimization (PPO) using recurrent rewards. By using the information about the rewards modeled effectively with PPO to maximize our objective, we were able to get over 30\% improvement over the other naive algorithms in accumulating total profits. This shows promise in getting reinforcement learning algorithms to perform tasks required to plan their actions in complex domains like financial markets. We also introduce a novel method for embedding longs based on soliton waves that outperformed normal embedding in our use case with random floating point data augmentation.
format Preprint
id arxiv_https___arxiv_org_abs_2404_03888
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A proximal policy optimization based intelligent home solar management
Creer, Kode
Parvez, Imitiaz
Machine Learning
Artificial Intelligence
In the smart grid, the prosumers can sell unused electricity back to the power grid, assuming the prosumers own renewable energy sources and storage units. The maximizing of their profits under a dynamic electricity market is a problem that requires intelligent planning. To address this, we propose a framework based on Proximal Policy Optimization (PPO) using recurrent rewards. By using the information about the rewards modeled effectively with PPO to maximize our objective, we were able to get over 30\% improvement over the other naive algorithms in accumulating total profits. This shows promise in getting reinforcement learning algorithms to perform tasks required to plan their actions in complex domains like financial markets. We also introduce a novel method for embedding longs based on soliton waves that outperformed normal embedding in our use case with random floating point data augmentation.
title A proximal policy optimization based intelligent home solar management
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2404.03888