Saved in:
Bibliographic Details
Main Authors: Weber, Lucas, Bušić, Ana, Zhu, Jiamin
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2402.07525
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914674898894848
author Weber, Lucas
Bušić, Ana
Zhu, Jiamin
author_facet Weber, Lucas
Bušić, Ana
Zhu, Jiamin
contents Utilities have introduced demand charges to encourage customers to reduce their demand peaks, since a high peak may cause very high costs for both the utility and the consumer. We herein study the bill minimization problem for customers equipped with an energy storage device and a self-owned renewable energy production. A model-free reinforcement learning algorithm is carefully designed to reduce both the energy charge and the demand charge of the consumer. The proposed algorithm does not need forecasting models for the energy demand and the renewable energy production. The resulting controller can be used online, and progressively improved with newly gathered data. The algorithm is validated on real data from an office building of IFPEN Solaize site. Numerical results show that our algorithm can reduce electricity bills with both daily and monthly demand charges.
format Preprint
id arxiv_https___arxiv_org_abs_2402_07525
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Reinforcement learning based demand charge minimization using energy storage
Weber, Lucas
Bušić, Ana
Zhu, Jiamin
Optimization and Control
Utilities have introduced demand charges to encourage customers to reduce their demand peaks, since a high peak may cause very high costs for both the utility and the consumer. We herein study the bill minimization problem for customers equipped with an energy storage device and a self-owned renewable energy production. A model-free reinforcement learning algorithm is carefully designed to reduce both the energy charge and the demand charge of the consumer. The proposed algorithm does not need forecasting models for the energy demand and the renewable energy production. The resulting controller can be used online, and progressively improved with newly gathered data. The algorithm is validated on real data from an office building of IFPEN Solaize site. Numerical results show that our algorithm can reduce electricity bills with both daily and monthly demand charges.
title Reinforcement learning based demand charge minimization using energy storage
topic Optimization and Control
url https://arxiv.org/abs/2402.07525