Feature-driven reinforcement learning for photovoltaic in continuous intraday trading

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Abate, Arega Getaneh, Zhang, Xiao-Bing, Liu, Xiufeng, Liu, Ruyu
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918391091036160
author Abate, Arega Getaneh
Zhang, Xiao-Bing
Liu, Xiufeng
Liu, Ruyu
author_facet Abate, Arega Getaneh
Zhang, Xiao-Bing
Liu, Xiufeng
Liu, Ruyu
contents Sequential intraday electricity trading allows photovoltaic (PV) operators to reduce imbalance settlement costs as forecasts improve throughout the day. Yet deployable trading policies must jointly handle forecast uncertainty, intraday prices, liquidity, and the asymmetric economics of PV imbalance exposure. This paper proposes a feature-driven reinforcement learning (FDRL) framework for intraday PV trading in the Nordic market. Its main methodological contribution is a corrected reward that evaluates performance relative to a no-trade baseline, removing policy-independent noise that can otherwise push reinforcement learning toward inactive policies in high-price regimes. The framework combines this objective with a predominantly linear policy and a closed-form execution surrogate for efficient, interpretable training. In a strict walk-forward evaluation over 2021-2024 across four Nordic bidding zones (DK1, DK2, SE3, SE4), the method delivers statistically significant profit improvements over the spot-only baseline in every zone. Portfolio experiments show that a pooled cross-zone policy can match zone-specific models, while transfer-learning results indicate a two-cluster market structure and effective deployment in new zones with limited local data. The proposed framework offers an interpretable and computationally practical way to reduce imbalance costs, while the transfer results provide guidance for scaling strategies across bidding zones with different market designs.
format Preprint
id arxiv_https___arxiv_org_abs_2510_16021
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Feature-driven reinforcement learning for photovoltaic in continuous intraday trading
Abate, Arega Getaneh
Zhang, Xiao-Bing
Liu, Xiufeng
Liu, Ruyu
Machine Learning
General Economics
Economics
Sequential intraday electricity trading allows photovoltaic (PV) operators to reduce imbalance settlement costs as forecasts improve throughout the day. Yet deployable trading policies must jointly handle forecast uncertainty, intraday prices, liquidity, and the asymmetric economics of PV imbalance exposure. This paper proposes a feature-driven reinforcement learning (FDRL) framework for intraday PV trading in the Nordic market. Its main methodological contribution is a corrected reward that evaluates performance relative to a no-trade baseline, removing policy-independent noise that can otherwise push reinforcement learning toward inactive policies in high-price regimes. The framework combines this objective with a predominantly linear policy and a closed-form execution surrogate for efficient, interpretable training. In a strict walk-forward evaluation over 2021-2024 across four Nordic bidding zones (DK1, DK2, SE3, SE4), the method delivers statistically significant profit improvements over the spot-only baseline in every zone. Portfolio experiments show that a pooled cross-zone policy can match zone-specific models, while transfer-learning results indicate a two-cluster market structure and effective deployment in new zones with limited local data. The proposed framework offers an interpretable and computationally practical way to reduce imbalance costs, while the transfer results provide guidance for scaling strategies across bidding zones with different market designs.
title Feature-driven reinforcement learning for photovoltaic in continuous intraday trading
topic Machine Learning
General Economics
Economics
url https://arxiv.org/abs/2510.16021