Saved in:
Bibliographic Details
Main Author: Giorgio, Bruno
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2504.11601
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912330665689088
author Giorgio, Bruno
author_facet Giorgio, Bruno
contents Reinforcement learning (RL) has emerged as a powerful paradigm for solving decision-making problems in dynamic environments. In this research, we explore the application of Double DQN (DDQN) and Dueling Network Architectures, to financial trading tasks using historical SP500 index data. Our focus is training agents capable of optimizing trading strategies while accounting for practical constraints such as transaction costs. The study evaluates the model performance across scenarios with and without commissions, highlighting the impact of cost-sensitive environments on reward dynamics. Despite computational limitations and the inherent complexity of financial time series data, the agent successfully learned meaningful trading policies. The findings confirm that RL agents, even when trained on limited datasets, can outperform random strategies by leveraging advanced architectures such as DDQN and Dueling Networks. However, significant challenges persist, particularly with a sub-optimal policy due to the complexity of data source.
format Preprint
id arxiv_https___arxiv_org_abs_2504_11601
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Dueling Deep Reinforcement Learning for Financial Time Series
Giorgio, Bruno
Machine Learning
Reinforcement learning (RL) has emerged as a powerful paradigm for solving decision-making problems in dynamic environments. In this research, we explore the application of Double DQN (DDQN) and Dueling Network Architectures, to financial trading tasks using historical SP500 index data. Our focus is training agents capable of optimizing trading strategies while accounting for practical constraints such as transaction costs. The study evaluates the model performance across scenarios with and without commissions, highlighting the impact of cost-sensitive environments on reward dynamics. Despite computational limitations and the inherent complexity of financial time series data, the agent successfully learned meaningful trading policies. The findings confirm that RL agents, even when trained on limited datasets, can outperform random strategies by leveraging advanced architectures such as DDQN and Dueling Networks. However, significant challenges persist, particularly with a sub-optimal policy due to the complexity of data source.
title Dueling Deep Reinforcement Learning for Financial Time Series
topic Machine Learning
url https://arxiv.org/abs/2504.11601