Reinforcement Learning for Speculative Trading under Exploratory Framework
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866911563047239680 |
|---|---|
| author | Zhao, Yun Tse, Alex S. L. Zheng, Harry |
| author_facet | Zhao, Yun Tse, Alex S. L. Zheng, Harry |
| contents | We study a speculative trading problem within the exploratory reinforcement learning (RL) framework of Wang et al. [2020]. The problem is formulated as a sequential optimal stopping problem over entry and exit times under general utility function and price process. We first consider a relaxed version of the problem in which the stopping times are modeled by the jump times of Cox processes driven by bounded, non-randomized intensity controls. Under the exploratory formulation, the agent's randomized control is characterized via the probability measure over the jump intensities, and their objective function is regularized by Shannon's differential entropy. This yields a system of the exploratory HJB equations and Gibbs distributions in closed-form as the optimal policy. Error estimates and convergence of the RL objective to the value function of the original problem are established. Finally, an RL algorithm is designed, and its implementation is showcased in a pairs-trading application. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_02035 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Reinforcement Learning for Speculative Trading under Exploratory Framework Zhao, Yun Tse, Alex S. L. Zheng, Harry Mathematical Finance Machine Learning Optimization and Control Computational Finance Trading and Market Microstructure 93E20, 60G40, 91G80, 60J60, 91G60, 68T07, 93E35 We study a speculative trading problem within the exploratory reinforcement learning (RL) framework of Wang et al. [2020]. The problem is formulated as a sequential optimal stopping problem over entry and exit times under general utility function and price process. We first consider a relaxed version of the problem in which the stopping times are modeled by the jump times of Cox processes driven by bounded, non-randomized intensity controls. Under the exploratory formulation, the agent's randomized control is characterized via the probability measure over the jump intensities, and their objective function is regularized by Shannon's differential entropy. This yields a system of the exploratory HJB equations and Gibbs distributions in closed-form as the optimal policy. Error estimates and convergence of the RL objective to the value function of the original problem are established. Finally, an RL algorithm is designed, and its implementation is showcased in a pairs-trading application. |
| title | Reinforcement Learning for Speculative Trading under Exploratory Framework |
| topic | Mathematical Finance Machine Learning Optimization and Control Computational Finance Trading and Market Microstructure 93E20, 60G40, 91G80, 60J60, 91G60, 68T07, 93E35 |
| url | https://arxiv.org/abs/2604.02035 |