Salvato in:
Dettagli Bibliografici
Autori principali: Bai, Lihua, Gamage, Thejani, Ma, Jin, Wang, Gaozhan
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:https://arxiv.org/abs/2309.10242
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910076170665984
author Bai, Lihua
Gamage, Thejani
Ma, Jin
Wang, Gaozhan
author_facet Bai, Lihua
Gamage, Thejani
Ma, Jin
Wang, Gaozhan
contents In this paper, we study the optimal dividend problem under the continuous time diffusion model with the bounded dividend rate from the Reinforcement Learning (RL) perspective. Unlike the standard literature, our main focus will be on numerical algorithms that allow part or all of the system parameters to be unspecified so that the optimal control cannot be explicitly determined. Following the RL literature we introduce the entropy-regularized exploratory control problem, which randomizes the control actions and balances the levels of exploitation and exploration, and carry out a theoretical analysis of the associated Policy Improvement (PI) and Policy Evaluation (PE) devices and the corresponding sequence of the approximating optimal strategies. Specifically, our algorithm will be based on two independent neural networks that approximate the value function and its derivative simultaneously. Such an algorithm, to the best of our knowledge, is new in the context of the optimal dividend problems, and can be effective even for the situation when the premium and/or interest rate is state dependent, hence beyond reach of the standard statistical methods. Some numerical experiments are presented to empirically demonstrate the effectiveness of our RL algorithm.
format Preprint
id arxiv_https___arxiv_org_abs_2309_10242
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Reinforcement Learning for optimal dividend problem under diffusion model
Bai, Lihua
Gamage, Thejani
Ma, Jin
Wang, Gaozhan
Optimization and Control
In this paper, we study the optimal dividend problem under the continuous time diffusion model with the bounded dividend rate from the Reinforcement Learning (RL) perspective. Unlike the standard literature, our main focus will be on numerical algorithms that allow part or all of the system parameters to be unspecified so that the optimal control cannot be explicitly determined. Following the RL literature we introduce the entropy-regularized exploratory control problem, which randomizes the control actions and balances the levels of exploitation and exploration, and carry out a theoretical analysis of the associated Policy Improvement (PI) and Policy Evaluation (PE) devices and the corresponding sequence of the approximating optimal strategies. Specifically, our algorithm will be based on two independent neural networks that approximate the value function and its derivative simultaneously. Such an algorithm, to the best of our knowledge, is new in the context of the optimal dividend problems, and can be effective even for the situation when the premium and/or interest rate is state dependent, hence beyond reach of the standard statistical methods. Some numerical experiments are presented to empirically demonstrate the effectiveness of our RL algorithm.
title Reinforcement Learning for optimal dividend problem under diffusion model
topic Optimization and Control
url https://arxiv.org/abs/2309.10242