Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Cichocki, Andrzej, Cruces, Sergio, Sarmiento, Auxiliadora, Tanaka, Toshihisa
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2406.00655
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913625949601792
author Cichocki, Andrzej
Cruces, Sergio
Sarmiento, Auxiliadora
Tanaka, Toshihisa
author_facet Cichocki, Andrzej
Cruces, Sergio
Sarmiento, Auxiliadora
Tanaka, Toshihisa
contents This paper introduces a novel family of generalized exponentiated gradient (EG) updates derived from an Alpha-Beta divergence regularization function. Collectively referred to as EGAB, the proposed updates belong to the category of multiplicative gradient algorithms for positive data and demonstrate considerable flexibility by controlling iteration behavior and performance through three hyperparameters: $α$, $β$, and the learning rate $η$. To enforce a unit $l_1$ norm constraint for nonnegative weight vectors within generalized EGAB algorithms, we develop two slightly distinct approaches. One method exploits scale-invariant loss functions, while the other relies on gradient projections onto the feasible domain. As an illustration of their applicability, we evaluate the proposed updates in addressing the online portfolio selection problem (OLPS) using gradient-based methods. Here, they not only offer a unified perspective on the search directions of various OLPS algorithms (including the standard exponentiated gradient and diverse mean-reversion strategies), but also facilitate smooth interpolation and extension of these updates due to the flexibility in hyperparameter selection. Simulation results confirm that the adaptability of these generalized gradient updates can effectively enhance the performance for some portfolios, particularly in scenarios involving transaction costs.
format Preprint
id arxiv_https___arxiv_org_abs_2406_00655
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Generalized Exponentiated Gradient Algorithms and Their Application to On-Line Portfolio Selection
Cichocki, Andrzej
Cruces, Sergio
Sarmiento, Auxiliadora
Tanaka, Toshihisa
Machine Learning
Information Theory
Portfolio Management
This paper introduces a novel family of generalized exponentiated gradient (EG) updates derived from an Alpha-Beta divergence regularization function. Collectively referred to as EGAB, the proposed updates belong to the category of multiplicative gradient algorithms for positive data and demonstrate considerable flexibility by controlling iteration behavior and performance through three hyperparameters: $α$, $β$, and the learning rate $η$. To enforce a unit $l_1$ norm constraint for nonnegative weight vectors within generalized EGAB algorithms, we develop two slightly distinct approaches. One method exploits scale-invariant loss functions, while the other relies on gradient projections onto the feasible domain. As an illustration of their applicability, we evaluate the proposed updates in addressing the online portfolio selection problem (OLPS) using gradient-based methods. Here, they not only offer a unified perspective on the search directions of various OLPS algorithms (including the standard exponentiated gradient and diverse mean-reversion strategies), but also facilitate smooth interpolation and extension of these updates due to the flexibility in hyperparameter selection. Simulation results confirm that the adaptability of these generalized gradient updates can effectively enhance the performance for some portfolios, particularly in scenarios involving transaction costs.
title Generalized Exponentiated Gradient Algorithms and Their Application to On-Line Portfolio Selection
topic Machine Learning
Information Theory
Portfolio Management
url https://arxiv.org/abs/2406.00655