Saved in:
Bibliographic Details
Main Authors: Leão, Dorival, Aoki, Reiko, Ohashi, Alberto, Red, Teh Led
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2507.03759
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908971896406016
author Leão, Dorival
Aoki, Reiko
Ohashi, Alberto
Red, Teh Led
author_facet Leão, Dorival
Aoki, Reiko
Ohashi, Alberto
Red, Teh Led
contents This paper presents ``randomized SINDy", a sequential machine learning algorithm designed for dynamic data that has a time-dependent structure. It employs a probabilistic approach, with its PAC learning property rigorously proven through the mathematical theory of functional analysis. The algorithm dynamically predicts using a learned probability distribution of predictors, updating weights via gradient descent and a proximal algorithm to maintain a valid probability density. Inspired by SINDy (Brunton et al. 2016), it incorporates feature augmentation and Tikhonov regularization. For multivariate normal weights, the proximal step is omitted to focus on parameter estimation. The algorithm's effectiveness is demonstrated through experimental results in regression and binary classification using real-world data.
format Preprint
id arxiv_https___arxiv_org_abs_2507_03759
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Sequential Regression Learning with Randomized Algorithms
Leão, Dorival
Aoki, Reiko
Ohashi, Alberto
Red, Teh Led
Machine Learning
This paper presents ``randomized SINDy", a sequential machine learning algorithm designed for dynamic data that has a time-dependent structure. It employs a probabilistic approach, with its PAC learning property rigorously proven through the mathematical theory of functional analysis. The algorithm dynamically predicts using a learned probability distribution of predictors, updating weights via gradient descent and a proximal algorithm to maintain a valid probability density. Inspired by SINDy (Brunton et al. 2016), it incorporates feature augmentation and Tikhonov regularization. For multivariate normal weights, the proximal step is omitted to focus on parameter estimation. The algorithm's effectiveness is demonstrated through experimental results in regression and binary classification using real-world data.
title Sequential Regression Learning with Randomized Algorithms
topic Machine Learning
url https://arxiv.org/abs/2507.03759