Autotune: fast, accurate, and automatic tuning parameter selection for Lasso

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Sadhukhan, Tathagata, Wilms, Ines, Smeekes, Stephan, Basu, Sumanta
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908713298690048
author Sadhukhan, Tathagata
Wilms, Ines
Smeekes, Stephan
Basu, Sumanta
author_facet Sadhukhan, Tathagata
Wilms, Ines
Smeekes, Stephan
Basu, Sumanta
contents Least absolute shrinkage and selection operator (Lasso), a popular method for high-dimensional regression, is now used widely for estimating high-dimensional time series models such as the vector autoregression (VAR). Selecting its tuning parameter efficiently and accurately remains a challenge, despite the abundance of available methods for doing so. We propose $\mathsf{autotune}$, a strategy for Lasso to automatically tune itself by optimizing a penalized Gaussian log-likelihood alternately over regression coefficients and noise standard deviation. Using extensive simulation experiments on regression and VAR models, we show that $\mathsf{autotune}$ is faster, and provides better generalization and model selection than established alternatives in low signal-to-noise regimes. In the process, $\mathsf{autotune}$ provides a new estimator of noise standard deviation that can be used for high-dimensional inference, and a new visual diagnostic procedure for checking the sparsity assumption on regression coefficients. Finally, we demonstrate the utility of $\mathsf{autotune}$ on a real-world financial data set. An R package based on C++ is also made publicly available on Github.
format Preprint
id arxiv_https___arxiv_org_abs_2512_11139
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Autotune: fast, accurate, and automatic tuning parameter selection for Lasso
Sadhukhan, Tathagata
Wilms, Ines
Smeekes, Stephan
Basu, Sumanta
Methodology
Machine Learning
Least absolute shrinkage and selection operator (Lasso), a popular method for high-dimensional regression, is now used widely for estimating high-dimensional time series models such as the vector autoregression (VAR). Selecting its tuning parameter efficiently and accurately remains a challenge, despite the abundance of available methods for doing so. We propose $\mathsf{autotune}$, a strategy for Lasso to automatically tune itself by optimizing a penalized Gaussian log-likelihood alternately over regression coefficients and noise standard deviation. Using extensive simulation experiments on regression and VAR models, we show that $\mathsf{autotune}$ is faster, and provides better generalization and model selection than established alternatives in low signal-to-noise regimes. In the process, $\mathsf{autotune}$ provides a new estimator of noise standard deviation that can be used for high-dimensional inference, and a new visual diagnostic procedure for checking the sparsity assumption on regression coefficients. Finally, we demonstrate the utility of $\mathsf{autotune}$ on a real-world financial data set. An R package based on C++ is also made publicly available on Github.
title Autotune: fast, accurate, and automatic tuning parameter selection for Lasso
topic Methodology
Machine Learning
url https://arxiv.org/abs/2512.11139