Cover Image

Asymptotically free sketched ridge ensembles: Risks, cross-validation, and tuning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Patil, Pratik, LeJeune, Daniel
Format:	Preprint
Published:	2023
Subjects:	Statistics Theory Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

RandALO: Out-of-sample risk estimation in no time flat
by: Nobel, Parth, et al.
Published: (2024)

Corrected generalized cross-validation for finite ensembles of penalized estimators
by: Bellec, Pierre C., et al.
Published: (2023)

Optimal Unconstrained Self-Distillation in Ridge Regression: Strict Improvements, Precise Asymptotics, and One-Shot Tuning
by: Dang, Hien, et al.
Published: (2026)

Precise Asymptotics of Bagging Regularized M-estimators
by: Koriyama, Takuya, et al.
Published: (2024)

Implicit Regularization Paths of Weighted Neural Representations
by: Du, Jin-Hong, et al.
Published: (2024)

An Adaptive Tangent Feature Perspective of Neural Networks
by: LeJeune, Daniel, et al.
Published: (2023)

Failures and Successes of Cross-Validation for Early-Stopped Gradient Descent
by: Patil, Pratik, et al.
Published: (2024)

Optimal Ridge Regularization for Out-of-Distribution Prediction
by: Patil, Pratik, et al.
Published: (2024)

Revisiting Optimism and Model Complexity in the Wake of Overparameterized Machine Learning
by: Patil, Pratik, et al.
Published: (2024)

Effective regions and kernels in continuous sparse regularisation, with application to sketched mixtures
by: De Castro, Yohann, et al.
Published: (2025)

Optimal ridge penalty for real-world high-dimensional data can be zero or negative due to the implicit ridge regularization
by: Kobak, Dmitry, et al.
Published: (2018)

The Common Intuition to Transfer Learning Can Win or Lose: Case Studies for Linear Regression
by: Dar, Yehuda, et al.
Published: (2021)

Simultaneous analysis of approximate leave-one-out cross-validation and mean-field inference
by: Bellec, Pierre C
Published: (2025)

A distribution-free valid p-value for finite samples of bounded random variables
by: Alvarez, Joaquin
Published: (2024)

Dimension free ridge regression
by: Cheng, Chen, et al.
Published: (2022)

Holdout cross-validation for large non-Gaussian covariance matrix estimation using Weingarten calculus
by: Lamrani, Lamia, et al.
Published: (2025)

From Cross-Validation to SURE: Asymptotic Risk of Tuned Regularized Estimators
by: Adusumilli, Karun, et al.
Published: (2026)

Precise analysis of ridge interpolators under heavy correlations -- a Random Duality Theory view
by: Stojnic, Mihailo
Published: (2024)

Algorithms for ridge estimation with convergence guarantees
by: Qiao, Wanli, et al.
Published: (2021)

Perturbative adaptive importance sampling for Bayesian LOO cross-validation
by: Chang, Joshua C, et al.
Published: (2024)

On the Precise Asymptotics of Universal Inference
by: Takatsu, Kenta
Published: (2025)

Addressing pitfalls in implicit unobserved confounding synthesis using explicit block hierarchical ancestral sampling
by: Sun, Xudong, et al.
Published: (2025)

Asymptotically Optimal Sequential Testing with Markovian Data
by: Sethi, Alhad, et al.
Published: (2026)

Gradient dynamics for low-rank fine-tuning beyond kernels
by: Dayi, Arif Kerem, et al.
Published: (2024)

New affine invariant ensemble samplers and their dimensional scaling
by: Chen, Yifan
Published: (2025)

Anytime-valid, Bayes-assisted, Prediction-Powered Inference
by: Kilian, Valentin, et al.
Published: (2025)

Precise Asymptotics and Refined Regret of Variance-Aware UCB
by: Fan, Yingying, et al.
Published: (2024)

Asymptotic Classification Error for Heavy-Tailed Renewal Processes
by: Rong, Xinhui, et al.
Published: (2024)

An Asymptotic Law of the Iterated Logarithm for $\mathrm{KL}_{\inf}$
by: Ram, Ashwin, et al.
Published: (2026)

Asymptotic Theory of Geometric and Adaptive $k$-Means Clustering
by: Jaffe, Adam Quinn
Published: (2022)

Derivatives and residual distribution of regularized M-estimators with application to adaptive tuning
by: Bellec, Pierre C, et al.
Published: (2021)

High-dimensional analysis of ridge regression for non-identically distributed data with a variance profile
by: Bigot, Jérémie, et al.
Published: (2024)

Asymptotically Optimal Problem-Dependent Bandit Policies for Transfer Learning
by: Prevost, Adrien, et al.
Published: (2025)

Asymptotics of Random Feature Regression Beyond the Linear Scaling Regime
by: Hu, Hong, et al.
Published: (2024)

Asymptotic Optimism for Tensor Regression Models with Applications to Neural Network Compression
by: Shi, Haoming, et al.
Published: (2026)

Asymptotic FDR Control with Model-X Knockoffs: Is Moments Matching Sufficient?
by: Fan, Yingying, et al.
Published: (2025)

Asymptotic Theory and Phase Transitions for Variable Importance in Quantile Regression Forests
by: Nakamura, Tomoshige, et al.
Published: (2025)

Improved convergence rate of kNN graph Laplacians: differentiable self-tuned affinity
by: Cheng, Xiuyuan, et al.
Published: (2024)

High-dimensional ridge regression with random features for non-identically distributed data with a variance profile
by: Dabo, Issa-Mbenard, et al.
Published: (2025)

Mitigating loss of variance in ensemble data assimilation: machine learning-based and distance-free localization
by: Silva, Vinicius L. S., et al.
Published: (2025)