Copertina

Optimal Unconstrained Self-Distillation in Ridge Regression: Strict Improvements, Precise Asymptotics, and One-Shot Tuning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Dang, Hien, Patil, Pratik, Rinaldo, Alessandro
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Statistics Theory Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Optimal Ridge Regularization for Out-of-Distribution Prediction
di: Patil, Pratik, et al.
Pubblicazione: (2024)

Precise Asymptotics of Bagging Regularized M-estimators
di: Koriyama, Takuya, et al.
Pubblicazione: (2024)

Asymptotically free sketched ridge ensembles: Risks, cross-validation, and tuning
di: Patil, Pratik, et al.
Pubblicazione: (2023)

Meta-Learning with Generalized Ridge Regression: High-dimensional Asymptotics, Optimality and Hyper-covariance Estimation
di: Jin, Yanhao, et al.
Pubblicazione: (2024)

Implicit Regularization Paths of Weighted Neural Representations
di: Du, Jin-Hong, et al.
Pubblicazione: (2024)

Optimal and Structure-Adaptive CATE Estimation with Kernel Ridge Regression
di: Kim, Seok-Jin
Pubblicazione: (2026)

Kernel Ridge Regression Inference
di: Singh, Rahul, et al.
Pubblicazione: (2023)

Failures and Successes of Cross-Validation for Early-Stopped Gradient Descent
di: Patil, Pratik, et al.
Pubblicazione: (2024)

On the Precise Asymptotics of Universal Inference
di: Takatsu, Kenta
Pubblicazione: (2025)

Preventing Model Collapse Under Overparametrization: Optimal Mixing Ratios for Interpolation Learning and Ridge Regression
di: Garg, Anvit, et al.
Pubblicazione: (2025)

Revisiting Optimism and Model Complexity in the Wake of Overparameterized Machine Learning
di: Patil, Pratik, et al.
Pubblicazione: (2024)

Spectral Estimators for Multi-Index Models: Precise Asymptotics and Optimal Weak Recovery
di: Kovačević, Filip, et al.
Pubblicazione: (2025)

Precise Asymptotics and Refined Regret of Variance-Aware UCB
di: Fan, Yingying, et al.
Pubblicazione: (2024)

Optimal Nuisance Function Tuning for Estimating a Doubly Robust Functional under Proportional Asymptotics
di: McGrath, Sean, et al.
Pubblicazione: (2025)

Low-Dimensional Adaptation of Rectified Flow: A Diffusion and Stochastic Localization Perspective
di: Roy, Saptarshi, et al.
Pubblicazione: (2026)

Asymptotics of Random Feature Regression Beyond the Linear Scaling Regime
di: Hu, Hong, et al.
Pubblicazione: (2024)

Asymptotically Optimal Sequential Testing with Markovian Data
di: Sethi, Alhad, et al.
Pubblicazione: (2026)

Asymptotic Optimism for Tensor Regression Models with Applications to Neural Network Compression
di: Shi, Haoming, et al.
Pubblicazione: (2026)

Asymptotic Theory and Phase Transitions for Variable Importance in Quantile Regression Forests
di: Nakamura, Tomoshige, et al.
Pubblicazione: (2025)

Precise Asymptotics for Spectral Methods in Mixed Generalized Linear Models
di: Zhang, Yihan, et al.
Pubblicazione: (2022)

Self-Distillation is Optimal Among Spectral Shrinkage Estimators in Spiked Covariance Models
di: Lecoiu, Radu, et al.
Pubblicazione: (2026)

Self-Boost via Optimal Retraining: An Analysis via Approximate Message Passing
di: Javanmard, Adel, et al.
Pubblicazione: (2025)

Statistical Complexity and Optimal Algorithms for Non-linear Ridge Bandits
di: Rajaraman, Nived, et al.
Pubblicazione: (2023)

A non-asymptotic theory of Kernel Ridge Regression: deterministic equivalents, test error, and GCV estimator
di: Misiakiewicz, Theodor, et al.
Pubblicazione: (2024)

Asymptotically Optimal Problem-Dependent Bandit Policies for Transfer Learning
di: Prevost, Adrien, et al.
Pubblicazione: (2025)

Non-Asymptotic Analysis of Data Augmentation for Precision Matrix Estimation
di: Morisset, Lucas, et al.
Pubblicazione: (2025)

Corrected generalized cross-validation for finite ensembles of penalized estimators
di: Bellec, Pierre C., et al.
Pubblicazione: (2023)

From Cross-Validation to SURE: Asymptotic Risk of Tuned Regularized Estimators
di: Adusumilli, Karun, et al.
Pubblicazione: (2026)

Self-Normalized Martingales and Uniform Regret Bounds for Linear Regression
di: Chen, Fan, et al.
Pubblicazione: (2026)

Optimal Excess Risk Bounds for Empirical Risk Minimization on $p$-Norm Linear Regression
di: Hanchi, Ayoub El, et al.
Pubblicazione: (2023)

Locally Near Optimal Piecewise Linear Regression in High Dimensions via Difference of Max-Affine Functions
di: Kanj, Haitham, et al.
Pubblicazione: (2026)

Unified Inference Framework for Single and Multi-Player Performative Prediction: Method and Asymptotic Optimality
di: Zhang, Zhixian, et al.
Pubblicazione: (2026)

Distribution-Free Confidence Ellipsoids for Ridge Regression with PAC Bounds
di: Szentpéteri, Szabolcs, et al.
Pubblicazione: (2026)

Online Covariance Estimation in Averaged SGD: Improved Batch-Mean Rates and Minimax Optimality via Trajectory Regression
di: Ni, Yijin, et al.
Pubblicazione: (2026)

Rate-Optimal Non-Asymptotics for the Quadratic Prediction Error Method
di: Stamouli, Charis, et al.
Pubblicazione: (2024)

High-probability sample complexities for policy evaluation with linear function approximation
di: Li, Gen, et al.
Pubblicazione: (2023)

One-Shot Learning for k-SAT
di: Galanis, Andreas, et al.
Pubblicazione: (2025)

A Random Matrix Perspective of Echo State Networks: From Precise Bias--Variance Characterization to Optimal Regularization
di: Moakher, Yessin, et al.
Pubblicazione: (2025)

Differentially Private Sliced Inverse Regression: Minimax Optimality and Algorithm
di: Xia, Xintao, et al.
Pubblicazione: (2024)

Addressing pitfalls in implicit unobserved confounding synthesis using explicit block hierarchical ancestral sampling
di: Sun, Xudong, et al.
Pubblicazione: (2025)