Cover Image

Self-Distillation is Optimal Among Spectral Shrinkage Estimators in Spiked Covariance Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lecoiu, Radu, Mukherjee, Debarghya, Sur, Pragya
Format:	Preprint
Published:	2026
Subjects:	Statistics Theory Machine Learning Methodology
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Optimal and Provable Calibration in High-Dimensional Binary Classification: Angular Calibration and Platt Scaling
by: Li, Yufan, et al.
Published: (2025)

Preventing Model Collapse Under Overparametrization: Optimal Mixing Ratios for Interpolation Learning and Ridge Regression
by: Garg, Anvit, et al.
Published: (2025)

Adaptive Estimation and Inference in Semi-parametric Heterogeneous Clustered Multitask Learning via Neyman Orthogonality
by: Chen, Hanxiao, et al.
Published: (2026)

Optimal Nuisance Function Tuning for Estimating a Doubly Robust Functional under Proportional Asymptotics
by: McGrath, Sean, et al.
Published: (2025)

UTOPIA: Universally Trainable Optimal Prediction Intervals Aggregation
by: Fan, Jianqing, et al.
Published: (2023)

Optimal Aggregation of Prediction Intervals under Unsupervised Domain Shift
by: Ge, Jiawei, et al.
Published: (2024)

Spectrum-Aware Debiasing: A Modern Inference Framework with Applications to Principal Components Regression
by: Li, Yufan, et al.
Published: (2023)

Optimal Differentially Private PCA and Estimation for Spiked Covariance Matrices
by: Cai, T. Tony, et al.
Published: (2024)

Minimax optimal adaptive structured transfer learning through semi-parametric domain-varying coefficient model
by: Chen, Hanxiao, et al.
Published: (2026)

Generalization error of min-norm interpolators in transfer learning
by: Song, Yanke, et al.
Published: (2024)

On the estimation rate of Bayesian PINN for inverse problems
by: Sun, Yi, et al.
Published: (2024)

Predictive Inference in Multi-environment Scenarios
by: Duchi, John C., et al.
Published: (2024)

Minimax-Optimal Spectral Clustering with Covariance Projection for High-Dimensional Anisotropic Mixtures
by: Huang, Chengzhu, et al.
Published: (2025)

Nuisance Function Tuning and Sample Splitting for Optimally Estimating a Doubly Robust Functional
by: McGrath, Sean, et al.
Published: (2022)

HEDE: Heritability estimation in high dimensions by Ensembling Debiased Estimators
by: Song, Yanke, et al.
Published: (2024)

Characterizing Finite-Dimensional Posterior Marginals in High-Dimensional GLMs via Leave-One-Out
by: Sáenz, Manuel, et al.
Published: (2025)

High-dimensional Asymptotics of Langevin Dynamics in Spiked Matrix Models
by: Liang, Tengyuan, et al.
Published: (2022)

Mode-wise Principal Subspace Pursuit and Matrix Spiked Covariance Model
by: Tang, Runshi, et al.
Published: (2023)

Variational Bayesian Bow tie Neural Networks with Shrinkage
by: Sheinkman, Alisa, et al.
Published: (2024)

CINDES: Classification induced neural density estimator and simulator
by: Dai, Dehao, et al.
Published: (2025)

Enhancing Signal Proportion Estimation Through Leveraging Arbitrary Covariance Structures
by: Bai, Jingtian, et al.
Published: (2025)

Modeling Covariate Transition for Efficient Estimation of Longitudinal Treatment Effects in Randomized Experiments
by: Chihara, Naoki, et al.
Published: (2026)

A Debiased Estimator for the Mediation Functional in Ultra-High-Dimensional Setting in the Presence of Interaction Effects
by: Bo, Shi, et al.
Published: (2024)

Interaction Screening and Pseudolikelihood Approaches for Tensor Learning in Ising Models
by: Liu, Tianyu, et al.
Published: (2023)

SGD with Dependent Data: Optimal Estimation, Regret, and Inference
by: Shen, Yinan, et al.
Published: (2026)

Optimal Bias-variance Tradeoff in Matrix and Tensor Estimation
by: Kumar, Shivam, et al.
Published: (2025)

Estimation and Inference for the Average Treatment Effect in a Score-Explained Heterogeneous Treatment Effect Model
by: Wibisono, Kevin Christian, et al.
Published: (2025)

Optimal and Structure-Adaptive CATE Estimation with Kernel Ridge Regression
by: Kim, Seok-Jin
Published: (2026)

Globally-Optimal Greedy Experiment Selection for Active Sequential Estimation
by: Li, Xiaoou, et al.
Published: (2024)

Semi-Supervised Treatment Effect Estimation with Unlabeled Covariates for Prediction-Powered Causal Inference
by: Kato, Masahiro
Published: (2025)

Uncertainty Quantification of MLE for Entity Ranking with Covariates
by: Fan, Jianqing, et al.
Published: (2022)

Optimal Estimation of Shared Singular Subspaces across Multiple Noisy Matrices
by: Ma, Zhengchi, et al.
Published: (2024)

Doubly Robust Interval Estimation for Optimal Policy Evaluation in Online Learning
by: Shen, Ye, et al.
Published: (2021)

Covariate Assisted Entity Ranking with Sparse Intrinsic Scores
by: Fan, Jianqing, et al.
Published: (2024)

Distributional Treatment Effect Estimation across Heterogeneous Sites via Optimal Transport
by: Bateni, Borna, et al.
Published: (2025)

Minimax Optimal Estimation of Transport-Growth Pairs in Unbalanced Optimal Transport
by: Ponnoprat, Donlapark, et al.
Published: (2026)

Transfer Learning with Distance Covariance for Random Forest: Error Bounds and an EHR Application
by: Li, Chenze, et al.
Published: (2025)

Transfer Learning for Classification under Decision Rule Drift with Application to Optimal Individualized Treatment Rule Estimation
by: Wang, Xiaohan, et al.
Published: (2025)

Learning under Latent Group Sparsity via Diffusion on Networks
by: Ghosh, Subhroshekhar, et al.
Published: (2025)

Optimal Discriminant Analysis in High-Dimensional Latent Factor Models
by: Bing, Xin, et al.
Published: (2022)