Cover Image

Revisiting Optimism and Model Complexity in the Wake of Overparameterized Machine Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Patil, Pratik, Du, Jin-Hong, Tibshirani, Ryan J.
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Statistics Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Optimal Ridge Regularization for Out-of-Distribution Prediction
by: Patil, Pratik, et al.
Published: (2024)

Failures and Successes of Cross-Validation for Early-Stopped Gradient Descent
by: Patil, Pratik, et al.
Published: (2024)

Implicit Regularization Paths of Weighted Neural Representations
by: Du, Jin-Hong, et al.
Published: (2024)

Precise Asymptotics of Bagging Regularized M-estimators
by: Koriyama, Takuya, et al.
Published: (2024)

Corrected generalized cross-validation for finite ensembles of penalized estimators
by: Bellec, Pierre C., et al.
Published: (2023)

Asymptotically free sketched ridge ensembles: Risks, cross-validation, and tuning
by: Patil, Pratik, et al.
Published: (2023)

Gradient Equilibrium in Online Learning: Theory and Applications
by: Angelopoulos, Anastasios N., et al.
Published: (2025)

Multivariate Trend Filtering for Lattice Data
by: Sadhanala, Veeranjaneyulu, et al.
Published: (2021)

Optimal Unconstrained Self-Distillation in Ridge Regression: Strict Improvements, Precise Asymptotics, and One-Shot Tuning
by: Dang, Hien, et al.
Published: (2026)

Asymptotic Optimism for Tensor Regression Models with Applications to Neural Network Compression
by: Shi, Haoming, et al.
Published: (2026)

On Instability of Minimax Optimal Optimism-Based Bandit Algorithms
by: Praharaj, Samya, et al.
Published: (2025)

Upper Counterfactual Confidence Bounds: a New Optimism Principle for Contextual Bandits
by: Xu, Yunbei, et al.
Published: (2020)

Branch Scaling Manifests as Implicit Architectural Regularization for Improving Generalization in Overparameterized ResNets
by: Yu, Zixiong, et al.
Published: (2024)

Batches Stabilize the Minimum Norm Risk in High Dimensional Overparameterized Linear Regression
by: Ioushua, Shahar Stein, et al.
Published: (2023)

Basic Inequalities for First-Order Optimization with Applications to Statistical Risk Analysis
by: Paik, Seunghoon, et al.
Published: (2025)

Cross-validation: what does it estimate and how well does it do it?
by: Bates, Stephen, et al.
Published: (2021)

Optimism Stabilizes Thompson Sampling for Adaptive Inference
by: Yan, Shunxing, et al.
Published: (2026)

Asymptotic Optimism of Random-Design Linear and Kernel Regression Models
by: Luo, Hengrui, et al.
Published: (2025)

Byzantine-Robust Distributed Sparse Learning Revisited
by: Wang, Yuxuan, et al.
Published: (2026)

Revisiting Theory of Contrastive Learning for Domain Generalization
by: Alvandi, Ali, et al.
Published: (2025)

Valid Inference for Machine Learning Model Parameters
by: Dey, Neil, et al.
Published: (2023)

Disentangled Feature Importance
by: Du, Jin-Hong, et al.
Published: (2025)

Reassessing How to Compare and Improve the Calibration of Machine Learning Models
by: Chidambaram, Muthu, et al.
Published: (2024)

Addressing pitfalls in implicit unobserved confounding synthesis using explicit block hierarchical ancestral sampling
by: Sun, Xudong, et al.
Published: (2025)

The Morgan-Pitman Test of Equality of Variances and its Application to Machine Learning Model Evaluation and Selection
by: Arratia, Argimiro, et al.
Published: (2025)

Unifying Different Theories of Conformal Prediction
by: Barber, Rina Foygel, et al.
Published: (2025)

Multi-Armed Bandits With Machine Learning-Generated Surrogate Rewards
by: Ji, Wenlong, et al.
Published: (2025)

Laplace Transform Based Low-Complexity Learning of Continuous Markov Semigroups
by: Kostic, Vladimir R., et al.
Published: (2024)

Review and Prospect of Algebraic Research in Equivalent Framework between Statistical Mechanics and Machine Learning Theory
by: Watanabe, Sumio
Published: (2024)

Revisiting Agnostic PAC Learning
by: Hanneke, Steve, et al.
Published: (2024)

Robustness Against Weak or Invalid Instruments: Exploring Nonlinear Treatment Models with Machine Learning
by: Guo, Zijian, et al.
Published: (2022)

Complexity Dependent Error Rates for Physics-informed Statistical Learning via the Small-ball Method
by: Marcondes, Diego
Published: (2025)

MoMA: Model-based Mirror Ascent for Offline Reinforcement Learning
by: Hong, Mao, et al.
Published: (2024)

Two-Sample Testing with a Graph-Based Total Variation Integral Probability Metric
by: Green, Alden, et al.
Published: (2024)

Settling the Sample Complexity of Model-Based Offline Reinforcement Learning
by: Li, Gen, et al.
Published: (2022)

The Sample Complexity of Multicalibration
by: Collina, Natalie, et al.
Published: (2026)

Meta-Learning with Generalized Ridge Regression: High-dimensional Asymptotics, Optimality and Hyper-covariance Estimation
by: Jin, Yanhao, et al.
Published: (2024)

Learning Spectral Methods by Transformers
by: He, Yihan, et al.
Published: (2025)

Small Ensemble-based Data Assimilation: A Machine Learning-Enhanced Data Assimilation Method with Limited Ensemble Size
by: Li, Zhilin, et al.
Published: (2025)

Learning Perturbations to Extrapolate Your LLM
by: Cen, Zetai, et al.
Published: (2026)