Cover Image

A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Suh, Namjoon, Cheng, Guang
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Statistics Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Approximation of RKHS Functionals by Neural Networks
by: Zhou, Tian-Yi, et al.
Published: (2024)

A Statistical Theory of Contrastive Learning via Approximate Sufficient Statistics
by: Lin, Licong, et al.
Published: (2025)

Statistical Learning Theory for Distributional Classification
by: Fiedler, Christian
Published: (2026)

Transformers Meet In-Context Learning: A Universal Approximation Theory
by: Li, Gen, et al.
Published: (2025)

On the Statistical Capacity of Deep Generative Models
by: Tam, Edric, et al.
Published: (2025)

A Statistical Theory of Contrastive Pre-training and Multimodal Generative AI
by: Oko, Kazusato, et al.
Published: (2025)

Extrapolation in Statistical Learning with Extreme Value Theory
by: Engelke, Sebastian, et al.
Published: (2026)

From Collapse to Improvement: Statistical Perspectives on the Evolutionary Dynamics of Iterative Training on Contaminated Sources
by: Bakshi, Soham, et al.
Published: (2026)

Training Implicit Generative Models via an Invariant Statistical Loss
by: de Frutos, José Manuel, et al.
Published: (2024)

Unveil Conditional Diffusion Models with Classifier-free Guidance: A Sharp Statistical Theory
by: Fu, Hengyu, et al.
Published: (2024)

Statistical Guarantees for Approximate Stationary Points of Shallow Neural Networks
by: Taheri, Mahsa, et al.
Published: (2022)

Review and Prospect of Algebraic Research in Equivalent Framework between Statistical Mechanics and Machine Learning Theory
by: Watanabe, Sumio
Published: (2024)

A Statistical Analysis for Supervised Deep Learning with Exponential Families for Intrinsically Low-dimensional Data
by: Chakraborty, Saptarshi, et al.
Published: (2024)

Decentralized Sparse Linear Regression via Gradient-Tracking: Linear Convergence and Statistical Guarantees
by: Maros, Marie, et al.
Published: (2022)

Revisiting Theory of Contrastive Learning for Domain Generalization
by: Alvandi, Ali, et al.
Published: (2025)

An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization
by: Chen, Minshuo, et al.
Published: (2024)

Statistically Optimal Generative Modeling with Maximum Deviation from the Empirical Distribution
by: Vardanyan, Elen, et al.
Published: (2023)

A Random Matrix Theory Perspective on the Spectrum of Learned Features and Asymptotic Generalization Capabilities
by: Dandi, Yatin, et al.
Published: (2024)

Error Analysis of Discrete Flow with Generator Matching
by: Wan, Zhengyan, et al.
Published: (2025)

Statistical Learning Theory in Lean 4: Empirical Processes from Scratch
by: Zhang, Yuanhe, et al.
Published: (2026)

Towards a Statistical Understanding of Neural Networks: Beyond the Neural Tangent Kernel Theories
by: Zhang, Haobo, et al.
Published: (2024)

A Statistical Analysis of Deep Federated Learning for Intrinsically Low-dimensional Data
by: Chakraborty, Saptarshi, et al.
Published: (2024)

Statistical-Computational Trade-offs in Learning Multi-Index Models via Harmonic Analysis
by: Latourelle-Vigeant, Hugo, et al.
Published: (2026)

Multitask Learning and Bandits via Robust Statistics
by: Xu, Kan, et al.
Published: (2021)

Observable Geometry of Singular Statistical Models
by: Plummer, Sean
Published: (2026)

A Theory of Universal Agnostic Learning
by: Hanneke, Steve, et al.
Published: (2026)

Statistical Decision Theory with Counterfactual Loss
by: Koch, Benedikt, et al.
Published: (2025)

Inference for Deep Neural Network Estimators in Generalized Nonparametric Models
by: Meng, Xuran, et al.
Published: (2025)

Diffusion Models Are Statistically Optimal for Learning Low-Dimensional Multi-Modal Distributions
by: Wu, Jingda, et al.
Published: (2026)

Provable Sample-Efficient Transfer Learning Conditional Diffusion Models via Representation Learning
by: Cheng, Ziheng, et al.
Published: (2025)

Jackknife Variance Estimation for Hájek-Dominated Generalized U-Statistics
by: Juergens, Jakob R.
Published: (2025)

Statistical Inference and Learning for Shapley Additive Explanations (SHAP)
by: Whitehouse, Justin, et al.
Published: (2026)

Statistical analysis of Inverse Entropy-regularized Reinforcement Learning
by: Belomestny, Denis, et al.
Published: (2025)

Statistical Learning Guarantees for Group-Invariant Barron Functions
by: Yang, Yahong, et al.
Published: (2025)

Generalization in Representation Models via Random Matrix Theory: Application to Recurrent Networks
by: Moakher, Yessin, et al.
Published: (2025)

Linear Response Estimators for Singular Statistical Models
by: Elliott, Chris, et al.
Published: (2026)

Robust Bayesian Inference via Variational Approximations of Generalized Rho-Posteriors
by: Khribch, EL Mahdi, et al.
Published: (2026)

Statistical Convergence of Spherical First Hitting Diffusion Models
by: Bienewald, Simon, et al.
Published: (2026)

Wasserstein Parallel Transport for Predicting the Dynamics of Statistical Systems
by: Saidi, Tristan Luca, et al.
Published: (2026)

Transfer Learning on Edge Connecting Probability Estimation under Graphon Model
by: Wang, Yuyao, et al.
Published: (2025)