Cover Image

Risk Bounds on MDL Estimators for Linear Regression Models with Application to Simple ReLU Neural Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Takeishi, Yoshinari, Takeuchi, Jun'ichi
Format:	Preprint
Published:	2024
Subjects:	Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Sparse Superposition Codes with Binomial Dictionary are Capacity-Achieving with Maximum Likelihood Decoding
by: Takeishi, Yoshinari, et al.
Published: (2025)

Approximating Simple ReLU Networks based on Spectral Decomposition of Fisher Information
by: Ho, Ka Long Keith, et al.
Published: (2025)

Neural Tangent Kernels and Fisher Information Matrices for Simple ReLU Networks with Random Hidden Weights
by: Takeuchi, Jun'ichi, et al.
Published: (2025)

Three Quantization Regimes for ReLU Networks
by: Ou, Weigutian, et al.
Published: (2024)

The Optimal Condition Number for ReLU Function
by: Xia, Yu, et al.
Published: (2025)

Asymptotically Minimax Regret by Bayes Mixtures
by: Takeuchi, Jun'ichi, et al.
Published: (2024)

Covering Numbers for Deep ReLU Networks with Applications to Function Approximation and Nonparametric Regression
by: Ou, Weigutian, et al.
Published: (2024)

On Polynomial Approximations for Privacy-Preserving and Verifiable ReLU Networks
by: Ali, Ramy E., et al.
Published: (2020)

Injectivity capacity of ReLU gates
by: Stojnic, Mihailo
Published: (2024)

Phase retrieval with semi-algebraic and ReLU neural network priors
by: Bendory, Tamir, et al.
Published: (2023)

Deep ReLU networks -- injectivity capacity upper bounds
by: Stojnic, Mihailo
Published: (2024)

Newton-Direction-Based ReLU-Thresholding Methods for Nonnegative Sparse Signal Recovery
by: Bian, Ning, et al.
Published: (2026)

Dense ReLU Neural Networks for Temporal-spatial Model
by: Padilla, Carlos Misael Madrid, et al.
Published: (2024)

A Lower Bound for the Number of Linear Regions of Ternary ReLU Regression Neural Networks
by: Nakahara, Yuta, et al.
Published: (2025)

Online Realizable Regression and Applications for ReLU Networks
by: Doron-Arad, Ilan, et al.
Published: (2026)

Geometry-induced Regularization in Deep ReLU Neural Networks
by: Bona-Pellissier, Joachim, et al.
Published: (2024)

New Empirical Process Tools and Their Applications to Robust Deep ReLU Networks and Phase Transitions for Nonparametric Regression
by: Ding, Yizhe, et al.
Published: (2025)

The Thermodynamic Costs of Simple Linear Regression
by: D'Ambrosia, Samuel H., et al.
Published: (2026)

Classification and Regression Error Bounds for Inhomogenous Data With Applications to Wireless Networks
by: Ganesan, Ghurumuruhan
Published: (2024)

Function Gradient Approximation with Random Shallow ReLU Networks with Control Applications
by: Lamperski, Andrew, et al.
Published: (2024)

On the Expressiveness of Rational ReLU Neural Networks With Bounded Depth
by: Averkov, Gennadiy, et al.
Published: (2025)

Towards Lower Bounds on the Depth of ReLU Neural Networks
by: Hertrich, Christoph, et al.
Published: (2021)

Convergence of Shallow ReLU Networks on Weakly Interacting Data
by: Dana, Léo, et al.
Published: (2025)

Direct and Converse Theorems in Estimating Signals with Sublinear Sparsity
by: Takeuchi, Keigo
Published: (2026)

A Unified MDL-based Binning and Tensor Factorization Framework for PDF Estimation
by: Musab, Mustafa, et al.
Published: (2025)

Component-based Sketching for Deep ReLU Nets
by: Wang, Di, et al.
Published: (2024)

Interpretability as Compression: Reconsidering SAE Explanations of Neural Activations with MDL-SAEs
by: Ayonrinde, Kola, et al.
Published: (2024)

The Geometry of ReLU Networks through the ReLU Transition Graph
by: Dhayalkar, Sahil Rajesh
Published: (2025)

The Computational Complexity of Counting Linear Regions in ReLU Neural Networks
by: Stargalla, Moritz, et al.
Published: (2025)

Decentralized Generalized Approximate Message-Passing for Tree-Structured Networks
by: Takeuchi, Keigo
Published: (2023)

Stochastic Bandits with ReLU Neural Networks
by: Xu, Kan, et al.
Published: (2024)

Topological Expressivity of ReLU Neural Networks
by: Ergen, Ekin, et al.
Published: (2023)

On Space Folds of ReLU Neural Networks
by: Lewandowski, Michal, et al.
Published: (2025)

Pathwise Explanation of ReLU Neural Networks
by: Lim, Seongwoo, et al.
Published: (2025)

Directional Convergence, Benign Overfitting of Gradient Descent in leaky ReLU two-layer Neural Networks
by: Hashimoto, Ichiro
Published: (2025)

Deep ReLU Networks Have Surprisingly Simple Polytopes
by: Fan, Feng-Lei, et al.
Published: (2023)

Boosting Ordered Statistics Decoding of Short LDPC Codes with Simple Neural Network Models
by: Li, Guangwen, et al.
Published: (2024)

Fast and Efficient Implementation of the Maximum Likelihood Estimation for the Linear Regression with Gaussian Model Uncertainty
by: Guo, Ruohai, et al.
Published: (2025)

Batches Stabilize the Minimum Norm Risk in High Dimensional Overparameterized Linear Regression
by: Ioushua, Shahar Stein, et al.
Published: (2023)

Sharp Lower Bounds for Linearized ReLU^k Approximation on the Sphere
by: Mao, Tong, et al.
Published: (2025)