A Generalization Bound for Nearly-Linear Networks
Fuente:
arXiv
Enregistré dans:
| Auteur principal: | Golikov, Eugene |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
A Lower Bound for the Number of Linear Regions of Ternary ReLU Regression Neural Networks
par: Nakahara, Yuta, et autres
Publié: (2025)
par: Nakahara, Yuta, et autres
Publié: (2025)
Locally Linear Continual Learning for Time Series based on VC-Theoretical Generalization Bounds
par: Ferreira, Yan V. G., et autres
Publié: (2026)
par: Ferreira, Yan V. G., et autres
Publié: (2026)
Neural Network Verification with Branch-and-Bound for General Nonlinearities
par: Shi, Zhouxing, et autres
Publié: (2024)
par: Shi, Zhouxing, et autres
Publié: (2024)
Effective Sample Size and Generalization Bounds for Temporal Networks
par: Gahtan, Barak, et autres
Publié: (2025)
par: Gahtan, Barak, et autres
Publié: (2025)
Variance-Dependent Regret Bounds for Non-stationary Linear Bandits
par: Wang, Zhiyong, et autres
Publié: (2024)
par: Wang, Zhiyong, et autres
Publié: (2024)
Near-Optimal Experiment Design in Linear non-Gaussian Cyclic Models
par: Sharifian, Ehsan, et autres
Publié: (2025)
par: Sharifian, Ehsan, et autres
Publié: (2025)
Optimization, Generalization and Differential Privacy Bounds for Gradient Descent on Kolmogorov-Arnold Networks
par: Wang, Puyu, et autres
Publié: (2026)
par: Wang, Puyu, et autres
Publié: (2026)
Lecture Notes on Linear Neural Networks: A Tale of Optimization and Generalization in Deep Learning
par: Cohen, Nadav, et autres
Publié: (2024)
par: Cohen, Nadav, et autres
Publié: (2024)
Towards Initialization-dependent and Non-vacuous Generalization Bounds for Overparameterized Shallow Neural Networks
par: Lei, Yunwen, et autres
Publié: (2026)
par: Lei, Yunwen, et autres
Publié: (2026)
Sharper Generalization Bounds for Transformer
par: Li, Yawen, et autres
Publié: (2026)
par: Li, Yawen, et autres
Publié: (2026)
Automated Design of Linear Bounding Functions for Sigmoidal Nonlinearities in Neural Networks
par: König, Matthias, et autres
Publié: (2024)
par: König, Matthias, et autres
Publié: (2024)
Flash Inference: Near Linear Time Inference for Long Convolution Sequence Models and Beyond
par: Oncescu, Costin-Andrei, et autres
Publié: (2024)
par: Oncescu, Costin-Andrei, et autres
Publié: (2024)
Misspecified $Q$-Learning with Sparse Linear Function Approximation: Tight Bounds on Approximation Error
par: Du, Ally Yalei, et autres
Publié: (2024)
par: Du, Ally Yalei, et autres
Publié: (2024)
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set
par: Liu, Xinyu, et autres
Publié: (2025)
par: Liu, Xinyu, et autres
Publié: (2025)
Gradient Flow Through Diagram Expansions: Learning Regimes and Explicit Solutions
par: Yarotsky, Dmitry, et autres
Publié: (2026)
par: Yarotsky, Dmitry, et autres
Publié: (2026)
On the Probabilistic Learnability of Compact Neural Network Preimage Bounds
par: Marzari, Luca, et autres
Publié: (2025)
par: Marzari, Luca, et autres
Publié: (2025)
Linear Mode Connectivity in Sparse Neural Networks
par: McDermott, Luke, et autres
Publié: (2023)
par: McDermott, Luke, et autres
Publié: (2023)
Relating Piecewise Linear Kolmogorov Arnold Networks to ReLU Networks
par: Schoots, Nandi, et autres
Publié: (2025)
par: Schoots, Nandi, et autres
Publié: (2025)
Efficient Robust Conformal Prediction via Lipschitz-Bounded Networks
par: Massena, Thomas, et autres
Publié: (2025)
par: Massena, Thomas, et autres
Publié: (2025)
Improved Generalization Bounds for Communication Efficient Federated Learning
par: Gholami, Peyman, et autres
Publié: (2024)
par: Gholami, Peyman, et autres
Publié: (2024)
Learning Non-Vacuous Generalization Bounds from Optimization
par: Tan, Chengli, et autres
Publié: (2022)
par: Tan, Chengli, et autres
Publié: (2022)
Accelerating Training with Neuron Interaction and Nowcasting Networks
par: Knyazev, Boris, et autres
Publié: (2024)
par: Knyazev, Boris, et autres
Publié: (2024)
Three Mechanisms of Feature Learning in a Linear Network
par: Xu, Yizhou, et autres
Publié: (2024)
par: Xu, Yizhou, et autres
Publié: (2024)
Solving Probabilistic Verification Problems of Neural Networks using Branch and Bound
par: Boetius, David, et autres
Publié: (2024)
par: Boetius, David, et autres
Publié: (2024)
PAC-Bayesian Generalization Bounds for Knowledge Graph Representation Learning
par: Lee, Jaejun, et autres
Publié: (2024)
par: Lee, Jaejun, et autres
Publié: (2024)
On the Koopman-Based Generalization Bounds for Multi-Task Deep Learning
par: Mohammadigohari, Mahdi, et autres
Publié: (2025)
par: Mohammadigohari, Mahdi, et autres
Publié: (2025)
Mixed Dynamics In Linear Networks: Unifying the Lazy and Active Regimes
par: Tu, Zhenfeng, et autres
Publié: (2024)
par: Tu, Zhenfeng, et autres
Publié: (2024)
Learning Distinguishable Representations in Deep Q-Networks for Linear Transfer
par: Sathish, Sooraj, et autres
Publié: (2025)
par: Sathish, Sooraj, et autres
Publié: (2025)
Identifying General Mechanism Shifts in Linear Causal Representations
par: Chen, Tianyu, et autres
Publié: (2024)
par: Chen, Tianyu, et autres
Publié: (2024)
Ginger: An Efficient Curvature Approximation with Linear Complexity for General Neural Networks
par: Hao, Yongchang, et autres
Publié: (2024)
par: Hao, Yongchang, et autres
Publié: (2024)
Shortcut Features as Top Eigenfunctions of NTK: A Linear Neural Network Case and More
par: Lim, Jinwoo, et autres
Publié: (2026)
par: Lim, Jinwoo, et autres
Publié: (2026)
Theoretical Analysis of Meta Reinforcement Learning: Generalization Bounds and Convergence Guarantees
par: Wang, Cangqing, et autres
Publié: (2024)
par: Wang, Cangqing, et autres
Publié: (2024)
From Small to Large: Generalization Bounds for Transformers on Variable-Size Inputs
par: Alokhina, Anastasiia, et autres
Publié: (2025)
par: Alokhina, Anastasiia, et autres
Publié: (2025)
The Weight Gram Matrix Captures Sequential Feature Linearization in Deep Networks
par: Cha, Taehun, et autres
Publié: (2026)
par: Cha, Taehun, et autres
Publié: (2026)
On the Learning Dynamics of Two-layer Linear Networks with Label Noise SGD
par: Zhang, Tongcheng, et autres
Publié: (2026)
par: Zhang, Tongcheng, et autres
Publié: (2026)
On the Expressive Power of Transformers for Maxout Networks and Continuous Piecewise Linear Functions
par: Gu, Linyan, et autres
Publié: (2026)
par: Gu, Linyan, et autres
Publié: (2026)
Prompts Generalize with Low Data: Non-vacuous Generalization Bounds for Optimizing Prompts with More Informative Priors
par: Madras, David, et autres
Publié: (2025)
par: Madras, David, et autres
Publié: (2025)
Minibatch and Local SGD: Algorithmic Stability and Linear Speedup in Generalization
par: Lei, Yunwen, et autres
Publié: (2023)
par: Lei, Yunwen, et autres
Publié: (2023)
Knowledge Distillation in Wide Neural Networks: Risk Bound, Data Efficiency and Imperfect Teacher
par: Ji, Guangda, et autres
Publié: (2020)
par: Ji, Guangda, et autres
Publié: (2020)
Advancing Constrained Monotonic Neural Networks: Achieving Universal Approximation Beyond Bounded Activations
par: Sartor, Davide, et autres
Publié: (2025)
par: Sartor, Davide, et autres
Publié: (2025)
Documents similaires
-
A Lower Bound for the Number of Linear Regions of Ternary ReLU Regression Neural Networks
par: Nakahara, Yuta, et autres
Publié: (2025) -
Locally Linear Continual Learning for Time Series based on VC-Theoretical Generalization Bounds
par: Ferreira, Yan V. G., et autres
Publié: (2026) -
Neural Network Verification with Branch-and-Bound for General Nonlinearities
par: Shi, Zhouxing, et autres
Publié: (2024) -
Effective Sample Size and Generalization Bounds for Temporal Networks
par: Gahtan, Barak, et autres
Publié: (2025) -
Variance-Dependent Regret Bounds for Non-stationary Linear Bandits
par: Wang, Zhiyong, et autres
Publié: (2024)