Deep Neural Networks are Adaptive to Function Regularity and Data Distribution in Approximation and Estimation
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | Liu, Hao, Cheng, Jiahui, Liao, Wenjing |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
Neural Scaling Laws of Deep ReLU and Deep Operator Network: A Theoretical Study
par: Liu, Hao, et autres
Publié: (2024)
par: Liu, Hao, et autres
Publié: (2024)
Understanding Scaling Laws with Statistical and Approximation Theory for Transformer Neural Networks on Intrinsically Low-dimensional Data
par: Havrilla, Alex, et autres
Publié: (2024)
par: Havrilla, Alex, et autres
Publié: (2024)
Data-Driven Model Reduction using WeldNet: Windowed Encoders for Learning Dynamics
par: Dahal, Biraj, et autres
Publié: (2025)
par: Dahal, Biraj, et autres
Publié: (2025)
Adaptive Tabu Dropout for Regularization of Deep Neural Network
par: Hasan, Md. Tarek, et autres
Publié: (2024)
par: Hasan, Md. Tarek, et autres
Publié: (2024)
Coefficient-to-Basis Network: A Fine-Tunable Operator Learning Framework for Inverse Problems with Adaptive Discretizations and Theoretical Guarantees
par: Zhang, Zecheng, et autres
Publié: (2025)
par: Zhang, Zecheng, et autres
Publié: (2025)
VAEs and GANs: Implicitly Approximating Complex Distributions with Simple Base Distributions and Deep Neural Networks -- Principles, Necessity, and Limitations
par: Wei, Yuan-Hao
Publié: (2025)
par: Wei, Yuan-Hao
Publié: (2025)
Approximation of RKHS Functionals by Neural Networks
par: Zhou, Tian-Yi, et autres
Publié: (2024)
par: Zhou, Tian-Yi, et autres
Publié: (2024)
Learning Theory of Transformers: Local-to-Global Approximation via Softmax Partition of Unity
par: Shi, Zhongjie, et autres
Publié: (2026)
par: Shi, Zhongjie, et autres
Publié: (2026)
Adaptive Gradient Regularization: A Faster and Generalizable Optimization Technique for Deep Neural Networks
par: Jiang, Huixiu, et autres
Publié: (2024)
par: Jiang, Huixiu, et autres
Publié: (2024)
Pruning Deep Neural Networks via a Combination of the Marchenko-Pastur Distribution and Regularization
par: Berlyand, Leonid, et autres
Publié: (2025)
par: Berlyand, Leonid, et autres
Publié: (2025)
Policy Regularized Distributionally Robust Markov Decision Processes with Linear Function Approximation
par: Gu, Jingwen, et autres
Publié: (2025)
par: Gu, Jingwen, et autres
Publié: (2025)
New Approximation Results and Optimal Estimation for Fully Connected Deep Neural Networks
par: Tang, Zhaoji
Publié: (2025)
par: Tang, Zhaoji
Publié: (2025)
Approximating Matrix Functions with Deep Neural Networks and Transformers
par: Padmanabhan, Rahul, et autres
Publié: (2026)
par: Padmanabhan, Rahul, et autres
Publié: (2026)
Adaptive Norm-Based Regularization for Neural Networks
par: Qasim, Muhammad, et autres
Publié: (2026)
par: Qasim, Muhammad, et autres
Publié: (2026)
On the Dimension-Free Approximation of Deep Neural Networks for Symmetric Korobov Functions
par: Lu, Yulong, et autres
Publié: (2025)
par: Lu, Yulong, et autres
Publié: (2025)
Sharpness-Aware Minimization with Adaptive Regularization for Training Deep Neural Networks
par: Zou, Jinping, et autres
Publié: (2024)
par: Zou, Jinping, et autres
Publié: (2024)
QoS-Nets: Adaptive Approximate Neural Network Inference
par: Trommer, Elias, et autres
Publié: (2024)
par: Trommer, Elias, et autres
Publié: (2024)
Quantization-Aware Regularizers for Deep Neural Networks Compression
par: Malchiodi, Dario, et autres
Publié: (2026)
par: Malchiodi, Dario, et autres
Publié: (2026)
Lattice-based Deep Neural Networks: Regularity and Tailored Regularization
par: Keller, Alexander, et autres
Publié: (2026)
par: Keller, Alexander, et autres
Publié: (2026)
Training Deep Morphological Neural Networks as Universal Approximators
par: Fotopoulos, Konstantinos, et autres
Publié: (2025)
par: Fotopoulos, Konstantinos, et autres
Publié: (2025)
Simultaneous Approximation of the Score Function and Its Derivatives by Deep Neural Networks
par: Yakovlev, Konstantin, et autres
Publié: (2025)
par: Yakovlev, Konstantin, et autres
Publié: (2025)
Adaptive Random Feature Regularization on Fine-tuning Deep Neural Networks
par: Yamaguchi, Shin'ya, et autres
Publié: (2024)
par: Yamaguchi, Shin'ya, et autres
Publié: (2024)
Decoupled Orthogonal Dynamics: Regularization for Deep Network Optimizers
par: Chen, Hao, et autres
Publié: (2026)
par: Chen, Hao, et autres
Publié: (2026)
Noise-Adaptive Layerwise Learning Rates: Accelerating Geometry-Aware Optimization for Deep Neural Network Training
par: Hao, Jie, et autres
Publié: (2025)
par: Hao, Jie, et autres
Publié: (2025)
Deep Neural Network-Driven Adaptive Filtering
par: Wang, Qizhen, et autres
Publié: (2025)
par: Wang, Qizhen, et autres
Publié: (2025)
Inverse Evolution Layers: Physics-informed Regularizers for Deep Neural Networks
par: Liu, Chaoyu, et autres
Publié: (2023)
par: Liu, Chaoyu, et autres
Publié: (2023)
Optimal Neural Network Approximation for High-Dimensional Continuous Functions
par: Maiti, Ayan, et autres
Publié: (2024)
par: Maiti, Ayan, et autres
Publié: (2024)
Improving Set Function Approximation with Quasi-Arithmetic Neural Networks
par: Tokar, Tomas, et autres
Publié: (2026)
par: Tokar, Tomas, et autres
Publié: (2026)
Frequency Regularization: Unveiling the Spectral Inductive Bias of Deep Neural Networks
par: Lu, Jiahao
Publié: (2025)
par: Lu, Jiahao
Publié: (2025)
Estimating Implicit Regularization in Deep Learning
par: Rudoler, Joseph H., et autres
Publié: (2026)
par: Rudoler, Joseph H., et autres
Publié: (2026)
Extended Deep Adaptive Input Normalization for Preprocessing Time Series Data for Neural Networks
par: September, Marcus A. K., et autres
Publié: (2023)
par: September, Marcus A. K., et autres
Publié: (2023)
Multivariate Time Series Data Imputation via Distributionally Robust Regularization
par: Liao, Che-Yi, et autres
Publié: (2026)
par: Liao, Che-Yi, et autres
Publié: (2026)
Flexible Deep Neural Networks for Partially Linear Survival Data: Estimation and Survival Inference
par: Arie, Asaf Ben, et autres
Publié: (2025)
par: Arie, Asaf Ben, et autres
Publié: (2025)
Adaptive Soft Error Protection for Neural Network Processing
par: Xue, Xinghua, et autres
Publié: (2024)
par: Xue, Xinghua, et autres
Publié: (2024)
Deep Network Approximation: Beyond ReLU to Diverse Activation Functions
par: Zhang, Shijun, et autres
Publié: (2023)
par: Zhang, Shijun, et autres
Publié: (2023)
On the Approximation of Phylogenetic Distance Functions by Artificial Neural Networks
par: Rosenzweig, Benjamin K., et autres
Publié: (2025)
par: Rosenzweig, Benjamin K., et autres
Publié: (2025)
Defending against Backdoor Attack on Deep Neural Networks
par: Cheng, Hao, et autres
Publié: (2020)
par: Cheng, Hao, et autres
Publié: (2020)
Generalization Error Guaranteed Auto-Encoder-Based Nonlinear Model Reduction for Operator Learning
par: Liu, Hao, et autres
Publié: (2024)
par: Liu, Hao, et autres
Publié: (2024)
Topology of Out-of-Distribution Examples in Deep Neural Networks
par: Datta, Esha, et autres
Publié: (2025)
par: Datta, Esha, et autres
Publié: (2025)
Data Diversity as Implicit Regularization: How Does Diversity Shape the Weight Space of Deep Neural Networks?
par: Ba, Yang, et autres
Publié: (2024)
par: Ba, Yang, et autres
Publié: (2024)
Documents similaires
-
Neural Scaling Laws of Deep ReLU and Deep Operator Network: A Theoretical Study
par: Liu, Hao, et autres
Publié: (2024) -
Understanding Scaling Laws with Statistical and Approximation Theory for Transformer Neural Networks on Intrinsically Low-dimensional Data
par: Havrilla, Alex, et autres
Publié: (2024) -
Data-Driven Model Reduction using WeldNet: Windowed Encoders for Learning Dynamics
par: Dahal, Biraj, et autres
Publié: (2025) -
Adaptive Tabu Dropout for Regularization of Deep Neural Network
par: Hasan, Md. Tarek, et autres
Publié: (2024) -
Coefficient-to-Basis Network: A Fine-Tunable Operator Learning Framework for Inverse Problems with Adaptive Discretizations and Theoretical Guarantees
par: Zhang, Zecheng, et autres
Publié: (2025)