Imagen de Portada

Curse of Dimensionality in Neural Network Optimization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Na, Sanghoon, Yang, Haizhao
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Optimization and Control
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

On the Stochastic (Variance-Reduced) Proximal Gradient Method for Regularized Expected Reward Optimization
por: Liang, Ling, et al.
Publicado: (2024)

Accelerating Multi-Block Constrained Optimization Through Learning to Optimize
por: Liang, Ling, et al.
Publicado: (2024)

Understanding the Curse of Unrolling
por: Mehmood, Sheheryar, et al.
Publicado: (2026)

PINS: Proximal Iterations with Sparse Newton and Sinkhorn for Optimal Transport
por: Wu, Di, et al.
Publicado: (2025)

Neural Network Training Techniques Regularize Optimization Trajectory: An Empirical Study
por: Chen, Cheng, et al.
Publicado: (2020)

Verifying Properties of Binary Neural Networks Using Sparse Polynomial Optimization
por: Yang, Jianting, et al.
Publicado: (2024)

Exploring the Potential of Bilevel Optimization for Calibrating Neural Networks
por: Sanguin, Gabriele, et al.
Publicado: (2025)

SGD with Partial Hessian for Deep Neural Networks Optimization
por: Sun, Ying, et al.
Publicado: (2024)

Regularized Gauss-Newton for Optimizing Overparameterized Neural Networks
por: Adeoye, Adeyemi D., et al.
Publicado: (2024)

Optimality-Informed Neural Networks for Solving Parametric Optimization Problems
por: Hoffmann, Matthias K., et al.
Publicado: (2025)

FSNet: Feasibility-Seeking Neural Network for Constrained Optimization with Guarantees
por: Nguyen, Hoang T., et al.
Publicado: (2025)

TS-RSR: A provably efficient approach for batch Bayesian Optimization
por: Ren, Zhaolin, et al.
Publicado: (2024)

Towards Guided Descent: Optimization Algorithms for Training Neural Networks At Scale
por: Nagwekar, Ansh
Publicado: (2025)

Optimization Over Trained Neural Networks: Taking a Relaxing Walk
por: Tong, Jiatai, et al.
Publicado: (2024)

Statistical Inference of Constrained Stochastic Optimization via Sketched Sequential Quadratic Programming
por: Na, Sen, et al.
Publicado: (2022)

Bayesian Optimization of a Lightweight and Accurate Neural Network for Aerodynamic Performance Prediction
por: Shihua, James M., et al.
Publicado: (2025)

Bayesian Optimization with Preference Exploration using a Monotonic Neural Network Ensemble
por: Wang, Hanyang, et al.
Publicado: (2025)

Analyzing Neural Network-Based Generative Diffusion Models through Convex Optimization
por: Zhang, Fangzhao, et al.
Publicado: (2024)

Scale-Invariant Neural Network Optimization: Norm Geometry and Heavy-Tailed Noise
por: Zhang, Jiayu, et al.
Publicado: (2026)

Random Gradient-Free Optimization in Infinite Dimensional Spaces
por: Peixoto, Caio Lins, et al.
Publicado: (2025)

The Optimality of (Accelerated) SGD for High-Dimensional Quadratic Optimization
por: Zhang, Haihan, et al.
Publicado: (2024)

Comparison of High-Dimensional Bayesian Optimization Algorithms on BBOB
por: Santoni, Maria Laura, et al.
Publicado: (2023)

Mean-Field Limits for Two-Layer Neural Networks Trained with Consensus-Based Optimization
por: De Deyn, William, et al.
Publicado: (2025)

Optimization over Trained (and Sparse) Neural Networks: A Surrogate within a Surrogate
por: Pham, Hung, et al.
Publicado: (2025)

On the Curse of Memory in Recurrent Neural Networks: Approximation and Optimization Analysis
por: Li, Zhong, et al.
Publicado: (2020)

LDAdam: Adaptive Optimization from Low-Dimensional Gradient Statistics
por: Robert, Thomas, et al.
Publicado: (2024)

Prescriptive PCA: Dimensionality Reduction for Two-stage Stochastic Optimization
por: He, Long, et al.
Publicado: (2023)

Optimizing the Optimizer for Physics-Informed Neural Networks and Kolmogorov-Arnold Networks
por: Kiyani, Elham, et al.
Publicado: (2025)

High-Dimensional Bayesian Optimization Using Both Random and Supervised Embeddings
por: Priem, Rémy, et al.
Publicado: (2025)

A Survey on Design-space Dimensionality Reduction Methods for Shape Optimization
por: Serani, Andrea, et al.
Publicado: (2024)

Learning-Augmented Decentralized Online Convex Optimization in Networks
por: Li, Pengfei, et al.
Publicado: (2023)

Scalable Mixed-Integer Optimization with Neural Constraints via Dual Decomposition
por: Zeng, Shuli, et al.
Publicado: (2025)

Blessings and Curses of Covariate Shifts: Adversarial Learning Dynamics, Directional Convergence, and Equilibria
por: Liang, Tengyuan
Publicado: (2022)

Assessing and Enhancing Graph Neural Networks for Combinatorial Optimization: Novel Approaches and Application in Maximum Independent Set Problems
por: Hu, Chenchuhui
Publicado: (2024)

From Cursed to Competitive: Closing the ZO-FO Gap via Input-to-State Stability
por: Farzin, Amir Ali, et al.
Publicado: (2026)

Shallow Neural Networks Learn Low-Degree Spherical Polynomials with Feature Learning by Learnable Channel Attention
por: Yang, Yingzhen
Publicado: (2025)

Optimal Depth of Neural Networks
por: Qi, Qian
Publicado: (2025)

KKT-Informed Neural Network
por: Femine, Carmine Delle
Publicado: (2024)

A Distributional View of High Dimensional Optimization
por: Benning, Felix
Publicado: (2025)

Inexact Column Generation for Bayesian Network Structure Learning via Difference-of-Submodular Optimization
por: Yang, Yiran, et al.
Publicado: (2025)