Cover Image

Hierarchical Zero-Order Optimization for Deep Neural Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Cao, Sansheng, Ma, Zhengyu, Tian, Yonghong
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Scaling Recurrent Neural Networks to a Billion Parameters with Zero-Order Optimization
by: Chaubard, Francois, et al.
Published: (2025)

Dimer-Enhanced Optimization: A First-Order Approach to Escaping Saddle Points in Neural Network Training
by: Hu, Yue, et al.
Published: (2025)

Explainable Hierarchical Deep Learning Neural Networks (Ex-HiDeNN)
by: Batley, Reza T., et al.
Published: (2025)

Deep Networks Learn Deep Hierarchical Models
by: Daniely, Amit
Published: (2026)

Unifying Adversarial Perturbation for Graph Neural Networks
by: Yang, Jinluan, et al.
Published: (2025)

Communication-Efficient Byzantine-Resilient Federated Zero-Order Optimization
by: Neto, Afonso de Sá Delgado, et al.
Published: (2024)

Enhancing Deep Learning with Optimized Gradient Descent: Bridging Numerical Methods and Neural Network Training
by: Ma, Yuhan, et al.
Published: (2024)

Deep Manifold Part 2: Neural Network Mathematics
by: Ma, Max Y., et al.
Published: (2025)

Spectral Higher-Order Neural Networks
by: Peri, Gianluca, et al.
Published: (2026)

Layer Embedding Deep Fusion Graph Neural Network
by: Xu, Taihua, et al.
Published: (2026)

Probing Neural Combinatorial Optimization Models
by: Zhang, Zhiqin, et al.
Published: (2025)

Hierarchical Neural Constructive Solver for Real-world TSP Scenarios
by: Goh, Yong Liang, et al.
Published: (2024)

Optimizing Deep Neural Networks using Safety-Guided Self Compression
by: Zbeeb, Mohammad, et al.
Published: (2025)

Deep Manifold Part 1: Anatomy of Neural Network Manifold
by: Ma, Max Y., et al.
Published: (2024)

MAFT: Efficient Model-Agnostic Fairness Testing for Deep Neural Networks via Zero-Order Gradient Search
by: Wang, Zhaohui, et al.
Published: (2024)

Reconstructing Deep Neural Networks: Unleashing the Optimization Potential of Natural Gradient Descent
by: Liu, Weihua, et al.
Published: (2024)

DeepHGNN: Study of Graph Neural Network based Forecasting Methods for Hierarchically Related Multivariate Time Series
by: Sriramulu, Abishek, et al.
Published: (2024)

Deep Reinforcement Learning with Spiking Q-learning
by: Chen, Ding, et al.
Published: (2022)

Cross-Entropy Optimization for Hyperparameter Optimization in Stochastic Gradient-based Approaches to Train Deep Neural Networks
by: Li, Kevin, et al.
Published: (2024)

Atherosclerosis through Hierarchical Explainable Neural Network Analysis
by: Adam, Irsyad, et al.
Published: (2025)

Topological Neural Networks: Mitigating the Bottlenecks of Graph Neural Networks via Higher-Order Interactions
by: Giusti, Lorenzo
Published: (2024)

Dispelling the Curse of Singularities in Neural Network Optimizations
by: Cao, Hengjie, et al.
Published: (2026)

Lecture Notes on Linear Neural Networks: A Tale of Optimization and Generalization in Deep Learning
by: Cohen, Nadav, et al.
Published: (2024)

DouRN: Improving DouZero by Residual Neural Networks
by: Chen, Yiquan, et al.
Published: (2024)

Diversity Optimization for Travelling Salesman Problem via Deep Reinforcement Learning
by: Li, Qi, et al.
Published: (2025)

Wormhole Dynamics in Deep Neural Networks
by: Lai, Yen-Lung, et al.
Published: (2025)

Hierarchical Attention-based Graph Neural Network with Relevance-driven Pruning
by: Kum, Seungwoo
Published: (2026)

From Overfitting to Reliability: Introducing the Hierarchical Approximate Bayesian Neural Network
by: Amirkhanian, Hayk, et al.
Published: (2025)

Exact Computation of Any-Order Shapley Interactions for Graph Neural Networks
by: Muschalik, Maximilian, et al.
Published: (2025)

Gradient Alignment in Physics-informed Neural Networks: A Second-Order Optimization Perspective
by: Wang, Sifan, et al.
Published: (2025)

SafePowerGraph: Safety-aware Evaluation of Graph Neural Networks for Transmission Power Grids
by: Ghamizi, Salah, et al.
Published: (2024)

ZeroShotOpt: Towards Zero-Shot Pretrained Models for Efficient Black-Box Optimization
by: Meindl, Jamison, et al.
Published: (2025)

Deep Neural Network Benchmarks for Selective Classification
by: Pugnana, Andrea, et al.
Published: (2024)

Proximity-Informed Calibration for Deep Neural Networks
by: Xiong, Miao, et al.
Published: (2023)

Certifying Global Robustness for Deep Neural Networks
by: Li, You, et al.
Published: (2024)

Fully Spiking Actor Network with Intra-layer Connections for Reinforcement Learning
by: Chen, Ding, et al.
Published: (2024)

Learning Dynamics of Deep Learning -- Force Analysis of Deep Neural Networks
by: Ren, Yi
Published: (2025)

Application-Specific Component-Aware Structured Pruning of Deep Neural Networks in Control via Soft Coefficient Optimization
by: Sundaram, Ganesh, et al.
Published: (2025)

SoD$^2$: Statically Optimizing Dynamic Deep Neural Network
by: Niu, Wei, et al.
Published: (2024)

Deep Neural Networks via Complex Network Theory: a Perspective
by: La Malfa, Emanuele, et al.
Published: (2024)