Cover Image

CAO: Curvature-Adaptive Optimization via Periodic Low-Rank Hessian Sketching

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Du, Wenzhang
Format:	Preprint
Published:	2025
Subjects:	Machine Learning 68T07, 90C26, 90C30, 65K05 I.2.6; G.1.6; I.5.1
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Inter-Layer Hessian Analysis of Neural Networks with DAG Architectures
by: Bolshim, Maxim, et al.
Published: (2026)

Local properties of neural networks through the lens of layer-wise Hessians
by: Bolshim, Maxim, et al.
Published: (2025)

Stochastic Estimation of the Layer-wise Hessian Trace for Monitoring Neural-network Training
by: Bolshim, Maxim, et al.
Published: (2026)

Escaping Saddle Points via Curvature-Calibrated Perturbations: A Complete Analysis with Explicit Constants and Empirical Validation
by: Alpay, Faruk, et al.
Published: (2025)

Refining Graphical Neural Network Predictions Using Flow Matching for Optimal Power Flow with Constraint-Satisfaction Guarantee
by: Khanal, Kshitiz
Published: (2025)

NOVAK: Unified adaptive optimizer for deep neural networks
by: Kavun, Sergii
Published: (2026)

Enhancing Model Based Derivative Free Optimization using Direct Search
by: Li, Zijun, et al.
Published: (2026)

Differentiable Optimization Layers for Guaranteed Fairness in Deep Learning
by: Troxell, David, et al.
Published: (2026)

FedWCM: Unleashing the Potential of Momentum-based Federated Learning in Long-Tailed Scenarios
by: Li, Tianle, et al.
Published: (2025)

FlowAdam: Implicit Regularization via Geometry-Aware Soft Momentum Injection
by: Singh, Devender, et al.
Published: (2026)

Benchmarking Generative AI Against Bayesian Optimization for Constrained Multi-Objective Inverse Design
by: Awan, Muhammad Bilal, et al.
Published: (2025)

PyEPO: A PyTorch-based End-to-End Predict-then-Optimize Library for Linear and Integer Programming
by: Tang, Bo, et al.
Published: (2022)

Deep Legendre Transform
by: Minabutdinov, Aleksey, et al.
Published: (2025)

Machine Learning Algorithms for Improving Black Box Optimization Solvers
by: Kimiaei, Morteza, et al.
Published: (2025)

i-DEQ: A stable inertial deep equilibrium model for image restoration
by: Clerc, Antonin, et al.
Published: (2026)

NeurOptimisation: The Spiking Way to Evolve
by: Cruz-Duarte, Jorge Mario, et al.
Published: (2025)

The Non-Linearity Perturbation Threshold: Width Scaling and Landscape Bifurcations in Deep Learning
by: Alexander, Michael
Published: (2026)

Sparse Training of Neural Networks based on Multilevel Mirror Descent
by: Lunk, Yannick, et al.
Published: (2026)

A unified convergence theory for adaptive first-order methods in the nonconvex case, including AdaNorm, full and diagonal AdaGrad, Shampoo and Muo
by: Gratton, S., et al.
Published: (2026)

Multi-Objective Optimization with Desirability and Morris-Mitchell Criterion
by: Bartz-Beielstein, Thomas, et al.
Published: (2025)

Pseudoconvex Problems in Operational Decision Systems: Algorithms for Joint Learning and Optimization
by: Li, Zijun, et al.
Published: (2026)

Dynamic Regularized CBDT: Variance-Calibrated Causal Boosting for Interpretable Heterogeneous Treatment Effects
by: Liu, Yichen
Published: (2025)

Explainable and Class-Revealing Signal Feature Extraction via Scattering Transform and Constrained Zeroth-Order Optimization
by: Saito, Naoki, et al.
Published: (2025)

From Non-Identifiability to Goal-Integrated Decision-Making in Parametric Inverse Optimization
by: Ahmadi, Farzin, et al.
Published: (2026)

Functional Similarity Metric for Neural Networks: Overcoming Parametric Ambiguity via Activation Region Analysis
by: Hennadii, Kutomanov
Published: (2026)

Efficient Training of Physics-enhanced Neural ODEs via Direct Collocation and Nonlinear Programming
by: Langenkamp, Linus, et al.
Published: (2025)

GDNSQ: Gradual Differentiable Noise Scale Quantization for Low-bit Neural Networks
by: Salishev, Sergey, et al.
Published: (2025)

Ghosts of Softmax: Complex Singularities That Limit Safe Step Sizes in Cross-Entropy
by: Sao, Piyush
Published: (2026)

Amazon Locker Capacity Management
by: Sethuraman, Samyukta, et al.
Published: (2023)

Step-E: A Differentiable Data Cleaning Framework for Robust Learning with Noisy Labels
by: Du, Wenzhang
Published: (2025)

Optimizing Donor Outreach for Blood Collection Sessions: A Scalable Decision Support Framework
by: Carneiro, André, et al.
Published: (2026)

Stochastic convergence of parallel asynchronous adaptive first-order methods
by: Gratton, Serge, et al.
Published: (2026)

Adaptive Conditional Forest Sampling for Spectral Risk Optimisation under Decision-Dependent Uncertainty
by: Kurbucz, Marcell T.
Published: (2026)

Iterative Exploration-Driven Sparse SDP Clustering via Thompson Sampling
by: Mun, Jongmin, et al.
Published: (2025)

Complex-valued convolutional neural network classification of hand gesture from radar images
by: Khandan, Shokooh
Published: (2024)

City-Conditioned Memory for Multi-City Traffic and Mobility Forecasting
by: Du, Wenzhang
Published: (2025)

ZetA: A Riemann Zeta-Scaled Extension of Adam for Deep Learning
by: BC, Samiksha
Published: (2025)

Interior-Point Vanishing Problem in Semidefinite Relaxations for Neural Network Verification
by: Ueda, Ryota, et al.
Published: (2025)

Limitations of Scalarisation in MORL: A Comparative Study in Discrete Environments
by: Shah, Muhammad Sa'ood, et al.
Published: (2025)

An Augmented Lagrangian Method for Training Recurrent Neural Networks
by: Wang, Yue, et al.
Published: (2024)