:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Korbit, Mikalai, Zanon, Mario
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	https://arxiv.org/abs/2603.25976
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Fast Gauss-Newton for Multiclass Cross-Entropy
by: Korbit, Mikalai, et al.
Published: (2026)

Incremental Gauss-Newton Descent for Machine Learning
by: Korbit, Mikalai, et al.
Published: (2024)

Exact Gauss-Newton Optimization for Training Deep Neural Networks
by: Korbit, Mikalai, et al.
Published: (2024)

Simultaneous Training of First- and Second-Order Optimizers in Population-Based Reinforcement Learning
by: Pfeiffer, Felix, et al.
Published: (2024)

FOSI: Hybrid First and Second Order Optimization
by: Sivan, Hadar, et al.
Published: (2023)

CAGE: Curvature-Aware Gradient Estimation For Accurate Quantization-Aware Training
by: Tabesh, Soroush, et al.
Published: (2025)

Leveraging Second-Order Curvature for Efficient Learned Image Compression: Theory and Empirical Evidence
by: Zhang, Yichi, et al.
Published: (2026)

S2O: Enhancing Adversarial Training with Second-Order Statistics of Weights
by: Jin, Gaojie, et al.
Published: (2026)

Saliency Maps are Ambiguous: Analysis of Logical Relations on First and Second Order Attributions
by: Schwenke, Leonid, et al.
Published: (2025)

FUSE: First-Order and Second-Order Unified SynthEsis in Stochastic Optimization
by: Jiang, Zhanhong, et al.
Published: (2025)

First and Second Order Approximations to Stochastic Gradient Descent Methods with Momentum Terms
by: Lu, Eric
Published: (2025)

HORST: Composing Optimizer Geometries for Sparse Transformer Training
by: Jacobs, Tom, et al.
Published: (2026)

Runtime-Orchestrated Second-Order Optimization for Scalable LLM Training
by: Lu, Yishun, et al.
Published: (2026)

Online Curvature-Aware Replay: Leveraging $\mathbf{2^{nd}}$ Order Information for Online Continual Learning
by: Urettini, Edoardo, et al.
Published: (2025)

The Minimax Rate of Second-Order Calibration
by: Ciosek, Kamil, et al.
Published: (2026)

SORA: Free Second-Order Attacks in Fast Adversarial Training
by: Teymourian, Mazdak, et al.
Published: (2026)

Low-Rank Curvature for Zeroth-Order Optimization in LLM Fine-Tuning
by: Seung, Hyunseok, et al.
Published: (2025)

The Power of Second Order Methods for Sequence Preconditioning
by: Marsden, Annie, et al.
Published: (2026)

Second Order Methods for Bandit Optimization and Control
by: Suggala, Arun, et al.
Published: (2024)

ZO-SAM: Zero-Order Sharpness-Aware Minimization for Efficient Sparse Training
by: Ji, Jie, et al.
Published: (2026)

Curvature-Aware Safety Restoration In LLMs Fine-Tuning
by: Bach, Thong, et al.
Published: (2025)

CAT: Curvature-Adaptive Transformers for Geometry-Aware Learning
by: Lin, Ryan Y., et al.
Published: (2025)

Stepping on the Edge: Curvature Aware Learning Rate Tuners
by: Roulet, Vincent, et al.
Published: (2024)

Mitigating Task-Order Sensitivity and Forgetting via Hierarchical Second-Order Consolidation
by: Nag, Protik, et al.
Published: (2026)

Unbiased and Second-Order-Free Training for High-Dimensional PDEs
by: Seo, Jaemin, et al.
Published: (2026)

Beyond First-Order: Training LLMs with Stochastic Conjugate Subgradients and AdamW
by: Zhang, Di, et al.
Published: (2025)

Second-Order Uncertainty Quantification: Variance-Based Measures
by: Sale, Yusuf, et al.
Published: (2023)

On the Second-Order Convergence of Biased Policy Gradient Algorithms
by: Mu, Siqiao, et al.
Published: (2023)

Second-Order Forward-Mode Automatic Differentiation for Optimization
by: Cobb, Adam D., et al.
Published: (2024)

Second-Order Tensorial Partial Differential Equations on Graphs
by: Einizade, Aref, et al.
Published: (2025)

Second-Order Fine-Tuning without Pain for LLMs:A Hessian Informed Zeroth-Order Optimizer
by: Zhao, Yanjun, et al.
Published: (2024)

Spectral-factorized Positive-definite Curvature Learning for NN Training
by: Lin, Wu, et al.
Published: (2025)

A Split-Client Approach to Second-Order Optimization
by: Chayti, El Mahdi, et al.
Published: (2025)

AtomComposer: Discovering Chemical Space from First Principles with Reinforcement Learning
by: Hastrup, Bjarke, et al.
Published: (2026)

MixtureKit: A General Framework for Composing, Training, and Visualizing Mixture-of-Experts Models
by: Chamma, Ahmad, et al.
Published: (2025)

Comparing BFGS and OGR for Second-Order Optimization
by: Przybysz, Adrian, et al.
Published: (2025)

Estimation and Deconvolution of Second Order Cyclostationary Signals
by: Makienko, Igor, et al.
Published: (2024)

DCAST: Diverse Class-Aware Self-Training Mitigates Selection Bias for Fairer Learning
by: Tepeli, Yasin I., et al.
Published: (2024)

ZEUS: Accelerating Diffusion Models with Only Second-Order Predictor
by: Wang, Yixiao, et al.
Published: (2026)

On the Parameterization of Second-Order Optimization Effective Towards the Infinite Width
by: Ishikawa, Satoki, et al.
Published: (2023)