Image de couverture de livre

Comparing BFGS and OGR for Second-Order Optimization

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Przybysz, Adrian, Kołek, Mikołaj, Sobota, Franciszek, Duda, Jarek
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Linear cost mutual information estimation and independence test of similar performance as HSIC
par: Duda, Jarek, et autres
Publié: (2025)

TextBFGS: A Case-Based Reasoning Approach to Code Optimization via Error-Operator Retrieval
par: Zhang, Zizheng, et autres
Publié: (2026)

Second-Order Convergence in Private Stochastic Non-Convex Optimization
par: Tao, Youming, et autres
Publié: (2025)

Biology-inspired joint distribution neurons based on Hierarchical Correlation Reconstruction allowing for multidirectional propagation of values and densities
par: Duda, Jarek
Publié: (2024)

The Potential of Second-Order Optimization for LLMs: A Study with Full Gauss-Newton
par: Abreu, Natalie, et autres
Publié: (2025)

Simultaneous Training of First- and Second-Order Optimizers in Population-Based Reinforcement Learning
par: Pfeiffer, Felix, et autres
Publié: (2024)

Adaptive stable distribution and Hurst exponent by method of moments moving estimator for nonstationary time series
par: Duda, Jarek
Publié: (2025)

Adaptive Student's t-distribution with method of moments moving estimator for nonstationary time series
par: Duda, Jarek
Publié: (2023)

HyperMAML: Few-Shot Adaptation of Deep Models with Hypernetworks
par: Przewięźlikowski, M., et autres
Publié: (2022)

Higher order PCA-like rotation-invariant features for detailed shape descriptors modulo rotation
par: Duda, Jarek
Publié: (2026)

Taming Preconditioner Drift: Unlocking the Potential of Second-Order Optimizers for Federated Learning on Non-IID Data
par: Liu, Junkang, et autres
Publié: (2026)

Explaining Predictive Uncertainty by Exposing Second-Order Effects
par: Bley, Florian, et autres
Publié: (2024)

Second Order Bounds for Contextual Bandits with Function Approximation
par: Pacchiano, Aldo
Publié: (2024)

A Second-Order Perspective on Model Compositionality and Incremental Learning
par: Porrello, Angelo, et autres
Publié: (2024)

Adaptive Cubic Regularized Second-Order Latent Factor Analysis Model
par: Wang, Jialiang, et autres
Publié: (2025)

Gradient Alignment in Physics-informed Neural Networks: A Second-Order Optimization Perspective
par: Wang, Sifan, et autres
Publié: (2025)

Chasing COMET: Leveraging Minimum Bayes Risk Decoding for Self-Improving Machine Translation
par: Guttmann, Kamil, et autres
Publié: (2024)

Improving KAN with CDF normalization to quantiles
par: Strawa, Jakub, et autres
Publié: (2025)

Beyond the Calibration Point: Mechanism Comparison in Differential Privacy
par: Kaissis, Georgios, et autres
Publié: (2024)

Hierarchical Learning for Maze Navigation: Emergence of Mental Representations via Second-Order Learning
par: Manir, Shalima Binta, et autres
Publié: (2025)

Second-Order Actor-Critic Methods for Discounted MDPs via Policy Hessian Decomposition
par: Manivannan, Sanjeev, et autres
Publié: (2026)

Behaviour Distillation
par: Lupu, Andrei, et autres
Publié: (2024)

DRSLF: Double Regularized Second-Order Low-Rank Representation for Web Service QoS Prediction
par: Wu, Hao, et autres
Publié: (2025)

Refining Adaptive Zeroth-Order Optimization at Ease
par: Shu, Yao, et autres
Publié: (2025)

COPA: Comparing the incomparable in multi-objective model evaluation
par: Javaloy, Adrián, et autres
Publié: (2025)

Leakage and Second-Order Dynamics Improve Hippocampal RNN Replay
par: Casco-Rodriguez, Josue, et autres
Publié: (2026)

Hierarchical Zero-Order Optimization for Deep Neural Networks
par: Cao, Sansheng, et autres
Publié: (2026)

The Recurrent Sticky Hierarchical Dirichlet Process Hidden Markov Model
par: Słupiński, Mikołaj, et autres
Publié: (2024)

Bayesian Inference in Recurrent Explicit Duration Switching Linear Dynamical Systems
par: Słupiński, Mikołaj, et autres
Publié: (2024)

NAVIX: Scaling MiniGrid Environments with JAX
par: Pignatelli, Eduardo, et autres
Publié: (2024)

SASSHA: Sharpness-aware Adaptive Second-order Optimization with Stable Hessian Approximation
par: Shin, Dahun, et autres
Publié: (2025)

Subspace-based Approximate Hessian Method for Zeroth-Order Optimization
par: Kim, Dongyoon, et autres
Publié: (2025)

Communication-Efficient Byzantine-Resilient Federated Zero-Order Optimization
par: Neto, Afonso de Sá Delgado, et autres
Publié: (2024)

A Clean Slate for Offline Reinforcement Learning
par: Jackson, Matthew Thomas, et autres
Publié: (2025)

Transformers Learn to Achieve Second-Order Convergence Rates for In-Context Linear Regression
par: Fu, Deqing, et autres
Publié: (2023)

Second-Order Information Matters: Revisiting Machine Unlearning for Large Language Models
par: Gu, Kang, et autres
Publié: (2024)

OptEx: Expediting First-Order Optimization with Approximately Parallelized Iterations
par: Shu, Yao, et autres
Publié: (2024)

Robust Second-Order Nonconvex Optimization and Its Application to Low Rank Matrix Sensing
par: Li, Shuyao, et autres
Publié: (2024)

Scaling Recurrent Neural Networks to a Billion Parameters with Zero-Order Optimization
par: Chaubard, Francois, et autres
Publié: (2025)

A Historical Trajectory Assisted Optimization Method for Zeroth-Order Federated Learning
par: Wu, Chenlin, et autres
Publié: (2024)