Cover Image

Rethinking Bregman Divergences in Kronecker-Factored Optimizers

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, Bing, Zhou, Wenjie, Zhao, Chengcheng
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Online Nonconvex Bilevel Optimization with Bregman Divergences
by: Bohne, Jason, et al.
Published: (2024)

Beyond KL Divergence: Policy Optimization with Flexible Bregman Divergences for LLM Reasoning
by: Yuan, Rui, et al.
Published: (2026)

A Generalized Bias-Variance Decomposition for Bregman Divergences
by: Pfau, David
Published: (2025)

Lower Difficulty and Better Robustness: A Bregman Divergence Perspective for Adversarial Training
by: Wu, Zihui, et al.
Published: (2022)

Geometric Convergence Analysis of Variational Inference via Bregman Divergences
by: Bohara, Sushil, et al.
Published: (2025)

Structured and Fast Optimization: The Kronecker SGD Algorithm
by: Song, Zhao, et al.
Published: (2023)

Direct Debiased Machine Learning via Bregman Divergence Minimization
by: Kato, Masahiro
Published: (2025)

Adaptive Regularization for Sparsity Control in Bregman-Based Optimizers
by: Aloradi, Ahmad, et al.
Published: (2026)

Kronecker-Factored Approximate Curvature for Modern Neural Network Architectures
by: Eschenhagen, Runa, et al.
Published: (2023)

Symmetrizing Bregman Divergence on the Cone of Positive Definite Matrices: Which Mean to Use and Why
by: Sial, Tushar, et al.
Published: (2026)

Bregman Douglas-Rachford Splitting Method
by: Ma, Shiqian, et al.
Published: (2025)

Kronecker Factorization Improves Efficiency and Interpretability of Sparse Autoencoders
by: Kurochkin, Vadim, et al.
Published: (2025)

KFCPO: Kronecker-Factored Approximated Constrained Policy Optimization
by: Lim, Joonyoung, et al.
Published: (2025)

MKOR: Momentum-Enabled Kronecker-Factor-Based Optimizer Using Rank-1 Updates
by: Mozaffari, Mohammad, et al.
Published: (2023)

A Unified Framework for Debiased Machine Learning: Riesz Representer Fitting under Bregman Divergence
by: Kato, Masahiro
Published: (2026)

Row-Stochastic Matrices Can Provably Outperform Doubly Stochastic Matrices in Decentralized Learning
by: Liu, Bing, et al.
Published: (2025)

ImprovDML: Improved Trade-off in Private Byzantine-Resilient Distributed Machine Learning
by: Liu, Bing, et al.
Published: (2025)

Kronecker-Factored Approximate Curvature for Physics-Informed Neural Networks
by: Dangel, Felix, et al.
Published: (2024)

Diving into Kronecker Adapters: Component Design Matters
by: Bai, Jiayu, et al.
Published: (2026)

Symplectic Bregman divergences
by: Nielsen, Frank
Published: (2024)

Taming Nonconvex Stochastic Mirror Descent with General Bregman Divergence
by: Fatkhullin, Ilyas, et al.
Published: (2024)

Stream separation improves Bregman conditioning in transformers
by: Kerce, James Clayton
Published: (2026)

Fast Inference with Kronecker-Sparse Matrices
by: Gonon, Antoine, et al.
Published: (2024)

How Scale Breaks "Normalized Stress" and KL Divergence: Rethinking Quality Metrics
by: Smelser, Kiran, et al.
Published: (2025)

A Unified Framework for Rethinking Policy Divergence Measures in GRPO
by: Wu, Qingyuan, et al.
Published: (2026)

Bias-variance decompositions: the exclusive privilege of Bregman divergences
by: Heskes, Tom
Published: (2025)

Curved representational Bregman divergences and their applications
by: Nielsen, Frank
Published: (2025)

Kronecker-Structured Nonparametric Spatiotemporal Point Processes
by: Xu, Zhitong, et al.
Published: (2026)

Scalable Gaussian Processes with Latent Kronecker Structure
by: Lin, Jihao Andreas, et al.
Published: (2025)

Bregman Linearized Augmented Lagrangian Method for Nonconvex Constrained Stochastic Zeroth-order Optimization
by: Shi, Qiankun, et al.
Published: (2025)

A New Way: Kronecker-Factored Approximate Curvature Deep Hedging and its Benefits
by: Enkhbayar, Tsogt-Ochir
Published: (2024)

Deep Kronecker Network
by: Feng, Long, et al.
Published: (2022)

Calibeating for general proper losses: A Bregman divergence approach
by: Fichtl, Maximilian, et al.
Published: (2026)

Kronecker-factored Approximate Curvature (KFAC) From Scratch
by: Dangel, Felix, et al.
Published: (2025)

Water Quality Data Imputation via A Fast Latent Factorization of Tensors with PID-based Optimizer
by: Liu, Qian, et al.
Published: (2025)

Adaptive Data Compression and Reconstruction for Memory-Bounded EEG Continual Learning
by: Xie, Chengcheng
Published: (2026)

Divergence-Augmented Policy Optimization
by: Wang, Qing, et al.
Published: (2025)

External Division of Two Bregman Proximity Operators for Poisson Inverse Problems
by: Haishima, Kazuki, et al.
Published: (2026)

Learning density ratios in causal inference using Bregman-Riesz regression
by: Hines, Oliver J., et al.
Published: (2025)

k-MLE, k-Bregman, k-VARs: Theory, Convergence, Computation
by: Yue, Zuogong, et al.
Published: (2024)